Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PHPStan setup & level1 fixes #276

Merged
merged 14 commits into from
Jan 31, 2025
Merged

Conversation

uuf6429
Copy link
Contributor

@uuf6429 uuf6429 commented Dec 7, 2024

Based on #277.

This PR sets up PHPStan and applies fixes until level 1.

The plan is to fix the problems separately later on.

@uuf6429 uuf6429 changed the title Chore/phpstan setup PHPStan setup Dec 7, 2024
@uuf6429
Copy link
Contributor Author

uuf6429 commented Dec 7, 2024

@acoulton one motivation for adding PHPStan is that during the recent title change, I realised that there is a big discrepancy in types. For example:

class SomeRecord
{
    /** @var string */
    private $keyword;                                         // 1️⃣

    /** @var int */
    private $line;                                            // 1️⃣

    /**
     * @param string $keyword
     * @param int $line
     */
    public function __construct($keyword, $line) {            // 2️⃣
        $this->keyword = $keyword;
        $this->line = $line;
    }

    /** @return string */                                     // 3️⃣
    public function getKeyword(){ return $this->keyword; }    // 4️⃣

    /** @return int */                                        // 3️⃣
    public function getLine(){ return $this->line; }          // 4️⃣
}

class SomeRecordTest extends TestCase
{
    public function testSomething(): void
    {
        $r = new SomeRecord('word', null);                    // 5️⃣
        ...
    }
}

The main problem: $line is defined as int, but many tests pass a null. This happens a lot, for various other properties.

I would like to fix that and declare types in a backword compatible way:

  • 1️⃣ type can be safely defined (for private props), but not sure if it should be nullable because of the test (see point 5)
  • 2️⃣ type can probably be defined - it will affect users passing invalid types (question from 1️⃣ about null also applies)
  • 3️⃣ if tests are to be kept as is, then null would be a valid value and the PHPDoc should be updated.
  • 4️⃣ probably we cannot declare the return type without a BC break.
  • 5️⃣ from my understanding, null should not be allowed and a valid value - such as -1 or 0 should be used instead.

Alternatively, we could avoid the BC headache and define all the types correctly for the next major release.

What do you think?

@uuf6429 uuf6429 marked this pull request as draft December 8, 2024 15:59
@uuf6429 uuf6429 force-pushed the chore/phpstan-setup branch from 57a92b2 to d83e4a7 Compare December 8, 2024 16:03
@acoulton
Copy link
Contributor

acoulton commented Dec 9, 2024

@uuf6429 I haven't looked at this or your PHP-CS pulls in detail as I realised they're marked draft and overlap a bit with the PHPUnit / docs PR so I assume we should review & merge those first.

On the type-safety, I think (if we're certain it is only tests that are passing nulls):

  • I agree, those tests are invalid and should be passing a value that mirrors real-world usage (so e.g. 1).
  • It is definitely fine to put a typehint on the private properties
  • It's also fine to put a typehint on the constructor params - if the phpdoc typed them as int then IMO it is not a BC break to start enforcing that (and it will be enforced by adding a typehint to the property anyway, so might as well be done on the constructor)
  • As you say, we can't add concrete return types without breaking BC - unless the class is final.

@carlos-granados
Copy link
Contributor

Regarding this draft pull request:

In the main Behat repository we use Psalm, while this PR introduces PHPStan in this one. I believe that it would be better if we unified this and used a single static analysis tool. Otherwise this can be confusing when you are working in one code base or the other and you need to follow different processes depending on which repo you are on. So I believe that we have two options:

  • Update the main Behat repo to use PHPStan instead of Psalm. I believe that right now there are many more projects using PHPStan than using PSalm, so this may also help with developers adding code to the project as it is more probable that they are familiar with PHPStan than with PSalm. Our current PSalm level is not too high and we almost don't use any PSalm specific annotations so I believe that a transition to PHPStan should not be too difficult
  • Or use PSalm in this repository as well

Also, I am not a big fan of baseline files. They have a number of drawbacks:

  • Accumulation of Ignored Errors: Over time, the baseline file can grow as it accumulates ignored errors, making it challenging to manage and potentially leading to overlooked issues.
  • Stale Error Records: As the code evolves, some errors in the baseline may become obsolete. PHPStan doesn't automatically remove these outdated entries, requiring manual intervention to keep the baseline current.
  • Potential for Complacency: Relying heavily on the baseline might lead to a false sense of code quality, as existing issues remain unaddressed.
  • Complexity in Management: In projects with multiple developers or extensive codebases, managing the baseline can become complex
    I prefer to start with a low level of rules and slowly update the code until we reach a level which gives us enough confidence in it

@uuf6429
Copy link
Contributor Author

uuf6429 commented Dec 10, 2024

@carlos-granados as you know, this is just a draft, so I wouldn't focus too much on it yet. But to answer your points:

  1. We should just switch to PHPStan in my opinion, especially since we have already implemented it in a few other behat/mink project (e.g. some mink drivers).
  2. I agree about the baseline - the point here is that it is a workaround so that this PR could be merged separately (or at least reviewed so). Otherwise it will end up containing a lot of fixes and/or a broken or incomplete pipeline.

The next point would be if we merge this PR and the fixes PR into one (to avoid polluting github) or if we keep them separate (and e.g. the baseline would be stored somewhere in the git history). This can be discussed later though.

PS: A small comment on one of your points: if a baselined error becomes obsolete, PHPStan will fail automatically (unless disabled by a specific setting). Just an FYI.

@acoulton
Copy link
Contributor

I'd agree with just using PHPStan - I noticed the doctrine project have just decided to drop psalm and use PHPStan-only in future.

Also agree with @carlos-granados that my preference would be to introduce it at the lowest-compatible level (without a baseline) and then gradually increase the level in parallel with fixing the issues. This also means it's easy to see from the config which level we have actually achieved.

@uuf6429 uuf6429 force-pushed the chore/phpstan-setup branch from d83e4a7 to 402b751 Compare December 14, 2024 16:21
@uuf6429 uuf6429 changed the title PHPStan setup PHPStan setup & level1 fixes Jan 17, 2025
@uuf6429 uuf6429 marked this pull request as ready for review January 17, 2025 20:53
Copy link
Contributor

@acoulton acoulton left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for this @uuf6429 - I spotted a couple of things / questions.

src/Behat/Gherkin/Loader/CucumberNDJsonAstLoader.php Outdated Show resolved Hide resolved
src/Behat/Gherkin/Loader/DirectoryLoader.php Outdated Show resolved Hide resolved
@uuf6429 uuf6429 requested a review from acoulton January 22, 2025 21:33
phpstan.dist.neon Outdated Show resolved Hide resolved
src/Behat/Gherkin/Loader/ArrayLoader.php Outdated Show resolved Hide resolved
@uuf6429 uuf6429 force-pushed the chore/phpstan-setup branch from ac537e1 to 5fae544 Compare January 23, 2025 22:21
@uuf6429 uuf6429 requested a review from stof January 23, 2025 22:23
Copy link
Contributor

@acoulton acoulton left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great, thanks @uuf6429

Copy link
Contributor

@carlos-granados carlos-granados left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looking good, thanks @uuf6429 , just a small comment

src/Behat/Gherkin/Parser.php Outdated Show resolved Hide resolved
Copy link
Contributor

@carlos-granados carlos-granados left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All good now, thanks @uuf6429

@carlos-granados carlos-granados merged commit bd74622 into Behat:master Jan 31, 2025
8 checks passed
@uuf6429 uuf6429 deleted the chore/phpstan-setup branch January 31, 2025 21:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants