You've opened the pull request against the latest branch 1.11.x. If your code is relevant on 1.10.x and you want it to be released sooner, please rebase your pull request and change its target to 1.10.x.

I've created a similar package to do help with testing custom rules: https://github.com/DaveLiddament/phpstan-rule-test-helper. This provides AbstractRuleTestCase to extend for testing custom rules.

This allows you to either hard code the error message in the fixture file (similar to @janedbal's suggestion) . E.g.

 $item->updateName("world"); // ERROR can not call method

If the same error message is repeated multiple times, then you can also override the getErrorFormatter with the error message. This means error messages need updating only in one place in the test:

 protected function getErrorFormatter(): string 
 {
 return "Can not call method";
 } 

The fixture simplifies to:

 $item->updateName("world"); // ERROR 

Finally you can provide context in the error messages:

 protected function getErrorFormatter(): string 
 {
 return "Can not call method {0} from {1}";
 } 

The fixture error has additional contextual information, if there is more than 1 bit it is separated by | character.

 $item->updateName("world"); // ERROR Item::updateName|Foo

In the above example the expected error message would be: Can not call method Item::updateName from Foo

It be nice to either bring similar functionality into PHPStan, or highlight helper packages that can help with testing.

Some thoughts after letting this sit for a while:

• Expecting errors in comments is very similar to ignoring errors
• If we implement a similar system I want it to work like assertType - that it can be tested both by running PHPUnit and simply by analysing code with PHPStan
• So what about @phpstan-error An exact error message that works the same way as @phpstan-ignore with an error identifier in 1.11.x?

Some thoughts after letting this sit for a while:

• Expecting errors in comments is very similar to ignoring errors
• If we implement a similar system I want it to work like assertType - that it can be tested both by running PHPUnit and simply by analysing code with PHPStan
• So what about @phpstan-error An exact error message that works the same way as @phpstan-ignore with an error identifier in 1.11.x?

I like @phpstan-error.

I love the fact you'd then not even need to create PHPUnit tests, you can just point PHPStan at the code snippet.

So what about @phpstan-error An exact error message that works the same way as @phpstan-ignore with an error identifier in 1.11.x?

I'm not sure that the next-line magic is needed here. Imo not.

For the meantime, we open-sourced our solution to a standalone package with just this functionality (inline error asserts in tested code): https://github.com/shipmonk-rnd/phpstan-dev