I made this change in this PR because I was changing this error when I realized that the caret was always pointing to the beginning of the line when usingRAISE_SYNTAX_ERROR_NO_COL_OFFSET

So this is a test of the PR and should not be committed?

So this is a test of the PR and should not be committed?

I was proposing to commit this in tandem with the other change because currently, the caret points to the end of the call and that seems wrong to me:

>>> f(x for x in range(10), x, y, z)  File "<console>", line 1    f(x for x in range(10), x, y, z)                                   ^SyntaxError: Generator expression must be parenthesized

Also, the old parser doesn't show a column offset:

./python -X oldparserPython 3.9.0a6+ (heads/no-collisions:6530eb2be9, May 10 2020, 01:41:04)>>> f(x for x in range(10), x, y, z)  File "<console>", line 1SyntaxError: Generator expression must be parenthesized

But omitting the column seems wrong too (there could be multiple calls on the line). Ideally the caret should point to the first character after the(.

Ideally the caret should point to the first character after the(.

In this case, I agree, but what about something like

f(a, b, c, x for x in range(10), x, y, z)

should it point to the beginning ofx for x in range(10) or to the first caracter after the(?

IMO it's still better if it points to the start than to the end, because that's closer to the function name.

I finally solved this mystery, I think.

The reason the old parser doesn't show the caret is because you tried it in the REPL. It seems the old parser doesn't show the source line for errors generated in some later pass (ast.c or the bytecode compiler), because the code that retrieves the source linereads the source file again. Compare these two:

~/cpython$ ./python.exe  -X oldparserPython 3.9.0a6+ (heads/master:f453221c8b, May 12 2020, 10:45:53) [Clang 11.0.0 (clang-1100.0.33.8)] on darwinType "help", "copyright", "credits" or "license" for more information.>>> (pass)  File "<stdin>", line 1    (pass)     ^SyntaxError: invalid syntax>>> f() = 1  File "<stdin>", line 1SyntaxError: cannot assign to function call>>>

Only the first of these shows the source line and the caret, because the error is detected by the (old) parser. The second comes from ast.c and there the attempt to retrieve the source line fails, causing thetext member of the SyntaxError object to be None.

But if you put the second syntax error in a file, the old parser shows the source line and the caret (and as I've shown, the caret is in the right place too).

I'm going to close this PR;@lysnikolaou will fix it properly in#20050.