Bug report

Bug description:

Found by OSS-Fuzz.

The testcase is:

#coding=U7+AA0''

resulting in:

$ ./python -c "import py_compile; py_compile.compile('testcase')"Sorry: SystemError: Parser/string_parser.c:286: bad argument to internal function

I gather this is because+AA0 decodes to\r in UTF-7, however,_PyTokenizer_translate_newlines is called before the codec decoding so it slips by and blows up (at least it apologizes😆). I think it could be fixed by calling_PyTokenizer_translate_newlines again after decoding if a\r is introduced, WDYT?

cc@lysnikolaou@pablogsal

CPython versions tested on:

CPython main branch

Operating systems tested on:

No response

Linked PRs

• gh-145234: Fix SystemError in parser when \r is introduced after code… #145276
• gh-145234: Normalize decoded CR in string tokenizer #145281
• [3.14] gh-145234: Normalize decoded CR in string tokenizer (GH-145281) #145310
• [3.13] gh-145234: Normalize decoded CR in string tokenizer (GH-145281) #145312