NotificationsYou must be signed in to change notification settings
Fork5
Star26

Commitd535136

committed

Don't downcase non-ascii identifier chars in multi-byte encodings.

Long-standing code has called tolower() on identifier character byteswith the high bit set. This is clearly an error and produces junk outputwhen the encoding is multi-byte. This patch therefore restricts thisactivity to cases where there is a character with the high bit set ANDthe encoding is single-byte.There have been numerous gripes about this, most recently from MartinSchäfer.Backpatch to all live releases.

1 parent94e3311 commitd535136Copy full SHA for d535136

File tree

1 file changed

-3

lines changed

src/backend/parser
- scansup.c

1 file changed

-3

lines changed

`‎src/backend/parser/scansup.c`

Lines changed: 5 additions & 3 deletions

Original file line number	Diff line number	Diff line change
`@@ -132,25 +132,27 @@ downcase_truncate_identifier(const char *ident, int len, bool warn)`
`132`	`132`	`{`
`133`	`133`	`char*result;`
`134`	`134`	`inti;`
	`135`	`+boolenc_is_single_byte;`
`135`	`136`
`136`	`137`	`result=palloc(len+1);`
	`138`	`+enc_is_single_byte=pg_database_encoding_max_length()==1;`
`137`	`139`
`138`	`140`	`/*`
`139`	`141`	`* SQL99 specifies Unicode-aware case normalization, which we don't yet`
`140`	`142`	`* have the infrastructure for. Instead we use tolower() to provide a`
`141`	`143`	`* locale-aware translation. However, there are some locales where this`
`142`	`144`	`* is not right either (eg, Turkish may do strange things with 'i' and`
`143`	`145`	`* 'I'). Our current compromise is to use tolower() for characters with`
`144`		`- * the high bit set,and use an ASCII-only downcasing for 7-bit`
`145`		`- * characters.`
	`146`	`+ * the high bit set,as long as they aren't part of a multi-byte character,`
	`147`	`+ *and use an ASCII-only downcasing for 7-bitcharacters.`
`146`	`148`	`*/`
`147`	`149`	`for (i=0;i<len;i++)`
`148`	`150`	`{`
`149`	`151`	`unsignedcharch= (unsignedchar)ident[i];`
`150`	`152`
`151`	`153`	`if (ch >='A'&&ch <='Z')`
`152`	`154`	`ch+='a'-'A';`
`153`		`-elseif (IS_HIGHBIT_SET(ch)&&isupper(ch))`
	`155`	`+elseif (enc_is_single_byte&&IS_HIGHBIT_SET(ch)&&isupper(ch))`
`154`	`156`	`ch=tolower(ch);`
`155`	`157`	`result[i]= (char)ch;`
`156`	`158`	`}`

0 commit comments

Comments

(0)

Movatterモバイル変換

Navigation Menu

Search code, repositories, users, issues, pull requests...

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Commitd535136

File tree

1 file changed

1 file changed

`‎src/backend/parser/scansup.c`

0 commit comments