Message 119662 - Python tracker

➜

This issue tracker has been migrated to GitHub , and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

In-reply-to
Author	vstinner
Recipients	MrJean1, amaury.forgeotdarc, db3l, flox, ixokai, loewis, mark.dickinson, michael.foord, ned.deily, piro, pitrou, ronaldoussoren, rpetrov, skip.montanaro, slmnhq, vstinner
Date	2010年10月27日.00:36:32
SpamBayes Score	1.9759349e-05
Marked as misclassified	No
Message-id	<1288139796.38.0.381630346424.issue10209@psf.upfronthosting.co.za>

Content
PyUnicode_EncodeFSDefault() and os.fsencode() should decompose the filename (NFD) before encoding it to utf-8. PyUnicode_DecodeFSDefault(AndSize)() and os.fsdecode() should precompose the filename (NFC) after decoding it from utf-8. Qt library does this on Mac: see locale_encode()/locale_decode() (filename encoder/decoder) functions in src/corelib/io/qfile.cpp. It should fix some issues of test_pep277 on Mac OS X (see #8423). I'm not completly sure that we should do that :-) (I used the nosy list from issues #4388 and #8423). -- Technical Q&A QA1173, Text Encodings in VFS: http://developer.apple.com/mac/library/qa/qa2001/qa1173.html Q: I'm writing a file system (VFS) plug-in for Mac OS X. How do I handle text encodings correctly? A: In Mac OS X's VFS API file names are, by definition, canonically decomposed Unicode, encoded using UTF-8. This raises a number of interesting issues. (...)

Content

PyUnicode_EncodeFSDefault() and os.fsencode() should decompose the filename (NFD) before encoding it to utf-8.
PyUnicode_DecodeFSDefault(AndSize)() and os.fsdecode() should precompose the filename (NFC) after decoding it from utf-8.
Qt library does this on Mac: see locale_encode()/locale_decode() (filename encoder/decoder) functions in src/corelib/io/qfile.cpp.
It should fix some issues of test_pep277 on Mac OS X (see #8423).
I'm not completly sure that we should do that :-)
(I used the nosy list from issues #4388 and #8423).
--
Technical Q&A QA1173, Text Encodings in VFS:
http://developer.apple.com/mac/library/qa/qa2001/qa1173.html
Q: I'm writing a file system (VFS) plug-in for Mac OS X. How do I handle text encodings correctly?
A: In Mac OS X's VFS API file names are, by definition, canonically decomposed Unicode, encoded using UTF-8. This raises a number of interesting issues. (...)

History
Date	User	Action	Args
2010年10月27日 00:36:36	vstinner	set	recipients: + vstinner, loewis, skip.montanaro, ixokai, db3l, ronaldoussoren, amaury.forgeotdarc, mark.dickinson, pitrou, piro, MrJean1, ned.deily, rpetrov, michael.foord, flox, slmnhq
2010年10月27日 00:36:36	vstinner	set	messageid: <1288139796.38.0.381630346424.issue10209@psf.upfronthosting.co.za>
2010年10月27日 00:36:34	vstinner	link	issue10209 messages
2010年10月27日 00:36:32	vstinner	create

homepage