homepage

When I compile Python-3.0a1 on Mac OS X with Japanese locale,
I've got LookupError like below.
==========================================
running build_scripts
creating build/scripts-3.0
Traceback (most recent call last):
 File "./setup.py", line 1572, in <module>
 main()
 File "./setup.py", line 1567, in main
 'Lib/smtpd.py']
 File "/private/tmp/Python-3.0a1/Lib/distutils/core.py", line 148, in setup
 dist.run_commands()
 File "/private/tmp/Python-3.0a1/Lib/distutils/dist.py", line 943, in
run_commands
 self.run_command(cmd)
 File "/private/tmp/Python-3.0a1/Lib/distutils/dist.py", line 963, in
run_command
 cmd_obj.run()
 File "/private/tmp/Python-3.0a1/Lib/distutils/command/build.py", line
106, in run
 self.run_command(cmd_name)
 File "/private/tmp/Python-3.0a1/Lib/distutils/cmd.py", line 317, in
run_command
 self.distribution.run_command(command)
 File "/private/tmp/Python-3.0a1/Lib/distutils/dist.py", line 963, in
run_command
 cmd_obj.run()
 File
"/private/tmp/Python-3.0a1/Lib/distutils/command/build_scripts.py", line
51, in run
 self.copy_scripts()
 File
"/private/tmp/Python-3.0a1/Lib/distutils/command/build_scripts.py", line
82, in copy_scripts
 first_line = f.readline()
 File "/private/tmp/Python-3.0a1/Lib/io.py", line 1259, in readline
 decoder = self._decoder or self._get_decoder()
 File "/private/tmp/Python-3.0a1/Lib/io.py", line 1111, in _get_decoder
 make_decoder = codecs.getincrementaldecoder(self._encoding)
 File "/private/tmp/Python-3.0a1/Lib/codecs.py", line 951, in
getincrementaldecoder
 decoder = lookup(encoding).incrementaldecoder
LookupError: unknown encoding: X-MAC-JAPANESE
make: *** [sharedmods] Error 1
==========================================
This problem happens for lack of appropriate codec
so also occurs in apps using getdefaultencoding.
After patching Tools/unicode/Makefile and
running make generates build/mac_japanese.py, mac-japanese codec.

Marc-Andre, do you understand this issue? Your name is in
Tools/unicode/Makefile; the patch deletes the line
$(RM) build/mac_japanese.*
from the apple target, which seems rather arbitrary.

My name appears in that Makefile because I wrote it and used it to
create the charmap codecs.
The reason why the Mac Japanese codec was not created for 2.x was the
size of the mapping table. 
Ideal would be to have the C version of the CJK codecs support the Mac
Japanese encoding as well. Adding back the charmap based Mac Japanese
codec would be a compromise.
The absence of the Mac Japanese codec causes (obvious) problems for many
Japanese Python users running Mac OS X.

Adding Python 2.6 as version target.

I'll take this.

Added a patch that implements codecs for CJK Macintosh encodings.
I tried to implement that just alike the other existing CJK codecs,
but it required many inefficient mapping tables due to their odd
mappings (like this: u'ABCDE' <-> 'ab' AND u'ABCD' <-> 'ac'!).
So, I decided to implement a general extension codec wrapper that
can be easily modified by dictionaries given by Python code.
Because all Mac CJK encodings have codecs that implement their base
encodings, I just put their difference in Python codec code.
The extension mechanism may be reused in customized codecs for
in-house applications or legacy encoding supports.
The first patch was generated for 2.6 trunk. I'm working on porting
it to 3.0.

Committed patch "cjkmactemporary.diff" as r65988 in the py3k branch.
I'll open another issue for cjkcodecs implementation of Mac codecs.

On 2008年08月23日 10:08, Hye-Shik Chang wrote:
> Hye-Shik Chang <hyeshik@gmail.com> added the comment:
> 
> Committed patch "cjkmactemporary.diff" as r65988 in the py3k branch.
> I'll open another issue for cjkcodecs implementation of Mac codecs.
Thanks !

Confirmed now I can build Python on Mac OS X with Japanese locale.
I tested the followings. 
Python 2.6b3+ trunk:66060
Python 3.0b3+ py3k:66060
Thank you very much.

Any idea why mac cjk encodings still aren't available in Python 2.7 and 3.2 ?