[B! charset][python] wozozoã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

wozozo id:wozozo

charsetã¨pythonã«é–¢ã™ã‚‹wozozoã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (9)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

Python ã§ã‚¨ãƒ³ã‚³ãƒ¼ãƒ‡ã‚£ãƒ³ã‚°ã‚’åˆ¤å®šã™ã‚‹ - å‚€å„¡å¸«ã®é¤¨.Pythonï¼šæ¥½å¤©ãƒ–ãƒã‚°
2008.05.25 Python ã§ã‚¨ãƒ³ã‚³ãƒ¼ãƒ‡ã‚£ãƒ³ã‚°ã‚’åˆ¤å®šã™ã‚‹ (1) ãƒ†ãƒ¼ãƒžï¼šãƒ—ãƒã‚°ãƒ©ãƒŸãƒ³ã‚°è¨€èªž Python ã‚’ä½¿ã†(336) ã‚«ãƒ†ã‚´ãƒªï¼šPython Python ã§ã‚¨ãƒ³ã‚³ãƒ¼ãƒ‡ã‚£ãƒ³ã‚°ã®è‡ªå‹•åˆ¤å®šã‚’ã™ã‚‹ã«ã¯ã„ãã¤ã‹ã®æ–¹æ³•ãŒã‚ã‚‹ã€‚æ–‡å—åˆ—ã®ã‚³ãƒ¼ãƒ‰ã‚’ç›´æŽ¥èª¿ã¹ã¦ãã®æƒ…å ±ã ã‘ã§åˆ¤å®šã™ã‚‹ã‚¿ã‚¤ãƒ—ã¨ã€HTML ã‚„ XML ãƒ•ã‚¡ã‚¤ãƒ«ã«å«ã¾ã‚Œã‚‹ãƒ¡ã‚¿æƒ…å ±ãªã©ã‚‚åˆ©ç”¨ã—ã€ãã†ã—ãŸæƒ…å ±ã§åˆ¤å®šã§ããªã„ã‚‚ã®ã¯æ–‡å—ã‚³ãƒ¼ãƒ‰ã®æƒ…å ±ã‹ã‚‰åˆ¤å®šã™ã‚‹ã‚¿ã‚¤ãƒ—ãŒã‚ã‚‹ã€‚ å‰è€…ã®ã‚¿ã‚¤ãƒ—ã§ã¯ã€pykf ã‚„ã€nkfpythonã€kanjilib ãªã©ãŒã‚ã‚‹ã€‚pykf ã¯ã€ShiftJIS, EUC-JP, JISã‚³ãƒ¼ãƒ‰ã‚’ç›¸äº’ã«å¤‰æ›ã™ã‚‹ãŸã‚ã®Pythonæ‹¡å¼µãƒ¢ã‚¸ãƒ¥ãƒ¼ãƒ«ã§ã€Universal Encoding Detector ã‚„ encutils ã®ã‚ˆã†ã«ã¯ã€ãƒ¡ã‚¿æƒ…å ±ã‚’ä½¿ã‚ãªã„ç›´æŽ¥æ–‡å—ã‚³ãƒ¼ãƒ‰ã‚’ãƒã‚§ãƒƒã‚¯ã™ã‚‹ã‚¿ã‚¤ãƒ—ã€‚æ—¥æœ¬èªžã®ã¿ã‚’å‰æã¨ã™ã‚‹ã®ã§ã‚ã‚Œã°
wozozo 2010/09/15
python

charset

ã‚ã¨ã§èªã‚€
ãƒªãƒ³ã‚¯
pythonã§æ–‡å—ã‚³ãƒ¼ãƒ‰å¤‰æ›ã®ãƒ†ã‚¹ãƒˆ - Vox
windows+python2.5ã§ ãƒã‚¤ãƒŠãƒªãƒ•ã‚¡ã‚¤ãƒ«ã‹ã‚‰SJISã®æ–‡å—åˆ—ã‚’èªã¿å–ã£ã¦utf8æ–‡å—åˆ—ã¨ã—ã¦sqliteã«ä¿å˜ã€‚å¾Œã§sqliteã‹ã‚‰èªã¿å‡ºã—ã¦SJISã§ä¿å˜ã€‚ã£ã¦ã“ã¨ã‚’pythonã§ã‚„ã‚ã†ã¨ã—ã¦å¤§ã„ã«èº“ãã€‚ä¸€å¿œç†è§£ã—ãŸã‚‚ã®ã®ã€ã©ã†ã«ã‚‚æŠŠæ¡ã—ã¥ã‚‰ã„ã®ã§ã¾ã¨ã‚ã¦ãƒ†ã‚¹ãƒˆã‚³ãƒ¼ãƒ‰ã‚’æ™’ã—ã¦ã¿ã‚‹ # -*- coding: utf-8 -*- # vim:fileencoding=utf-8 #ãƒã‚¤ãƒˆã‚³ãƒ¼ãƒ‰ j = 'æ—¥æœ¬èªž' #unicodeæ–‡å—åˆ— uj = u'æ—¥æœ¬èªž' #9'ãƒã‚¤ãƒˆ' print len(j) #3'æ–‡å—' print len(uj) #unicodeæ–‡å—åˆ—ãªã®ã§ã€pythonãŒè‡ªå‹•çš„ã«stdoutã«é©åˆã™ã‚‹ã‚ˆã†å¤‰æ›ã™ã‚‹ print uj #utf8ã®ãƒã‚¤ãƒˆã‚³ãƒ¼ãƒ‰ã‚’unicodeã«å¤‰æ›ã—ã¦å‡ºåŠ› print unicode(j,'utf-8') #ä¸Šã¨åŒã˜ã ãŒdec
wozozo 2009/09/06
python

charset
ãƒªãƒ³ã‚¯
ã¯ã¦ãªãƒ–ãƒã‚° | ç„¡æ–™ãƒ–ãƒã‚°ã‚’ä½œæˆã—ã‚ˆã†
ã‚ãŸã—çš„æ£šã¼ãŸä¸€ä¸‡å††é¸æ›¸ æ€¥ã«åƒè‘‰ã•ã‚“ã«æ‰‹æ¸¡ã•ã‚ŒãŸå°ç’ã€é–‹ã‘ã¦ã¿ãŸã‚‰1ä¸‡å††æœãŒ1æžšã€‚ä½•ã”ã¨ã‹ã¨æ€ãˆã°ã€åŒæœŸã®å‡ºå¼µã‚’ä»£ã‚ã£ãŸãŠç¤¼ã‚’ã‚‚ã‚‰ã£ãŸã‚‰ã—ã„ã€‚ ã€Œè‘µã¯ãƒ¯ãƒ³ã‚ªãƒšã§è‚²å…ã—ã¦ãã‚ŒãŸã‹ã‚‰ã€ã¨åŠåˆ†ã‚ã‘ã¦ãã‚Œã¾ã—ãŸã€‚ æ³¡éŠã®1ä¸‡å†† ã“ã‚Œã¯ã‚‚ã†ã€ã‚ãŸã—çš„1ä¸‡å††é¸æ›¸ã‚’ã—ã‚ã¨ã„ã†æ€ã—å¬ã—ãªã®ã§ã¯â€¦â€¦
wozozo 2009/03/08
æ—¥æœ¬èªž

python

charset
ãƒªãƒ³ã‚¯
lxmlã§æ—¥æœ¬èªžã®Webãƒšãƒ¼ã‚¸ã®ã‚¿ã‚¤ãƒˆãƒ«ã‚’å–å¾—ã™ã‚‹ - Pyro Memo
æ—¥æœ¬èªžãŒåŒ–ã‘ã¦å¤§å¤‰è‹¦åŠ´ã—ãŸã®ã§ãƒ¡ãƒ¢ã€‚çµè«–ã¨ã—ã¦ã€XMLï¼ˆã¾ãŸã¯HTMLï¼‰ã‚’è§£æžã™ã‚‹å‰ã«unicodeé–¢æ•°ã«é€šã—ã¦ãŠãã€ã¨ã„ã†ã“ã¨ã§è‰¯ã„ã®ã‹ãªï¼Ÿç›¸å¤‰ã‚ã‚‰ãšæ–‡å—ã‚³ãƒ¼ãƒ‰é–¢é€£ã¯ã‚ˆãåˆ†ã‹ã‚‰ãªã„ã€‚ from urllib import urlopen from lxml import etree html = urlopen("http://b.hatena.ne.jp") charset = html.headers.getparam('charset') html_data = unicode(html.read(),charset) et = etree.fromstring(html_data, parser=etree.HTMLParser()) title_element = et.xpath("./head/title")[0] title = title_element.text.e
wozozo 2009/03/06
lxml æ–‡å—åŒ–ã‘ æ—¥æœ¬èªž

python

xml

charset
ãƒªãƒ³ã‚¯
Pythonã¨æ—¥æœ¬èªžè¡¨ç¤ºã¨æ–‡å—ã‚³ãƒ¼ãƒ‰ã€unicode ã€str ã€utf-8 ã€shift-jis ã€ã€ã€ - Cassiopeiaã®æ—¥è¨˜
Pythonã¯ä½¿ã„ã‚„ã™ã„è¦šãˆã‚„ã™ã„æ°—æŒã¡ã„ã„ã¨ã¾ã§è¨€ã†äººã‚‚ã„ã‚‹ã€‚ãŸã—ã‹ã«ãã®é€šã‚Šã ã¨æ€ã£ãŸã€‚ã—ã‹ã—ã€æ—¥æœ¬èªžã‚’ä½¿ãŠã†ã¨ã—ãŸæ™‚ã«æ€¥ã«æ°—æŒã¡è‰¯ããªããªã‚‹ã€‚ãã†æ„Ÿã˜ãŸã®ã¯åƒ•ã ã‘ã§ã¯ãªã„ã¯ãšã ã€‚ ã¨ã„ã†ã“ã¨ã§ä»Šæ—¥ã®æ—¥è¨˜ã®ãƒã‚¿ã¯Pythonã¨æ—¥æœ¬èªžã¨ãªã‚Šã¾ã—ãŸã€‚ (WindowsXPã«ã‚³ã‚³ã‹ã‚‰ "Python 2.5.1 Windows installer" ã‚’ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã—ãŸç’°å¢ƒã§ãƒ†ã‚¹ãƒˆã—ã¦ã„ã¾ã™ã€‚) ã¾ãšã¯ã€ã‚ãªãŸãŒæ›¸ã„ãŸã‚³ãƒ¼ãƒ‰ã¯utf-8ã§ä¿å˜ã™ã‚‹ã€‚ãã—ã¦ã€ãã®ã‚³ãƒ¼ãƒ‰ã®å…ˆé ã«ã¯ä»¥ä¸‹ã‚’è¨˜å…¥ã™ã‚‹ã€‚ # -*- coding: utf-8 -*- ã‚ãªãŸã¯ã‚¨ãƒ‡ã‚£ã‚¿ã«ä½•ã‚’ä½¿ã£ã¦ã„ã¾ã™ã‹ï¼Ÿã€€ç§€ä¸¸ã€ãƒ¡ãƒ¢å¸³ã€vimã€meadowã€æˆ–ã„ã¯ Python Scripterã€eclipse ï¼Ÿ ã„ãšã‚Œã«ã—ã¦ã‚‚ãƒ•ã‚¡ã‚¤ãƒ«ã‚’ä¿å˜ã™ã‚‹æ™‚ã®ã‚¨ãƒ³ã‚³ãƒ¼ãƒ‰ã¯utf-8ã«ã™ã¹ã—ã€‚ ã§ã¯æ—©é€Ÿæ°—æŒã¡ã‚ˆããªã„(è¡¨ç¤ºãŒæ–‡å—åŒ–ã‘ã™ã‚‹ï¼)ä¾‹ã€‚
wozozo 2008/12/10
charset

python
ãƒªãƒ³ã‚¯
ãªã‚“ã¨ãªãencodeã¨decode ä½¿ã£ã¦ã¿ãŸ - ç‰Œèªžå‚™å¿˜éŒ² -pygo
ã„ã¤ã‚‚ä½¿ã†æ™‚ã‚ã‘ã‚ã‹ã‚‰ãªããªã‚‹ã®ã§ãƒ¡ãƒ¢(Â´ï½¥Ï‰ï½¥`) Pythonã®å¯¾è©±ãƒ¢ãƒ¼ãƒ‰ã§encodeã¨decode ä½¿ã£ã¦ã¿ã‚‹ã€‚ ãƒ¦ãƒ‹ã‚³ãƒ¼ãƒ‰ -> 'utf8' >>> u'ç‰›ã‚¿ãƒ³'.encode('utf8') '\xe7\x89\x9b\xe3\x82\xbf\xe3\x83\xb3' >>> print '\xe7\x89\x9b\xe3\x82\xbf\xe3\x83\xb3' ç‰›ã‚¿ãƒ³ 'utf8' ï½°> ãƒ¦ãƒ‹ã‚³ãƒ¼ãƒ‰ >>> '\xe7\x89\x9b\xe3\x82\xbf\xe3\x83\xb3'.decode('utf8') u'\u725b\u30bf\u30f3' >>> 'ç‰›ã‚¿ãƒ³'.decode('utf8') u'\u725b\u30bf\u30f3' >>> print u'\u725b\u30bf\u30f3' ç‰›ã‚¿ãƒ³ >>> unicode('ç‰›ã‚¿ãƒ³', 'utf8')
wozozo 2008/10/30
python

charset
ãƒªãƒ³ã‚¯
2008-01-08 - ãƒ—ãƒã‚°ãƒ©ãƒŸãƒ³ã‚°æ—¥è¨˜ ] ã‚¨ãƒ³ã‚³ãƒ¼ãƒ‡ã‚£ãƒ³ã‚°æŒ‡å®š
odz buffer: Pythonã®ã‚¨ãƒ³ã‚³ãƒ¼ãƒ‡ã‚£ãƒ³ã‚° (http://d.hatena.ne.jp/odz/20080106/1199638622) å…¥å‡ºåŠ›å‘¨ã‚Šã®ã‚¨ãƒ³ã‚³ãƒ¼ãƒ‡ã‚£ãƒ³ã‚°ã®è¨å®šã®æ–¹æ³•ãŒæ›¸ã‹ã‚Œã¦ã„ãŸã€‚ã“ã®ä¾‹ã§ã€ã‚¨ãƒ³ã‚³ãƒ¼ãƒ‡ã‚£ãƒ³ã‚°ã‚’å–å¾—ã™ã‚‹å‰åŠã¨å…¥å‡ºåŠ›ã®ã‚¨ãƒ³ã‚³ãƒ¼ãƒ‡ã‚£ãƒ³ã‚°ã‚’è¨å®šã™ã‚‹å¾ŒåŠã«åˆ†ã‘ã¦è€ƒãˆã‚‹ã€‚ import sys, locale, codecs enc = locale.getpreferredencoding() sys.stdout = codecs.getwriter(enc)(sys.stdout) sys.stdin = codecs.getreader(enc)(sys.stdin) ã€ŽPythonãƒãƒ¥ãƒ¼ãƒˆãƒªã‚¢ãƒ«ã€ã«ã¯ä»¥ä¸‹ã®ã‚³ãƒ¼ãƒ‰ãŒè¼‰ã£ã¦ã„ãŸã€‚ import codecs, sys sys.stdout = codecs.lookup('utf-8')[-1](sy
wozozo 2008/10/22
python

charset
ãƒªãƒ³ã‚¯
Pythonã®UnicodeEncodeErrorã‚’çŸ¥ã‚‹ - HDEãƒ©ãƒœ
Pythonã«ã¯ã˜ã‚ã¦è§¦ã£ã¦ã€ã„ã¤ã®ã¾ã«ã‹1å¹´ãŒéŽãŽãŸã®ã§ã™ãŒã€ä¸€ç•ªã¯ã¾ã£ãŸã®ã¯ã€ã‚„ã£ã±ã‚Šunicodeã®æ‰±ã„ã ã£ãŸã¨æ€ã„ã¾ã™ã€‚ ç‰¹ã«ã€ UnicodeEncodeError: 'ascii' codec can't encode characters in position 0-12: ordinal not in range(128) ã®ã‚ˆã†ãªã‚¨ãƒ©ãƒ¼ã«ã¯ã•ã‚“ã–ã‚“æ‚©ã¾ã•ã‚Œã¾ã—ãŸã€‚ã“ã“ãŒãŸã¨ãˆã°rubyãªã©ä»–ã®è¨€èªžã¨æ¯”ã¹ã¦ã‚ã‹ã‚Šã«ãã„ãŸã‚ã«ã€PythonãŒå–ã£ã¤ãã«ãã„è¨€èªžã«ãªã£ã¦ã„ã‚‹ã®ã§ã¯ãªã„ã‹ã€ã¨å€‹äººçš„ã«ã¯æ€ã„ã¾ã™ã€‚ ãã“ã§ã€ã“ã®ã‚¨ãƒ©ãƒ¼ã«é–¢ä¿‚ã™ã‚‹ã¯ã¾ã‚Šã©ã“ã‚ã¨Tipsã‚’ã„ãã¤ã‹åˆ—æŒ™ã—ã¦ã¿ã¾ã—ãŸã€‚ã“ã‚Œã‹ã‚‰Pythonã«è§¦ã‚Œã‚‰ã‚Œã‚‹æ–¹ã®å‚è€ƒã«ãªã‚Œã°ã¨æ€ã„ã¾ã™ã€‚ ãªãŠã€ç’°å¢ƒã¯UNIXä¸Šã®Python 2.4, 2.5ã‚’æƒ³å®šã—ã¦ã„ã¾ã™ã€‚ u1ã¯unicodeåž‹ã§ã€s1ã¯stråž‹ã§ã™ã€‚s1ã«ã©ã®ã‚ˆ
wozozo 2008/10/19
python

unicode

charset
ãƒªãƒ³ã‚¯
Python ã§æ—¥æœ¬èªžã‚’æ‰±ã†åŸºæœ¬ã‚’ã¾ã¨ã‚ã¦ã¿ã‚‹ãƒ¡ãƒ¢(ãã®2) - çŒ«(=ãƒ»Ï‰ãƒ»=)é¡” 1.0Î²
ã€Œãã®1ã€ã®ã¾ã¨ã‚ â‡’Python ã§æ—¥æœ¬èªžã‚’æ‰±ã†åŸºæœ¬ã‚’ã¾ã¨ã‚ã¦ã¿ã‚‹ãƒ¡ãƒ¢(ãã®1) - çŒ«(=ãƒ»Ï‰ãƒ»=)é¡” 1.0Î² 1è¡Œã‚ã‹2è¡Œã‚ã§ # coding: ã€œ ã‚’æŒ‡å®šã™ã‚‹ã€‚ '' ã¯é€šå¸¸ã®æ–‡å—åˆ—ã€‚ä¿å˜ã—ãŸå½¢å¼ã®ã¾ã¾ã®ã€Œãƒã‚¤ãƒˆåˆ—ã€ã€‚ u'' ã¯ Unicode æ–‡å—åˆ—ã€‚å¤šãƒã‚¤ãƒˆæ–‡å—ç’°å¢ƒã§1æ–‡å—ã‚’1æ–‡å—ã¨ã—ã¦æ‰±ã†ãŸã‚ã«å¿…è¦ã€‚ é€šå¸¸ã®æ–‡å—åˆ—ã‹ã‚‰ Unicode æ–‡å—åˆ—ã¸ã®å¤‰æ›ã¯ unicode() é–¢æ•°ã‚’ä½¿ã†ã€‚ ä»Šæ—¥ã®ãŠé¡Œ unicode() é–¢æ•°ã‚’ã‚‚ã†ã¡ã‚‡ã£ã¨æŽ¢ã‚‹ Unicode æ–‡å—åˆ—ã‚’ä½œã‚‹åˆ¥ã®æ–¹æ³• æ–‡å—ã‚³ãƒ¼ãƒ‰ã®å¤‰æ›æ–¹æ³• (1) Unicode æ–‡å—åˆ—ã‹ã‚‰ä»»æ„ã® encoding ã¸ æ–‡å—ã‚³ãƒ¼ãƒ‰ã®å¤‰æ›æ–¹æ³• (2) encoding-A ã‹ã‚‰ encoding-B ã¸ unicode() é–¢æ•°ã‚’ã‚‚ã†ã¡ã‚‡ã£ã¨æŽ¢ã‚‹ å‰å›žã®ãŠã•ã‚‰ã„ã€‚ ä»¥ä¸‹ã€é€šå¸¸ã®æ–‡å—åˆ—(ãƒã‚¤ãƒˆåˆ—)ã¯ã€ãƒ¡ãƒ³ãƒ‰ã‚¯ã‚µã‚¤ã‹ã‚‰å…¨éƒ¨ euc-
wozozo 2008/09/11
python

charset
ãƒªãƒ³ã‚¯
1