[B! utf-8] TaROã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

TaRO id:TaRO

utf-8ã«é–¢ã™ã‚‹TaROã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (8)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

ã»ã…ã»ã…ã˜ã‚‡ã›ã¤ : UTF-8ã¨UTF-8Nã®é•ã„ã«ã‚ˆã‚‹ãƒ¯ãƒŠ
2008å¹´02æœˆ27æ—¥08:32 ã‚«ãƒ†ã‚´ãƒª UTF-8ã¨UTF-8Nã®é•ã„ã«ã‚ˆã‚‹ãƒ¯ãƒŠ rubyã‚’æ›¸ã„ã¦ã„ã‚‹ã®ã ãŒã€çµæ§‹æ„å¤–ãªã¨ã“ã‚ã§ã¯ã¾ã£ã¦ã€æ™‚é–“ã‚’è²»ã‚„ã—ã¦ã—ã¾ã£ãŸã®ã§ãƒ¡ãƒ¢ã—ã¦ãŠãã€‚ ã©ã†ã‚„ã‚‰UTF-8ã«ã¯UTF-8ã¨UTF-8Nã®2ç¨®é¡žãŒã‚ã‚‹ã€‚ãã‚Œã‚‰ã®é•ã„ã¯ã€UTF-8ã§ã¯BOMï¼ˆByte Order Markï¼‰ã¨å‘¼ã°ã‚Œã‚‹ã€ã‚¨ãƒ³ãƒ‡ã‚£ã‚¢ãƒ³ã‚’åˆ¤å®šã™ã‚‹ãŸã‚ã®ãƒ‡ãƒ¼ã‚¿ãŒå…ˆé 3ãƒã‚¤ãƒˆã«æ›¸ãè¾¼ã¾ã‚Œã€UTF-8Nã§ã¯æ›¸ãè¾¼ã¾ã‚Œãªã„ã¨ã„ã†ã‚‚ã®ã€‚ ï¼ˆè¿½è¨˜20080401ï¼šã‚³ãƒ¡ãƒ³ãƒˆã§ã”æŒ‡æ‘˜ã‚’ã„ãŸã ã„ãŸã‚ˆã†ã«ã€ä¸Šã®è¡¨è¨˜ã¯é©åˆ‡ã§ã¯ã‚ã‚Šã¾ã›ã‚“ã€‚æ£ã—ãã¯ã€ŒUTF-8ã€ã§ã¯åŸºæœ¬çš„ã«BOMã¯ä»˜ä¸Žã•ã‚Œãšã€BOMãŒä»˜ä¸Žã•ã‚ŒãŸå ´åˆã«é™ã‚Šã€ŒUTF-8BOMã€ãªã©ã®è¡¨è¨˜ã‚’ä¸Žãˆã¦åŒºåˆ¥ã™ã‚‹ã¹ãã§ã‚ã‚‹ã‚ˆã†ã§ã™ã€‚wikipadiaã€ŒUTF-8ã€ã€€æœ¬æ¥ã§ã‚ã‚Œã°ã™ã¹ã¦ã®è¡¨è¨˜ã‚’å¤‰æ›´ã™ã¹ãã§ã™ãŒã€ã“ã“ã§ã¯TerePadãŒBOMã¤ãã®UTF-8ã‚’ã€Œ
TaRO 2012/11/27
utf-8
ãƒªãƒ³ã‚¯
XMLç”¨èªžäº‹å…¸ [BOM (Byte Order Mark)]
BOM (Byte Order Mark) ãƒã‚¤ãƒˆãƒ»ã‚ªãƒ¼ãƒ€ãƒ¼ãƒ»ãƒžãƒ¼ã‚¯ Unicodeã®UTF-16ãªã©ã®16bitå˜ä½ã®æ–‡å—ã‚¨ãƒ³ã‚³ãƒ¼ãƒ‡ã‚£ãƒ³ã‚°ã‚¹ã‚ãƒ¼ãƒ ã§ã¯ã€8bitå˜ä½ã§ãƒ‡ãƒ¼ã‚¿ã‚’é…åˆ—ã™ã‚‹éš›ã®ã‚¨ãƒ³ãƒ‡ã‚£ã‚¢ãƒ³ã¨ã—ã¦ã€ãƒ“ãƒƒã‚°ã‚¨ãƒ³ãƒ‡ã‚£ã‚¢ãƒ³ã¨ãƒªãƒˆãƒ«ã‚¨ãƒ³ãƒ‡ã‚£ã‚¢ãƒ³ã®ä¸¡æ–¹ã‚’è¨±ã—ã¦ã„ã‚‹ã€‚ãã®ãŸã‚ã€ã©ã¡ã‚‰ã®ã‚¨ãƒ³ãƒ‡ã‚£ã‚¢ãƒ³ã§è¨˜è¿°ã•ã‚ŒãŸãƒ‡ãƒ¼ã‚¿ã‹ã‚’ç¢ºå®Ÿã«åˆ¤å®šã™ã‚‹ãŸã‚ã®ç‰¹åˆ¥ãªãƒžãƒ¼ã‚¯ã¨ãªã‚‹ç¬¦å·ã¨ã—ã¦ã€BOMï¼ˆByte Order Markï¼‰ãŒç”¨æ„ã•ã‚Œã¦ã„ã‚‹ã€‚ ã¾ãŸBOMã¯ã€ã‚ã‚‹ãƒ†ã‚ã‚¹ãƒˆãŒUnicodeã§è¨˜è¿°ã•ã‚Œã¦ã„ã‚‹ã‹ã©ã†ã‹ã‚’è‡ªå‹•åˆ¤å®šã™ã‚‹æ‰‹æ®µã¨ã—ã¦ä½¿ç”¨ã•ã‚Œã‚‹å ´åˆã‚‚ã‚ã‚‹ã€‚ã“ã®ç›®çš„ã«ä½¿ç”¨ã•ã‚Œã‚‹å ´åˆã¯ã€ã‚¨ãƒ³ãƒ‡ã‚£ã‚¢ãƒ³ãŒå˜åœ¨ã™ã‚‹UTF-16ã ã‘ã§ãªãã€ã‚¨ãƒ³ãƒ‡ã‚£ã‚¢ãƒ³ãŒå˜åœ¨ã—ãªã„UTF-8ã®ãƒ†ã‚ã‚¹ãƒˆã«ä»˜åŠ ã•ã‚Œã‚‹å ´åˆã‚‚ã‚ã‚‹ã€‚ BOMã¯ã€å¿…ãšãƒ†ã‚ã‚¹ãƒˆã®å…ˆé ã«ä»˜åŠ ã•ã‚Œã‚‹ã€‚ãƒ†ã‚ã‚¹ãƒˆã®ä¸é–“ã«ç½®ã‹ã‚Œã‚‹ã“ã¨ã¯ãªã„ã€‚BOMã®å€¤ã¯ã€U+ffefã¨å®šã‚ã‚‰ã‚Œã¦
TaRO 2012/11/27
utf-8
ãƒªãƒ³ã‚¯
ç¬¬4å›žã€€UTF-8ã®å†—é•·ãªã‚¨ãƒ³ã‚³ãƒ¼ãƒ‰ | gihyo.jp
ä»Šå›žã¯ã€æ–‡å—ã‚³ãƒ¼ãƒ‰ã«é–¢é€£ã™ã‚‹ã‚»ã‚ãƒ¥ãƒªãƒ†ã‚£ã®è©±é¡Œã§ã¯å¤å‚ã¨ã‚‚ã„ãˆã‚‹UTF-8ã®å†—é•·ãªã‚¨ãƒ³ã‚³ãƒ¼ãƒ‰ã¨ã„ã†ãƒ†ãƒ¼ãƒžã«ã¤ã„ã¦ç´¹ä»‹ã—ã¾ã™ã€‚ UTF-8ã¨ã¯ UTF-8ã¯ã€å„æ–‡å—ã‚’1ï½ž4ãƒã‚¤ãƒˆã®å¯å¤‰é•·ã§è¡¨ç¾ã™ã‚‹Unicodeã®ç¬¦å·åŒ–æ–¹å¼ã®ã²ã¨ã¤ã§ã™ã€‚ Uï¼‹0000ã‹ã‚‰Uï¼‹007Fã®ç¯„å›²ã®æ–‡å—ã‚’0x00ã‹ã‚‰0x7Fã®1ãƒã‚¤ãƒˆã§è¡¨ç¾ã—ã¦ã„ã‚‹ãŸã‚ã€US-ASCIIã¨äº’æ›æ€§ãŒã‚ã‚‹ã€ãƒã‚¤ãƒˆåˆ—ã®é€”ä¸ã‹ã‚‰ã§ã‚‚æ–‡å—ã®å…ˆé ãƒã‚¤ãƒˆã‚’ç°¡å˜ã«æ¤œå‡ºã§ãã‚‹ã€å¤šãƒã‚¤ãƒˆæ–‡å—ã®é€”ä¸ã«0x00ã‚„0x5Cï¼ˆ\â ï¼‰â ã€0x2Fï¼ˆ/ï¼‰ãªã©ãŒç¾ã‚Œãªã„ã€ãªã©ã®ç‰¹å¾´ãŒã‚ã‚Šã¾ã™ã€‚ UTF-8ã§ã®æ–‡å—ã®ãƒ“ãƒƒãƒˆãƒ‘ã‚¿ãƒ¼ãƒ³ã¯è¡¨1ã®ã‚ˆã†ã«ãªã‚Šã¾ã™ã€‚ è¡¨1ã€€UTF-8ã§ã®ãƒ“ãƒƒãƒˆãƒ‘ã‚¿ãƒ¼ãƒ³
TaRO 2012/05/21
programming

unicode

utf-8
ãƒªãƒ³ã‚¯
Vimã¨UTF-8ã¨æ—¥æœ¬èªž
Vimã¯ http://www.vim.orgã§é…å¸ƒã•ã‚Œã¦ã„ã‚‹Unixç”±æ¥ã®viæ´¾ç”Ÿã‚¨ãƒ‡ã‚£ã‚¿ã§Windowsã§ã‚‚ä½¿ç”¨ã™ã‚‹ã“ã¨ãŒã§ãã¾ã™ã€‚ æ“ä½œä½“ç³»ãŒç‹¬ç‰¹ã§ã¨ã£ã¤ãã¯ã‚ã¾ã‚Šè‰¯ãã‚ã‚Šã¾ã›ã‚“ãŒã€ãªã‚Œã‚‹ã¨éžå¸¸ã«åŠ¹çŽ‡ã®ã‚ˆã„ç·¨é›†ã‚’è¡Œãˆã‚‹ã‚ˆã†ã«ãªã‚Šã¾ã™ã€‚ Vim(vi)è‡ªä½“ã®ç°¡å˜ãªä½¿ã„æ–¹(æ“ä½œæ–¹æ³•å…¥é–€)ã¯ã€Œã¯ã˜ã‚ã¦ã®viã€ã«ã¾ã¨ã‚ã¾ã—ãŸã€‚ å¸‚è²©ã®å…¥é–€æ›¸ã¨ã—ã¦ã¯ã€Œå…¥é–€vi ç¬¬6ç‰ˆ(amazon)ã€ãŒè¨³è‡ªä½“ã‚‚èªã¿ã‚„ã™ããƒãƒ¼ãƒˆã‚·ãƒ¼ãƒˆã‚‚ã¤ã„ã¦ã„ã‚‹ã®ã§ãŠã™ã™ã‚ã§ã™ã€‚ è¡¨é¢çš„ãªã‚³ãƒžãƒ³ãƒ‰è§£èª¬ã ã‘ã®æœ¬ã§ã¯ãªã„ã®ã§ viã‚’ç†è§£ã™ã‚‹ãŸã‚ã«æœ€é©ãªä¸€å†Šã¨æ€ã„ã¾ã™ã€‚ ç¬¬6ç‰ˆã§ã¯ viã ã‘ã§ãªã Vimã«ã¤ã„ã¦ã‚‚è§¦ã‚Œã‚‰ã‚Œã¦ã„ã¾ã™ã€‚ æ—¥æœ¬èªžç‰ˆWindowsã§ã®Vimã¯ãƒ‡ãƒ•ã‚©ãƒ«ãƒˆãŒcp932(Shift JIS)ã§å‹•ä½œã™ã‚‹ãŸã‚ã€æœ€è¿‘å¢—ãˆã¦ããŸWebç³»ã®ãƒ•ã‚¡ã‚¤ãƒ«ç‰ã§é–‹ãã“ã¨ãŒã§ããªã„ãƒ•ã‚¡ã‚¤ãƒ«ã‚‚ã‚ã‚Šã¾ã™ã€‚ åŸºæœ¬çš„ã«ã¯å†…éƒ¨ã‚¨ãƒ³ã‚³ãƒ¼ãƒ‡ã‚£ãƒ³ã‚°ã‚’
TaRO 2011/11/10
vim

Windows

utf-8
ãƒªãƒ³ã‚¯
Pythonã®UnicodeEncodeErrorã‚’çŸ¥ã‚‹ - HDEãƒ©ãƒœ
Pythonã«ã¯ã˜ã‚ã¦è§¦ã£ã¦ã€ã„ã¤ã®ã¾ã«ã‹1å¹´ãŒéŽãŽãŸã®ã§ã™ãŒã€ä¸€ç•ªã¯ã¾ã£ãŸã®ã¯ã€ã‚„ã£ã±ã‚Šunicodeã®æ‰±ã„ã ã£ãŸã¨æ€ã„ã¾ã™ã€‚ ç‰¹ã«ã€ UnicodeEncodeError: 'ascii' codec can't encode characters in position 0-12: ordinal not in range(128) ã®ã‚ˆã†ãªã‚¨ãƒ©ãƒ¼ã«ã¯ã•ã‚“ã–ã‚“æ‚©ã¾ã•ã‚Œã¾ã—ãŸã€‚ã“ã“ãŒãŸã¨ãˆã°rubyãªã©ä»–ã®è¨€èªžã¨æ¯”ã¹ã¦ã‚ã‹ã‚Šã«ãã„ãŸã‚ã«ã€PythonãŒå–ã£ã¤ãã«ãã„è¨€èªžã«ãªã£ã¦ã„ã‚‹ã®ã§ã¯ãªã„ã‹ã€ã¨å€‹äººçš„ã«ã¯æ€ã„ã¾ã™ã€‚ ãã“ã§ã€ã“ã®ã‚¨ãƒ©ãƒ¼ã«é–¢ä¿‚ã™ã‚‹ã¯ã¾ã‚Šã©ã“ã‚ã¨Tipsã‚’ã„ãã¤ã‹åˆ—æŒ™ã—ã¦ã¿ã¾ã—ãŸã€‚ã“ã‚Œã‹ã‚‰Pythonã«è§¦ã‚Œã‚‰ã‚Œã‚‹æ–¹ã®å‚è€ƒã«ãªã‚Œã°ã¨æ€ã„ã¾ã™ã€‚ ãªãŠã€ç’°å¢ƒã¯UNIXä¸Šã®Python 2.4, 2.5ã‚’æƒ³å®šã—ã¦ã„ã¾ã™ã€‚ u1ã¯unicodeåž‹ã§ã€s1ã¯stråž‹ã§ã™ã€‚s1ã«ã©ã®ã‚ˆ
TaRO 2010/11/08
unicode

python

utf-8

æ–‡å—ã‚³ãƒ¼ãƒ‰

ãƒ—ãƒã‚°ãƒ©ãƒŸãƒ³ã‚°
ãƒªãƒ³ã‚¯
ã‚¨ã‚¯ã‚»ãƒ«ã§CSVã«ä¿å˜ã—ã¦phpMyAdminã¸ã‚¤ãƒ³ãƒãƒ¼ãƒˆã™ã‚‹æ–¹æ³• : zontheworld
ã‚¨ã‚¯ã‚»ãƒ«ï¼ˆExcelï¼‰ã§ä½œã£ãŸãƒ‡ãƒ¼ã‚¿ã‚’ CSV ã§ä¿å˜ã—ã¦ phpMyAdmin ã¸ã‚¤ãƒ³ãƒãƒ¼ãƒˆã™ã‚‹ãŸã‚ã«ä¸‹è¨˜ã®å•é¡Œã‚’è§£æ¶ˆã™ã‚‹ã€‚ ï¼‘ï¼Žæ–‡å—ã‚³ãƒ¼ãƒ‰ã‚’UTF-8ã«ã™ã‚‹ã€‚ ã‚¨ã‚¯ã‚»ãƒ«ã§ CSV ãƒ•ã‚¡ã‚¤ãƒ«å½¢å¼ã«ä¿å˜ã™ã‚‹ã¨ã€æ–‡å—ã‚³ãƒ¼ãƒ‰ã¯ SJIS ã«ãªã‚‹ã€‚MySQLã®è¨å®šã«ã‚‚ã‚ˆã‚‹ãŒã€ç§ãŒä½¿ç”¨ã—ã¦ã„ã‚‹ç’°å¢ƒã§ã¯åŸºæœ¬çš„ã«æ–‡å—ã‚³ãƒ¼ãƒ‰ã¯UTF-8ã«è¨å®šã—ã¦ã„ã‚‹ã®ã§ã€ä¿å˜æ™‚ã«UTF-8ã§ä¿å˜ã—ãŸã„ã€‚ç¾çŠ¶ã¯ SJIS ã§ä¿å˜ã•ã‚Œã¦ã„ã‚‹ CSV ãƒ•ã‚¡ã‚¤ãƒ«ã®æ–‡å—ã‚³ãƒ¼ãƒ‰ã‚’ UTF-8 ã«å¤‰æ›ã—ã¦ä¿å˜ã—ãªãŠã—ã¦ã„ã‚‹ã€‚ â– ä¸‹è¨˜ã‚’å‚è€ƒ 100å¹´ãƒãƒªã‚¢: Excelãƒ‡ãƒ¼ã‚¿ã‚’UTF-8ãªCSVï¼ˆ;åŒºåˆ‡ã‚Šï¼‰ã§ä¿å˜ã™ã‚‹ ï¼’ï¼Žãƒ•ã‚£ãƒ¼ãƒ«ãƒ‰ã‚’ãƒ€ãƒ–ãƒ«ã‚¯ã‚©ãƒ¼ãƒ†ãƒ¼ã‚·ãƒ§ãƒ³ã§å›²ã‚€ã€‚ phpMyAdmin ã®ãƒ•ã‚£ãƒ¼ãƒ«ãƒ‰ã®å›²ã„è¨˜å·ãŒã€Œãƒ€ãƒ–ãƒ«ã‚¯ã‚©ãƒ¼ãƒ†ãƒ¼ã‚·ãƒ§ãƒ³ï¼ˆâ€ï¼‰ã€ã«ãªã£ã¦ã„ã‚‹ãŒã€ã‚¨ã‚¯ã‚»ãƒ«ã§ CSV ãƒ•ã‚¡ã‚¤ãƒ«å½¢å¼ã«ä¿å˜ã—ã¦ã‚‚ãƒ€ãƒ–ãƒ«ã‚¯ã‚©ãƒ¼ãƒ†ãƒ¼ã‚·ãƒ§ãƒ³ã§ã¯å›²ã£ã¦ã
TaRO 2010/09/09
æ–‡å—ã‚³ãƒ¼ãƒ‰

utf-8

excel

csv
ãƒªãƒ³ã‚¯
nobu417.jp ::: Techlog ::: gVim (MacVim) ã® .gvimrc
ç¾æ™‚ç‚¹ã§ã® .gvimrc ã®è¨å®šå†…å®¹ã€‚ set enc=utf-8 set fenc=utf-8 set fencs=iso-2022-jp,utf-8,euc-jp,cp932 set fileformats=unix,dos,mac colorscheme desert set imdisable set showtabline=2 set guifont=Osaka-Mono:h12 set columns=120 set lines=40 set antialias set transparency=5 syntax on set autoindent set tabstop=4 set number set nobackup ä»¥ä¸Šã€ãƒ¡ãƒ¢æ›¸ãã€‚
TaRO 2010/07/28
vim

utf-8
ãƒªãƒ³ã‚¯
python utf-8
ãªã‚“ã‹ã€ã“ã¨ã‚ã‚‹ã”ã¨ã« python ã§æ—¥æœ¬èªžãŒä¸Šæ‰‹ãä½¿ãˆãªãã¦ æœ€ä½Žé™å¿…è¦ã£ã½ã„è¨å®šã™ã‚‰ã—ã¦ãªã„ã£ã¦ã“ã¨ãŒã‚ã‚Šã¾ã™ ãã®åº¦ã«ã‚°ã‚°ã£ã¦ã‚‹ã‚ã‘ã§ã™ãŒä»Šå›žã‚‚ã‚°ã‚°ã‚Šã¾ã—ãŸ å†…éƒ¨ã‚¨ãƒ³ã‚³ãƒ¼ãƒ‡ã‚£ãƒ³ã‚°ã«ä½¿ã‚ã‚Œã‚‹ã‚¨ãƒ³ã‚³ãƒ¼ãƒ‰ã‚’UTF-8ã«è¨å®šã™ã‚‹æ–¹æ³•ã€‚ ã¨ã‚Šã‚ãˆãšã€ã“ã“ã«ã‚ã‚‹é€šã‚Šã« import sys sys.setdefaultencoding('utf-8') ã£ã¦å†…å®¹ã®ãƒ•ã‚¡ã‚¤ãƒ«ã‚’ /usr/lib/python2.?/site-packages/sitecustomize.py çš„ãªã‚‚ã®ã«ä¿å˜ ã§ã€å€‹åˆ¥ã®ã‚¹ã‚¯ãƒªãƒ—ãƒˆã«æ—¥æœ¬èªžæ›¸ããŸã‹ã£ãŸã‚‰ Python ã§UTF-8, shift_jis, euc_jpãªã©æ—¥æœ¬èªžã‚’ä½¿ã†æ–¹æ³• ã«ã‚ã‚‹ã‚ˆã†ã« #!/usr/bin/env python # -*- coding: utf-8 -*- ã£ã½ã„ã‚‚ã®ã‚’æ›¸ã„ã¦ãŠã‘ã° OK ãªã¯ãšã€‚ ã§ã€œã€ãªã‚‹ã¹ã decode ã—
TaRO 2010/07/27
python

utf-8

æ–‡å—ã‚³ãƒ¼ãƒ‰
ãƒªãƒ³ã‚¯
1