[B! utf8] takaesuã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

takaesu id:takaesu

utf8ã«é–¢ã™ã‚‹takaesuã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (15)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

UTF-8ã‹ã‚‰SJISã«å¤‰æ›ã™ã‚‹æ™‚ã«ã¯Shift-JISç³»ã‚¨ãƒ³ã‚³ãƒ¼ãƒ‰ã®ç¨®é¡žã ã‘ã˜ã‚ƒãªãã¦UNICODEæ£è¦åŒ–ã‚‚æ°—ã«ã—ãªã„ã¨ãƒ€ãƒ¡ã¨ã„ã†è©±
UTF-8ã‹ã‚‰SJISã«å¤‰æ›ã™ã‚‹æ™‚ã«ã¯Shift-JISç³»ã‚¨ãƒ³ã‚³ãƒ¼ãƒ‰ã®ç¨®é¡žã ã‘ã˜ã‚ƒãªãã¦UNICODEæ£è¦åŒ–ã‚‚æ°—ã«ã—ãªã„ã¨ãƒ€ãƒ¡ã¨ã„ã†è©± åˆ©ç”¨ã‚·ãƒ¼ãƒ³ UTF-8ã§è¨˜è¿°ã•ã‚ŒãŸãƒ†ã‚ã‚¹ãƒˆã‚’Shift-JISã‚¨ãƒ³ã‚³ãƒ¼ãƒ‰ã«å¤‰æ›ã™ã‚‹æ©Ÿä¼šã¯ã‚ã‚Šã¾ã™ã€‚ UNICODEã§è¡¨ç¾ã§ãã‚‹æ–‡å—ã®ç¨®é¡žã®æ–¹ãŒShift-JISã«æ¯”ã¹ã¦åœ§å€’çš„ã«åºƒã„ã®ã§ã™ã¹ã¦ã®æ–‡å—ãŒå¤‰æ›ã§ãã‚‹ã‚ã‘ã§ã¯ã‚ã‚Šã¾ã›ã‚“ãŒã€ã€Œã“ã‚Œã¯å¤‰æ›ã§ãã¦ã‚ˆã‹ã‚ã†ã€ã¨ã„ã†ã‚‚ã®ã¾ã§ã“ã¼ã‚Œè½ã¡ã‚‹ã‚±ãƒ¼ã‚¹ã¯å¤šæ•°ã‚ã‚Šã¾ã™ã€‚ ä»¥ä¸‹ã“ã¼ã‚Œè½ã¡ã‚‹ä¾‹ã¨ãã®å¯¾å¿œã‚’ç¤ºã—ã¾ã™ã€‚ ã‚µãƒ³ãƒ—ãƒ«ã‚³ãƒ¼ãƒ‰ ã¾ãšã¯ã‚µãƒ³ãƒ—ãƒ«ã‚³ãƒ¼ãƒ‰ã€‚ rubyã§è¨˜è¿°ã—ã¦ã„ã¾ã™ãŒã€åŽŸç†ã¯ã©ã®è¨€èªžã§ã‚‚åŒã˜ã§ã™ã€‚ str = "ã‚ï½žã‚â‘ é«™å³¶å±‹ãƒã‚šãƒã‚™ã¯ã‚š" sjis = str.encode(Encoding::Shift_JIS, :invalid => :replace, :undef => :replace) File.
takaesu 2023/02/28
ruby

rails

csv

utf8

sjis

æ–‡å—åˆ—

unicode
ãƒªãƒ³ã‚¯
MySQLã®æ–‡å—ã‚³ãƒ¼ãƒ‰ã‚’utf8mb4ã«ã™ã‚‹ - light log
å‰ã«herokuã§åŒã˜ã“ã¨ã‚’ã‚„ã£ãŸã€‚ yamacent.hatena blog.com ä»Šåº¦ã¯my.cnfã¨ã‹ã‚’ã„ã˜ã‚Šã¤ã¤æ‰‹å…ƒã®MySQLã«å¯¾ã—ã¦ã€æ–‡å—ã‚³ãƒ¼ãƒ‰ã‚’utf8mb4ã«è¨å®šã™ã‚‹ã€‚çµµæ–‡å—ã‚’æ ¼ç´ã™ã‚‹ãŸã‚ã«å¿…è¦ã€‚ ç’°å¢ƒ $ mysql --version mysql Ver 14.14 Distrib 5.6.25, for Linux (x86_64) using Edit Line wrapper $ cat /etc/redhat-release CentOS release 6.6 (Final) ç¾åœ¨ã®æ–‡å—ã‚³ãƒ¼ãƒ‰ã®ç¢ºèª mysql> show variables like '%char%'; +--------------------------+----------------------------+ | Variable_name | Value | +-----------
takaesu 2015/09/16
utf8mb4

mysql

utf8

æ–‡å—ã‚³ãƒ¼ãƒ‰
ãƒªãƒ³ã‚¯
RDS MySQL5.5.33 ã§ã€Žutf8mb4ã€(4ãƒã‚¤ãƒˆå¯¾å¿œUTF-8æ–‡å—ã‚³ãƒ¼ãƒ‰ã‚»ãƒƒãƒˆ)ã‚’è©¦ã—ã¦ã¿ãŸ | DevelopersIO
ã¡ã‚‡ã£ã¨ã—ãŸå°ãƒã‚¿ã§ã™ã€‚RDS(MySQL)ã«æ–¼ã„ã¦ã€ã€Žutf8mb4ã€ã«å¯¾å¿œã—ãŸç’°å¢ƒãŒä½œæˆå‡ºæ¥ã‚‹ã‹ï¼å¯¾å¿œã—ã¦ã„ã‚‹ã‹ã¨ã„ã†ä»¶ã§ç¢ºèªã™ã‚‹æ©Ÿä¼šãŒã‚ã‚Šã¾ã—ãŸã®ã§ã€å½“ã‚¨ãƒ³ãƒˆãƒªã«å‚™å¿˜éŒ²çš„ã¨ã—ã¦è¨˜ã—ã¦ãŠãã¾ã™ã€‚ ç›®æ¬¡ ã€Žutf8mb4ã€ã¨ã¯ RDS(MySQL)ç’°å¢ƒã®ç”¨æ„ ã€Žutf8mb4ã€ã«å¯¾å¿œã—ãŸãƒ‘ãƒ©ãƒ¡ãƒ¼ã‚¿ã‚°ãƒ«ãƒ¼ãƒ—ã‚’ä½œæˆãƒ»é©ç”¨ ã€Žutf8mb4ã€é–¢é€£ãƒ‘ãƒ©ãƒ¡ãƒ¼ã‚¿ã‚°ãƒ«ãƒ¼ãƒ—é©ç”¨å¾Œã®å†…å®¹ç¢ºèª ã€Žutf8mb4ã€ã¨ã¯ ã“ã®ã€Žutf8mb4ã€ã¨ã„ã†ã‚‚ã®ã€æ–‡å—ã‚³ãƒ¼ãƒ‰ã®ä¸€ç¨®ã§ã€UTF8ã§4ãƒã‚¤ãƒˆæ–‡å—ã‚’æ‰±ã†äº‹ãŒå‡ºæ¥ã‚‹ã‚‚ã®ã‚‰ã—ã„ã§ã™ã€‚ MySQLã§4ãƒã‚¤ãƒˆã®UTF-8æ–‡å—ã‚’æ‰±ã£ã¦ã¿ã‚‹ - HHeLiBeXã®æ—¥è¨˜ æ£é“ç·¨ ã¾ãŸã€ãã‚Œãžã‚Œã®ãƒãƒ¼ã‚¸ãƒ§ãƒ³ã§æ‰±ã†äº‹ãŒå‡ºæ¥ã‚‹Character Setã®ä¸€è¦§ã‚‚ä»¥ä¸‹ã«ãƒ¡ãƒ¢ã—ã¦ãŠãã¾ã™ã€‚ MySQL :: MySQL 5.1 Reference Manual :: 10.1.13 Ch
takaesu 2015/07/16
rds

æ–‡å—ã‚³ãƒ¼ãƒ‰

UTF8

utf8mb4
ãƒªãƒ³ã‚¯
æ©Ÿç¨®ä¾å˜æ–‡å—ã¨Unicode - WebStudio
å°Žå…¥ æ©Ÿç¨®ä¾å˜æ–‡å—ã¨å‘¼ã°ã‚Œã‚‹æ–‡å—ãŒã‚ã‚Šã¾ã™ã€‚ ä¾‹ãˆã°Windowsã§ã¯ã€ å¤§æ–‡å—ã®ãƒãƒ¼ãƒžæ•°å—(â… â…¡â…¢â…£â…¤â…¥â…¦â…§â…¨â…©)ã€ å°æ–‡å—ã®ãƒãƒ¼ãƒžæ•°å—(â…°â…±â…²â…³â…´â…µâ…¶â…·â…¸â…¹)ã€ ä¸¸å›²ã¿æ•°å—(â‘ â‘¡â‘¢â‘£â‘¤â‘¥â‘¦â‘§â‘¨â‘©â‘ªâ‘«â‘¬â‘â‘®â‘¯â‘°â‘±â‘²â‘³)ã€ ä¸¸å›²ã¿æ–‡å—(ãŠ¤ãŠ¥ãŠ¦ãŠ§ãŠ¨)ã€ ã‚«ã‚¿ã‚«ãƒŠè¡¨è¨˜ã®å˜ä½(ã‰ããŒ”ãŒ˜ãŒ§ãŒ¦ã‘ãŒ«ãŒ¢)ã€ å˜ä½è¨˜å·(ãŽãŽãŽ¡)ã€ è¤‡æ•°ã®ã‚¢ãƒ«ãƒ•ã‚¡ãƒ™ãƒƒãƒˆã‚’åˆæˆã—ãŸæ–‡å—(ãâ„¡â„–)ã€ å…ƒå·(ã»ã¼ã½ã¾)ã€ ä¼šç¤¾åç‰ã§ç”¨ã„ã‚‰ã‚Œã‚‹æ‹¬å¼§å›²ã¿æ–‡å—(ãˆ±ãˆ²ãˆ¹)ç‰ãŒæ©Ÿç¨®ä¾å˜æ–‡å—ã¨å‘¼ã°ã‚Œã¦ã„ã¾ã™ã€‚ æ©Ÿç¨®ä¾å˜æ–‡å—ã¯ä¸€èˆ¬çš„ã«ã€ç•°æ©Ÿç¨®é–“ã§ãƒ‡ãƒ¼ã‚¿ã®äº¤æ›ã‚’è¡Œã£ãŸå ´åˆã€ ä¾‹ãˆã°Windowsã§ä½œæˆã—ãŸãƒ†ã‚ã‚¹ãƒˆãƒ•ã‚¡ã‚¤ãƒ«ã‚’Macintoshã§è¡¨ç¤ºã—ãŸå ´åˆã«æ–‡å—åŒ–ã‘ã—ã¦ã—ã¾ã†ã®ã§ã€ ã“ã‚Œã‚‰ç•°æ©Ÿç¨®ã§ãƒ‡ãƒ¼ã‚¿äº¤æ›ã™ã‚‹ã“ã¨ã‚’å‰æã¨ã—ãŸã‚¤ãƒ³ã‚¿ãƒ¼ãƒãƒƒãƒˆã§ã¯åˆ©ç”¨ã™ã‚‹ã¹ãã§ã¯ãªã„ã¨è¨€ã‚ã‚Œã¦ã„ã¾ã™ã€‚ ã—ã‹ã—ã€ã“ã‚Œã‚‰ã¯æ©Ÿç¨®ä¾å˜æ–‡å—ã¨å‘¼ã°ã‚Œã¦ã„ã‚‹ã‚‚ã®ã®ã€ ãã®æ„å‘³ã¯ã‚
takaesu 2015/03/26
unicode

utf8

utf-8

æ–‡å—ã‚³ãƒ¼ãƒ‰

encoding
ãƒªãƒ³ã‚¯
Ruby | BOMä»˜ãUTF-8ã®CSVãƒ•ã‚¡ã‚¤ãƒ«ã‚’å‡ºåŠ›ã—ã¦Excelã§é–‹ã‘ã‚‹ã‚ˆã†ã«ã™ã‚‹ - Tbpgr Blog
æ¦‚è¦ BOMä»˜ãUTF-8ã®CSVãƒ•ã‚¡ã‚¤ãƒ«ã‚’å‡ºåŠ›ã—ã¦Excelã§é–‹ã‘ã‚‹ã‚ˆã†ã«ã™ã‚‹ è©³ç´° BOMä»˜ãUTF-8ã®CSVãƒ•ã‚¡ã‚¤ãƒ«ã‚’å‡ºåŠ›ã—ã¦Excelã§é–‹ã‘ã‚‹ã‚ˆã†ã«ã—ã¾ã™ ã‚µãƒ³ãƒ—ãƒ« # encoding: utf-8 class File def self.insert_bom(input_filename, output_filename) src = File.read(input_filename) File.open(output_filename, "w:UTF-8") do |f| src = ' ' + src src.setbyte(0, 0xEF) src.setbyte(1, 0xBB) src.setbyte(2, 0xBF) f.print src end end end file = $*[0] exit unless File.exists? file File.in
takaesu 2015/02/11
utf-8

utf8

bom

ã‚¨ã‚¯ã‚»ãƒ«

csv

ruby
ãƒªãƒ³ã‚¯
XMLç”¨èªžäº‹å…¸ [BOM (Byte Order Mark)]
BOM (Byte Order Mark) ãƒã‚¤ãƒˆãƒ»ã‚ªãƒ¼ãƒ€ãƒ¼ãƒ»ãƒžãƒ¼ã‚¯ Unicodeã®UTF-16ãªã©ã®16bitå˜ä½ã®æ–‡å—ã‚¨ãƒ³ã‚³ãƒ¼ãƒ‡ã‚£ãƒ³ã‚°ã‚¹ã‚ãƒ¼ãƒ ã§ã¯ã€8bitå˜ä½ã§ãƒ‡ãƒ¼ã‚¿ã‚’é…åˆ—ã™ã‚‹éš›ã®ã‚¨ãƒ³ãƒ‡ã‚£ã‚¢ãƒ³ã¨ã—ã¦ã€ãƒ“ãƒƒã‚°ã‚¨ãƒ³ãƒ‡ã‚£ã‚¢ãƒ³ã¨ãƒªãƒˆãƒ«ã‚¨ãƒ³ãƒ‡ã‚£ã‚¢ãƒ³ã®ä¸¡æ–¹ã‚’è¨±ã—ã¦ã„ã‚‹ã€‚ãã®ãŸã‚ã€ã©ã¡ã‚‰ã®ã‚¨ãƒ³ãƒ‡ã‚£ã‚¢ãƒ³ã§è¨˜è¿°ã•ã‚ŒãŸãƒ‡ãƒ¼ã‚¿ã‹ã‚’ç¢ºå®Ÿã«åˆ¤å®šã™ã‚‹ãŸã‚ã®ç‰¹åˆ¥ãªãƒžãƒ¼ã‚¯ã¨ãªã‚‹ç¬¦å·ã¨ã—ã¦ã€BOMï¼ˆByte Order Markï¼‰ãŒç”¨æ„ã•ã‚Œã¦ã„ã‚‹ã€‚ ã¾ãŸBOMã¯ã€ã‚ã‚‹ãƒ†ã‚ã‚¹ãƒˆãŒUnicodeã§è¨˜è¿°ã•ã‚Œã¦ã„ã‚‹ã‹ã©ã†ã‹ã‚’è‡ªå‹•åˆ¤å®šã™ã‚‹æ‰‹æ®µã¨ã—ã¦ä½¿ç”¨ã•ã‚Œã‚‹å ´åˆã‚‚ã‚ã‚‹ã€‚ã“ã®ç›®çš„ã«ä½¿ç”¨ã•ã‚Œã‚‹å ´åˆã¯ã€ã‚¨ãƒ³ãƒ‡ã‚£ã‚¢ãƒ³ãŒå˜åœ¨ã™ã‚‹UTF-16ã ã‘ã§ãªãã€ã‚¨ãƒ³ãƒ‡ã‚£ã‚¢ãƒ³ãŒå˜åœ¨ã—ãªã„UTF-8ã®ãƒ†ã‚ã‚¹ãƒˆã«ä»˜åŠ ã•ã‚Œã‚‹å ´åˆã‚‚ã‚ã‚‹ã€‚ BOMã¯ã€å¿…ãšãƒ†ã‚ã‚¹ãƒˆã®å…ˆé ã«ä»˜åŠ ã•ã‚Œã‚‹ã€‚ãƒ†ã‚ã‚¹ãƒˆã®ä¸é–“ã«ç½®ã‹ã‚Œã‚‹ã“ã¨ã¯ãªã„ã€‚BOMã®å€¤ã¯ã€U+ffefã¨å®šã‚ã‚‰ã‚Œã¦
takaesu 2015/02/11
utf-8

utf8

bom
ãƒªãƒ³ã‚¯
ruby1.9ã§BOMä»˜ãutf-8ã®ãƒ•ã‚¡ã‚¤ãƒ«ã®å†…å®¹ã‚’Shift-JISã«å¤‰æ›ã™ã‚‹
utf-8ã®ãƒ•ã‚¡ã‚¤ãƒ«ã®ä¸èº«ã‚’Shift-JISã«å¤‰æ›´ã—ã‚ˆã†ã¨æ€ã£ãŸã‚‰ã‚¨ãƒ©ãƒ¼ãŒå‡ºãŸã®ã§ã™ã€‚ ä»¥ä¸‹ã®ã‚ˆã†ãªæ„Ÿã˜ã‚’å®Ÿè¡Œã—ã‚ˆã†ã¨ã—ãŸã‚‰ã€ aaa = open("aaa.csv").read p aaa.encode("cp932") ä»¥ä¸‹ã®ã‚ˆã†ãªã‚¨ãƒ©ãƒ¼ãŒå‡ºã¦ã—ã¾ã£ãŸã®ã§ã™ã€‚ in `encode': U+FEFF from UTF-8 to Windows-31J (Encoding::UndefinedConversionError) ã©ã†ã‚„ã‚‰å¤‰æ›´ã—ã‚ˆã†ã¨ã—ãŸãƒ•ã‚¡ã‚¤ãƒ«ã¯ã€ã‚‚BOMä»˜ãutf-8ã¨ã„ã†ã‚‚ã®ã ã£ãŸã‚ˆã†ã§ã™ã€‚ ã¡ãªã¿ã«BOMã¨ã¯ã€ãƒã‚¤ãƒˆé †ãƒžãƒ¼ã‚¯ï¼ˆByte Order Markï¼‰ã¨ã„ã†ã‚‚ã®ã®ã‚ˆã†ã§ã€æ–‡æ›¸ãƒ•ã‚¡ã‚¤ãƒ«ã®å…ˆé ã«ä»˜ã‘ã‚‹ EF BB BF ã¨ã„ã†ï¼“ãƒã‚¤ãƒˆã®ãƒã‚¤ãƒŠãƒªãƒ‡ãƒ¼ã‚¿ã®ã“ã¨ã®ã‚ˆã†ã§ã™ã€‚ãƒ•ã‚¡ã‚¤ãƒ«ã®æ–‡å—ã‚³ãƒ¼ãƒ‰ãŒUTF-8ã§ã‚ã‚‹ã“ã¨ã‚’æ˜Žç¤ºã™ã‚‹ãŸã‚ã«ä»˜ã‘ã‚‹ã“ã¨ã‚‚ã‚ã‚‹ã‚ˆã†ã§ã™ã€‚ ã§ã€ã‚¨ãƒ©ãƒ¼
takaesu 2015/02/11
Bomã‚’å‰Šé™¤ã™ã‚‹æ–¹æ³•

unicode

ruby

utf8

utf-8
ãƒªãƒ³ã‚¯
UTF-8ã®BOMã®å‰Šé™¤ã§ãƒãƒžã‚‹
cles::blog å¹³å¸¸å¿ƒæ˜¯é“ blogs: cles::blog NP_cles() Â« bashã§å¤šé‡èµ·å‹•ã‚’é˜²æ¢ã™ã‚‹ï¼ˆãã®ï¼’ï¼‰ :: DoS æ”»æ’ƒã®åˆ¤æ–åŸºæº–ã‚’ IPA ãŒç–å®šã¸ Â» 2010/11/29 UTF-8ã®BOMã®å‰Šé™¤ã§ãƒãƒžã‚‹Â javaÂ rubyÂ charsetÂ regex 605 2ã¸ã‡ Xalanã§XMLã‚’XSLå¤‰æ›ã™ã‚‹ãƒ—ãƒã‚°ãƒ©ãƒ ã‚’æ›¸ã„ãŸã‚‰ã€ãã®ã†ã¡ã®ï¼‘ã¤ã®XMLãŒä¸‹è¨˜ã®ã‚¨ãƒ©ãƒ¼ã‚’åã„ã¦å¤‰æ›ã§ããªãã¦ãƒãƒžã£ã¦ã—ã¾ã„ã¾ã—ãŸã€‚ Caused by: javax.xml.transf orm.Transf ormerException: com.sun.org.apache.xml.internal.utils.WrappedRuntimeException: An invalid XML character (Unicode: 0xfffe) was found in t
takaesu 2015/02/11
utf8

bom

UTF-8

unicode
ãƒªãƒ³ã‚¯
UTF-8ã«ã‚‚ã„ã‚ã„ã‚ã‚ã‚‹ - ã‚¶ãƒªã‚¬ãƒ‹ãŒè¦‹ã¦ã„ãŸ...ã€‚
å‰å›žã‹ã‚‰ã®ç¶šãã€‚ æ”¹è¡Œã‚³ãƒ¼ãƒ‰ã®é•ã„ã‚’ä½“æ„Ÿã—ã¦ã¿ã‚‹ - ã‚¶ãƒªã‚¬ãƒ‹ãŒè¦‹ã¦ã„ãŸ...ã€‚ æ–‡å—ã‚¨ãƒ³ã‚³ãƒ¼ãƒ‰ã¨ãƒã‚±ãƒ¼ãƒ«ã‚’ä½“æ„Ÿã™ã‚‹ - ã‚¶ãƒªã‚¬ãƒ‹ãŒè¦‹ã¦ã„ãŸ...ã€‚ æ”¹è¡Œã‚³ãƒ¼ãƒ‰ã®é•ã„ã‚‚çŸ¥ã£ãŸã€‚æ–‡å—ã‚³ãƒ¼ãƒ‰ã¨ãƒã‚±ãƒ¼ãƒ«ã€ã‚¿ãƒ¼ãƒŸãƒŠãƒ«ã®è¨€èªžç’°å¢ƒã¨ã®é–¢ä¿‚ã‚‚çŸ¥ã£ãŸã€‚ã“ã‚Œã§æ–‡å—ã«ã¾ã¤ã‚ã‚‹æ‚©ã¿ã¨ã¯ãŠã•ã‚‰ã°ã§ãã‚‹ã¨æ€ã£ãŸã‚‰ã€ã¾ã ãƒ€ãƒ¡ã ã£ãŸ...ã€‚ å®Ÿé¨“ç’°å¢ƒ OSX 10.8 Mountain Lionä»¥å‰((OSX 10.9 Mavericksã§ã¯ã€Macä»•æ§˜ãªNFDã®UTF-8ã‚’è¡¨ç¤ºã—ã‚ˆã†ã¨ã™ã‚‹ã¨ã‚¨ãƒ©ãƒ¼ã«ãªã£ã¦ã—ã¾ã£ãŸãŸã‚ã€10.8ä»¥å‰ã®ç’°å¢ƒã§å®Ÿé¨“ã—ãŸã€‚Assertion failed: (width > 0), function conv_c, file /SourceCache/shell_cmds/shell_cmds-175/hexdump/conv.c, line 137. ** ** Abort trap: 6
takaesu 2014/12/18
mac

æ–‡å—ã‚³ãƒ¼ãƒ‰

unicode

utf8
ãƒªãƒ³ã‚¯
ã‚³ãƒžãƒ³ãƒ‰ãƒ©ã‚¤ãƒ³ã§MIMEãƒ˜ãƒƒãƒ€ãƒ¼ã‚’ã‚¨ãƒ³ã‚³ãƒ¼ãƒ‰ï¼†ãƒ‡ã‚³ãƒ¼ãƒ‰ã™ã‚‹æ–¹æ³• - Qiita
èƒŒæ™¯ MIME(ãƒžã‚¤ãƒ )ã¨ã¯ã‚¤ãƒ³ã‚¿ãƒ¼ãƒãƒƒãƒˆã®é›»åãƒ¡ãƒ¼ãƒ«ã§æ§˜ã€…ãªãƒ•ã‚©ãƒ¼ãƒžãƒƒãƒˆã‚’æ‰±ãˆã‚‹ã‚ˆã†ã«ã™ã‚‹è¦æ ¼ã®ã“ã¨ã§ã™ã€‚MIMEã«ã‚ˆã£ã¦é›»åãƒ¡ãƒ¼ãƒ«ã«PDFã€ç”»åƒã€å‹•ç”»ãªã©æ§˜ã€…ãªãƒ‰ã‚ãƒ¥ãƒ¡ãƒ³ãƒˆã‚’æ·»ä»˜ã™ã‚‹ã“ã¨ãŒã§ãã¾ã™ã€‚ ã—ã‹ã—ã€æœ¬æ¥é›»åãƒ¡ãƒ¼ãƒ«ã¯US-ASCIIã—ã‹ä½¿ç”¨ã§ããªã„ãŸã‚ã€ãƒ¡ãƒ¼ãƒ«ã®ãƒ˜ãƒƒãƒ€ãƒ¼éƒ¨åˆ†ã«ãã®ã¾ã¾ãƒžãƒ«ãƒãƒã‚¤ãƒˆæ–‡å—ã‚’å…¥ã‚Œã‚‹ã“ã¨ã¯ã§ãã¾ã›ã‚“ã€‚ãã®ãŸã‚ã€ç¾åœ¨ã®é›»åãƒ¡ãƒ¼ãƒ«ã§ã¯ä»¥ä¸‹ã®ã‚ˆã†ãªå½¢å¼ã§æ–‡å—åˆ—ã‚’ã‚¨ãƒ³ã‚³ãƒ¼ãƒ‰ã—ã¦ã€ãƒ˜ãƒƒãƒ€ãƒ¼ã«æ ¼ç´ã—ã¦ã„ã¾ã™ã€‚ =?charset?encoding?encoded-text=?= ãã“ã§ã€ã“ã®ã‚ˆã†ãªãƒ•ã‚©ãƒ¼ãƒžãƒƒãƒˆã®æ–‡å—åˆ—ã‚’ã‚³ãƒžãƒ³ãƒ‰ãƒ©ã‚¤ãƒ³ã§ã‚¨ãƒ³ã‚³ãƒ¼ãƒ‰ã€ãƒ‡ã‚³ãƒ¼ãƒ‰ã™ã‚‹æ–¹æ³•ã«ã¤ã„ã¦æ›¸ã„ã¦ã„ãã¾ã™ã€‚ ã“ã†ã„ã†ã¨ãã«ã€nkf ã‚³ãƒžãƒ³ãƒ‰ãŒå¤§æ´»èºã—ã¾ã™ã€‚ ãªãŠã€MIME ã®èª¬æ˜Žã«ã¤ã„ã¦ã¯ç«¯æŠ˜ã‚‹ã®ã§ã‚ã—ã‹ã‚‰ãšã€‚ ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ« mac ã®å ´åˆ ã‚¨ãƒ³ã‚³ãƒ¼ãƒ‡ã‚£ãƒ³ã‚°ã®å¤‰æ› MIMEã®å‰ã«æ–‡å—ã‚¨ãƒ³
takaesu 2014/11/06
å¤‰æ› MIMEãƒ˜ãƒƒãƒ€ãƒ¡ãƒ¼ãƒ«æœ¬æ–‡ç‰

rails

utf8

base64

nkf
ãƒªãƒ³ã‚¯
MySQLã§character_set_databaseãŒlatin1ã«ãªã£ã¦ã—ã¾ã†å•é¡Œã®å¯¾å¿œæ–¹æ³• - ã‚ˆã‹ã‚ã†ã‚‚ã‚“ï¼
ã‚¢ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ã®ãƒãƒ¼ã‚¸ãƒ§ãƒ³ã‚¢ãƒƒãƒ—ãªã©ã§ãƒ†ãƒ¼ãƒ–ãƒ«è¿½åŠ ã‚’ä¼´ã†ã‚¹ã‚ãƒ¼ãƒžå¤‰æ›´ãŒã‚ã£ãŸå ´åˆã«ã€ãƒ†ãƒ¼ãƒ–ãƒ«è¿½åŠ ã—ãŸã¨ã“ã‚ã®ãƒ‡ãƒ¼ã‚¿ã ã‘ç”»é¢ã§ã€Œï¼Ÿï¼Ÿï¼Ÿï¼Ÿã€ã«ãªã£ã¦è¡¨ç¤ºã•ã‚Œã¦ã—ã¾ã†ã“ã¨ãŒç¨€ã«ã‚ã‚Šã¾ã™ã€‚ ã“ã®å¯¾å¿œæ–¹æ³•ã«ã¤ã„ã¦ã€ç™ºç”Ÿç†ç”±ã¨å…±ã«ç°¡å˜ã«è§£èª¬ã—ã¦ãŠã“ã†ã¨æ€ã„ã¾ã™ã€‚ çµæžœã ã‘ã‚’å…ˆã«æ›¸ã„ã¦ãŠãã¨ã€ä»Šå›žã®æ ¹æœ¬åŽŸå› ã¯AmazonRDSã‚’èµ·å‹•ã™ã‚‹ã¨ãã®ãƒ‘ãƒ©ãƒ¡ãƒ¼ã‚¿ã‚°ãƒ«ãƒ¼ãƒ—ã®åˆæœŸè¨å®šãŒä¸ååˆ†ã§ã€åˆå›žcreate databaseæ™‚ã« default character set ã«æƒ³å®šå¤–ã®ã‚‚ã®ãŒã‚»ãƒƒãƒˆã•ã‚Œã¦ã„ãŸãŸã‚ã§ã™ã€‚ ä¸‹è¨˜ã§ã¯ãã®åŽŸå› ã‚’ç‰¹å®šã™ã‚‹æ–¹æ³•ã¨è§£æ±ºæ–¹æ³•ã‚’ç¤ºã—ã¦ã„ãã¾ã™ã€‚ ã¾ãšã¯æ–‡å—åŒ–ã‘ã—ãŸæ™‚ã«çŠ¶æ³ç¢ºèªã‚’è¡Œã£ã¦ã¿ã¦ãã ã•ã„ã€‚ãŠãã‚‰ãã¯ä¸‹è¨˜ã®ã‚ˆã†ãªçŠ¶æ³ã«ãªã£ã¦ã„ã‚‹ã‹ã¨æ€ã„ã¾ã™ã€‚â€»ä»Šå›žã¯æ–‡å—ã‚³ãƒ¼ãƒ‰ã‚’å…¨ã¦utf8ã«çµ±ä¸€ã—ã¦ã„ã‚‹ã‚‚ã®ã¨ã—ã¾ã™ã€‚ ã¾ãšã¯æ–‡å—åŒ–ã‘ã—ã¦ã„ã‚‹ãƒ†ãƒ¼ãƒ–ãƒ«ã®æƒ…å ±ã‚’ç¢ºèªã—ã¦ã¿ã¾ã™ã€‚ mysql> sh
takaesu 2014/04/11
mysql

rds

æ–‡å—ã‚³ãƒ¼ãƒ‰

database

AWS

MySQL

latin1

utf8
ãƒªãƒ³ã‚¯
ActiveRecordã‚’utf8mb4ã§å‹•ã‹ã™ - Qiita
ã‚‚ã†MySQL 5.5 GAãŒå‡ºã¦ã‹ã‚‰ä¸€å¹´ãŒçµŒã¡ã€MySQL 5.6 GAã‚‚ãã‚ãã‚å‡ºã‚‹ã“ã‚ã ã—ã€æ–°è¦ã§ä½œã‚‹ã‚¢ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ã¯utf8mb4ã§ã„ããŸã„ã®ã§ãã®æ–¹æ³•ã€‚ ã¾ãšã€mysql2ãŒ0.3.11ä»¥å‰ã®ãƒãƒ¼ã‚¸ãƒ§ãƒ³ã§ã¯utf8mb4ã«å¯¾å¿œã—ã¦ãªã„ã®ã§ã€ãã‚Œã‚ˆã‚Šæ–°ã—ã„ãƒãƒ¼ã‚¸ãƒ§ãƒ³ã‚’ä½¿ã†å¿…è¦ãŒã‚ã‚Šã¾ã™ã€‚ ã“ã‚Œã§encoding: utf8mb4ã§æŽ¥ç¶šã§ãã‚‹ã‚ˆã†ã«ãªã‚Šã¾ã™ã€‚ ã¤ãŽã«ActiveRecord::Migrationã§utf8mb4ãªãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã‚’ä½œæˆã™ã‚‹ã‚ˆã†ã«ã‚³ãƒ³ãƒ•ã‚£ã‚°ã§charsetã¨collationã‚’æŒ‡å®šã—ã¾ã™ã€‚
takaesu 2014/04/11
[

rails

ActiveRecord

utf8mb4

utf8

æ–‡å—ã‚³ãƒ¼ãƒ‰
ãƒªãƒ³ã‚¯
perl - use utf8; #ã£ã¦ä½•ã ? : 404 Blog Not Found
2009å¹´06æœˆ15æ—¥07:00 ã‚«ãƒ†ã‚´ãƒªLightweight Languages perl - use utf8; #ã£ã¦ä½•ã ? id:otsuneã«å»ºè¨äºˆå®šãƒ•ãƒ©ã‚°ãŒãŸã¦ã‚‰ã‚Œã¦ã„ãŸã®ã§ã€‚ å†¬é€šã‚Šã«æ¶ˆãˆè¡Œãåˆ¶æœã‚¬ãƒ¼ãƒ«ã¯ã€å¤¢ç‰©èªžã«ãƒªã‚¢ãƒ«ã‚’æ±‚ã‚ãªã„ã€‚ - subtech Perl ã® utf8 é–¢ä¿‚ãŒæœªã å…¨ãç†è§£ã§ããªã„ã€‚ã‚ã‹ã‚‰ãªã„ã“ã¨ãŒã‚ã‹ã‚‰ãªã„ã®ã§æ•´ç† use utf8ã¯ã„ã¤ãƒ•ãƒ©ã‚°ã‚’ãŸã¦ã‚‹ã‹ use utf8 ã—ã¦ã¦ã‚‚ãƒ•ãƒ©ã‚°ãŸãŸãªã„ã“ã¨ãŒã‚ã‚‹â€¦â€¦ ã“ã‚Œã¯ã€ä»¥ä¸‹ã®å®Ÿä¾‹ã‚’è¦‹ã¦ã„ãŸã ãã®ãŒä¸€ç•ªã‚ˆã„ã ã‚ã†ã€‚ #!/usr/bin/perl use strict; use warnings; use utf8 (); sub check_flag{ my $str = shift; print qq("$str" ), utf8::is_utf8($str) ? 'is' : 'IS NOT',
takaesu 2012/12/04
utf8

perl

æ–‡å—ã‚³ãƒ¼ãƒ‰

encode

decode
ãƒªãƒ³ã‚¯
UTF-8 å¯¾å¿œã® msysGit 1.7.10 ãƒªãƒªãƒ¼ã‚¹ï¼ ã„ã‚ˆã„ã‚ˆ Windows ã§ git ã§ãã‚‹ã‚ˆ!!! - ã¦ã£ãç…®ãƒ–ãƒã‚°
gitå…ˆæ—¥ã€msysGitï¼ˆGit for Windowsï¼‰ãŒã„ã‚ˆã„ã‚ˆå…¬å¼ã« UTF-8 ã‚’ã‚µãƒãƒ¼ãƒˆï¼ ã¨ã„ã†è¨˜äº‹ã§ã€ŒUTF-8 å¯¾å¿œã®ã‚³ãƒ¼ãƒ‰ãŒã‚³ãƒŸãƒƒãƒˆã•ã‚ŒãŸã€ã“ã¨ã‚’ãŠä¼ãˆã—ã¾ã—ãŸãŒã€ã¤ã„ã«ã€UTF-8 å¯¾å¿œã®æ–°ãƒãƒ¼ã‚¸ãƒ§ãƒ³ã€msysGit 1.7.10 ãŒãƒªãƒªãƒ¼ã‚¹ã•ã‚Œã¾ã—ãŸã€‚ã„ã‚ˆã„ã‚ˆ Windows ã§ã‚‚æ—¥æœ¬èªžãƒ•ã‚¡ã‚¤ãƒ«åã‚’æ‰±ãˆã‚‹ã‚ˆã†ã«ãªã£ãŸã®ã§ã€ã€Œgit ã§ã¯ "è©³ç´°è¨è¨ˆæ‰€ä»•æ§˜æ›¸.xlsx" ã‚’ã‚³ãƒŸãƒƒãƒˆã§ããªã„ã‚“ã§ã—ã‚‡ï¼Ÿã€ã¨ãƒ–ãƒ¼ãƒ–ãƒ¼ã„ã£ã¦ãŸäººã‚’èª¬å¾—ã§ãã‚‹ææ–™ã¯ãã‚ã„ã¾ã—ãŸ!!!!ãã‚Œã‚’è¨˜å¿µã—ã¦ã€ã“ã®è¨˜äº‹ã§ã¯ UTF-8 å¯¾å¿œã® msysGit 1.7.10 ã‚’è©¦ã—ã¦ã¿ãŸ ãƒ–ãƒ¼ãƒ–ãƒ¼ã„ã†äººã‚’é»™ã‚‰ã›ã‚‹ãŸã‚ã®ã€ŒGUI ã§ git ã™ã‚‹ Windows å‘ã‘ãƒ„ãƒ¼ãƒ«ã€ã¾ã¨ã‚ã®2æœ¬ç«‹ã¦ã§ãŠé€ã‚Šã—ãŸã„ã¨æ€ã„ã¾ã™ã€‚UTF-8 å¯¾å¿œã® msysGit 1.7.10 ã‚’è©¦ã—ã¦ã¿ãŸã•ã£ãã Google Code
takaesu 2012/04/24
windows

git

msysGit

msysGit1.7

utf8

æ—¥æœ¬èªžå

ãƒãƒ¼ã‚¸ãƒ§ãƒ³ç®¡ç†

æ—¥æœ¬èªž
ãƒªãƒ³ã‚¯
PHPã¨MySQLã®å€‹äººçš„ã¾ã¨ã‚ - ã±ã‚“ã´ãƒ¼ã¾ã£ã—ãã‚‰
MySQLã§ã¯ã¾ã£ãŸã“ã¨ MySQLã®æ–‡å—åŒ–ã‘ ä»Šã•ã‚‰ä½•ã„ã£ã¦ã‚“ã®ã‚³ã‚¤ãƒ„ã¨ã‹ãã“è¨€ã‚ãªã„ã€‚ æ–‡å—ã‚³ãƒ¼ãƒ‰ã‚’ç¢ºèªã™ã‚‹SQLæ–‡ã€ŒSHOW VARIABLES LIKE â€˜char%â€™;ã€ MySQL4.1ä»¥é™ã¯ã‚µãƒ¼ãƒã¨ã¯åˆ¥ã«ã‚¯ãƒ©ã‚¤ã‚¢ãƒ³ãƒˆã®æ–‡å—ã‚³ãƒ¼ãƒ‰ãŒè¨å®šã•ã‚Œã¦ã„ã‚‹ã€‚ ã‚¯ãƒ©ã‚¤ã‚¢ãƒ³ãƒˆã€ã‚µãƒ¼ãƒé–“ã§é•ã†æ–‡å—ã‚³ãƒ¼ãƒ‰ãŒã‚»ãƒƒãƒˆã•ã‚Œã¦ã„ã‚‹ã¨ã€ä¸€åº¦ucs2å¤‰æ›ã‚’é€šã‚‹ã€‚ ã‚ˆã£ã¦ã€ã‚¯ãƒ©ã‚¤ã‚¢ãƒ³ãƒˆã€ã‚µãƒ¼ãƒé–“ã§é•ã†æ–‡å—ã‚³ãƒ¼ãƒ‰ã‚’æŒ‡å®šã™ã‚‹ã“ã¨ã¨ãªã‚Šæ–‡å—åŒ–ã‘ãŒèµ·ã“ã‚‹å¯èƒ½æ€§ãŒã‚ã‚‹ã€‚ PHPã¯my.cnfã§[mysql]ã€[client]ã‚’è¨å®šã—ã‚ˆã†ãŒã‚¯ãƒ©ã‚¤ã‚¢ãƒ³ãƒˆã®æ–‡å—ã‚³ãƒ¼ãƒ‰ã¯ãƒ“ãƒ«ãƒ‰æ™‚ã«æŒ‡å®šã•ã‚ŒãŸã‚ãƒ£ãƒ©ã‚¯ã‚¿ã‚»ãƒƒãƒˆ(é€šå¸¸latin1)ã€‚ my.cnfã®è¨å®š [mysql] default-character-set = utf8 [mysqld] default-character-set = utf8 mysqlã‚¯ãƒ©ã‚¤ã‚¢ãƒ³ãƒˆã‹ã‚‰ãƒã‚§
takaesu 2012/04/20
mysql

æ–‡å—ã‚³ãƒ¼ãƒ‰

php

æ–‡å—åŒ–ã‘

utf8

latin1
ãƒªãƒ³ã‚¯
1