[B! normalization] kei2100ã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

kei2100 id:kei2100

normalizationã«é–¢ã™ã‚‹kei2100ã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (6)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

æ–‡å—ã‚³ãƒ¼ãƒ‰å«Œã„ã - Qiita
WEBã‚·ã‚¹ãƒ†ãƒ ã®æ§‹ç¯‰ã‚’ã—ã¦ã„ã¦ã€æ–‡å—ã‚³ãƒ¼ãƒ‰é–¢é€£ã§ã¤ã¾ãšãã“ã¨ãŒã‚ˆãã‚ã‚‹ã€‚ ãã®ãŸã³ã«ã€ä½•ã‚„ã£ãŸã‘ï¼Ÿã£ã¦æ‚©ã‚€ã“ã¨ãŒå«Œãªã®ã§ã¾ã¨ã‚ã¦ã„ãã¾ã™ã€‚æ–‡å—ã‚³ãƒ¼ãƒ‰é–¢é€£ã¯ã€ã»ã‚“ã¨ã«ã‚ã‚“ã©ãã•ãã¦ã„ã‚„ã ã€‚ã‚¯ãƒ©ã‚¤ã‚¢ãƒ³ãƒˆã‚‚ã€ã‚µãƒ¼ãƒã‚‚DBã‚‚å…¨éƒ¨UTF-8ã«ã—ã¦ã‚„ã‚Œã°è‰¯ã„ã®ã«ã€‚ã€‚ã€‚ å…¨è§’ãƒãƒ«ãƒ€å•é¡Œ ç°¡å˜ã«ã„ã†ã¨ã€SJISã¨UTF-8ã§æ–‡å—ã‚³ãƒ¼ãƒ‰ã‚‚ãƒžãƒƒãƒ”ãƒ³ã‚°ãŒãšã‚Œã¦ã„ã‚‹å•é¡Œã€‚ ãªã‚“ã§ã“ã‚“ãªã“ã¨ã«ãªã£ã¦ã„ã‚‹ã®ã‹ã€‚ã€‚ã€‚ ã©ã®ã‚ˆã†ãªäº‹è±¡ã‹ è¦‹ãŸç›®ãŒã»ã¼åŒã˜ãªã€Œã€œã€ï¼ˆæ³¢ãƒ€ãƒƒã‚·ãƒ¥ï¼‰ã€ã€Œï½žã€ï¼ˆå…¨è§’ãƒãƒ«ãƒ€ï¼‰ã¨ã„ã†äºŒã¤ã®æ–‡å—ãŒãã‚Œãžã‚ŒUTF-8ã§ã€Œ0x301Cã€ã€Œ0xFF5Eã€ã®æ–‡å—ã‚³ãƒ¼ãƒ‰ãŒå‰²ã‚Šå½“ã¦ã‚‰ã‚Œã¦ã„ã¾ã™ã€‚ã—ã‹ã—ã€Sjisã§ã¯ã€ã€Œã€œã€ï¼ˆæ³¢ãƒ€ãƒƒã‚·ãƒ¥ï¼‰ãŒã€Œ0x8160ã€ã€ã€Œï½žã€ï¼ˆå…¨è§’ãƒãƒ«ãƒ€ï¼‰ã¯å¯¾å¿œãªã—ã¨ãªã£ã¦ã„ã¾ã™ã€‚ãã®ãŸã‚ã€SJISã«å¤‰æ›ã™ã‚‹ã¨ãã«å¯¾å¿œã™ã‚‹æ–‡å—ãŒãªã„ã¨ã„ã†ã“ã¨ãŒã‚ã‚Šå¾—ã¦ã—ã¾ã„ã¾ã™ã€‚ â– SJISã¨Unicodeã®å¤‰
kei2100 2021/05/10
unicode

normalization
ãƒªãƒ³ã‚¯
UTF-8 ã®æ–‡å—åˆ—ã‚’ã§ãã‚‹é™ã‚Š Shift_JIS ã«å¤‰æ›ã—ãŸã„ - ãã‚Šãã‚Šã‚„ã¾
Shift_JIS ã® CSV ã§é€£æºã™ã‚‹å¤–éƒ¨ã‚µãƒ¼ãƒ“ã‚¹ãŒã‚ã‚Šã€DB ã§ã¯ UTF-8 ã§ãƒ†ã‚ã‚¹ãƒˆã‚’æŒã£ã¦ã„ãŸãŸã‚æ–‡å—ã‚³ãƒ¼ãƒ‰ã‚’å¤‰æ›ã™ã‚‹å¿…è¦ãŒç”Ÿã˜ãŸã€‚ ã¨ã“ã‚ãŒ UTF-8 ã«å˜åœ¨ã™ã‚‹å¤šãã®æ–‡å—ã¯ Shift_JIS ã«å¯¾å¿œãŒãªã„ãŸã‚å¤‰æ›ã™ã‚‹ã“ã¨ãŒã§ããªã„1ã€‚ ãã“ã§ã€äº‹å‰ã« NFKC å½¢å¼ã§ Unicode æ£è¦åŒ–ã™ã‚‹ã“ã¨ã§å¤‰æ›å¯èƒ½ãªæ–‡å—ã‚’å¢—ã‚„ã™ã“ã¨ã‚’è©¦ã¿ãŸã€‚ ã¾ãšã¯ Unicode æ£è¦åŒ–ã®å‰æã¨ã—ã¦ã€Unicode ã®æ£æº–ç‰ä¾¡ã¨äº’æ›ç‰ä¾¡ã«ã¤ã„ã¦èª¬æ˜Žã™ã‚‹ã€‚ ä»¥é™ã® U+16é€²æ•° ã¨ã„ã†è¡¨è¨˜ã¯ Unicode ã®ã‚³ãƒ¼ãƒ‰ãƒã‚¤ãƒ³ãƒˆ (æ–‡å—ã« ID ã®ã‚ˆã†ãªã‚‚ã®ãŒå‰²ã‚Šå½“ã¦ã‚‰ã‚Œã¦ã„ã‚‹) ã‚’ç¤ºã™ã€‚ ã¾ãŸã€ã‚³ãƒ¼ãƒ‰ãƒã‚¤ãƒ³ãƒˆã«å¯¾å¿œã™ã‚‹æ–‡å—ã®è©³ç´°ã¯ https://codepoints.net/ ã¨ã„ã£ãŸã‚µã‚¤ãƒˆã§ç¢ºèªã™ã‚‹ã“ã¨ãŒã§ãã‚‹ã€‚ æ£æº–ç‰ä¾¡ ä¾‹ã¨ã—ã¦ã€ã²ã‚‰ãŒãªã®ã€ŒãŒã€ã«ã¤ã„ã¦è€ƒãˆã‚‹ã€‚Unicode ã§ã¯ã€Œ
kei2100 2020/08/06
æ–‡å—ã‚³ãƒ¼ãƒ‰

normalization
ãƒªãƒ³ã‚¯
Find all Unicode Characters from Hieroglyphs to Dingbats â€“ Unicode Compart
Unicode-Compart is a site dedicated to Unicode and all things related to Unicode, characters, glyphs and internationalization
kei2100 2019/05/16
unicode

normalization
ãƒªãƒ³ã‚¯
Go è¨€èªžã¨ Unicode æ£è¦åŒ–
ä»Šå›žã¯å°‘ã—ç›®å…ˆã‚’å¤‰ãˆã¦ã€ŒUnicode æ£è¦åŒ–ï¼ˆnormalizationï¼‰ã€ã®ãŠè©±ã€‚ 2ç¾½ã®ã€Œãƒšãƒ³ã‚®ãƒ³ã€ ã¾ãšã€Œãƒšãƒ³ã‚®ãƒ³ã€ã¨ã„ã†æ–‡å—åˆ—ã‚’æ€ã„æµ®ã‹ã¹ã¦ã¿ã‚‹ã€‚ ã“ã®æ–‡å—åˆ—ã‚’ Unicode ã®ã‚³ãƒ¼ãƒ‰ãƒã‚¤ãƒ³ãƒˆã§è¡¨ã™ã¨ä»¥ä¸‹ã®ã‚ˆã†ã«ãªã‚‹ã€‚ ãƒšï¼šU+30DA ãƒ³ï¼šU+30F3 ã‚®ï¼šU+30AE ãƒ³ï¼šU+30F3 ã¨ã“ã‚ã§ãƒšãƒ³ã‚®ãƒ³ã®ã€Œãƒšã€ã¨ã€Œã‚®ã€ã¯åŠæ¿ç‚¹ãŠã‚ˆã³æ¿ç‚¹ã‚’å«ã‚€ã€‚ Unicode ã¯ã€Œãƒšã€ã¨ã€Œã‚®ã€ã‚’ãã‚Œãžã‚Œ2ã¤ã®è¦ç´ ã«åˆ†è§£ã§ãã‚‹ã€‚ ãƒšï¼šU+30D8 + U+309A ãƒ³ï¼šU+30F3 ã‚®ï¼šU+30AD + U+3099 ãƒ³ï¼šU+30F3 U+309A ãŠã‚ˆã³ U+3099 ã¯ãã‚Œãžã‚ŒåŠæ¿ç‚¹ã¨æ¿ç‚¹ã‚’è¡¨ã™ã€Œçµåˆæ–‡å—ï¼ˆcombining characterï¼‰ã€ã§ã‚ã‚‹ã€‚ ã€Œãƒ˜ã€ã‚„ã€Œã‚ã€ã®ã‚ˆã†ãªã€ŒåŸºåº•æ–‡å—ï¼ˆbase characterï¼‰ã€ã«çµåˆæ–‡å—ã‚’1ã¤ä»¥ä¸Š1 ä»˜åŠ ã—ãŸæ–‡å—ã‚’ã€Œåˆæˆåˆ—ï¼ˆcomposite
kei2100 2019/05/13
golang

normalization
ãƒªãƒ³ã‚¯
Unicodeæ£è¦åŒ–
æ£ã—ã„ä¸¦ã³æ›¿ãˆã§ã¯ã€è¡¨ç¤ºã¯(A)ã®ã¾ã¾ã§ã™ãŒã€é–“é•ã£ãŸä¸¦ã³æ›¿ãˆã§ã¯ã€æ£è¦çµåˆã‚¯ãƒ©ã‚¹ãŒäº’ã„ã«ç‰ã—ã„MACRONã¨ACUTEã‚’ä¸¦ã³æ›¿ãˆãŸãŸã‚ã€è¡¨ç¤ºã¯(B)ã®ã‚ˆã†ã«ã€eã®ä¸Šã®ã‚¢ã‚¯ã‚»ãƒ³ãƒˆè¨˜å·ã®ä½ç½®ãŒå…¥ã‚Œæ›¿ã‚ã£ã¦ã—ã¾ã„ã¾ã™ã€‚ æ£è¦åˆ†è§£ãƒ»äº’æ›åˆ†è§£ ã‚ã‚‹æ–‡å—åˆ—ã®æ£è¦åˆ†è§£ (Canonical Decomposition) ã‚’å¾—ã‚‹ã«ã¯ã€ã¾ãšã€ãã‚Œãžã‚Œã®æ–‡å—ã‚’æ£è¦ãƒžãƒƒãƒ”ãƒ³ã‚°ã«ã‚ˆã£ã¦å†å¸°çš„ã«ã€å¯èƒ½ãªé™ã‚Šã€åˆ†è§£ã—ã¾ã™ã€‚ã™ãªã‚ã¡ã€1å›žåˆ†è§£ã—ãŸå¾Œã«ç¾ã‚ŒãŸæ–‡å—ãŒãªãŠã‚‚åˆ†è§£å¯èƒ½ã§ã‚ã‚Œã°ã•ã‚‰ã«åˆ†è§£ã—ã¾ã™ã€‚åˆ†è§£ãƒžãƒƒãƒ”ãƒ³ã‚°ãŒãã®æ–‡å—è‡ªèº«ã§ã‚ã‚‹å ´åˆã¯ã€åˆ†è§£ä¸å¯èƒ½ãªã®ã§ã€ãã®ã¾ã¾ã§ã™ã€‚ ã—ã‹ã—ã€åˆ†è§£ã—ãŸã ã‘ã§ã¯å¿…ãšã—ã‚‚æ£ã—ã„çµæžœãŒå¾—ã‚‰ã‚Œã¾ã›ã‚“ã€‚ã¤ã¾ã‚Šã€çµåˆæ–‡å—ã®é †åºã®ä¸€æ„æ€§ã‚’ä¿è¨¼ã™ã‚‹ãŸã‚ã€åˆ†è§£å¾Œã®æ–‡å—åˆ—ã«å¯¾ã—ã¦æ£è¦é †åºã‚¢ãƒ«ã‚´ãƒªã‚ºãƒ ã‚’é©ç”¨ã—ãªã‘ã‚Œã°ãªã‚Šã¾ã›ã‚“ã€‚ã“ã®ã‚ˆã†ã«ã€æ£è¦ãƒžãƒƒãƒ”ãƒ³ã‚°ã«ã‚ˆã‚‹å†å¸°çš„åˆ†è§£ã¨ã€æ£è¦é †åºã‚¢ãƒ«ã‚´ãƒªã‚ºãƒ ã«ã‚ˆã‚‹
kei2100 2017/10/26
nfkc

programming

normalization
ãƒªãƒ³ã‚¯
ãƒã‚¤ãƒ•ãƒ³ã«ä¼¼ã¦ã‚‹æ–‡å—ã®æ–‡å—ã‚³ãƒ¼ãƒ‰ - Qiita
Deleted articles cannot be recovered. Draft of this article would be also deleted. Are you sure you want to delete this article?
kei2100 2016/10/14
ãƒã‚¤ãƒ•ãƒ³ ãƒ€ãƒƒã‚·ãƒ¥ hyphen dash

programing
ãƒªãƒ³ã‚¯
1