"use utf8" accidentally sets utf8 flag on all barewords including ascii characters · Issue #9854 · Perl/perl5
From @miyagawa The following test fails both on 5.10.1 and blead (per chip on #p5p). The bareword on the left side of fat comma (=>) always gets utf8 flag set, even if the characters only consist of ascii chars. See http​://www.perlmonks.org/?node_id=668987 for more details. use strict; use utf8; use Test​::More tests => 2; my %foo = (a => 'b', 'c' => 'd'); for my $key (keys %foo) { ok !utf8​::is_
JSON, jQuery and some Unicode characters (U+2028)
bulknews.typepad.com Tatsuhiko Miyagawa's blog to discuss mostly tech and nerdy stuff. You have a web application that generates JSON dynamically from the data in your database, which probably comes from the cloud. Your data might have some weird strings, like U+2028 the Unicode LINE SEPARATOR character. When you use Perl's JSON::XS, or probably other JSON encoder modules as well, it gives you an
Journal of miyagawa (1653)
Investigating the UTF-8 on/off performance issues for work. Template::Stash::ForceUTF8 does utf8_on calls to all stash variables, which could be crucial to perfomance to the large-scale site like ours.Looking through TT source code, I came up with the simple hack to add 'use encoding "utf-8"' to the generated code by TT. This solves the utf-8 bytes and string concatination (auto-upgrades from lati
Encode-DoubleEncodedUTF8-0.05
To install Encode::DoubleEncodedUTF8, copy and paste the appropriate command in to your terminal. cpanm cpanm Encode::DoubleEncodedUTF8 CPAN shell perl -MCPAN -e shell install Encode::DoubleEncodedUTF8 For more information on module installation, please visit the detailed CPAN module installation guide.
subtech - Bulknews::Subtech - Fix dodgy utf-8 bytes
ã¯ã¦ãªã‚°ãƒ«ãƒ¼ãƒ—ã®çµ‚了日を2020å¹´1月31æ—¥(金)ã«æ±ºå®šã—ã¾ã—㟠以下ã®ã‚¨ãƒ³ãƒˆãƒªã®é€šã‚Šã€ä»Šå¹´æœ«ã‚’目処ã«ã¯ã¦ãªã‚°ãƒ«ãƒ¼ãƒ—を終了予定ã§ã‚る旨をãŠçŸ¥ã‚‰ã›ã—ã¦ãŠã‚Šã¾ã—ãŸã€‚ 2019年末を目処ã«ã€ã¯ã¦ãªã‚°ãƒ«ãƒ¼ãƒ—ã®æ供を終了ã™ã‚‹äºˆå®šã§ã™ - ã¯ã¦ãªã‚°ãƒ«ãƒ¼ãƒ—日記 ã“ã®ãŸã³ã€æ£å¼ã«çµ‚了日を決定ã„ãŸã—ã¾ã—ãŸã®ã§ã€ä»¥ä¸‹ã®é€šã‚Šã”確èªãã ã•ã„。 終了日: 2020å¹´1月31æ—¥(金) エクスãƒãƒ¼ãƒˆå¸Œæœ›ç”³è«‹æœŸé™:2020å¹´1月31æ—¥(金) 終了日以é™ã¯ã€ã¯ã¦ãªã‚°ãƒ«ãƒ¼ãƒ—ã®é–²è¦§ãŠã‚ˆã³æŠ•ç¨¿ã¯è¡Œãˆã¾ã›ã‚“。日記ã®ã‚¨ã‚¯ã‚¹ãƒãƒ¼ãƒˆãŒå¿…è¦ãªæ–¹ã¯ä»¥ä¸‹ã®è¨˜äº‹ã«ã—ãŸãŒã£ã¦æ‰‹ç¶šãã‚’ã—ã¦ãã ã•ã„。 ã¯ã¦ãªã‚°ãƒ«ãƒ¼ãƒ—ã«æŠ•ç¨¿ã•ã‚ŒãŸæ—¥è¨˜ãƒ‡ãƒ¼ã‚¿ã®ã‚¨ã‚¯ã‚¹ãƒãƒ¼ãƒˆã«ã¤ã„㦠- ã¯ã¦ãªã‚°ãƒ«ãƒ¼ãƒ—日記 ã”利用ã®ã¿ãªã•ã¾ã«ã¯ã”迷惑をãŠã‹ã‘ã„ãŸã—ã¾ã™ãŒã€ã©ã†ãžã‚ˆã‚ã—ããŠé¡˜ã„ã„ãŸã—ã¾ã™ã€‚ 2020-06-25 追記 ã¯ã¦ãªã‚°ãƒ«ãƒ¼ãƒ—日記ã®ã‚¨ã‚¯ã‚¹ãƒãƒ¼ãƒˆãƒ‡ãƒ¼ã‚¿ã¯2020å¹´2月28
iandeth. - æ–‡å—列ã®utf8-flag状態を手軽ã«èª¿ã¹ã‚‹ - DBI::data_string_desc()
yet another way to peek at scalar's utf8-flag... DBIモジュールã®perldocã‚’èªã‚“ã§ã„ã¦ã€Œã‚€ã€ã“れイイã‹ã‚‚ã€ã¨æ€ãˆãŸãƒ¦ãƒ¼ãƒ†ã‚£ãƒªãƒ†ã‚£é–¢æ•°ã€‚ä»»æ„ã®æ–‡å—列ãªã‚Šã‚¹ã‚«ãƒ©å¤‰æ•°ãªã‚Šã‚’渡ã™ã¨ã€utf8-flag状態 / ascii or non-ascii 判定 / æ–‡å—æ•° / ãƒã‚¤ãƒˆæ•° ... ç‰ã®è©³ç´°æƒ…å ±ã‚’ãƒãƒãƒƒã¨è¿”ã—ã¦ãã‚Œã¾ã™ã€‚ use DBI; print DBI::data_string_desc('hoge');#実行çµæžœ UTF8 off, ASCII, 4 characters 4 bytes 以下ã€ã„ã‚ã‚“ãªãƒ‘ターンã§ã®å®Ÿè¡Œçµæžœ: # 'abc' UTF8 off, ASCII, 3 characters 3 bytes # utf8 flagged 'abc' UTF8 on, ASCII, 3 characters 3 bytes
UTF-8æ–‡å—列をãƒã‚¤ãƒˆæ•°ã§ã‚«ãƒƒãƒˆã—ãŸæ™‚ã®æœ«å°¾ã®å‡¦ç† - 徒書
……を先日考ãˆã¦ã„ãŸã¨ã“ã‚ã€NiAOUã•ã‚“よりサンプルスクリプトをæ示ã—ã¦é ‚ãã¾ã—ãŸãŒã€é¢ç™½ãã†ãªã®ã§è‡ªåˆ†ã§ã‚‚ä»–ã®ã‚„ã‚Šæ–¹ãŒãªã„ã‹è€ƒãˆã¦ã¿ã¾ã—ãŸï¼ˆPerlクイズã°ã‚Šã«ï¼‰ã€‚ # hint: uft-8 ã®ä¸€æ–‡å—ã®æ£è¦è¡¨ç¾ # [\x00-\x7F]| # [\xC0-\xDF][\x80-\xBF]| # [\xE0-\xEF][\x80-\xBF][\x80-\xBF]| # [\xF0-\xF7][\x80-\xBF][\x80-\xBF][\x80-\xBF]| # [\xF8-\xFB][\x80-\xBF][\x80-\xBF][\x80-\xBF][\x80-\xBF]| # [\xFC-\xFD][\x80-\xBF][\x80-\xBF][\x80-\xBF][\x80-\xBF][\x80-\xBF] 実ã®ã¨ã“ã‚知りãŸã‹ã£ãŸã®ã¯ã“ã®éƒ¨åˆ†ã§ã€æœ€é«˜ä½•ãƒã‚¤ãƒˆã¾ã§ã‚ã‚Šå¾—ã‚‹ã®ã‹ã¨ã‹ã€å„
1
ランã‚ング
ランã‚ング
ランã‚ング
リリースã€éšœå®³æƒ…å ±ãªã©ã®ã‚µãƒ¼ãƒ“スã®ãŠçŸ¥ã‚‰ã›
最新ã®äººæ°—エントリーã®é…ä¿¡
j次ã®ãƒ–ックマーク
kå‰ã®ãƒ–ックマーク
lã‚ã¨ã§èªã‚€
eコメント一覧を開ã
oページを開ã
http://d.hatena.ne.jp/tokuhirom/20070514/1179108961
{{#tags}}- {{label}}
{{/tags}}