当記事ã¯VBAã§URLデコード | Think Twiceã¸ç§»è¡Œã—ã¾ã—ãŸã€‚
Excel VBAã§UTF-8ã§ãƒ‘ーセントエンコードã•ã‚ŒãŸæ–‡å—列をデコードã™ã‚‹(簡易版) - No Programming, No Life
当記事ã¯VBAã§URLデコード | Think Twiceã¸ç§»è¡Œã—ã¾ã—ãŸã€‚
perl - 最速ã®UTF-8処ç†æ³• : 404 Blog Not Found
2013å¹´03月04æ—¥14:45 カテゴリTipsLightweight Languages perl - 最速ã®UTF-8処ç†æ³• Perl Cookbook (English, Kindle Ed.) Christiansen / Torkington [邦訳: Perlクックブック] ã¨ã„ã†ã‚ã‘ã§è§£èª¬ã€‚ 2013/03/04:Unicode::UTF8 ãŒã‚¬ãƒçˆ†é€Ÿã™ãŽã‚‹ - bayashi.net encode より decode ã®ãŒå·®ãŒå¤§ãã„æ„Ÿã˜ã€‚encode ã ã‘ã ã¨ã€æ–‡å—列長ããªã‚‹ã¨ Encode ã®æ–¹ãŒé€Ÿã„ã£ã½ã„。 ã¾ãšã¯æ”¹ã‚ã¦æ¤œè¨¼ã—ã¦ã¿ã¾ã—ょã†ã€‚ https://gist.github.com/dankogai/5079930 確ã‹ã«ãã®é€šã‚Šã«ãªã£ã¦ã„ã¾ã™ã€‚Unicode::UTF8ã¯Encodeã¯ãŠã‚ã‹Perl組ã¿è¾¼ã¿ã®utf8::decodeより高速ãªã®ã‹(æ–‡å—列をコピ
)
Specials (Unicode block) - Wikipedia
Specials is a short Unicode block of characters allocated at the very end of the Basic Multilingual Plane, at U+FFF0–FFFF, containing these code points: U+FFF9 INTERLINEAR ANNOTATION ANCHOR, marks start of annotated text U+FFFA INTERLINEAR ANNOTATION SEPARATOR, marks start of annotating character(s) U+FFFB INTERLINEAR ANNOTATION TERMINATOR, marks end of annotation block U+FFFC  OBJECT REPLACEMENT
Perlゼミ(サンプルコードPerl入門)
Perlå…¥å¦å¼ å…¨6回ã®Perl入門講座。æ±äº¬ã€å¤§é˜ªã€æ²–縄ã€æœå¹Œã§é–‹å‚¬ã€‚(æ±äº¬ã¯4月ã¨10月スタートã€ãれ以外ã¯5月スタート) YAPC::Japan Perlを軸ã¨ã—ãŸITã«é–¢ã‚ã‚‹å…¨ã¦ã®äººã®ãŸã‚ã®ã‚«ãƒ³ãƒ•ã‚¡ãƒ¬ãƒ³ã‚¹ã€‚ æ±äº¬ å‰ç¥¥å¯º.pm 五åç”°.pm 大阪 ãªã«ã‚Perl 沖縄 沖縄.pm
perl - $PerlIO::encoding::fallback ã®è¬Ž : 404 Blog Not Found
2009å¹´07月07æ—¥07:30 カテゴリLightweight Languages perl - $PerlIO::encoding::fallback ã®è¬Ž ã™ã³ã°ã›ã‚“。ãã‚Œã€ãƒ‰ã‚ュメントãƒã‚°ã§ã™ã€‚ PerlIO ã® encoding layer ã® fallback ã§ã¯ã¾ã£ãŸ - daily dayflower Encode - character encodings - search.cpan.org ã‚’ã¿ã‚‹ã¨ã‚ã‹ã‚‹ã‚ˆã†ã«ï¼ŒFB_XMLCREF 㯠XMLCREF | LEAVE_SRC ãªã‚“ã ã‘ã©ï¼Œã„ã‚ã„ã‚試行錯誤ã—ã¦ã‚‹ã¨ã©ã†ã‚„ら LEAVE_SRC ãŒæ‚ªã•ã‚’ã™ã‚‹ã‚‰ã—ã„。 $PerlIO::encoding::fallbackを指定ã™ã‚‹ã¨ãã¯ã€FB_*を使ã£ã¦ã¯ã„ã‘ã¾ã›ã‚“。 今ã‹ã‚‰ãã®ç†ç”±ã‚’説明ã—ã¾ã™ã€‚ Encode::LEAVE_SRCã£ã¦ä½•ã•? ã¾ãšã¯ã€Encode::FB
perl - Encodeã§XSSを防ã : 404 Blog Not Found
2009å¹´03月03æ—¥19:00 カテゴリLightweight Languages perl - Encodeã§XSSを防ã 良記事。 第7回■文å—エンコーディングãŒç”Ÿã¿å‡ºã™ãœã„弱性を知る：ITpro ã ã‘ã©ã€å•é¡Œç‚¹ã®ã¿å…·ä½“例ãŒã‚ã£ã¦ã€å¯¾ç–ã«ãªã„ã®ãŒç‰‡æ‰‹è½ã¡ã«æ„Ÿã˜ã‚‰ã‚ŒãŸã®ã§ã€ãã®ç‚¹ã‚’補足。 çµè«–ã ã‘言ã£ã¦ã—ã¾ãˆã°ã€Perlãªã‚‰ä»¥ä¸‹ã®åŽŸå‰‡ã‚’守るã ã‘ã§ã™ã€‚ 404 Blog Not Found:perl - Encode 入門 ã™ã§ã«OSCONã§ã‚‚YAPCã§ã‚‚ã€ã‚ã¡ã“ã¡ãã¡ã“ã¡ã§ã“ã®åŸºæœ¬æ–¹é‡ã«é–¢ã—ã¦ã¯è©±ã—ãŸã®ã§ã™ãŒã€ã“ã“ 404 Blog Not Found ã§ã‚‚改ã‚ã¦ã€‚ Perl 㧠utf8 化ã‘ã—ãŸã¨ãã«ã©ã†ã—ãŸã‚‰ã„ã„ã‹ - TokuLog 改゠ã ã¾ã£ã¦ã‚³ãƒ¼ãƒ‰ã‚’書ã‘よãƒã‚²å…¥ã‚Šå£ã§ decode ã—ã¦ã€å†…部ã§ã¯ã™ã¹ã¦ flagged utf8 ã§æ‰±ã„ã€å‡ºå£ã§ encode ã™ã‚‹ã€‚ã“ã‚ŒãŒ
Encode::Supported
Tools Download (1.99MB) MetaCPAN Explorer Permissions Subscribe to distribution Install Instructions Dependencies Exporter Storable parent and possibly others Reverse dependencies CPAN Testers List Dependency graph Permalinks This version Latest version Alex Davies Alex Kapranoff Alex Vandiver Andreas J. Koenig Andrew Pennebaker Andy Grundman Anton Tagunov Autrijus Tang Benjamin Goldberg Bjoern Ho
UTF-8 vs. ISO-10646 : 404 Blog Not Found
2006å¹´03月11æ—¥13:07 カテゴリLightweight Languages一日一行野郎 UTF-8 vs. ISO-10646 ã“ã‚Œã ã¨LiberalãªUTF-8ã§ã™ã。 [ã‚’] UTF-8 ã®æ–‡å—ã«ãƒžãƒƒãƒã™ã‚‹æ£è¦è¡¨ç¾ UTF-8ã®æ–‡å—ã«ãƒžãƒƒãƒã™ã‚‹æ£è¦è¡¨ç¾ã®ç´ 直版。 æ–°æ—§ã€ã¨ã„ã†ã®ã‹ã€LiberalãªUTF-8ã¨StrictãªUTF-8ã®é•ã„ã¯ã€RFC2044ã¨RFC2279を見れã°ã¯ã£ãã‚Šã—ã¾ã™ã€‚è¦ã¯U+11000より上をèªã‚ã‚‹ã‹ã©ã†ã‹ã¨ã„ã†ã“ã¨ã§ã™ã€‚今ã®ã¨ã“ã‚Unicode.orgã®å®šç¾©ã§ã¯ã€U+0000 - U+10FFFF ã—ã‹èªã‚ã¦ã„ãªã„ã®ã§ã€ãã¡ã‚‰ã®å®šç¾©ã«å¾“ã†ã¨ã€ã‚€ã—ã‚ã“ã®æ£è¦è¡¨ç¾ã¯ã•ã‚‰ã«çŸã $RE_UTF8CHAR_STRICT = qr/(?:[\x00-\x7f]|[\xC0-\xDF][\x80-\xBF]|[\xE0-\xEF][\x80-\xBF]{2}
The Perl UTF-8 and utf8 Encoding Mess (by Jeremy Zawodny)
I've been hacking on some Perl code that extracts data that comes from web users around the world and been stored into MySQL (with no real encoding information, of course). My goal it to generate well-formed, valid XML that can be read by another tool. Now I'll be the first to admit that I never really took the time to like, understand, or pay much attention to all the changes in Perl's character
404 Blog Not Found:perl - Encode 入門
2008å¹´04月09æ—¥01:00 カテゴリLightweight Languages perl - Encode 入門 ã™ã§ã«OSCONã§ã‚‚YAPCã§ã‚‚ã€ã‚ã¡ã“ã¡ãã¡ã“ã¡ã§ã“ã®åŸºæœ¬æ–¹é‡ã«é–¢ã—ã¦ã¯è©±ã—ãŸã®ã§ã™ãŒã€ã“ã“ 404 Blog Not Found ã§ã‚‚改ã‚ã¦ã€‚ Perl 㧠utf8 化ã‘ã—ãŸã¨ãã«ã©ã†ã—ãŸã‚‰ã„ã„ã‹ - TokuLog 改゠ã ã¾ã£ã¦ã‚³ãƒ¼ãƒ‰ã‚’書ã‘よãƒã‚² 入りå£ã§ decode ã—ã¦ã€å†…部ã§ã¯ã™ã¹ã¦ flagged utf8 ã§æ‰±ã„ã€å‡ºå£ã§ encode ã™ã‚‹ã€‚ã“ã‚ŒãŒã™ã¹ã¦ã§ã™ï¼ã¨ã«ã‹ãã“ã®åŸºæœ¬æ–¹é‡ã‚’ã¾ã‚‚ã£ã¦ã„ã‚Œã°å¹¸ã›ã«ãªã‚Œã¾ã™ã€‚ã“ã“ã§ã¯ã€EUC-JPã§ã‚¨ãƒ³ã‚³ãƒ¼ãƒ‰ã•ã‚ŒãŸãƒ•ã‚¡ã‚¤ãƒ«ä¸ã®ã€Œå°é£¼å¼¾ã€ã€Œã“ãŒã„ã ã‚“ã€ã€Œã‚³ã‚¬ã‚¤ãƒ€ãƒ³ã€ã€ŒKogai Danã€ã‚’æ£è¦è¡¨ç¾ã§æ›¸ãæ›ãˆã¦æ¨™æº–出力ã«EUC-JPã§å‡ºåŠ›ã™ã‚‹ãƒ—ãƒã‚°ãƒ©ãƒ を例ã«ã¨ã£ã¦èª¬æ˜Žã—ã¾ã™ã€‚ decode() then encode(
404 Blog Not Found:CPAN - HTTP::Response::Encoding Released!
2007å¹´04月17æ—¥22:30 カテゴリLightweight Languages CPAN - HTTP::Response::Encoding Released! HTTP-Response-Encoding ã‚’ Release ã—ãŸã®ã§ãŠçŸ¥ã‚‰ã›ã—ã¾ã™ã€‚ on CPAN (coming soon) http://www.dan.co.jp/~dankogai/cpan/HTTP-Response-Encoding-0.03.tar.gz ã©ã†ã„ã†ã‚‚ã®ã‹ã¨ã„ã†ã¨ã€ã“ã†ã„ã†ã‚‚ã®ã§ã™ã€‚ use LWP::UserAgent; use HTTP::Response::Encoding; my $ua = LWP::UserAgent->new(); my $res = $ua->get("http://www.example.com/"); warn $res->encoding; prin
404 Blog Not Found:perl tips - Encodeを速ã使ã†æ–¹æ³•
2007å¹´04月23æ—¥01:30 カテゴリLightweight LanguagesTips perl tips - Encodeを速ã使ã†æ–¹æ³• ã¯ã£ãり言ã£ã¦ã“ã‚Œã¯ãƒ•ã‚§ã‚¢ã§ã¯ãªã„。 ã¿ã‹ãƒã‚°: Erlangã¨Perlã®é€Ÿåº¦æ¯”較 Perlå´ã¯ï¼ŒEncodeãŒé…ã„． Encode::from_toãŒinplaceã§ã‚³ãƒ³ãƒãƒ¼ãƒˆã—ã¦ã—ã¾ã†ãŸã‚ã«ï¼Œç›´å‰ã«æ–‡å—列コピーãŒã‚ã‚‹ã®ã‚‚影響ã—ã¦ã„ã‚‹ã®ã‹ã‚‚ ãªãœãªã‚‰ã€Encode::from_to()ã¯é€Ÿåº¦ã§ã¯ãªãã€å®‰å…¨æ€§ã«æœ€é©åŒ–ã—ã¦ã„ã‚‹ã‹ã‚‰ã€‚ ãã‚‚ãã‚‚ã¯ã˜ã‚ã‹ã‚‰UTF-8ã€ãれもutf8フラグãŒãŸã£ã¦ã„ã‚‹æ–‡å—列ã«from_toを使ã†ã®ã¯ã°ã‹ã’ã¦ã„る。 for(my $i = 0; $i < 0xffff; $i++) { my $str2 = $str; Encode::from_to($str2, "UTF-8", "Shift_JIS"); } ã¯å˜ã«
[Perl] Encode.pm ã® fallback ㌠iso-2022-jp ã§ãã‹ãªã„
ã¯ã¦ãªã‚°ãƒ«ãƒ¼ãƒ—ã®çµ‚了日を2020å¹´1月31æ—¥(金)ã«æ±ºå®šã—ã¾ã—㟠以下ã®ã‚¨ãƒ³ãƒˆãƒªã®é€šã‚Šã€ä»Šå¹´æœ«ã‚’目処ã«ã¯ã¦ãªã‚°ãƒ«ãƒ¼ãƒ—を終了予定ã§ã‚る旨をãŠçŸ¥ã‚‰ã›ã—ã¦ãŠã‚Šã¾ã—ãŸã€‚ 2019年末を目処ã«ã€ã¯ã¦ãªã‚°ãƒ«ãƒ¼ãƒ—ã®æ供を終了ã™ã‚‹äºˆå®šã§ã™ - ã¯ã¦ãªã‚°ãƒ«ãƒ¼ãƒ—日記 ã“ã®ãŸã³ã€æ£å¼ã«çµ‚了日を決定ã„ãŸã—ã¾ã—ãŸã®ã§ã€ä»¥ä¸‹ã®é€šã‚Šã”確èªãã ã•ã„。 終了日: 2020å¹´1月31æ—¥(金) エクスãƒãƒ¼ãƒˆå¸Œæœ›ç”³è«‹æœŸé™:2020å¹´1月31æ—¥(金) 終了日以é™ã¯ã€ã¯ã¦ãªã‚°ãƒ«ãƒ¼ãƒ—ã®é–²è¦§ãŠã‚ˆã³æŠ•ç¨¿ã¯è¡Œãˆã¾ã›ã‚“。日記ã®ã‚¨ã‚¯ã‚¹ãƒãƒ¼ãƒˆãŒå¿…è¦ãªæ–¹ã¯ä»¥ä¸‹ã®è¨˜äº‹ã«ã—ãŸãŒã£ã¦æ‰‹ç¶šãã‚’ã—ã¦ãã ã•ã„。 ã¯ã¦ãªã‚°ãƒ«ãƒ¼ãƒ—ã«æŠ•ç¨¿ã•ã‚ŒãŸæ—¥è¨˜ãƒ‡ãƒ¼ã‚¿ã®ã‚¨ã‚¯ã‚¹ãƒãƒ¼ãƒˆã«ã¤ã„㦠- ã¯ã¦ãªã‚°ãƒ«ãƒ¼ãƒ—日記 ã”利用ã®ã¿ãªã•ã¾ã«ã¯ã”迷惑をãŠã‹ã‘ã„ãŸã—ã¾ã™ãŒã€ã©ã†ãžã‚ˆã‚ã—ããŠé¡˜ã„ã„ãŸã—ã¾ã™ã€‚ 2020-06-25 追記 ã¯ã¦ãªã‚°ãƒ«ãƒ¼ãƒ—日記ã®ã‚¨ã‚¯ã‚¹ãƒãƒ¼ãƒˆãƒ‡ãƒ¼ã‚¿ã¯2020å¹´2月28
![[Perl] Encode.pm ã® fallback ㌠iso-2022-jp ã§ãã‹ãªã„](https://cdn-ak-scissors.b.st-hatena.com/image/square/bd195ffb1b2f04efdbb930cdbe2feef27397f2aa/height=288;version=1;width=512/https%3A%2F%2Fogimage.blog.st-hatena.com%2F26006613547248301%2F26006613547294880%2F1709195433)
yasuokaã®æ—¥è¨˜ | スラド
2021å¹´12月23æ—¥ã®æ—¥è¨˜ã®èªè€…ã‹ã‚‰ã€NDLå¤å…¸ç±OCR用RoBERTa-small ver.2ã¨ã„ã†å˜æ–‡å—日本語モデルをãŠæ•™ãˆã„ãŸã ã„ãŸã€‚以å‰ã€ç§(安岡å一)ãŒä½œã£ãŸroberta-small-japanese-aozora-charã‚’å†ãƒˆãƒ¬ãƒ¼ãƒ‹ãƒ³ã‚°ã—ã¦ã€TrOCRã®ãƒ‡ã‚³ãƒ¼ãƒ€ãƒ¼ã«ä½¿ã£ã¦ã„るらã—ã„。ã¨ã‚Šã‚ãˆãšã€å½“該モデルをGoogle Colaboratoryã§å‹•ã‹ã—ã¦ã¿ã‚ˆã†ã€‚ !pip install transformers !test -f model-ver2.zip || curl -LO https://lab.ndl.go.jp/dataset/ndlkotensekiocr/trocr/model-ver2.zip !test -d model-ver2 || unzip model-ver2.zip from transformers import pipeline f
Encode - è¦æ ¼ã®ãƒã‚°ã¾ã§ã¯ç›´ã›ã¾ã›ã‚“ : 404 Blog Not Found
2006å¹´05月10æ—¥11:00 カテゴリLightweight LanguagesLogos Encode - è¦æ ¼ã®ãƒã‚°ã¾ã§ã¯ç›´ã›ã¾ã›ã‚“ ãã‚ŒãŒè¦æ ¼ã ã‹ã‚‰ã§ã™ã€‚ b:note: Encodeã®ãƒŠã‚¾ 最近会ã†æ©Ÿä¼šãŒç„¡ã„ã®ã§ã€ãƒˆãƒ©ãƒƒã‚¯ãƒãƒƒã‚¯ã—ã¾ã™ã€‚ $moji = "～"; Encode::from_to($moji, "euc-jp", "utf8"); print $moji; ã§å‡ºã¦ããŸæ–‡å—ã‚’Windowsã®ãƒ¡ãƒ¢å¸³ã¨ã‹ç§€ä¸¸ã§ã¿ã‚‹ã¨ã€ï½žã®æ³¢å½¢ãŒå対ã«ãªã£ãŸæ–‡å—ã«ãªã£ã¦ã—ã¾ã„ã¾ã™ã€‚ ã“ã“ã§ã„ã†ã€Œï½žã€ã¯U+FF5Eã€Fullwidth Tildeã®ã“ã¨ã§ã™ã€‚ ãã®ç”ãˆã¯ã€ã€ŒUnicode ConsortiumãŒç”¨æ„ã—ãŸJISX0212ã¨Unicodeã®å¤‰æ›è¡¨ãŒãã†ã ã£ãŸã‹ã‚‰ã€ã¨ã„ã†ã“ã¨ã«ãªã‚Šã¾ã™ã€‚Encodeã®ã›ã„ã§ã¯ãªã„ã®ã§ã™ã€‚詳ã—ãã¯ã€ Japanese <-> Unicode Map
Windowsã§Encode::Detectを入れるãŸã‚ã®Makefile.PL - çƒè³Šæ§˜
を作ã£ãŸï¼ŽWin32ã«Encode::Detectを入れる - Charsbar::Noteã‚’å‚考ã«ã—ã¦ï¼Œã¡ã‚‡ã£ã¨ã ã‘構æˆå¤‰ãˆã¤ã¤ã“れを自動ã§ã‚„るよã†ã«ã—ãŸï¼ŽEncode-Detect-0.01ã®tarballを展開ã—ã¦ï¼Œä»¥ä¸‹ã®ã‚½ãƒ¼ã‚¹ã‚’Makefile.PLã¨ã—ã¦ç½®ã„ã¦ã‚„ã‚Œã°ï¼Œã‚ã¨ã¯ãŠãã¾ã‚Šã® perl Makefile.PL ã‹ã‚‰ nmake install ã§ï¼Ž 自分ã®ç’°å¢ƒã§ã¯ã“ã‚Œã§ã†ã¾ãã„ã£ãŸã®ã§ï¼ŒDetector.xs ã® extern "C" ã¯å¤–ã—ã¦ã¾ã›ã‚“． #!perl use strict; use warnings; use ExtUtils::MakeMaker; use File::Copy::Recursive qw(fmove); use File::Slurp qw(slurp write_file); my @DELETE = qw(Build.PL MANI
Win32ã«Encode::Detectを入れる - Charsbar::Note
ã“ã®ã‚¨ãƒ³ãƒˆãƒªã®ãƒ•ã‚©ãƒãƒ¼è¨˜äº‹ãŒ http://d.hatena.ne.jp/charsbar/20060622/1150903898 ã«ã‚ã‚Šã¾ã™ã€‚ 先日Plaggerã®æŽ¨å¥¨ãƒ¢ã‚¸ãƒ¥ãƒ¼ãƒ«ã¨ãªã£ãŸEncode::Detect。 This module provides an interface to Mozilla's universal charset detector, which detects the charset used to encode data. ã¨ã®ã“ã¨ã§ã€å¤šå°‘ã®ã‚¯ã‚»ã¯ã‚ã‚‹ã‚‚ã®ã®åˆ¤å®šç²¾åº¦ã¯ãªã‹ãªã‹ã‚ˆã‚ã—ã„らã—ã„ã®ã§ã™ãŒã€ãªã«ã›CPAN Testersã®ã†ã¡ç„¡äº‹ã«ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«æˆåŠŸã—ãŸã®ã¯ãŸã£ãŸã®3人。Linuxユーザå«ã‚ã¦11人ãŒå¤±æ•—ã—ã¦ã„ã¦ã€ãƒã‚°ãƒ¬ãƒãƒ¼ãƒˆã‚‚ã‚ãŒã£ã¦ã„ã‚‹ã®ã«åŠå¹´è¿‘ãæ›´æ–°ã•ã‚Œã¦ã„ãªã„ã®ã§ã™ã‹ã‚‰å€‹äººçš„ã«ã¯ã‚ã¾ã‚Šä½¿ã†æ°—ã«ãªã‚‰ã‚“ã®ã よãªã‚ã¨ã€æ€ã„ã¤ã¤ã‚‚ã€ã‚„ã£ã±ã‚Šæ°—ã«ã¯ãª
1
ãŠçŸ¥ã‚‰ã›
障害
ランã‚ング
リリースã€éšœå®³æƒ…å ±ãªã©ã®ã‚µãƒ¼ãƒ“スã®ãŠçŸ¥ã‚‰ã›
最新ã®äººæ°—エントリーã®é…ä¿¡
j次ã®ãƒ–ックマーク
kå‰ã®ãƒ–ックマーク
lã‚ã¨ã§èªã‚€
eコメント一覧を開ã
oページを開ã
Perl vs Windows改行コード - 2006-11-15 - D-5 出張版
Encode.pm版lib/MT/I18N.pm - Ogawa::Memoranda
{{#tags}}- {{label}}
{{/tags}}