[B! lwp] BigFatCatã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

BigFatCat id:BigFatCat

lwpã«é–¢ã™ã‚‹BigFatCatã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (9)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

LWP::Protocol::PSGIã‚’ä½¿ã£ã¦APIã‚’å©ããƒ¡ã‚½ãƒƒãƒ‰ã®ãƒ†ã‚¹ãƒˆã‚’æ›¸ã - $shibayu36->blog;
ãƒ†ã‚¹ãƒˆã‚’ã™ã‚‹ã¨ãã«å¤–éƒ¨ã®APIã‚’å©ãéƒ¨åˆ†ã®ãƒ†ã‚¹ãƒˆã‚’æ›¸ããŸã„å ´åˆã€å‡ºæ¥ã‚‹é™ã‚Šå¤–éƒ¨ã«ã‚¢ã‚¯ã‚»ã‚¹ã›ãšã«ãƒ†ã‚¹ãƒˆã‚’æ›¸ããŸã„ã€‚ãã†ã„ã†æ™‚ Test::Mock::Guardã‚’ä½¿ã£ã¦è©²å½“éƒ¨åˆ†ã®ãƒ¡ã‚½ãƒƒãƒ‰ãŒç‰¹å®šã®ãƒ‡ãƒ¼ã‚¿ã‚’è¿”ã™ã‚ˆã†ã«æ›¸ãæ›ãˆã¦ã—ã¾ã† LWP::Protocol::PSGIã‚’ä½¿ã†ãªã©ã€APIã‚’å©ãclientéƒ¨åˆ†ã‚’å·®ã—æ›¿ãˆã‚‹ Test::TCPã‚’ä½¿ã£ã¦ã€APIã®serveréƒ¨åˆ†ã‚’å·®ã—æ›¿ãˆã‚‹ ãªã©ã®æ–¹æ³•ãŒã‚ã‚‹ã€‚ ä»Šå›žã¯LWP::Protocol::PSGIã‚’ä½¿ã£ã¦APIã‚’å©ãclientéƒ¨åˆ†ã‚’å·®ã—æ›¿ãˆã‚‹ã¨ã„ã†ã®ã‚’ã‚„ã£ã¦ã¿ãŸã€‚ ãƒ†ã‚¹ãƒˆã—ãŸã„å®Ÿè£… ä¾‹ãˆã°ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ä»¶æ•°å–å¾—APIã‚’ä½¿ã£ãŸå®Ÿè£…ãŒã‚ã‚‹ã¨ã™ã‚‹ã€‚ ä»¥ä¸‹ã®æ§˜ãªæ„Ÿã˜ã€‚ package Bookmark::Client; use strict; use warnings; use URI; use URI::QueryParam; use LW
BigFatCat 2014/02/05
perl

test

webapi

psgi

lwp
ãƒªãƒ³ã‚¯
file_get_contentsçš„ãªäº‹ãŒã‚„ã‚Šã¦ãˆã‚“ã ã‚ˆï¼ - uzullaãŒãƒ–ãƒã‚°
å‰ç½®ã ãƒ¡ãƒ¢ã§ã™ã€‚ PHPã§ã•ãã•ãã¨ãƒ•ã‚¡ã‚¤ãƒ«èªã¿æ›¸ãã—ã¦ã„ã¦ã€Perlã ã¨ãªã‚“ã§ã“ã‚“ãªã‚¯ã‚½é¢å€’ãã•ã„ã“ã¨ã‚’ã—ãªã„ã¨ã„ã‘ãªã„ã‚“ã ï¼ã£ã¦æ‚©ã‚“ã§ã‚‹äººã‚‚å‚è€ƒã«ãªã‚‹ã¨æ€ã„ã¾ã™ã€‚ æƒ…å ±æä¾›makamakaã•ã‚“ã§ã™ã€‚ file_(get|put)_contentsç›¸å½“ãªã®ã¯ use File::Slurp; #read $res = read_file('path/to/file.ext'); #write write_file("/path/to/file.ext", $some_data); ã€Œä¿ºã¯HTTPã§ã‚²ãƒƒãƒˆã—ã¦ä¿å˜ã—ãŸã„ã‚“ã ã‚ˆï¼ã€ use File::Slurp; use Furl; $furl = new Furl(); $res = $furl->get('http://example.co.jp/file.jpg'); die $res->status_line unless $re
BigFatCat 2013/04/19
monger

lwp

perl

èªã¿ç‰©
ãƒªãƒ³ã‚¯
ä¸‹å¿ƒã§è¦šãˆã‚‹ã‚¨ãƒƒãƒãª Perl - è‹¥å¦»ã‚µã‚¤ãƒˆã€Œèˆžãƒ¯ã‚¤ãƒ•ã€ã‚’ã‚¹ã‚¯ãƒ¬ã‚¤ãƒ”ãƒ³ã‚°ã—ã¦ã¿ãŸ - ãŠã„ã¡ã‚ƒã‚“ã¨å‘¼ã°ã‚Œã¦ã„ã¾ã™
BigFatCat 2011/03/10
perl

spidering

lwp

ç”»åƒ
ãƒªãƒ³ã‚¯
Perl ãŒè¦šãˆã‚‰ã‚Œã¦èƒ¸ã‚‚ã‚ãƒ¥ãƒ³ã¨ãªã‚‹ã‚³ãƒ¼ãƒ‰ã‚’æ›¸ã„ã¦ã¿ãŸ - ãŠã„ã¡ã‚ƒã‚“ã¨å‘¼ã°ã‚Œã¦ã„ã¾ã™
ãªã‚“ã‹ Perl ã§ã‚¹ã‚¯ãƒ¬ã‚¤ãƒ”ãƒ³ã‚°ã™ã‚‹è¨˜äº‹ãŒè©±é¡Œã«ãªã£ã¦ã„ã‚‹ã‚ˆã†ã§ã—ã¦ã€‚ -ç°¡å˜ï¼ãŸã£ãŸï¼‘ï¼“è¡Œã®ã‚³ãƒ¼ãƒ‰ã§HTMLå–å¾—ï¼†è§£æžã‚’ã™ã‚‹Perlã‚¹ã‚¯ãƒªãƒ—ãƒˆ - DQNEOèµ·æ¥æ—¥è¨˜ ã“ã®ãƒ–ãƒã‚°ã®è‘—è€…ã®äººã€ã„ã„ãªã€‚ã¨æ€ã†ã€ã»ã‚“ã¨ã«ã€‚åƒ•ã‚‚ç´ ç›´ã§ã‚ã‚ŠãŸã„ãªã€ã¨ã€‚ã§ã€ã¡ã‚‡ã£ã¨é…ããªã£ã¦ã—ã¾ã„ã¾ã—ãŸãŒã€ä¾¿ä¹—ã—ã¦ã¿ã¾ã™ã€‚ **æœ¬æ—¥ã®æ•™æ ãŸã ã€çŸãâ—‹â—‹è¡Œã§æ›¸ãã¨ã‹ã¯å¾—æ„åˆ†é‡Žã§ã¯ãªã„ã®ã§ã€ãŠãŸã®ã—ã¿ç”»åƒã‚’æ‰‹ã«å…¥ã‚Œã‚‹æ–¹å‘ã«ã‚‚ã£ã¦ã„ã£ã¦ã¿ã¾ã—ãŸã€‚æ¬¡ã®ã‚µã‚¤ãƒˆã‚’æ•™æã«ã€‚ -ãªã‚“ã§ã‚‚ã¡ã‚ƒã‚“ãã‚‹ : èƒ¸ãŒãã‚…ã‚“ã¨ã™ã‚‹å¥³ã®åã®ç”»åƒ - ãƒ©ã‚¤ãƒ–ãƒ‰ã‚¢ãƒ–ãƒã‚° å¥½ã¿ãŒåˆã‚ãªã‘ã‚Œã°ã€ã‚µãƒ³ãƒ—ãƒ«ã‚³ãƒ¼ãƒ‰ã® URL ã®ã¨ã“ã‚ã ã‘å¤‰ãˆã¦ã‚‚ã‚‰ã£ã¦ã‚‚æ§‹ã„ã¾ã›ã‚“ã—ã€‚ **ã‚µãƒ³ãƒ—ãƒ«ã‚³ãƒ¼ãƒ‰ ä¸‹è¨˜ã®ã‚³ãƒ¼ãƒ‰ã§èƒ¸ã‚ãƒ¥ãƒ³ç”»åƒã‚’ GET ã§ãã¾ã™ã€‚ |perl| ! /usr/bin/perl use strict; use warnings; use Web::S
BigFatCat 2011/03/10
perl

spidering

lwp

ç”»åƒ
ãƒªãƒ³ã‚¯
ã¨ã‚“ã§ã‚‚ãªã„ç¾Žå°‘å¥³ã‚½ãƒ ãƒªã‚¨ãŒç¾ã‚ŒãŸã®ã§ã€Web::Scraper ã§èŒãˆç”»åƒã‚’ã¶ã£ã“æŠœã„ã¦ã¿ã‚‹ - ãŠã„ã¡ã‚ƒã‚“ã¨å‘¼ã°ã‚Œã¦ã„ã¾ã™
æœ¬æ—¥ã®è©±é¡Œã‚’å…¨éƒ¨ã‚‚ã£ã¦ã„ã£ã¦ã‚‹è¨˜äº‹ãŒã‚³ãƒ¬ï¼ˆâ†“ï¼‰ã€‚ -ã†ã¡ã®ãƒžãƒ³ã‚·ãƒ§ãƒ³ã®éš£ã®ãƒ™ãƒ©ãƒ³ãƒ€ã§å¥³åé«˜ç”ŸãŒã‚»ãƒƒâ—‹ã‚¹ã—ã¦ã‚‹ ç„¡é¡Œã®ãƒ‰ã‚ãƒ¥ãƒ¡ãƒ³ãƒˆ ï¼ˆã„ã‚„ã„ã‚„ã€ã¡ã‚‡ã£ã¨å¾…ã£ã¦ã€‚è©±ã¯æœ€å¾Œã¾ã§èžã„ã¦... m( )m ä»Šå›žã‚‚ã„ãŸã£ã¦çœŸé¢ç›®ãªã€Perl ãƒ¬ã‚·ãƒ”ã®ã‚¨ãƒ³ãƒˆãƒªãƒ¼ã§ã™ã‹ã‚‰ã€‚ï¼‰ **ã¨ã‚“ã§ã‚‚ãªã„ç¾Žå°‘å¥³ã‚½ãƒ ãƒªã‚¨ãŒç¾ã‚ŒãŸ å½“è©²è¨˜äº‹ã®ã‚¿ã‚¤ãƒˆãƒ«ã®ã›ã„ã§ã“ã®ã‚¨ãƒ³ãƒˆãƒªãƒ¼ã¯å®¶æ—ã«è¦‹ã›ã‚‰ã‚Œãªã„ã‚‚ã®ã«ãªã£ã¦ã—ã¾ã„ã¾ã—ãŸãŒã€èª°ã‚‚ã‚¿ã‚¤ãƒˆãƒ«ã«è§¦ã‚Œãªã„ã»ã©ã®é©šæ„•ã®èª¬å¾—åŠ›ã§ã€ç¾Žå°‘å¥³ãŸã¡ã‚’è§£èª¬ã—ã¦ã„ã¾ã™ï¼ˆçŽ„äººï¼‰ã€‚ < ä¸–ã®ä¸ã®å°»å¥½ãã®çš†ã•ã‚“ãŠå¾…ãŸã›ã—ã¾ã—ãŸã€‚å°»å¥½ãã®çš†ã•ã‚“ã«èˆžã„è¾¼ã‚“ã§æ¥ã‚‹ã€ã‚ã‚ŠããŸã‚Šãªãƒ“ã‚ãƒ‹ã®ãƒ‡ã‚«å°»ç”»åƒã«è¾Ÿæ˜“ã—ã¦ã„ã¾ã›ã‚“ã‹ã€‚ç§ã¯ã—ã¦ã„ã¾ã™ã€‚ãƒžã‚¸ã§ã€‚ ä½•ã‚‚åˆ†ã‹ã£ã¦ã„ã¾ã›ã‚“ã€‚æœ¬å½“ã®å°»å¥½ãã‚’æ¥½ã—ã¾ã›ã‚‹ç”»åƒã¨è¨€ã†ã®ã¯é¦¬é¹¿ã¿ãŸã„ã«ãƒ†ã‚«ãƒ†ã‚«ã®å°»ã‚’ã•ã‚‰ã™ç”»åƒãªã‚“ã‹ã§ã¯ã‚ã‚Šã¾ã›ã‚“ã€‚ãƒ›ãƒƒãƒˆãƒ‘ãƒ³ãƒ„ã§ã‚¨ãƒã„å°»ãƒ©ã‚¤ãƒ³ã‚’ã•ã‚Šã’ãªãå¼·èª¿ã™ã‚‹ç”»åƒãªã®
BigFatCat 2011/03/10
perl

spidering

lwp

ç”»åƒ
ãƒªãƒ³ã‚¯
perl - çŸç¸®URLã‚’ä¸€è¡Œã§å±•é–‹ã™ã‚‹ : 404 Blog Not Found
2011å¹´01æœˆ03æ—¥06:00 ã‚«ãƒ†ã‚´ãƒªLightweight Languages perl - çŸç¸®URLã‚’ä¸€è¡Œã§å±•é–‹ã™ã‚‹ Perlã§ã™ã‹ã‚‰ã€‚ Schwarze SQ: çŸç¸®URLã‚’å±•é–‹ã™ã‚‹Rubyã‚¹ã‚¯ãƒªãƒ—ãƒˆã‚’ä½œã£ã¦ã¿ãŸ ãªã«ã‚„ã‚‰çŸç¸®URLã‚’ä½¿ã„ã€ä¸æ£ãªã‚µã‚¤ãƒˆã«ã‚¢ã‚¯ã‚»ã‚¹ã•ã›ã‚¦ã‚£ãƒ«ã‚¹ã«æ„ŸæŸ“ã•ã›ã‚‹è¡Œç‚ºãŒæµè¡Œã£ã¦ã„ã‚‹ã‚‰ã—ã„(ã¾ãæƒ³å®šã®ç¯„å›²å†…ã ãŒ)ã€‚ãã“ã§ã€çŸç¸®URLã‚’å±•é–‹ã§ãã‚‹rubyã‚¹ã‚¯ãƒªãƒ—ãƒˆã‚’ã¡ã‚‡ã¡ã‚‡ã£ã¨ä½œã£ã¦ã¿ãŸã€‚perl -MLWP::UserAgent -lE \ 'say LWP::UserAgent->new->head(shift)->request->uri' \ http://j.mp/dankogai id:amachangãŒæ˜”ã“ã•ãˆã¦ãã‚ŒãŸã“ã®çŸç¸®URLã‚‚http://blog.livedoor.jp/dankogai/ã¨å±•é–‹ã•ã‚Œã‚‹ã¯ãšã§ã™ã€‚ ã‚‚ã†å°‘ã—verboseã«
BigFatCat 2011/01/05
perl

cpan

lwp

å°é£¼å¼¾

ãƒ¯ãƒ³ãƒ©ã‚¤ãƒŠãƒ¼
ãƒªãƒ³ã‚¯
malaæ°ã® Studying HTTP with Perl ã‚’è¦‹ãªãŒã‚‰æ›¸ã„ãŸãƒŽãƒ¼ãƒˆã®æ¸…æ›¸ - ku ryze denik â—ã€œ*
ãƒªã‚¯ã‚¨ã‚¹ãƒˆã‚’ 5000/sec ã¨ã‹ã™ã‚‹ã¨ãã®ãŸã‚ã® 200/secã§ã‚ˆã‘ã‚Œã°åˆ¥ã«LWPä½¿ã£ã¦ã‚Œã°ã„ã„ã‚ˆãƒžã‚¸ã§ã€å®Ÿéš›ä¾¿åˆ©ã ã—ã€‚ éžä¸¦åˆ—ãªhttpã‚¢ã‚¯ã‚»ã‚¹ LWP::RobotUA robots.txtè¦‹ãŸã‚Šã™ã‚‹ã®ã§è¡Œå„€ãŒè‰¯ã„ URI::Fetch ã‚ãƒ£ãƒƒã‚·ãƒ¥ã¨ã‹ã™ã‚‹ã€ã‚¤ãƒ³ã‚¿ãƒ¼ãƒ•ã‚§ãƒ¼ã‚¹ãŒã„ã„ HTTP::Lite ä¾å˜ãƒ¢ã‚¸ãƒ¥ãƒ¼ãƒ«ãªã—ã€ã©ã“ã§ã‚‚ä½¿ãˆã‚‹ã‚ˆ LWPx::ParanoidAgent ãƒãƒ¼ã‚«ãƒ«IPã¯å¼¾ãã€WEBéšæ‹“çš„ã‚µãƒ¼ãƒ“ã‚¹ã« ä¸¦åˆ—ãªhttpã‚¢ã‚¯ã‚»ã‚¹ AnyEvent::HTTP ç°¡å˜ Coro::LWP ã‚³ãƒ«ãƒ¼ãƒãƒ³ã€é»’é”è¡“(ãªã«ã‚’ã—ã¦ã‚‹ã‹ç†è§£ã—ã¦ä½¿ãŠã†) AnyEvent::Curl curlã®ã‚ªãƒ—ã‚·ãƒ§ãƒ³ã‚’è¦šãˆãªãã¦ã¯ãƒ€ãƒ¡ Coro::LWPã¯LWPã‚’coroä½¿ç”¨ã«å…¨ã¦ç½®ãæ›ãˆã‚‹ã‹ã‚‰æ³¨æ„ã€‚ coroãã®ã‚‚ã®ã‚’çŸ¥ã‚Šã¾ã—ã‚‡ã† Curlã£ã¦ cURLã®ã“ã¨ã€Cpanè¨˜æ³•ã ã‹ã‚‰Curlã ã‘ã©
BigFatCat 2010/10/25
perl

cpan

lwp

http

yapc
ãƒªãƒ³ã‚¯
ã‚†ãƒ¼ã™ã‘ã¹ãƒ¼æ—¥è¨˜
ã‚µã‚ã¨ã¯å½¼å¥³ã®è‡ªå®…è¿‘ãã€æ¹˜å—å°é§…å‰ã®ã‚¹ãƒ¼ãƒ‘ãƒ¼ãƒžãƒ¼ã‚±ãƒƒãƒˆã§å¾…ã¡åˆã‚ã›ã‚’ã—ãŸã€‚å½¼å¥³ã¯è‡ªè»¢è»Šã§å¾Œã‹ã‚‰è¿½ã„ã¤ãã¨è¨€ã„ã€åƒ•ã¯å¤§ããªã‚³ã‚¤ãƒ³ãƒ‘ãƒ¼ã‚ãƒ³ã‚°ã¸è»Šã‚’åœã‚ãŸã€‚ç…™è‰ã‚’ä¸€æœ¬å¸ã£ã¦ã‹ã‚‰ã‚¹ãƒ¼ãƒ‘ãƒ¼ãƒžãƒ¼ã‚±ãƒƒãƒˆã¸å‘ã‹ã†ã¨ã€ã²ã£ãã‚Šãªã—ã«ä¸»å©¦çš„ãªå¥³æ€§ã‹ãŠã°ã‚ã¡ã‚ƒã‚“ãŒå…¥ã‚Šå£ã‚’å‡ºãŸã‚Šå…¥ã£ãŸã‚Šã—ã¦ã„ãŸã€‚æ™‚åˆ»ã¯åˆå¾Œ5æ™‚ã«ãªã‚‹ã€‚æ™‚è¨ˆã‹ã‚‰ç›®ã‚’ä¸Šã’ã‚‹ã¨ã€å¾…ãŸã›ã¡ã‚ƒã£ãŸã‚ãã¨å¤§ã—ã¦æ‚ªã³ã‚Œã¦ãªã„æ§˜åã§ã‚µã‚ãŒæ‰‹ã¶ã‚‰ã§ã‚„ã£ã¦ããŸã€‚ ãŠç¤¼ã«æ–™ç†ã‚’ä½œã‚‹ã¨ã¯ã„ãˆã€ã‚µã‚ã®å®¶ã«ã¯é£ŸæãŒååˆ†è¶³ã‚Šã¦ã„ãªã„ã‚‰ã—ãã€ã“ã†ã—ã¦ã‚¹ãƒ¼ãƒ‘ãƒ¼ãƒžãƒ¼ã‚±ãƒƒãƒˆã«å¯„ã‚‹ã“ã¨ã«ãªã£ãŸã€‚ã‚µã‚ã¯é‡Žèœã‚³ãƒ¼ãƒŠãƒ¼ã‹ã‚‰ç²¾è‚‰ã‚³ãƒ¼ãƒŠãƒ¼ã¾ã§ã€ã¾ã‚‹ã§å„ªç§€ãªã‚«ãƒ¼ãƒŠãƒ“ã«å°Žã‹ã‚Œã‚‹ã‚ˆã†ã«ç„¡é§„ãªãç‚¹æ¤œã—ã¦ã„ã£ãŸã€‚æ¬²ã—ã„é£ŸæãŒã‚ã‚‹ã¨ã€2ç§’é–“ç¨‹åº¦ãã‚Œã‚‰ã‚’å‡è¦–ã—ã€ä¸€åº¦æ‰‹ã«å–ã£ãŸã˜ã‚ƒãŒã„ã‚‚ã‚„ã‚‰è±šè‚‰ã‚„ã‚‰ã‚’è¿·ã†ã“ã¨ãªãåƒ•ãŒæŒã£ã¦ã„ã‚‹ã‚«ã‚´ã«æ”¾ã‚Šè¾¼ã‚“ã ã€‚æœ€å¾Œã«ã‚¢ãƒ«ã‚³ãƒ¼ãƒ«é£²æ–™ãŒå†·ã‚„ã•ã‚Œã¦ã„ã‚‹æ£šã®å‰ã¸è¡Œãã¨ã€ç§ãŒé£²ã‚€ã‹ã‚‰ã¨ãƒ
BigFatCat 2010/05/12
perl

lwp

spidering
ãƒªãƒ³ã‚¯
LWP::UserAgent + POE::Filter::Line ã§è¡Œãƒ™ãƒ¼ã‚¹å‡¦ç† - naoyaã®ã¯ã¦ãªãƒ€ã‚¤ã‚¢ãƒªãƒ¼
#!/usr/bin/env perl use strict; use warnings; use LWP::UserAgent; use POE::Filter::Line; my $filter = POE::Filter::Line->new; my $ua = LWP::UserAgent->new; ## POE::Filter::Line ã§ $chunk ã‚’è¡Œå…¥åŠ›ã«å¤‰æ› $ua->get( 'http://d.hatena.ne.jp/naoya/', ':content_cb' => sub { my $chunk = shift; my $lines = $filter->get([ $chunk ]); for (@$lines) { print "got: $_\n"; } } ); POE::Filter ã¯å˜ç‹¬ã§ä½¿ã†ã“ã¨ãŒã§ãã¾ã™ã€‚LWP ã®ã‚³ãƒ¼ãƒ«ãƒãƒƒã‚¯ã¨çµ„ã¿åˆã‚
BigFatCat 2010/05/12
perl

cpan

poe

lwp
ãƒªãƒ³ã‚¯
1