[B! ã‚¯ãƒãƒ¼ãƒ©] fjwr38ã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

fjwr38 id:fjwr38

ã‚¯ãƒãƒ¼ãƒ©ã«é–¢ã™ã‚‹fjwr38ã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (19)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

ç¬¬22å›žã€€Coroã‚’ä½¿ã£ãŸã‚„ã•ã—ã„ã‚¯ãƒãƒ¼ãƒ©ã®ä½œã‚Šæ–¹ï¼ˆ1ï¼‰ | gihyo.jp
æœ¬é€£è¼‰ã§ã¯ç¬¬ä¸€ç·šã®Perl ãƒãƒƒã‚«ãƒ¼ãŒå›žæ›¿ã‚ã‚Šã§åŸ·ç†ã—ã¦ã„ãã¾ã™ã€‚ä»Šå›žã¯æœ¬èªŒVol.68ï½ž73ã¾ã§ã€Œãƒ•ãƒãƒ³ãƒˆã‚¨ãƒ³ãƒ‰Webæˆ¦ç•¥å®¤ã€ã‚’é€£è¼‰ã—ã¦ã„ãŸmalaã•ã‚“ã§ã€ãƒ†ãƒ¼ãƒžã¯ã‚¯ãƒãƒ¼ãƒ©ã®ä½œã‚Šæ–¹ã§ã™ã€‚å€‹äººç”¨ã®ã¡ã‚‡ã£ã¨ã—ãŸãƒ€ã‚¦ãƒ³ãƒãƒ¼ãƒ€ã‚’æ›¸ãã¨ãã‹ã‚‰ã€å¤§è¦æ¨¡ãªã‚¯ãƒãƒ¼ãƒ©ã‚’æ›¸ãå ´åˆã¾ã§ã€Perlã¯å¼·ã„å‘³æ–¹ã«ãªã‚Šã¾ã™ã€‚ ãªãŠæœ¬ç¨¿ã®ã‚µãƒ³ãƒ—ãƒ«ã‚³ãƒ¼ãƒ‰ã¯ã€æœ¬èªŒã‚µãƒãƒ¼ãƒˆã‚µã‚¤ãƒˆã‹ã‚‰å…¥æ‰‹ã§ãã¾ã™ã€‚ ã‚¯ãƒãƒ¼ãƒ©ã®ç¤¼å„€ä½œæ³• ã‚¯ãƒãƒ¼ãƒ©ã€ã‚¹ãƒ‘ã‚¤ãƒ€ã€bot[1]ã‚’ç¨¼åƒã•ã›ã‚‹éš›ã¯ã€ã‚¢ã‚¯ã‚»ã‚¹ã®ã—ã‹ãŸã«ã‚ˆã£ã¦ã¯ç›¸æ‰‹å…ˆã®ã‚µãƒ¼ãƒ“ã‚¹ã«å¤šå¤§ãªè² è·ã‚’ã‹ã‘ã¦ã—ã¾ã„ã¾ã™ã€‚æœ¬ç¯€ã§ã¯ã¾ãšã€ä½¿ç”¨è¨€èªžã«ã‹ã‹ã‚ã‚‰ãšã‚¯ãƒãƒ¼ãƒ©ã‚’æ›¸ãã†ãˆã§ä¸€èˆ¬çš„ã«çŸ¥ã£ã¦ãŠãã¹ãä½œæ³•ã«ã¤ã„ã¦è¿°ã¹ã¾ã™ã€‚ robots.txtã«ã‚ˆã‚‹botã®åˆ¶å¾¡â”€â â”€ ã‚¢ã‚¯ã‚»ã‚¹ã—ã¦ã‚ˆã„ã‹ã®æŒ‡ç¤º Webã‚µã‚¤ãƒˆã«ç½®ã‹ã‚Œã‚‹robots.txtã¯ã€botã‹ã‚‰ã€Œã‚¢ã‚¯ã‚»ã‚¹ã—ã¦ã‚ˆã„ã‹ã€ã‚’åˆ¤æ–ã™ã‚‹ã‚‚ã®ã§ã™ã€‚ã‚¢ã‚¯ã‚»ã‚¹ã™ã‚‹å¯¾è±¡ãŒht
fjwr38 2014/04/18
crawler

ã‚¯ãƒãƒ¼ãƒªãƒ³ã‚°

ã‚¯ãƒãƒ¼ãƒ©
ãƒªãƒ³ã‚¯
ã‚ã‚‰ãŸã‚ã¦Rubyè£½ã®ã‚¯ãƒãƒ¼ãƒ©ãƒ¼ã€"anemone"ã‚’èª¿ã¹ã¦ã¿ãŸ - ãƒ—ãƒã‚°ãƒ©ãƒžã§ã‚ã‚ŠãŸã„
ï¼“å¹´ã»ã©å‰ã«ã€Rubyè£½ã®ã‚¯ãƒãƒ¼ãƒ©ãƒ¼"anemone"ã‚’ç´¹ä»‹ã—ã¾ã—ãŸã€‚ãã®å½“æ™‚ã‹ã‚‰å®Œæˆåº¦ãŒé«˜ãã€Rubyã§ã‚¯ãƒãƒ¼ãƒ©ãƒ¼ã‚’ä½¿ã†å ´åˆã¯anemoneã‚’åˆ©ç”¨ã—ã¦ãã¾ã—ãŸã€‚æœ€è¿‘ã€ä»–ã«æ–°ã—ãã¦è‰¯ã„ã®ãŒãªã„ã‹èª¿ã¹ã¾ã—ãŸãŒã€æ©Ÿèƒ½é¢ã®ç¶²ç¾…æ€§ã¨ã„ã†æ„å‘³ã§anemoneã‚’è¶…ãˆã‚‹ã‚‚ã®ã¯è¦‹ã¤ã‘ã‚‰ã‚Œã¾ã›ã‚“ã§ã—ãŸã€‚ãã“ã§æ”¹ã‚ã¦anemoneã®ã‚½ãƒ¼ã‚¹ã‚’èªã‚“ã§ã¿ãŸã¨ã“ã‚ã€ã‚¯ãƒãƒ¼ãƒ©ãƒ¼ãŒå¿…è¦ã¨ã™ã‚‹æ©Ÿèƒ½ã‚’å¿…è¦æœ€å°é™ã§å®Ÿè£…ã•ã‚Œã€ã‚„ã¯ã‚Šä¸ã€…è‰¯ã„å‡ºæ¥ã§ã™ã€‚å†¬ä¼‘ã¿ã®å®¿é¡Œã§ã¯ãªã„ã§ã™ãŒã€å‹‰å¼·ã®æ„å‘³ã‚’å…¼ãã¦ã‚½ãƒ¼ã‚¹ã‚’è¿½ã£ã¦ã„ãã“ã¨ã«ã—ã¾ã™ã€‚ AnemoneãŒåˆ©ç”¨ã—ã¦ã„ã‚‹ãƒ©ã‚¤ãƒ–ãƒ©ãƒªä¸€è¦§ anemoneãŒåˆ©ç”¨ã—ã¦ã„ã‚‹ãƒ©ã‚¤ãƒ–ãƒ©ãƒªã¯ã€ï¼”ç¨®é¡žã«åˆ†é¡žã§ãã¾ã™ã€‚ Rubyæ¨™æº–orä¸€èˆ¬çš„ãªãƒ©ã‚¤ãƒ–ãƒ©ãƒª ãƒ‡ãƒ¼ã‚¿å–å¾—ã§åˆ©ç”¨ã—ã¦ã„ã‚‹ãƒ©ã‚¤ãƒ–ãƒ©ãƒª ãƒ‡ãƒ¼ã‚¿è§£æžã§åˆ©ç”¨ã—ã¦ã„ã‚‹ãƒ©ã‚¤ãƒ–ãƒ©ãƒª ãƒ‡ãƒ¼ã‚¿ä¿å˜ã§åˆ©ç”¨ã—ã¦ã„ã‚‹ãƒ©ã‚¤ãƒ–ãƒ©ãƒª ã“ã®åˆ†é¡žåˆ¥ã«æ§‹é€ ã‚’ã¿ã‚‹ã¨ã‚ã‹ã‚Šã‚„ã™ã„ã®ã§ã€é †ç•ªã«è¿½ã£
fjwr38 2014/01/05
Ruby

scraping

ã‚¯ãƒãƒ¼ãƒ©
ãƒªãƒ³ã‚¯
5åˆ†ã§Webã‚¹ã‚¯ãƒ¬ã‚¤ãƒ”ãƒ³ã‚°ã‚’ã™ã‚‹ - YAMAGUCHI::weblog
ã¯ã˜ã‚ã« ã‚ã‘ã¾ã—ã¦ãŠã‚ã§ã¨ã†ã”ã–ã„ã¾ã™ã€‚ä»Šå¹´ã‚‚Pythonç•Œã®æ±Ÿå¤ç”°ã¡ã‚ƒã‚“ã¨ã—ã¦é ‘å¼µã£ã¦ã„ãæ‰€å˜ã§ã™ã€‚ã•ã¦ id:nishiohirokazu ãŒ5åˆ†ã§Pythonã¯ä¾¿åˆ©ã ã¨æ€ãˆã‚‹è¨˜äº‹ã‚’å…ƒæ—¦ã‹ã‚‰æ›¸ã„ã¦ã„ã¾ã—ãŸã€‚ ã€Œã»ãˆãƒ¼ã€ã•ã™ãŒè¥¿å°¾ã•ã‚“ã‚„ã€ã£ã¦æ€ã£ã¦ãŸã‚‰ã€è¥¿å°¾ã•ã‚“ãŒã€ŒãŠã„å±±å£ã€5åˆ†ã§Pythonä¾¿åˆ©ã ãªãƒ¼ã£ã¦æ€ãˆã‚‹è¨˜äº‹æ›¸ã‘ã‚„ã€ã£ã¦ã„ã†ç„¡è¨€ã®åœ§åŠ›ã‚’ã‹ã‘ã¦ããŸã®ã§*1 *2ãªã‚“ã¨ãªãæ›¸ãã¾ã—ãŸã€‚ ã€Œ5åˆ†ã§ã€ã£ã¦ã„ã†ã®ãŒèªè€…ãŒèªã‚€æ™‚é–“ãªã®ã‹ã€ç†è€…ãŒæ›¸ãæ™‚é–“ãªã®ã‹ãŒã‚ã‹ã‚‰ãªã‹ã£ãŸã®ã§å‰è€…ã¨ã„ã†ã“ã¨ã«ã—ã¾ã—ãŸã€‚5åˆ†ã§è¨˜äº‹ã¨ã‚³ãƒ¼ãƒ‰ä¸¡æ–¹æ›¸ãã¨ã‹ç„¡ç†ã‚„ã€‚ ã“ã‚“ãªã“ã¨ãªã„ã§ã™ã‹ ã€ŒWebã§ã‚¹ã‚¯ãƒ¬ã‚¤ãƒ”ãƒ³ã‚°ã—ãŸã„ã‚ˆãƒ¼ã€ã¦ã¸ã¸ã€‚ã ã‘ã©æ–‡å—ã‚³ãƒ¼ãƒ‰ã¨ã‹ãŒãƒšãƒ¼ã‚¸ã”ã¨ã«ãƒãƒ©ãƒãƒ©ã§ãƒžã‚¸ã—ã‚“ã©ã„ã£ã™ã€‚ã—ã‹ã‚‚ã‚¿ã‚°æŠœãå‡ºã™ã®ã¨ã‹ã‚ã¡ã‚ƒã‚ã‚“ã©ã„ã£ã™><ã€ã£ã¦ã“ã¨ã¯ã‚ã£ãŸã‚Šã—ã¾ã›ã‚“ã‹ï¼Ÿ ãƒªãƒ³ã‚¯ã®ã‚¿ã‚¤ãƒˆãƒ«ã¨ã‹ã‚‚ç¶ºéº—ã«æŠœãå‡ºã—ãŸã„ãªãƒ¼
fjwr38 2013/10/04
jQuery

Python

ã‚¯ãƒãƒ¼ãƒ©
ãƒªãƒ³ã‚¯
Webã‚¯ãƒãƒ¼ãƒªãƒ³ã‚°ï¼†ã‚¹ã‚¯ãƒ¬ã‚¤ãƒ”ãƒ³ã‚°ã®æœ€å‰ç·š å…¬é–‹ç”¨
2. about me â€¢ æ‰æµ¦ éš†å¹¸ â€¢ ãƒãƒƒãƒˆã‚¨ãƒ¼ã‚¸ã‚§ãƒ³ãƒˆæ ªå¼ä¼šç¤¾ ä»£è¡¨å–ç· å½¹ â€¢ PacketBlackHole, OnePointWall, é˜²äºº, secroidã®åŽŸé–‹ç™ºè€… â€¢ CTFãƒãƒ£ãƒ¬ãƒ³ã‚¸ã‚¸ãƒ£ãƒ‘ãƒ³ çµŒæ¸ˆç”£æ¥çœä¸»å‚¬ã®CTF(ãƒãƒƒã‚ãƒ³ã‚°ã®æŠ€è¡“ å¤§ä¼šï¼‰å„ªå‹ãƒ¡ãƒ³ãƒãƒ¼ (Agent IV) â€¢ Winnyã®æš—å·è§£èªã«åˆã‚ã«æˆåŠŸ â€¢ TVãƒ‹ãƒ¥ãƒ¼ã‚¹ç•ªçµ„ã§ã®äº‹ä»¶è§£èª¬å¤šæ•° â€¢ ç¬¬ï¼”å›ž IPAè³žå—è³ž â€¢ 2010å¹´ã«æ”¿åºœã®æƒ…å ±ä¿å…¨æ¤œè¨Žå§”å“¡ â€¢ ãªã© 2 3. Agenda â€¢ ã‚¯ãƒãƒ¼ãƒªãƒ³ã‚° â€¢ æ¦‚è¦ãƒ»ãƒªã‚¹ã‚¯ãƒ»ãƒ¬ãƒ™ãƒ«ãƒ»å¯¾ç–ãƒ»å¯¾ç–ã®å¯¾ç– â€¢ ã‚¹ã‚¯ãƒ¬ã‚¤ãƒ”ãƒ³ã‚° â€¢ ç’°å¢ƒãƒ»å®Ÿä¾‹ â€¢ å¿œç”¨ä¾‹ â€¢ secroid â€¢ easy webscrap â€¢ zip de kure â€¢ P2P å…¬é–‹ç”¨ã¯ä¸€éƒ¨æƒ…å ±ã‚’å‰Šæ¸›ã—ã¦ã„ã¾ã™ã€‚ 3
fjwr38 2013/06/23
ã‚¯ãƒãƒ¼ãƒ©

ã‚¹ã‚¯ãƒ¬ã‚¤ãƒ”ãƒ³ã‚°
ãƒªãƒ³ã‚¯
ç°¡å˜ãªã‚¯ãƒãƒ¼ãƒ©ä½œã‚‹ãªã‚‰Pythonã ã‚ˆï¼
http://d.hatena.ne.jp/nishiohirokazu/20120323/1332504404 æœ€è¿‘ã€Webã‚¯ãƒãƒ¼ãƒ©ã‚¯ãƒ©ã‚¤ã‚¢ãƒ³ãƒˆã‚’ä½œã‚‹ãŠä»•äº‹ãŒå¢—ãˆãŸã€‚Webã‚¯ãƒãƒ¼ãƒ©ã‚¯ãƒ©ã‚¤ã‚¢ãƒ³ãƒˆã¨ã„ã†ã®ã¯HTTP(S)ã‚’ä»‹ã—ã¦æ§˜ã€…ãªãƒ•ã‚¡ã‚¤ãƒ«ã‚’ãƒ€ã‚¦ãƒ³ãƒãƒ¼ãƒ‰ã—ã¦è§£æžã—ã€çµæžœã‚’æºœã‚è¾¼ã‚€ã ã‘ã®ãƒ—ãƒã‚°ãƒ©ãƒ ã§ã‚ã‚‹ã€‚ãƒœãƒƒãƒˆã¨ã‚‚ã„ã†ã€‚ ã‚¯ãƒãƒ¼ãƒªãƒ³ã‚°ã®è¦æ¨¡ãŒå¤§ãããªã‚‹ã¨ã€ã‚¯ãƒãƒ¼ãƒ«å‡¦ç†éƒ¨ã¨çµæžœè²¯è“„éƒ¨ã‚’åˆ†é›¢ã™ã‚‹å¿…è¦ãŒã‚ã‚‹ã€‚ã‚¯ãƒãƒ¼ãƒ©ã«ã¯æ§˜ã€…ãªã‚‚ã®ãŒã‚ã‚‹ãŒã€ã‚‚ã®ã«ã‚ˆã£ã¦ã¯ç‰¹å®šã®ã‚µãƒ¼ãƒã«é›†ä¸çš„ã«ã‚¯ãƒãƒ¼ãƒªãƒ³ã‚°ã‚’è¡Œã†ã“ã¨ã‚‚ã‚ã‚‹ã€‚ã“ã®ã¨ãã€1ã¤ã®IPã‚’ä½¿ã£ã¦é›†ä¸çš„ã«ã‚¯ãƒãƒ¼ãƒªãƒ³ã‚°ã‚’è¡Œã†ã¨ã€æ”»æ’ƒã¨ã¿ãªã•ã‚Œä¸€çž¬ã§banã•ã‚Œã¦ã—ã¾ã†ã€‚ãã“ã§ã€ä¸€è¦‹ã™ã‚‹ã¨ã¾ã£ãŸãé–¢ä¿‚ãªã•ãã†ãªIPã‚’è¤‡æ•°ç¢ºä¿ã—ã€ãã‚Œãžã‚Œã«ã‚¯ãƒãƒ¼ãƒ©ãƒ¼ã‚’ä»•æŽ›ã‘ã¦èµ°ã‚‰ã›ã‚‹ã®ã§ã‚ã‚‹ã€‚ çµæžœè²¯è“„éƒ¨ã¯ã€è¦ã™ã‚‹ã«ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã‚µãƒ¼ãƒã§ã‚ã‚Šã€ä½•ã‚’ä½¿ç”¨ã—ã¦ã‚‚è‰¯ã„ã€‚ã‚¯ãƒãƒ¼ãƒ«å‡¦ç†éƒ¨ã¨ã®ã‚„ã‚Šã¨
fjwr38 2013/02/27
python

ã‚¯ãƒãƒ¼ãƒ©
ãƒªãƒ³ã‚¯
ã‚µã‚¤ãƒˆå†…ã®URLã‚’å…¨ã¦é›†ã‚ã‚‹PHPè£½ã‚¯ãƒãƒ¼ãƒ©ãƒ¼ - URL Collector [ã‚¼ãƒã¨ç„¡é™ã®é–“ã«]
<?php require('html sql/snoopy.class.php'); require('html sql/html sql.class.php'); $c = new UrlCollector(); $c->echoFlg = true; $arr = $c->getUrls('http://example.com/', 'ã‚¿ã‚¤ãƒˆãƒ«ã«å…±é€šã®éƒ¨åˆ†'); $fp = fopen('test.log', 'a'); foreach ($arr as $url => $title) { fwrite($fp, "$url :\t$title\n"); } fclose($fp); <?php /** * URL Collector * @see http://0-oo.net/sbox/php-tool-box/url-collector * @version 0.1.0 * @cop
fjwr38 2013/02/18
php

ã‚¹ã‚¯ãƒ¬ã‚¤ãƒ—

ã‚¯ãƒãƒ¼ãƒ©

ã‚¯ãƒãƒ¼ãƒ©ãƒ¼
ãƒªãƒ³ã‚¯
PHPã®ã‚¯ãƒãƒ¼ãƒ©ã«ã¤ã„ã¦ã®èª¿æŸ»ã€€PHPCrawlã®è§£æžãã®ï¼— - ï¼«ï¼ªã®æ¥å‹™æ”¹å–„æ—¥èªŒ
æœå¹Œã®ITä¼æ¥ã«å‹¤å‹™ã™ã‚‹SEï¼ãƒ—ãƒã‚°ãƒ©ãƒžã§ã™ã€‚æ¥å‹™æ”¹å–„ã€Javaã€VBAã€ã‚»ãƒŸãƒŠãƒ¼ã€è»¢è·ã€å‰¯æ¥ã€æŠ•è³‡ã«é–¢ã™ã‚‹è¨˜äº‹ãŒä¸å¿ƒã§ã™ã€‚Jã‚¿ãƒ¼ãƒ³çµŒé¨“è€…ã§ã™ã€‚Uã‚¿ãƒ¼ãƒ³ã€Iã‚¿ãƒ¼ãƒ³ã€Jã‚¿ãƒ¼ãƒ³ã«èˆˆå‘³ãŒã‚ã‚‹æ–¹ã¯æ°—æ¥½ã«ã‚³ãƒ¡ãƒ³ãƒˆãŠé¡˜ã„ã—ã¾ã™ã€‚ã¾ãŸã€ä»–æ¥ç¨®ã‹ã‚‰ITä¼æ¥ã«è»¢è·ã—ã¦ã„ã‚‹ã®ã§èˆˆå‘³ãŒã‚ã‚Œã°ã‚³ãƒ¡ãƒ³ãƒˆãŠé¡˜ã„ã—ã¾ã™ã€‚ PHPCrawlã§ã®ã‚¯ãƒãƒ¼ãƒ«ãŒã¨ã‚Šã‚ãˆãšå‡ºæ¥ã‚‹ã‚ˆã†ã«ãªã‚Šã¾ã—ãŸã€‚ ãŸã ã€ã‚¯ãƒãƒ¼ãƒ«ã§å¾ªç’°ã—ãŸå ´åˆã¯ã©ã†ãªã‚‹ã®ã‹ï¼Ÿç‰ã®æ¤œè¨¼ãŒå‡ºæ¥ã¦ã„ã¾ã›ã‚“ã®ã§ã€ ãƒ‡ãƒãƒƒã‚°ä»¥å¤–ã§æ€–ãã¦ä½¿ãˆã¾ã›ã‚“ã‘ã©ï¼¾ï¼¾ï¼› ã¨ã‚Šã‚ãˆãšã€PHPCrawlä¸€åº¦ã¾ã¨ã‚ã¦ãŠãã¾ã™ã¨ãƒ»ãƒ»ãƒ»ã€‚ PHPCrawlã¯ã€ãã®ã¾ã¾ã§ä½¿ã†ã¨ ãƒ»PHP5ã«å¯¾å¿œã—ã¦ã„ãªã„ç‚ºã€ãƒ¯ãƒ¼ãƒ‹ãƒ³ã‚°ãŒå‡ºã¾ãã‚‹ã€‚ãƒ»robot.txtã‚’è¦‹ãªã„ã€‚ãƒ»ãƒšãƒ¼ã‚¸ã‚’èªã¿è¾¼ã‚€é–“éš”ãŒè¨å®šã•ã‚Œã¦ã„ãªã„ã®ã§ã€ã‚¯ãƒãƒ¼ãƒ©ãƒ¼å¯¾è±¡ã®Webã‚µãƒ¼ãƒã«è² è·ã‚’ã‹ã‘ã‚‹å±é™ºæ€§ãŒã‚ã‚‹ã€‚ãƒ»æ—¥æœ¬èªžã¯æ–‡å—åŒ–ã‘ã™ã‚‹ã€‚ ã¨ã„ã£ãŸäº‹ã§ã€
fjwr38 2013/01/29
php

Webã‚µãƒ¼ãƒ“ã‚¹

ã‚¯ãƒãƒ¼ãƒ©
ãƒªãƒ³ã‚¯
æ©‹æœ¬å•†ä¼š Â» ã„ã‹ã«ã—ã¦ãŠã£ã±ã„ç”»åƒã‚’ãƒ€ã‚¦ãƒ³ãƒãƒ¼ãƒ‰ã™ã‚‹ã‹ã€œ2012ã€€ã‚’Rubyã§æ›¸ã„ãŸ
å…ƒãƒã‚¿ï¼šã„ã‹ã«ã—ã¦ãŠã£ã±ã„ç”»åƒã‚’ãƒ€ã‚¦ãƒ³ãƒãƒ¼ãƒ‰ã™ã‚‹ã‹ã€œ2012 â€“ ã‚†ãƒ¼ã™ã‘ã¹ãƒ¼æ—¥è¨˜ æ˜”ã€yusukebeã•ã‚“ã¨ã¯å¤§å¦ã§åŒã˜ç ”ç©¶å®¤ã ã£ãŸã€‚ ä¿ºãŒã¾ã¨ã‚‚ã«ãƒ—ãƒã‚°ãƒ©ãƒ ã‚’æ›¸ã‘ã‚‹ã‚ˆã†ã«ãªã£ãŸã®ã¯ã€ç ”ç©¶å®¤ã«å…¥ã£ãŸæ™‚ã«æ–°å…¥ç”Ÿå‘ã‘ã®yusukebeã‚µãƒ–ã‚¼ãƒŸã«å…¥ã£ã¦ã€Flashã§å®Ÿè£…ã•ã‚ŒãŸRSSãƒªãƒ¼ãƒ€ãƒ¼ã®ã‚½ãƒ¼ã‚¹ã‚³ãƒ¼ãƒ‰ã‚’è¦‹ã›ã¦ã‚‚ã‚‰ã£ãŸã‚ãŸã‚ŠãŒãã£ã‹ã‘ã ã£ãŸæ°—ãŒã™ã‚‹ã€‚ ä¿ºã‚‚é«˜æ ¡ç”ŸãŒï¼ˆRubyã§ï¼‰ãƒ—ãƒã‚°ãƒ©ãƒŸãƒ³ã‚°ã‚’ã¯ã˜ã‚ã‚‹ãã£ã‹ã‘ã«ãªã‚ŠãŸã„ã®ã§ã€Rubyç‰ˆã‚’ä½œã£ã¦ã¿ã¾ã—ãŸã€‚ Rubyã‚‚ã“ã†ã„ã†webã‚¯ãƒãƒ¼ãƒ©ãƒ¼ã‚’ä½œã‚‹ã®ã«å‘ã„ã¦ã„ã‚‹è¨€èªžã ã—ã€æœ€è¿‘ã®Macãªã‚“ã‹ã«ã¯æœ€åˆã‹ã‚‰ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã•ã‚Œã¦ã„ã‚‹ã®ã§è©¦ã—ã¦ã¿ã‚‹ã¨è‰¯ã„ã‚ˆã€‚ ã¾ãšjson gemã‚’ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã™ã‚‹ã€‚ sudo gem install json oppai.rb #!/usr/bin/env ruby require 'rubygems' require 'op
fjwr38 2012/03/01
rubyã‚¯ãƒãƒ¼ãƒ©

ruby

ã‚¯ãƒãƒ¼ãƒ©
ãƒªãƒ³ã‚¯
ã‚¯ãƒãƒ¼ãƒ©ã‚’ä½œã‚‹æŠ€è¡“ã¨è¨è¨ˆ (æ¯Žé€±ã®ãƒãƒ³ã‚ºã‚ªãƒ³å‹‰å¼·ä¼šè³‡æ–™)
3. XPathXML ã‚„ HTML ã®ä»»æ„ã®ä½ç½®ã‚’å–å¾—ã™ã‚‹ãŸã‚ã®å¼XPathã‚¨ãƒ³ã‚¸ãƒ³ãŒã‚ã‚Œã°ã€ XPathã‚’æŒ‡å®šã—ã¦ HTML ä¸Šã®å€¤ã‚’ç°¡å˜ã«æŒã£ã¦ã“ã‚Œã‚‹ 4. XPath<?php$url = 'http://www.nicovideo.jp/';libxml_use_internal_errors(true);$doc = new DOMDocument();$doc->loadHTML(file_get_contents($url));libxml_clear_errors();$xpath = new DOMXPath($doc);foreach ($xpath->query('//a') as $node) { echo $node->textContent . "";}
fjwr38 2012/01/21
ã‚¯ãƒãƒ¼ãƒ©,phpã§æã„ã¦ã‚‹

ã‚¯ãƒãƒ¼ãƒ©

programming
ãƒªãƒ³ã‚¯
2ã¡ã‚ƒã‚“ãã‚‹BOTã®ä½œã‚Šæ–¹ æº–å‚™ç·¨ - GIOã®æ—¥è¨˜
ã‚¢ãƒ›ãªè©± 2chç”»åƒã¾ã¨ã‚ã¨ã„ã†ã‚¦ã‚§ãƒ–ã‚µãƒ¼ãƒ“ã‚¹ã‚’ã”å˜çŸ¥ã§ã—ã‚‡ã†ã‹ã€‚ ã‚¯ãƒãƒ¼ãƒ«ï¼Ÿã‚¹ãƒ‘ã‚¤ãƒ€ãƒªãƒ³ã‚°ï¼Ÿã‚¹ã‚¯ãƒ¬ã‚¤ãƒ”ãƒ³ã‚°ï¼Ÿã„ã‚ã‚†ã‚‹BOTãŒ2chã«æ›¸ãè¾¼ã¾ã‚ŒãŸç”»åƒã‚’å–å¾—ã—ã€ ã¾ã¨ã‚ã¦è¦‹ã‚Œã‚‹ã‚ˆã†ã«ã—ãŸã‚µã‚¤ãƒˆãªã®ã§ã™ãŒã€ä»Šæ—¥ã€æ¬¡ã®è¨˜äº‹ã‚’è¦‹ã¤ã‘ãŸã€‚ http://www.oshiete-kun.net/archives/2009/02/2chdl.html ã‚¢ãƒ›ã™ãŽã‚‹ã€‚ã‚¯ãƒãƒ¼ãƒ©ã®ã‚¯ãƒãƒ¼ãƒ©ãªã‚“ã¦ã€‚ã€‚ ã—ã‹ã‚‚ã€2chç”»åƒã¾ã¨ã‚ã§è¦‹ã‚Œã‚‹ç”»åƒã¯å…¨ã¦Webç”¨ã«ç¸®å°ã—ãŸç”»åƒã§ã™ã€‚ ãƒ€ã‚¦ãƒ³ãƒãƒ¼ãƒ‰ã™ã‚‹ã‚ˆã†ãªã‚³ãƒ¬ã‚¯ã‚¿ãƒ¼ã¯ã‚ªãƒªã‚¸ãƒŠãƒ«ã‚’ãƒ€ã‚¦ãƒ³ãƒãƒ¼ãƒ‰ã—ãŸã»ã†ãŒè‰¯ã„ã§ã™ã‚ˆã€‚ ã¨ã„ã†ã“ã¨ã§BOTã¤ãã‚Šã¾ã—ã‚‡ã†ã€‚ å‰çŸ¥è˜ ã¾ãšã¯ã‚³ãƒ¼ãƒ‰ã‚’æ›¸ãå‰ã«2chã®ã—ãã¿ã‚’ç°¡å˜ã«ã€‚ 2chã¯ã‚¹ãƒ¬ãƒƒãƒ‰åž‹æŽ²ç¤ºæ¿ã®é›†åˆã§ã‚ã‚Šã€å…¨ã¦ã®æŽ²ç¤ºæ¿ã¯æ¬¡ã®HTMLãƒ•ã‚¡ã‚¤ãƒ«ã«ä¸€è¦§ã•ã‚Œã¦ã¾ã™ http://menu.2ch.net/bbsmenu.htmlãŸã¨ãˆã°ãƒ‹ãƒ¥ãƒ¼é€Ÿ
fjwr38 2011/11/24
2ch

ruby

ã‚¯ãƒãƒ¼ãƒ©
ãƒªãƒ³ã‚¯
rubyã§htmlã‚’è§£æž (ãƒžãƒ«ãƒƒã¨ï¼)
Rubyã®HTMLã‚’è§£æžã™ã‚‹ãƒ‘ãƒ¼ã‚µã¯ã„ã‚ã„ã‚ã‚ã‚Šã¾ã™ãŒã€ä»Šå›žã¯ hpricot ã‚’ä½¿ã£ã¦ã¿ã¾ã—ãŸã€‚ gemã§ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã§ãã‚‹ã®ã§ç°¡å˜ã€‚ ã‚µãƒ³ãƒ—ãƒ«ã€‚ require 'rubygems' require 'hpricot' doc = Hpricot(%{<a class=l href="hogehoge">bar</a>baz}) doc.search("a").map {|i| [ i['href'], i.inner_html ] } #=> [["hogehoge", "bar"], ["foo", "baz"]] HTMLãƒšãƒ¼ã‚¸ã®èªã¿è¾¼ã¿ doc = Hpricot("<p>A simple <b>test</b> string.</p>") open-uriã‚’ä½¿ãˆã°ã“ã‚“ãªé¢¨ã«URLå…ˆã®HTMLã‚’å–å¾—ã§ãã¾ã™ã€‚ require 'open-uri' doc = Hpricot(o
fjwr38 2011/10/24
hpricot

ã‚¯ãƒãƒ¼ãƒ©

Ruby
ãƒªãƒ³ã‚¯
KOSMOSã€€- æ…¶æ‡‰ç¾©å¡¾å¤§å¦ãƒ¡ãƒ‡ã‚£ã‚¢ã‚»ãƒ³ã‚¿ãƒ¼
æ¤œç´¢æ¡ä»¶ï¼š criteria input Show Results with: criteria input Show Results with: criteria input Show Results with: Show Results with: In In ãƒã‚°ã‚¤ãƒ³Â ã—ã¦ãƒ•ãƒ«ã‚¢ã‚¯ã‚»ã‚¹ã™ã‚‹
fjwr38 2011/10/23
ruby

ã‚¯ãƒãƒ¼ãƒ©
ãƒªãƒ³ã‚¯
ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã®Rubyã®Webã‚¯ãƒãƒ¼ãƒ©ãƒ¼"Anemone"ã‚’ä½¿ã£ã¦ã¿ã‚‹ - ãƒ—ãƒã‚°ãƒ©ãƒžã§ã‚ã‚ŠãŸã„
Webã‚µã‚¤ãƒˆã®èª¿æŸ»ã‚’ã—ã‚ˆã†ã¨æ€ã„ã€ã‚µã‚¤ãƒˆã‚¯ãƒãƒ¼ãƒ©ãƒ¼ãŒå¿…è¦ã«ãªã‚Šã¾ã—ãŸã€‚ å„è¨€èªžã”ã¨ã«è‰²ã€…ã‚ã‚‹ã®ã§ä½•ã‚’ä½¿ã†ã‹æ‚©ã‚€ã¨ã“ã‚ã§ã™ãŒã€Rubyã§ãŠæ‰‹è»½ã«ã¨ã„ã†ã“ã¨ã§Anemoneã‚’æŽ¡ç”¨ã—ã¾ã—ãŸã€‚ ã¡ãªã¿ã«ä»–ã®è¨€èªžã ã¨ã€ä¸‹è¨˜ã®ã†ã¡ã®ã©ã‚Œã‹ãŒè‰¯ã„ã®ã§ã¯ãªã„ã§ã—ã‚‡ã†ã‹ï¼Ÿ Javaï¼šNutchã€S2Robot Perlï¼šGungho ä½™è«‡ã§ã™ãŒæ—¥æœ¬èªžã§æ¤œç´¢ã™ã‚‹å ´åˆã€WEBã‚¯ãƒãƒ¼ãƒ©ãƒ¼ã§æ¤œç´¢ã™ã‚‹ã‹WEBã‚¹ãƒ‘ã‚¤ãƒ€ãƒ¼ã§æ¤œç´¢ã™ã‚‹ã‹æ‚©ã¿ã¾ã™ã€‚è‹±èªžã ã¨Web Spiderã‹Web Crawlerã§ã™ã€‚ã©ã¡ã‚‰ã‹ã¨ã„ãˆã°Web SpiderãŒä¸€èˆ¬çš„ã®ã‚ˆã†ã§ã™ã€‚æ—¥æœ¬ã ã¨WEBã‚¯ãƒãƒ¼ãƒ©ãƒ¼ã®æ–¹ãŒç›®çš„ã®ã‚‚ã®ã«è¾¿ã‚Šç€ãã‚„ã™ã„ã‚ˆã†ãªæ°—ãŒã—ã¾ã™ã€‚ã†ãƒ¼ã‚“ã€æ‚©ã¾ã—ã„ã€‚ Anemoneã®ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«æ‰‹é † Anemoneã¯ã€nokogiriã‚’ä½¿ã„ã¾ã™ã€‚ nokogiriãŒå…¥ã£ã¦ã„ã‚Œã°ã€ã™ã‚“ãªã‚Šã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã‚‚å‡ºæ¥ã‚‹ã¨æ€ã„ã¾ã™ã€‚ ã¡ãªã¿ã«nokogi
fjwr38 2011/10/23
ruby

ã‚¯ãƒãƒ¼ãƒ©
ãƒªãƒ³ã‚¯
Rubyè¨€èªžã§æ›¸ã„ãŸã‚¯ãƒãƒ¼ãƒ©ãƒ¼
ã¨ã‚ã‚‹ä¸å‹•ç”£æŠ•è³‡ç‰©ä»¶ã®ãƒ‡ãƒ¼ã‚¿ã‚’ã‚¯ãƒãƒ¼ãƒ«ã™ã‚‹ãŸã‚ã« ä½œã£ãŸã‚¯ãƒãƒ¼ãƒ© å‚™å¿˜éŒ²ã¨ã—ã¦æ®‹ã—ã¦ãŠãã€‚ Rubyç¿’ã„ãŸã¦ã§æ›¸ã„ãŸã®ã§è‰²ã€…ä¿®æ£ã™ã‚‹ã¨ã“ã‚ã‚‚ã‚ã‚Šãã†ã€‚ #! ruby -Ks # Â â—‹â—‹â—‹ã‚µã‚¤ãƒˆã‚¯ãƒãƒ¼ãƒ©ãƒ¼ # # Â åˆ©ç”¨æ–¹æ³•ï¼šã‚³ãƒžãƒ³ãƒ‰ãƒ©ã‚¤ãƒ³ã‚ˆã‚Šå®Ÿæ–½ # Â ruby site_crawler.rb å¼•æ•°1 # # Â å¼•æ•°1:ãªã—ã€€â†’Typeã®ã™ã¹ã¦ã‚’å–å¾— # Â å¼•æ•°1:ç¨®åˆ¥åç§°ã€€â†’Typeã«ä¸€è‡´ã™ã‚‹ã‚‚ã®ã ã‘ã‚’å–å¾— # Â ä¾‹ï¼‰ ruby site_crawler.rb æŠ•è³‡ç”¨ãƒžãƒ³ã‚·ãƒ§ãƒ³ Â ##æŠ•è³‡ç”¨ãƒžãƒ³ã‚·ãƒ§ãƒ³ã®ã¿å–å¾— # Â ä¾‹ï¼‰ ruby site_crawler.rb Â Â Â Â Â Â Â Â Â Â ##ã™ã¹ã¦å–å¾— # # Â å‡ºåŠ›ã•ã‚Œã‚‹CSVã¯ã€Shift-JISã€€ã‚¿ãƒ–åŒºåˆ‡ã‚Šã€€æ”¹è¡Œã‚³ãƒ¼ãƒ‰:CRFL require 'rubygems' require 'mechanize' requ
fjwr38 2011/10/23
ruby

ã‚¯ãƒãƒ¼ãƒ©
ãƒªãƒ³ã‚¯
rubyã§ã‚¯ãƒãƒ¼ãƒ©ãƒ¼ã‚’æ›¸ã„ã¦ã¿ãŸ - å±±ç¾Šã®é ã®æ—¥è¨˜
ï¼’ã¡ã‚ƒã‚“ãã‚‹ã®ã‚¹ãƒ¬ãƒƒãƒ‰ï¼ˆdatè½ã¡å«ã‚€ï¼‰ã‚¿ã‚¤ãƒˆãƒ«ã‚’å–å¾—ã™ã‚‹ã€‚ #!/usr/bin/ruby -KU -w require 'net/http' require 'kconv' def getfile(url) content='' begin res = Net::HTTP.get_response(URI.parse(url)) if res.code == '200' content=res.body.toutf8 end rescue end content end def scanhref(url,re) getfile(url).scan(re) end scanhref( 'http://menu.2ch.net/bbstable.html', /<A HREF=(http\S+).*?>(.+?)<\/A>/ ).each do |url, title| scanhref(
fjwr38 2011/10/23
ruby

ã‚¯ãƒãƒ¼ãƒ©
ãƒªãƒ³ã‚¯
jamboree.jpÂ -Â jamboree ãƒªã‚½ãƒ¼ã‚¹ãŠã‚ˆã³æƒ…å ±
This webpage was generated by the domain owner using Sedo Domain Parking. Disclaimer: Sedo maintains no relationship with third party advertisers. Reference to any specific service or trade mark is not controlled by Sedo nor does it constitute or imply its association, endorsement or recommendation.
fjwr38 2011/10/23
ruby

ã‚¯ãƒãƒ¼ãƒ©
ãƒªãƒ³ã‚¯
EventMachineã‚’ä½¿ã£ãŸã‚¯ãƒãƒ¼ãƒ©ã®æ›¸ãæ–¹ã®è¶³ãŒã‹ã‚Š
Photo by pnoeric ã„ã¾ã€PhotoShareã§ä½¿ã†ãŸã‚ã«ã€é«˜é€ŸãªEvent Drivenæ–¹å¼ã®ãƒãƒƒãƒˆãƒ¯ãƒ¼ã‚¯ãƒ©ã‚¤ãƒ–ãƒ©ãƒªã€EventMachineã‚’èª¿ã¹ã¦ã„ã¾ã™ã€‚ ã“ã®EventMachineã€ã»ã¨ã‚“ã©ã®å ´åˆã¯ã‚µãƒ¼ãƒã‚’ä½œã‚‹ã¨ãã«ä½¿ã‚ã‚Œã¦ã„ã¾ã™ãŒã€HTTPã‚¯ãƒ©ã‚¤ã‚¢ãƒ³ãƒˆã®æ©Ÿèƒ½ã‚‚å®Ÿè£…ã•ã‚Œã¦ãŠã‚Šã€å®Ÿã¯ã‚¯ãƒãƒ¼ãƒ©ã®æ§˜ãªç‰©ã‚’ä½œã‚‹ã¨ãã«ã‚‚åˆ©ç”¨ã™ã‚‹ã“ã¨ãŒã§ãã¾ã™ã€‚ ä»Šå›žã¯ã“ã£ã¡ã‚’ä½¿ã„ãŸã‹ã£ãŸã®ã§ã™ãŒã€ã‚°ã‚°ã£ã¦ã‚‚ã»ã¨ã‚“ã©æƒ…å ±ãŒå‡ºã¦ã“ãªã‹ã£ãŸã®ã§ã€Seattle.rbã§ç›¸è«‡ã—ãŸã¨ã“ã‚ã€Aaronã•ã‚“(RubyKaigi 2008ã§ãƒ—ãƒ¬ã‚¼ãƒ³ã—ã¦ã„ã‚‹ã®ã‚’ustã§è¦‹ã¦ã‚³ãƒ³ã‚¿ã‚¯ãƒˆã—ã¾ã—ãŸ)ã‹ã‚‰ã‚µãƒ³ãƒ—ãƒ«ãŒè²°ãˆãŸã®ã§ã€ãã‚Œã‚’å…ƒã«ã€åŒæ™‚æŽ¥ç¶šã™ã‚‹æ§˜ã«ã—ã¦ã¿ã¾ã—ãŸã€‚ ã“ã®ã‚³ãƒ¼ãƒ‰ã ã‘ã ã¨å½¹ã«ã¯ç«‹ã¡ã¾ã›ã‚“ãŒã€æƒ…å ±ãŒå°‘ãªã‹ã£ãŸã®ã§å‚è€ƒã«ä¸Šã’ã¦ãŠãã¾ã™ã€‚ require 'rubygems' require 'eventma
fjwr38 2011/10/23
ã‚¯ãƒãƒ¼ãƒ©

ruby
ãƒªãƒ³ã‚¯
83's : Rubyã®URIãƒ©ã‚¤ãƒ–ãƒ©ãƒªãŒã‚¯ãƒãƒ¼ãƒ©ã«æœ€é©éŽãŽã‚‹ä»¶
URI#+ãŒè³¢ã„ã£ã¦è©±ã‚’ä»¥å‰æ›¸ã„ãŸã‚“ã ã‘ã©ã€ ã•ã‚‰ã«ã“ã‚“ãªæŒ¯ã‚‹èˆžã„ã‚’ã™ã‚‹ã“ã¨ã‚’ã•ã£ãçŸ¥ã£ãŸã€‚ uri = URI.parse('http://fg-180.katamayu.net') (uri + 'http://twitter.com/yazu').to_s #=> "http://twitter.com/yazu" ã¨ã“ã‚ã§ã€//a/@hrefã‚’ã¶ã£ã“æŠœãã¨å¤§ä½“ /abc/def.html ghi.html ../jkl.html http://mno.pqr.com ã¨ã„ã†æ„Ÿã˜ã§å½¢å¼ãŒã°ã‚‰ã‘ã¦ã‚‹ã‚“ã ã‘ã©ã€ ä»Šã„ã‚‹ãƒšãƒ¼ã‚¸ã®URIã¨+ã™ã‚‹ã ã‘ã§ã“ã‚ŒãŒã‚ãƒ¬ã‚¤ã«ãªã£ã¦ã—ã¾ã†ã€‚ current_uri = URI.parse('http://example.com/123/') (current_uri + '/abc/def.html').to_s #=> "http://example.
fjwr38 2011/10/23
ruby

ã‚¯ãƒãƒ¼ãƒ©
ãƒªãƒ³ã‚¯
Rubyã§ã‚¯ãƒãƒ¼ãƒ©ãƒ¼ - BitArts Blog
ãƒªãƒ³ã‚¯ã ã‘ã˜ã‚ƒãªãã€ãƒ•ã‚©ãƒ¼ãƒ ã€ã‚¤ãƒ¡ãƒ¼ã‚¸ã€ãƒ•ãƒ¬ãƒ¼ãƒ ã¾ã§ãŒã£ã¤ã‚ŠåŽé›†ã—ã¦ãã‚Œã‚‹ã‚¯ãƒãƒ¼ãƒ©ãƒ¼ãŒæ¬²ã—ã‹ã£ãŸã‚“ã ã‘ã©wgetã§ã¯ã§ããªã„ã‚ˆã†ãªã®ã§è‡ªä½œã™ã‚‹ã“ã¨ã«ã—ãŸã€‚ ãƒ•ã‚©ãƒ¼ãƒ ã®ãƒ•ã‚£ãƒ¼ãƒ«ãƒ‰ã‚’é›†ã‚ãŸã‚Šã™ã‚‹ã®ã€ã¡ã‚‡ã£ã¨å¤§å¤‰ãã†ã ãªã€‚ã€‚ã¨æ€ã£ãŸã‚“ã ã‘ã©ã€WWW::Mechanizeã¨ã„ã†ãƒ©ã‚¤ãƒ–ãƒ©ãƒªã‚’ä½¿ã£ãŸã‚‰è¶…ç°¡å˜ã ã£ãŸã€‚ãƒ“ãƒMechanizeï¼ require "rubygems" require "mechanize" class CrawlerListener def notify_begin end def pre_request end def notify_response(result) puts %Q{#{result[:method]} #{result[:uri]} #{result[:query] ? result[:query].inspect : ""}} end def post_
fjwr38 2011/10/12
ã‚¯ãƒãƒ¼ãƒ©

ruby
ãƒªãƒ³ã‚¯
1