[B! scraping] ichi_Sã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

ichi_S id:ichi_S

scrapingã«é–¢ã™ã‚‹ichi_Sã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (4)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

ã‚¹ã‚¯ãƒ¬ã‚¤ãƒ”ãƒ³ã‚°ã®ãŸã‚ã®Nokogiriåˆ©ç”¨ãƒ¡ãƒ¢ - ãã‚Œã¯ãã‚Œã€ã“ã‚Œã¯ã“ã‚Œ
ã‚¹ã‚¯ãƒ¬ã‚¤ãƒ”ãƒ³ã‚°ã®ãƒãƒ¥ãƒ¼ãƒˆãƒªã‚¢ãƒ«ã‚’æ›¸ã„ã¦ã¿ãŸã€‚ å‚è€ƒï¼šhttp://nokogiri.rubyforge.org/nokogiri/Nokogiri.html ã¾ã ã¾ã ãŸãã•ã‚“ã®ã‚¯ãƒ©ã‚¹ã‚„ãƒ¡ã‚½ãƒƒãƒ‰ãŒã‚ã‚‹ãŒ(èªã‚“ã§ãªã„)ã€HTMLã®ã‚¹ã‚¯ãƒ¬ã‚¤ãƒ”ãƒ³ã‚°ã«é™å®šã™ã‚Œã°å¤šåˆ†ã“ã‚Œãã‚‰ã„ã§ååˆ†ã€‚ 2014-02-16è¿½è¨˜ ãªã‚“ã‹ãŸãã•ã‚“ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ã•ã‚Œã¦ã„ã‚‹ã“ã¨ã«æ°—ã¥ã„ãŸã®ã§ã€ã‚µãƒ³ãƒ—ãƒ«ã‚³ãƒ¼ãƒ‰ã®Ruby1.9/2å¯¾å¿œã®ã‚¢ãƒƒãƒ—ãƒ‡ãƒ¼ãƒˆã€‚ Mechanizeå‘¨ã‚Šã‚‚ä¿®æ£ã€‚WWW::Mechanize â†’ Mechanize ç‰ (0) å‰æçŸ¥è˜ Rubyã€HTMLã€DOMã€CSSã‚»ãƒ¬ã‚¯ã‚¿ã¾ãŸã¯XPath (1) ã‚¯ãƒ©ã‚¹æ§‹é€ ã®ç†è§£ Nokogiri::HTML::Document < Nokogiri::XML::Document < Nokogiri::XML::Node < Object Nokogiri::XML::
ichi_S 2012/05/09
html

Ruby

scraping

nokogiri
ãƒªãƒ³ã‚¯
Rails3 ã¨ jQuery ã§çœŸé¢ç›®ã«ã‚ªã‚·ãƒ£ãƒ¬ãªã‚¨ãƒã‚µã‚¤ãƒˆã‚’ã¤ãã£ã¦ã¿ã¾ã—ãŸ
ã„ã¤ãžã‚„ã®é£²ã¿ä¼šã§ã€ ã“ã‚Œã ã‘ã‚¦ã‚§ãƒ–ã®æŠ€è¡“ãŒé€²åŒ–ã—ã¦ã„ã‚‹ã®ã ã‹ã‚‰ã€ã‚‚ã£ã¨ã‚ªã‚·ãƒ£ãƒ¬ãªã‚¨ãƒã‚µã‚¤ãƒˆãŒã‚ã£ã¦ã‚‚ã„ã„ã‚“ã§ãªã„ã‹ã„ï¼Ÿ << ã¨ã„ã†è©±ã«ãªã‚Šã¾ã—ã¦ã€‚ ã ã‘ã©ã©ã†ã›ä½œã‚‹ã‚“ãªã‚‰ã¨ã„ã†ã“ã¨ã§ã€Rails3 ã¨ jQuery ã‚’ä½¿ã£ã¦çµæ§‹ãƒžã‚¸ãƒ¡ã«ã¤ãã£ã¦ã¿ã¾ã—ãŸã€‚ ï¼ˆâ€»å¤§äººã®äº‹æƒ…ã«ã‚ˆã‚Šã€ãƒªãƒ³ã‚¯ã¯ã‚„ã‚€ãªãå‰Šé™¤ã—ã¾ã—ãŸï¼‰ å½“åˆã¯ã‚¨ãƒã«ã‚ªã‚·ãƒ£ãƒ¬ã¯å¿…è¦ãªã„ã®ã‹ãªãƒ¼ã¨æ€ã£ãŸã¨ãã‚‚ã‚ã‚Šã¾ã—ãŸãŒã€ã„ã–ã¤ãã£ã¦ã¿ã‚‹ã¨ã€ã‚„ã£ã±ã‚Šé¸ã¹ã‚‹ãªã‚‰ã‚ªã‚·ãƒ£ãƒ¬ãªã‚„ã¤ã®æ–¹ãŒãŒã„ã„ã‚ˆãã€ã¨ã„ã†çµè«–ã«è½ã¡ç€ãã¾ã—ãŸã€‚ ä»Šå›žã¤ãã£ãŸã®ã¯è©¦é¨“çš„ãªã‚‚ã®ãªã®ã§ 90æ—¥é–“é™å®šã§ã—ã‹å…¬é–‹ã—ãªã„ã¤ã‚‚ã‚Šã§ã™ãŒã€æ—¥æœ¬ã®ã‚¨ãƒã‚µã‚¤ãƒˆãŒä»Šå¾Œã‚‚ã£ã¨ã‚ªã‚·ãƒ£ãƒ¬ã«ç™ºå±•ã—ã¦ã„ããã£ã‹ã‘ã«ãªã£ã¦ãã‚ŒãŸã‚‰å¬‰ã—ã„ã§ã™ã€‚ ä»¥ä¸‹ã€ã‚µã‚¤ãƒˆã®ã‚³ãƒ³ã‚»ãƒ—ãƒˆã‚„ä½¿ã£ã¦ã„ã‚‹æŠ€è¡“ã«ã¤ã„ã¦ã¾ã¨ã‚ã¦ã¿ã¾ã™ã€‚ **Rails3 ã¨ jQuery ã§çœŸé¢ç›®ã«ã‚ªã‚·ãƒ£ãƒ¬ãªã‚¨ãƒã‚µã‚¤ãƒˆã‚’ã¤ãã£ã¦ã¿ã¾ã—ãŸ 1
ichi_S 2012/04/20
rails3

ruby

jquery

scraping
ãƒªãƒ³ã‚¯
Ruby Scraping - FrontPage
Rubyã«ã‚ˆã‚‹Web Scrapingãƒ©ã‚¤ãƒ–ãƒ©ãƒªã®æƒ…å ±ã‚’ã¾ã¨ã‚ã‚‹ãŸã‚ã®Wikiã§ã™ã€‚ Nokogiri HTMLã‚’jQueryé¢¨ã«æ“ä½œã™ã‚‹ãƒ©ã‚¤ãƒ–ãƒ©ãƒªã€‚Hpricotã®æ›¸ãç›´ã—ç‰ˆ Hpricot HTMLã‚’ã€ŒRubyã‚‰ã—ãã€æ‰±ã†ãƒ©ã‚¤ãƒ–ãƒ©ãƒª Mechanize Webã‚µã‚¤ãƒˆã¸è‡ªå‹•ã§ã‚¢ã‚¯ã‚»ã‚¹ã™ã‚‹ãŸã‚ã®ãƒ©ã‚¤ãƒ–ãƒ©ãƒª scRUBYt! DSLã‚’ä½¿ã£ã¦ç°¡å˜ã«ã‚¹ã‚¯ãƒ¬ã‚¤ãƒ”ãƒ³ã‚°ã‚’è¡Œã†ãƒ©ã‚¤ãƒ–ãƒ©ãƒª feedalizer htmlã‹ã‚‰RSSãƒ•ã‚£ãƒ¼ãƒ‰ã‚’ä½œã‚‹ã®ã«å½¹ç«‹ã¤ãƒ©ã‚¤ãƒ–ãƒ©ãƒª scrAPI ãƒ‘ãƒ¼ã‚µã‚’å®šç¾©ã™ã‚‹ã“ã¨ã§HTMLã‚’è§£æžã™ã‚‹ãƒ©ã‚¤ãƒ–ãƒ©ãƒª ã‚¦ã‚§ãƒ–ã‚µã‚¤ãƒˆã‹ã‚‰å¿…è¦ãªãƒ‡ãƒ¼ã‚¿ã‚’æŠ½å‡ºã™ã‚‹ã“ã¨ã€‚(Scrape = å‰Šã‚Šå–ã‚‹) ãƒ©ã‚¤ãƒ–ãƒ©ãƒªã«ã‚ˆã£ã¦ã¯ã€å—ä¿¡ã—ãŸãƒ‡ãƒ¼ã‚¿ã®è§£æžã ã‘ã§ãªããƒ‡ãƒ¼ã‚¿ã®é€ä¿¡ã«ã‚‚å¯¾å¿œã—ã¦ã„ã‚‹ã€‚ ä¾‹ï¼š RSSã‚’é…ä¿¡ã—ã¦ã„ãªã„ã‚¦ã‚§ãƒ–ã‚µã‚¤ãƒˆã®HTMLã‚’ã‚¹ã‚¯ãƒ¬ã‚¤ãƒ”ãƒ³ã‚°ã—ã¦é‡Žè‰¯RSSã‚’ä½œã‚‹ Googleã®æ¤œç´¢çµæžœã‚’ã‚¹ã‚¯ãƒ¬ã‚¤
ichi_S 2011/02/04
scraping

ruby

library
ãƒªãƒ³ã‚¯
ç°¡å˜ï¼ãŸã£ãŸï¼–è¡Œã®ã‚³ãƒ¼ãƒ‰ã§ HTMLå–å¾—ï¼†è§£æžã‚’ã™ã‚‹PHPã‚¹ã‚¯ãƒªãƒ—ãƒˆ - é ã„ç›®æ—¥è¨˜
Re:ç°¡å˜ï¼ãŸã£ãŸï¼‘ï¼“è¡Œã®ã‚³ãƒ¼ãƒ‰ã§ HTMLå–å¾—ï¼†è§£æžã‚’ã™ã‚‹Perlã‚¹ã‚¯ãƒªãƒ—ãƒˆ - DQNEOèµ·æ¥æ—¥è¨˜ ã«æ„ŸåŒ–ã•ã‚Œã¦ã€PHPç‰ˆã‚’ä½œã£ã¦ã¿ã¾ã—ãŸã€‚ ãƒ‘ãƒ¼ã‚¹ãƒ©ã‚¤ãƒ–ãƒ©ãƒªã¯ä»¥ä¸‹ã‚’ä½¿ã„ã¾ã™ã€‚ http://sourceforge.net/projects/simplehtmldom/ require_once('simple_html_dom.php'); $url = 'http://www.yahoo.co.jp/'; $user_agent = "Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0)"; $dom = file_get_html($url,false, stream_context_create( array( 'http' => array( 'header' => "User-Agent: " . $
ichi_S 2010/06/07
php

scraping

html
ãƒªãƒ³ã‚¯
1