[B! scrAPI] griffin-stewieã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

griffin-stewie id:griffin-stewie

scrAPIã«é–¢ã™ã‚‹griffin-stewieã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (5)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

scrAPIã‚’è©¦ã™ã€‚ - ã¿ãšã´ãƒ¼æ—¥è¨˜
30åˆ†ãƒ—ãƒã‚°ãƒ©ãƒ ã€ãã®155ã€‚Rubyã®ã‚¹ã‚¯ãƒ¬ã‚¤ãƒ”ãƒ³ã‚°ãƒ„ãƒ¼ãƒ«ã‚ãƒƒãƒˆ scrAPIã‚’å‚è€ƒã«ã€scrAPIã‚’è©¦ã™ã€‚ æœ€åˆã¯ã€URLã‚’å…¥åŠ›ã™ã‚‹ã¨ä½•äººãŒLivedoor Readerã¨ã‹ã§è³¼èªã—ã¦ã„ã‚‹ã‹ã‚’è¡¨ç¤ºã™ã‚‹Webã‚µãƒ¼ãƒ“ã‚¹ã‚’ä½œã‚‹ã¤ã‚‚ã‚Šã ã£ãŸã‚“ã ã‘ã©é€”ä¸ã§é¢å€’ã«ãªã£ãŸã€‚ãªã®ã§ã€ã‚³ãƒžãƒ³ãƒ‰ãƒ©ã‚¤ãƒ³ãƒ„ãƒ¼ãƒ«ã§ã©ã†ãžã€‚ å¯¾å¿œã—ã¦ã‚‹ã®ã¯ã€ ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ Livedoor Reader Fastladder ã®3ã¤ã€‚ ä½¿ã„æ–¹ $ ruby popluar.rb http://example.com/ Hatena Bookmark: 9 Livedoor Reader: 0 Fastladder : 0 $ ruby popular.rb http://d.hatena.ne.jp/mzp/ Hatena Bookmark: 6 Livedoor Reader: 49 Fastladder : 16exa
griffin-stewie 2007/10/15
scrAPI

scraping

ruby
ãƒªãƒ³ã‚¯
Ruby Scraping - FrontPage
Rubyã«ã‚ˆã‚‹Web Scrapingãƒ©ã‚¤ãƒ–ãƒ©ãƒªã®æƒ…å ±ã‚’ã¾ã¨ã‚ã‚‹ãŸã‚ã®Wikiã§ã™ã€‚ HpricotHTMLã‚’ã€ŒRubyã‚‰ã—ãã€æ‰±ã†ãƒ©ã‚¤ãƒ–ãƒ©ãƒª MechanizeWebã‚µã‚¤ãƒˆã¸è‡ªå‹•ã§ã‚¢ã‚¯ã‚»ã‚¹ã™ã‚‹ãŸã‚ã®ãƒ©ã‚¤ãƒ–ãƒ©ãƒª scRUBYt!DSLã‚’ä½¿ã£ã¦ç°¡å˜ã«ã‚¹ã‚¯ãƒ¬ã‚¤ãƒ”ãƒ³ã‚°ã‚’è¡Œã†ãƒ©ã‚¤ãƒ–ãƒ©ãƒª feedalizerhtmlã‹ã‚‰RSSãƒ•ã‚£ãƒ¼ãƒ‰ã‚’ä½œã‚‹ã®ã«å½¹ç«‹ã¤ãƒ©ã‚¤ãƒ–ãƒ©ãƒª scrAPIãƒ‘ãƒ¼ã‚µã‚’å®šç¾©ã™ã‚‹ã“ã¨ã§HTMLã‚’è§£æžã™ã‚‹ãƒ©ã‚¤ãƒ–ãƒ©ãƒª ã‚¦ã‚§ãƒ–ã‚µã‚¤ãƒˆã‹ã‚‰å¿…è¦ãªãƒ‡ãƒ¼ã‚¿ã‚’æŠ½å‡ºã™ã‚‹ã“ã¨ã€‚(Scrape = å‰Šã‚Šå–ã‚‹) ãƒ©ã‚¤ãƒ–ãƒ©ãƒªã«ã‚ˆã£ã¦ã¯ã€å—ä¿¡ã—ãŸãƒ‡ãƒ¼ã‚¿ã®è§£æžã ã‘ã§ãªããƒ‡ãƒ¼ã‚¿ã®é€ä¿¡ã«ã‚‚å¯¾å¿œã—ã¦ã„ã‚‹ã€‚ ä¾‹ï¼š RSSã‚’é…ä¿¡ã—ã¦ã„ãªã„ã‚¦ã‚§ãƒ–ã‚µã‚¤ãƒˆã®HTMLã‚’ã‚¹ã‚¯ãƒ¬ã‚¤ãƒ”ãƒ³ã‚°ã—ã¦é‡Žè‰¯RSSã‚’ä½œã‚‹ Googleã®æ¤œç´¢çµæžœã‚’ã‚¹ã‚¯ãƒ¬ã‚¤ãƒ”ãƒ³ã‚°ã—ã¦è‡ªå‹•ã§Googleæ¤œç´¢ã™ã‚‹ã‚¹ã‚¯ãƒªãƒ—ãƒˆã‚’æ›¸ã ãƒ–ãƒã‚°ã®æŠ•ç¨¿ãƒšãƒ¼ã‚¸ã‚’è§£æžã—ã¦ã€ã‚³ãƒžãƒ³ãƒ‰ãƒ©ã‚¤ãƒ³ã‹ã‚‰
griffin-stewie 2007/10/11
[WWW::Mechanize]

scraping

ruby

html

hpricot

scrAPI

scRUBYt
ãƒªãƒ³ã‚¯
3 æ—¥åŠä¸»æ—¥è¨˜ - æºå¸¯çµµæ–‡å—ã‚³ãƒ¼ãƒ‰ã®ç›¸äº’å¤‰æ›è¡¨ã‚’ä½œã‚‹ã‚¹ãƒ¬
_ æºå¸¯çµµæ–‡å—ã‚³ãƒ¼ãƒ‰ã®ç›¸äº’å¤‰æ›è¡¨ã‚’ä½œã‚‹ã‚¹ãƒ¬ æºå¸¯ã® Web ã¨ãƒ¡ãƒ¼ãƒ«ã§ã¯ã€ä½¿ã†çµµæ–‡å—ã‚³ãƒ¼ãƒ‰ãŒé•ã†ã‚‰ã—ã„ã€‚ PC ã‚„ã‚µãƒ¼ãƒã‹ã‚‰ (Ruby ã‚’ä½¿ã£ã¦) æºå¸¯å®›ã¦ã«é…ä¿¡ã™ã‚‹ãƒ¡ãƒ¼ãƒ«ã§çµµæ–‡å—ã‚’ä½¿ã„ãŸã„ã€‚ ãƒ«ãƒ¼ãƒ«: ã‚ãƒ£ãƒªã‚¢ãŒå…¬é–‹ã—ã¦ã„ã‚‹ãƒ‡ãƒ¼ã‚¿ã‚’å…ƒã«ã™ã‚‹ã€‚ é›»åçš„ã«å¤‰æ›ã™ã‚‹ã€‚ æœ€åˆã‹ã‚‰ãƒ†ã‚ã‚¹ãƒˆå½¢å¼ã§ç”¨æ„ã—ã¦ã„ãªã„ã“ã¨ã«å¯¾ã—ã¦æ‚ªæ„ã‚’æ„Ÿã˜ã‚‹ã€‚ EZweb (AU) xdoc2txt ã§ typeD.pdf ã‹ã‚‰ ãƒ†ã‚ã‚¹ãƒˆè¦ç´ ã‚’æŠ½å‡ºã™ã‚‹ã€‚ $ xdoc2txt -f typeD.pdf å¾—ã‚‰ã‚ŒãŸ typeD.txt ã‹ã‚‰å¤‰æ›è¡¨ã‚’å–ã‚Šå‡ºã™ã€‚ src = IO.read('typeD.txt') src.scan(/[0-9A-F]{16,18}/s) do |str| puts str[-16,16] end 18æ–‡å—æ‹¾ã£ã¦å³ã‹ã‚‰16æ–‡å—æ‹¾ã†ã€‚ã“ã‚Œã¯[0-9A-F]ã‚’å«ã‚€ã‚¿ã‚¤ãƒˆãƒ«ãŒå¤‰æ›è¡¨ã«ãã£ã¤ããŸã‚ã€‚ ä¾‹
griffin-stewie 2007/02/12
ruby

scrAPI

å¤‰æ›

PDF

ãƒ†ã‚ã‚¹ãƒˆ
ãƒªãƒ³ã‚¯
String#scrape - ãƒ½( ãƒ»âˆ€ãƒ»)ãƒŽãã¾ãã¾ãƒ¼(2007-01-15)
â— String#scrape ã©ã†ã›ãŠå‰ã‚‰ã¯ã‚ã‚Œã ã‚ã€scrAPI ã¯å¼·åŠ›ã ã—ã€ã“ã‚Œã“ãè‡ªåˆ†ãŒã¾ã•ã«å¾…æœ›ã—ã¦ãŸé“å…·ã€ä½¿ã„ã“ãªã™ãœï¼ã¨æ„æ°—è¾¼ã‚“ã§ã‚‹ã‚“ã ã‘ã©ã€ã©ã‚Œã ã‘æ±ºæ„ã—ã¦ã‚‚ã‚ã®è¤‡é›‘ãªå¼•æ•°ã«æ¯Žå›žæŒ«æŠ˜ã—ã¡ã‚ƒã£ã¦ã€æŒ«æŠ˜ã¤ãƒ¼ã‹ã¡ã‚‡ã£ã¨ä½¿ã„ãŸã„ã ã‘ãªã®ã«ãƒ‘ãƒ¼ã‚¶(Scrape)ç”¨ã®ã‚¯ãƒ©ã‚¹ã‚’å®šç¾©ã™ã‚‹ã®ãŒé¢å€’ãªã‚“ã ã‚ˆãã€ã¿ãŸã„ãªè¨€ã„è¨³ã‚’æ¯Žå›žè‡ªåˆ†ã«ã—ã¤ã¤ã€çµå±€ä½¿ã„ã“ãªã›ã¦ãªã„è„³å†…ã‚†ã¨ã‚Šä¸–ä»£ã®ãŠå‰ã‚‰ãªã‚“ã ã‘ã©ã€ã¾ãå®Ÿéš›å¼•æ•°ã«ç„¡é§„ã«è‰²ã‚“ãªæ©Ÿèƒ½ã‚’è©°ã‚è¾¼ã¿éŽãŽã¦ã‚‹æ„Ÿã¯å¦ã‚ãªã„ã—ã€ã¨ã„ã†ã‹extractorã®srcã¨dstã¯ã©ã†è¦‹ã¦ã‚‚ç›´æ„Ÿçš„ã«é€†ã ã‚ã€grepã¿ãŸã„ã«ä½¿ã‚ã›ã‚ã‚ˆä½¿ãˆãªã„1ã ãªã€ã¿ãŸã„ãªæ„šç—´ã‚’ã“ã¼ã—ã¦ãŸã‚‰ã€ã‚€ã—ã‚CSS3ãªgrepã¨ã—ã¦ä½¿ãˆã‚‹ã ã‘ã§ã„ã„äº‹ã«æ°—ä»˜ã„ã¦ã€Youã€Stringã‚¯ãƒ©ã‚¹ã«å…¥ã‚Œã¡ã‚ƒã„ãªYOï¼ String#scrape ã®å®šç¾© require 'scrapi' class Strin
griffin-stewie 2007/02/10
ruby

library

html

ã‚¹ã‚¯ãƒ¬ã‚¤ãƒ”ãƒ³ã‚°

scrAPI
ãƒªãƒ³ã‚¯
3 æ—¥åŠä¸»æ—¥è¨˜ - scrapi - ScrAPI toolkit for Ruby
_ [Ruby] scrapi - ScrAPI toolkit for Ruby ruby ã®ã‚¹ã‚¯ãƒ¬ã‚¤ãƒ”ãƒ³ã‚°ãƒ„ãƒ¼ãƒ«ã‚ãƒƒãƒˆ scrAPI $ gem install scrapi ã ã¨lib/ã«libtidy.dll libtidy.soãŒç½®ã‹ã‚Œã‚‹ã®ã ã‘ã© scraper/reader.rb: def find_tidy() return if Tidy.path begin Tidy.path = File.join(File.dirname(__FILE__), "../tidy", "libtidy.so") rescue LoadError begin Tidy.path = File.join(File.dirname(__FILE__), "../tidy", "libtidy.dll") rescue LoadError Tidy.path = File.join(File.
griffin-stewie 2006/10/14
ã‚¹ã‚¯ãƒ¬ã‚¤ãƒ”ãƒ³ã‚°

ruby

scrAPI
ãƒªãƒ³ã‚¯
1

ãŠçŸ¥ã‚‰ã›

ã‚‚ã£ã¨èªã‚€

å…¬å¼Twitter

@hatebu
æœ€æ–°ã®äººæ°—ã‚¨ãƒ³ãƒˆãƒªãƒ¼ã®é…ä¿¡

ã‚ãƒ¼ãƒœãƒ¼ãƒ‰ã‚·ãƒ§ãƒ¼ãƒˆã‚«ãƒƒãƒˆä¸€è¦§

jæ¬¡ã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

kå‰ã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

lã‚ã¨ã§èªã‚€

eã‚³ãƒ¡ãƒ³ãƒˆä¸€è¦§ã‚’é–‹ã

oãƒšãƒ¼ã‚¸ã‚’é–‹ã

è¨å®šã‚’å¤‰æ›´ã—ã¾ã—ãŸx

ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

ã‚¿ã‚°

é–¢é€£ã‚¿ã‚°ã§çµžã‚Šè¾¼ã‚€ (10)

scrAPIã«é–¢ã™ã‚‹griffin-stewieã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (5)

ãŠçŸ¥ã‚‰ã›

ä»Šé€±ã®ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚ãƒ³ã‚°ï¼ˆ2025å¹´1æœˆç¬¬2é€±ï¼‰

æœˆé–“ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚ãƒ³ã‚°ï¼ˆ2024å¹´12æœˆï¼‰

ä»Šé€±ã®ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚ãƒ³ã‚°ï¼ˆ2025å¹´1æœˆç¬¬1é€±ï¼‰

å…¬å¼Twitter

ã‚ãƒ¼ãƒœãƒ¼ãƒ‰ã‚·ãƒ§ãƒ¼ãƒˆã‚«ãƒƒãƒˆä¸€è¦§

ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

å…¬å¼Twitter

ã¯ã¦ãªã®ã‚µãƒ¼ãƒ“ã‚¹

ã‚¿ã‚°

é–¢é€£ã‚¿ã‚°ã§çµžã‚Šè¾¼ã‚€ (10)

scrAPIã«é–¢ã™ã‚‹griffin-stewieã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (5)

scrAPIã‚’è©¦ã™ã€‚ - ã¿ãšã´ãƒ¼æ—¥è¨˜

Ruby Scraping - FrontPage

3 æ—¥åŠä¸»æ—¥è¨˜ - æºå¸¯çµµæ–‡å­—ã‚³ãƒ¼ãƒ‰ã®ç›¸äº’å¤‰æ›è¡¨ã‚’ä½œã‚‹ã‚¹ãƒ¬

String#scrape - ãƒ½( ãƒ»âˆ€ãƒ»)ãƒŽãã¾ãã¾ãƒ¼(2007-01-15)

3 æ—¥åŠä¸»æ—¥è¨˜ - scrapi - ScrAPI toolkit for Ruby

ãŠçŸ¥ã‚‰ã›

ä»Šé€±ã®ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚­ãƒ³ã‚°ï¼ˆ2025å¹´1æœˆç¬¬2é€±ï¼‰

æœˆé–“ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚­ãƒ³ã‚°ï¼ˆ2024å¹´12æœˆï¼‰

ä»Šé€±ã®ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚­ãƒ³ã‚°ï¼ˆ2025å¹´1æœˆç¬¬1é€±ï¼‰

å…¬å¼Twitter

ã‚­ãƒ¼ãƒœãƒ¼ãƒ‰ã‚·ãƒ§ãƒ¼ãƒˆã‚«ãƒƒãƒˆä¸€è¦§

ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

å…¬å¼Twitter

ã¯ã¦ãªã®ã‚µãƒ¼ãƒ“ã‚¹

é–¢é€£ã‚¿ã‚°ã§çµžã‚Šè¾¼ã‚€ (10)

scrAPIã«é–¢ã™ã‚‹griffin-stewieã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (5)

scrAPIã‚’è©¦ã™ã€‚ - ã¿ãšã´ãƒ¼æ—¥è¨˜

3 æ—¥åŠä¸»æ—¥è¨˜ - æºå¸¯çµµæ–‡å—ã‚³ãƒ¼ãƒ‰ã®ç›¸äº’å¤‰æ›è¡¨ã‚’ä½œã‚‹ã‚¹ãƒ¬

String#scrape - ãƒ½( ãƒ»âˆ€ãƒ»)ãƒŽãã¾ãã¾ãƒ¼(2007-01-15)

3 æ—¥åŠä¸»æ—¥è¨˜ - scrapi - ScrAPI toolkit for Ruby

ãŠçŸ¥ã‚‰ã›

ä»Šé€±ã®ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚ãƒ³ã‚°ï¼ˆ2025å¹´1æœˆç¬¬2é€±ï¼‰

æœˆé–“ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚ãƒ³ã‚°ï¼ˆ2024å¹´12æœˆï¼‰

ä»Šé€±ã®ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚ãƒ³ã‚°ï¼ˆ2025å¹´1æœˆç¬¬1é€±ï¼‰

å…¬å¼Twitter

ã‚ãƒ¼ãƒœãƒ¼ãƒ‰ã‚·ãƒ§ãƒ¼ãƒˆã‚«ãƒƒãƒˆä¸€è¦§

ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

å…¬å¼Twitter

ã¯ã¦ãªã®ã‚µãƒ¼ãƒ“ã‚¹