[B! scraping] hkjã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

hkj id:hkj

scrapingã«é–¢ã™ã‚‹hkjã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (4)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

Node.jsã§Webã‚µã‚¤ãƒˆã®æ›´æ–°ãƒã‚§ãƒƒã‚¯ã‚’è‡ªå‹•åŒ–ã™ã‚‹ - ã»ã‚“ã˜ã‚ƒã‚‰ãã£ã¨
ç‰¹å®šã®Webã‚µã‚¤ãƒˆã‚’å®šæœŸçš„ã«ãƒã‚§ãƒƒã‚¯ã—ã¦ç‰¹å®šã®ã‚ãƒ¼ãƒ¯ãƒ¼ãƒ‰ãŒå«ã¾ã‚Œã¦ã„ãŸã‚‰ é€šçŸ¥ã—ã¦ãã‚Œã‚‹ä»•çµ„ã¿ã‚’1ã¤è¦šãˆã¦ãŠãã¨è‰²ã€…é‡å®ã™ã‚‹ã€‚ ä¾‹ãˆã° ä¼šç¤¾ã«ç¤¾å“¡ç”¨Webã‚µã‚¤ãƒˆãŒã‚ã‚‹ãªã‚‰ã€ ï¼ˆãã—ã¦ãã®ã‚µã‚¤ãƒˆãŒRSSã‚‚ãƒ¡ãƒ¼ãƒ«é€šçŸ¥ã‚‚æä¾›ã—ã¦ãªã„ãªã‚‰ï¼‰ ãã“ã«ã€Œé‡è¦ã€ã¨ã‹ã€Œäººäº‹ã€ã¨ã‹ã®ã‚ãƒ¼ãƒ¯ãƒ¼ãƒ‰ã‚’å«ã‚€è¨˜äº‹ãŒæŠ•ç¨¿ã•ã‚ŒãŸæ™‚ã« é€šçŸ¥ã‚’å—ã‘å–ã‚Œã‚‹ã‚ˆã†ã«ã—ã¦ãŠã‘ã°ã€ ã„ã¡ã„ã¡ã‚µã‚¤ãƒˆã‚’ãƒã‚§ãƒƒã‚¯ã—ã«ã„ã‹ãªãã¦ã‚‚ é€ƒã•ãšç¢ºèªã§ãã‚‹ã€‚ ã¾ãŸã€Webã‚¹ã‚¯ãƒ¬ã‚¤ãƒ”ãƒ³ã‚°ã™ã‚‹æ–¹æ³•ã‚’è¦šãˆã¦ãŠã‘ã°ã€ é€šçŸ¥ã‚’å—ã‘å–ã‚‹ä»¥å¤–ã«ã‚‚ã€ ç”»é¢ã‚ãƒ£ãƒ—ãƒãƒ£ã®æ’®å½±ã‚„ç”»åƒã‚„ãƒ†ã‚ã‚¹ãƒˆã®åŽé›†ã‚’ è‡ªå‹•åŒ–ã—ãŸã‚Šã€ä½œæˆã—ãŸWebã‚·ã‚¹ãƒ†ãƒ ã®ç”»é¢ãƒ†ã‚¹ãƒˆã‚’è¡Œã†ã€ ç‰ã®å¿œç”¨ã‚‚ã—ã‚„ã™ããªã‚‹ã€‚ ä»Šå›žã¯ Node.js + Grunt + cheerio-httpcli ã‚’ä½¿ç”¨ã—ã¦ æ‰‹è»½ã«Webã‚µã‚¤ãƒˆã®ãƒ‡ãƒ¼ã‚¿ã‚’ãƒã‚§ãƒƒã‚¯ã™ã‚‹æ–¹æ³•ã‚’ç´¹ä»‹ã™ã‚‹ã€‚ ä»Šé€±ã®ã€Œä¸–ç•Œã®æžœã¦ã¾ã§ã‚¤ãƒƒãƒ†ï¼±ï¼ã€ã§ã€ŒQTu
hkj 2017/10/22
node.js

scraping
ãƒªãƒ³ã‚¯
Rubyã¨ã‹ä½¿ã£ã¦ã‚¯ãƒãƒ¼ãƒªãƒ³ã‚°ã‚„ã‚¹ã‚¯ãƒ¬ã‚¤ãƒ”ãƒ³ã‚°ã™ã‚‹ãƒŽã‚¦ãƒã‚¦ã‚’å…¬é–‹ã—ã¦ã¿ã‚‹ï¼ - ç—…ã¿ã¤ãã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ãƒ–ãƒã‚°
ä»Šã¾ã§ä½•åº¦ã‚‚ã‚¹ã‚¯ãƒ¬ã‚¤ãƒ”ãƒ³ã‚°ã¨ã‹ã‚¯ãƒãƒ¼ãƒªãƒ³ã‚°ã‚’ã—ã¦ããŸã®ã§ã€ãƒžã‚¨ã‚·ãƒ§ãƒªã‚¹ãƒˆã®ç«¯ãã‚Œã¨ã—ã¦ã‚³ãƒ„ã‚’å…¬é–‹ã™ã¹ãã‹ãªã‚ã€ã¨æ€ã„ã€å…¬é–‹ã—ã¾ã™ã€‚ ä»Šæ—¥ã®é¡Œæã¯ã€CNET Newsã§ã™ã€‚ç§ã¯ã‚¦ã‚§ãƒ–æ–‡æ›¸ã«ã‚¿ã‚°ä»˜ã‘ã‚’ã™ã‚‹ã¨ã„ã†ç ”ç©¶ã‚’ã—ã¦ã„ã‚‹ã®ã§ã™ãŒã€ãã®ãŸã‚ã®æ•™å¸«ãƒ‡ãƒ¼ã‚¿ã¨ã—ã¦ã‚¯ãƒãƒ¼ãƒªãƒ³ã‚°ã‚’ã—ã¾ã™ã€‚ photo by Sean MacEntee è¦ä»¶å®šç¾© CNET Newsã‹ã‚‰å…¨ãƒ‹ãƒ¥ãƒ¼ã‚¹ã‚’ä¿å˜ã—ã€ãã®æœ¬æ–‡ã‚’ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã«ä¿å˜ã—ã¾ã™ã€‚ã“ã‚Œã¯ã€æ¬¡ã®ã‚ˆã†ãªãƒ•ãƒãƒ¼ã«æ›¸ãä¸‹ã™ã“ã¨ãŒã§ãã¾ã™ã€‚ å…¨URLã‚’å–å¾—ã—ã€ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã«ä¿å˜ ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã«ã‚ã‚‹å…¨URLã‚’ãƒ€ã‚¦ãƒ³ãƒãƒ¼ãƒ‰ã™ã‚‹ ä¿å˜ã—ãŸå…¨ãƒšãƒ¼ã‚¸ã‚’è§£æžã—ã¦ã€æœ¬æ–‡ã‚’ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã«ä¿å˜ã™ã‚‹ ã¨ã„ã†æµã‚Œã§ã™ã€‚ã“ã‚Œã‚‰ã¯ç‹¬ç«‹ã—ã¦ã„ã¾ã™ã‹ã‚‰ã€ãã‚Œãžã‚Œã©ã®è¨€èªžã§è§£æžã—ã¦ã‚‚æ§‹ã„ã¾ã›ã‚“ã€‚ã—ã‹ã—å¾Œè¿°ã—ã¾ã™ãŒã€ã€Œã‚ã¨ã‹ã‚‰è¿½ã„ã‚„ã™ãã™ã‚‹ã€ã€Œé©æé©æ‰€ã€ã¨ã„ã£ãŸã‚ãŸã‚Šã‚’æ°—ã‚’ã¤ã‘ã¦ã€è¨€èªžé¸æŠžã‚’ã™ã‚‹ã¹ãã ã¨
hkj 2014/01/01
ruby

ã‚¹ã‚¯ãƒ¬ã‚¤ãƒ”ãƒ³ã‚°

scraping
ãƒªãƒ³ã‚¯
åœ°ç„ã®Rubyæœå¹Œã®ã€Œå¥³ã«æƒšã‚Œã•ã™é€†å¼•ããƒ¬ã‚·ãƒ”é›†ã€
ã“ã‚Œã¯ Rubyé€†å¼•ããƒ¬ã‚·ãƒ”Advent Calendar ã®å‚åŠ ã‚¨ãƒ³ãƒˆãƒªã§ã™ã€‚12æœˆ17æ—¥ã‚’æ‹…å½“ã—ã¾ã™ã€‚å‰æ—¥ã®æ‹…å½“ã¯ @y_ogagaga ã•ã‚“ã§ iCalendarå½¢å¼ã®ãƒ‡ãƒ¼ã‚¿ã‚’èªã¿æ›¸ãã—ãŸã„ã§ã—ãŸã€‚ è·å ´ã¨ã‹å¦æ ¡ã§ã€Rubyã«è©³ã—ã„é ¼ã‚Šã«ãªã‚‹å…ˆè¼©ãŒã„ã‚‹ã£ã¦ã„ã†ã®ã¯ã€ã“ã‚“ãªæ„Ÿã˜ãªã‚“ã˜ã‚ƒãªã‹ã‚ãƒ¼ã‹ã¨æƒ³åƒã™ã‚‹ã€‚ã€Œã“ã†ã„ã†ã“ã¨ã—ãŸã„ã‚“ã§ã™ã‘ã©ï¼Ÿã€ã¨èžã„ã¦ã¿ã‚‹ã¨ã€Œã‚ã‚ã€ã“ã‚Œã§ã§ãã‚‹ã‚ˆã€ã¨ä¸€çž¬ã§è¿”ã£ã¦ãã‚‹ã‚ˆã†ãªã€‚ ãƒ¬ã‚·ãƒ”å…ˆè¼©ï¼ˆä»®ç§°ï¼‰ã¯ã„ã‚ã„ã‚ãªãƒ©ã‚¤ãƒ–ãƒ©ãƒªã‚’çŸ¥ã£ã¦ã‚‹ã€‚ã ã‹ã‚‰ç¬¬1ç« ã®1.1ã«æ›¸ã„ã¦ã‚ã‚‹ã®ã¯Rubyã®ã‚³ãƒ¼ãƒ‰ã®æ›¸ãæ–¹ã˜ã‚ƒã‚ãªãã¦ã€æœ‰ç„¡ã‚’ã„ã‚ã•ãšrubygemsã‚’ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã—ã¦ä½¿ã†ã€ã¨ã„ã†ã“ã¨ã ã€‚ãƒ¬ã‚·ãƒ”å…ˆè¼©ã¯IRCã‚’ã°ã‚Šã°ã‚Šä½¿ã†ã€‚ã ã‹ã‚‰ç¬¬6ç« ãƒãƒƒãƒˆãƒ¯ãƒ¼ã‚¯å‡¦ç†ã®ã¯ã˜ã‚ã¯ã€ã‚¦ã‚§ãƒ–ã˜ã‚ƒãªãã£ã¦IRC BOTã®ã¤ãã‚Šã‹ãŸã ã€‚ãƒ¬ã‚·ãƒ”å…ˆè¼©ã¯ã„ã‚ã„ã‚ãªã‚³ãƒŸãƒ¥ãƒ‹ãƒ†ã‚£ã«å‚åŠ ã—ã¦ã„ã‚‹ã€‚ã ã‹ã‚‰æœ€å¾Œã®ç¬¬24ç«
hkj 2010/12/26
ruby

nokogiri

scraping
ãƒªãƒ³ã‚¯
Rubyã§2ã¡ã‚ƒã‚“ãã‚‹ã®ã‚¹ãƒ¬ã‚’èªã‚€ - hitode909ã®æ—¥è¨˜
Rubyã§2ã¡ã‚ƒã‚“ãã‚‹ã®ã‚¹ãƒ¬ã‚’èªã¿ãŸã‹ã£ãŸã®ã§ï¼Œèª¿ã¹ã¦ã¿ã‚‹ã¨ï¼Œ2ã¡ã‚ƒã‚“ãã‚‹BOTã®ä½œã‚Šæ–¹ã‚’è©³ç´°ã«è§£èª¬ã—ã¦ãã‚Œã¦ã„ã‚‹äººãŒã„ãŸï¼Ž 2ã¡ã‚ƒã‚“ãã‚‹BOTã®ä½œã‚Šæ–¹ æº–å‚™ç·¨ - GIOã®æ—¥è¨˜ 2ã¡ã‚ƒã‚“ãã‚‹BOTã®ä½œã‚Šæ–¹ è¨è¨ˆç·¨ - GIOã®æ—¥è¨˜ 2ã¡ã‚ƒã‚“ãã‚‹BOTã®ä½œã‚Šæ–¹ å®Ÿè£…ç·¨1 - GIOã®æ—¥è¨˜ 2ã¡ã‚ƒã‚“ãã‚‹BOTã®ä½œã‚Šæ–¹ å®Ÿè£…ç·¨2 - GIOã®æ—¥è¨˜ è¨˜äº‹å†…ã®ã‚½ãƒ¼ã‚¹ã‚³ãƒ¼ãƒ‰ã®ãƒªãƒ³ã‚¯ã¯åˆ‡ã‚Œã¦ã„ãŸã‘ã©ï¼ŒGitHubã§å…¬é–‹ã•ã‚Œã¦ãŸï¼Ž gioext/bot2ch Â· GitHub ã‚¹ãƒ¬ã®å†…å®¹ã‚’ãƒ‘ãƒ¼ã‚¹ã™ã‚‹å‡¦ç†ã¨ã‹ãŒãªã‹ã£ãŸã®ã§ï¼Œforkã—ã¦æ¬²ã—ã„æ©Ÿèƒ½ã‚’å‹æ‰‹ã«å®Ÿè£…ã—ãŸï¼Ž hitode909/bot2ch Â· GitHub è©¦ã—ã«ã“ã‚Œã‚’ä½¿ã£ã¦ï¼Œãƒ©ãƒ¼ãƒ¡ãƒ³æ¿ã®ï¼Œã‚¿ã‚¤ãƒˆãƒ«ã«ã“ã£ã¦ã‚Šã‚’å«ã‚€ã‚¹ãƒ¬ã®æœ€æ–°ã®ãƒ¬ã‚¹ã‚’è¡¨ç¤ºã—ã¦ã¿ã‚‹ï¼Ž require 'bot2ch' menu = Bot2ch::Menu.new board = m
hkj 2009/10/08
2ch

bot

ruby

scraping
ãƒªãƒ³ã‚¯
1