[B! BeautifulSoup] tenfu4teaã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

tenfu4tea id:tenfu4tea

BeautifulSoupã«é–¢ã™ã‚‹tenfu4teaã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (10)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

Phactory: Python: BeautifulSoupã§ã€HTML/XMLã‚’ã‚‰ãã‚‰ããƒ‘ãƒ¼ã‚¸ãƒ³ã‚°
BeautifulSoupã¨ã¯ã€HTML/SGML/XMLã‚’ãƒ‘ãƒ¼ã‚¸ãƒ³ã‚°ã™ã‚‹Pythonãƒ©ã‚¤ãƒ–ãƒ©ãƒªã§ã™ã€‚ ãƒãƒ¼ãƒŸãƒ³ã‚°ã«ã‚»ãƒ³ã‚¹ã‚’æ„Ÿã˜ã•ã›ã‚‹ã“ã®ãƒ©ã‚¤ãƒ–ãƒ©ãƒªã¯ã€å®Ÿç”¨ã¨ã—ã¦è€ƒãˆã¦ã‚‚å¤§å¤‰æœ‰ç”¨ãªãƒ©ã‚¤ãƒ–ãƒ©ãƒªã§ã™ã€‚ ã“ã‚Œã‚’ä½¿ã„å§‹ã‚ã‚‹ã¨ã€ã‚ã‚Šã¨ã‚ã‚‰ã‚†ã‚‹HTML/XMLã‚’ã„ã˜ã‚Šå€’ã—ãŸããªã‚Šã¾ã™ã€‚ ãƒ€ã‚¦ãƒ³ãƒãƒ¼ãƒ‰ BeautifulSoupã¯ã€Pythonã®æ¨™æº–ãƒ©ã‚¤ãƒ–ãƒ©ãƒªã§ã¯ã‚ã‚Šã¾ã›ã‚“ã®ã§ã€ ä½¿ç”¨ã™ã‚‹ãŸã‚ã«ã¯ä»¥ä¸‹ã‚µã‚¤ãƒˆã‹ã‚‰DLï¼†ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã™ã‚‹å¿…è¦ãŒã‚ã‚Šã¾ã™ã€‚ http://www.crummy.com/software/BeautifulSoup/ ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«æ–¹æ³• BeautifulSoup.pyã‚’ä¸Šè¨˜ã‚µã‚¤ãƒˆã‹ã‚‰DLã—ã¦ãã¦ã€ pythonã®ãƒ©ã‚¤ãƒ–ãƒ©ãƒªç½®å ´ã§ã‚ã‚‹ã€Œsite-packages/ã€ã«é…ç½®ã™ã‚‹ã ã‘ã§OKã§ã™ã€‚ ãã®ä¸Šã§ã€ #!/usr/bin/python from BeautifulSoup
tenfu4tea 2009/07/07
BeautifulSoup

python

scraping
ãƒªãƒ³ã‚¯
Google App Engineã¯æ‰‹è»½ã§é¢ç™½ã„ - snuffkinã®éŠã³å ´
Google App Engineã®ã‚¢ã‚«ã‚¦ãƒ³ãƒˆã¯æŒã£ã¦ã„ãŸã®ã§ã™ãŒã€ã“ã‚Œã¾ã§å®Ÿéš›ã«éŠã‚“ã ã“ã¨ã¯ã‚ã‚Šã¾ã›ã‚“ã§ã—ãŸã€‚ã“ã®é–“ã€Pythonã®ã‚½ãƒ¼ã‚¹ã‚’ãƒ‡ãƒãƒƒã‚°ã™ã‚‹æ©Ÿä¼šãŒã‚ã£ãŸã®ã§è§¦ç™ºã•ã‚Œã¦Google App Engineã§éŠã‚“ã§ã¿ã¾ã—ãŸã€‚ ã“ã‚Œã€é¢ç™½ã„ã§ã™ãã€‚ è‡ªåˆ†ã§ä½œã£ãŸPythonã‚¢ãƒ—ãƒªã‚’Googleã®ã‚¤ãƒ³ãƒ•ãƒ©ã‚’ä½¿ã£ã¦å…¨ä¸–ç•Œã«å…¬é–‹ã§ãã‚‹ ã‚¢ã‚¯ã‚»ã‚¹ç‰ã‚’ç¢ºèªã§ãã‚‹ç®¡ç†ç”»é¢ãŒç”¨æ„ã•ã‚Œã¦ã„ã‚‹ ã‚¢ãƒ—ãƒªæ¯Žã«1ã¤ã®URLã‚’ã‚‚ã‚‰ãˆã‚‹ãŒã€ã²ã¨ã‚Š3å€‹ã¾ã§ã—ã‹ã‚¢ãƒ—ãƒªã‚’ç™»éŒ²ã§ããªã„ Pythonã§ã¡ã‚‡ã£ã¨ã—ãŸãƒ—ãƒã‚°ãƒ©ãƒ ã‚’æ›¸ã„ã¦å…¬é–‹ã™ã‚‹ã£ã¦ã®ã¯ã€æ…£ã‚Œã‚‹ã¨éšåˆ†æ‰‹è»½ãã†ã§ã™ã€‚iPhone/iPod touchã‚¢ãƒ—ãƒªã‚ˆã‚Šé–‹ç™ºã®æ•·å±…ã¯ä½Žãã†ã§ã™ã€‚ã¾ã‚ã€Googleã¯Webã‚¢ãƒ—ãƒªã€iPhoneã¯ãƒªãƒƒãƒã‚¯ãƒ©ã‚¤ã‚¢ãƒ³ãƒˆãªæ–¹å‘ã®ã‚ˆã†ãªã®ã§ã€æ¯”è¼ƒã™ã‚‹ã“ã¨ãŒãƒŠãƒ³ã‚»ãƒ³ã‚¹ã¨æ„Ÿã˜ã‚‹æ–¹ã‚‚ã„ã‚‹ã§ã—ã‚‡ã†ãŒã€‚ ã¡ãªã¿ã«ã€ãƒžãƒªãƒŽã‚¹ã®é¸æ‰‹ä¸€è¦§ã‚’è¡¨ç¤ºã™ã‚‹ã‚³ãƒ¼
tenfu4tea 2009/07/07
Google App Engine

BeautifulSoup
ãƒªãƒ³ã‚¯
Python ã§ç°¡å˜ãªãƒ†ã‚ã‚¹ãƒˆå‡¦ç† (3) - Beautiful Soup ã‚’ä½¿ã£ã¦ã‚¹ã‚¯ãƒ¬ã‚¤ãƒ”ãƒ³ã‚°
1. Beautiful Soup ã§ãƒ‡ãƒ¼ã‚¿ã‚’å–å¾— æ°—è±¡åºã®éŽåŽ»ã®ãƒ‡ãƒ¼ã‚¿ã‹ã‚‰ã€ç‰¹å®šã®å€¤ã‚’æŠ½å‡ºã—ãŸã„ã€‚ Python ã§ç°¡å˜ãªãƒ†ã‚ã‚¹ãƒˆå‡¦ç† (2) - ãƒ‡ãƒ¼ã‚¿ã®æŠ½å‡ºÂ ã«ãŠã„ã¦ã¯ã€ãƒ–ãƒ©ã‚¦ã‚¶ä¸Šã§ã‚³ãƒ”ãƒ¼ã—ãŸæ–‡å—åˆ— (ãƒ‡ãƒ¼ã‚¿) ã‚’ã€Python ã®ã‚½ãƒ¼ã‚¹ã‚³ãƒ¼ãƒ‰ã«è²¼ã‚Šä»˜ã‘ã€å¿…è¦ãªãƒ‡ãƒ¼ã‚¿ã‚’æŠ½å‡ºã—ãŸã€‚ ä»Šå›žã¯ã€Python ã§ Web ã«ã‚¢ã‚¯ã‚»ã‚¹ã—ã€å¿…è¦ãªãƒ‡ãƒ¼ã‚¿ã‚’æŠ½å‡ºã—ã¦ã¿ã‚‹ã€‚ Python ã§ã¯ã€urllib2 ã‚’åˆ©ç”¨ã™ã‚‹ã¨ã€ HTTP ã® POST ãƒ¡ã‚½ãƒƒãƒ‰ã‚’é€ä¿¡ã™ã‚‹ã“ã¨ãŒã§ãã‚‹ã€‚ cf. Python ã§ POST - æŽ²ç¤ºæ¿ã®è¿·æƒ‘æŠ•ç¨¿ã‚’ä¸€æ‹¬å‰Šé™¤ ãŸã ã—ã€urllib2 ã‚’ä½¿ã†ã®ã¯é¢å€’ã€‚ä»£ã‚ã‚Šã«ã€ Beautiful Soup ã‚’åˆ©ç”¨ã™ã‚‹ã€‚ cf. Panopticon :: Python :: BeautifulSoupã‚’è§¦ã£ã¦ã¿ã‚‹ 2. ã‚¹ã‚¯ãƒ¬ã‚¤ãƒ”ãƒ³ã‚°ã¨ã¯ ã‚¹ã‚¯ãƒ¬ã‚¤ãƒ”ãƒ³ã‚°ã¨ã„ã†è¨€è‘‰ã¯ã€Ruby
tenfu4tea 2009/07/07
python

BeautifulSoup

scraping
ãƒªãƒ³ã‚¯
WebTestã§ã‚‚ä½¿ã£ã¦ã„ã‚‹BeautifulSoupã¯ä¾¿åˆ©ãªæ„Ÿã˜
WebTestã‚’ä½¿ã£ã¦ãƒ†ã‚¹ãƒˆã‚’æ›¸ã„ã¦ã„ã‚‹ã®ã§ã™ãŒã€htmlã®ãƒ‘ãƒ¼ã‚¹ã«BeautifulSoupã¨ã„ã†ã‚‚ã®ãŒä½¿ã‚ã‚Œã¦ã„ã¦ã“ã‚ŒãŒã„ã‚ã„ã‚å‡ºæ¥ã‚‹æ„Ÿã˜ã§ä¾¿åˆ©ã§ã™ã€‚ ä»¥ä¸‹ã€ã„ãã¤ã‹ãƒ¡ãƒ¢ã§ã™ã€‚ ä»¥ä¸‹ã¯ã€WebTestã‚’åˆ©ç”¨ã—ã¦ã„ã‚‹ã¨ãã®ã‚±ãƒ¼ã‚¹ã§ã™ã€‚ res = app.get("/") soup = res.html ã¨äº‹å‰ã«ã‚„ã£ã¦ã„ã‚‹ã¨æ€ã£ã¦ãã ã•ã„ã€‚ classãŒaaaãªdivã‚¿ã‚°ã‚’ã™ã¹ã¦æŽ¢ã™ aaa = soup.findAll('div',{'class':'aaa'}) print aaa[0] ã¨ã‹ã§å†…å®¹ãŒè¦‹ã‚Œã¾ã™ã€‚ ã‚¿ã‚°ã‚’ã¯ãšã—ãŸã‚‚ã®ã‚’è¦‹ã‚‹ã«ã¯ã€ print aaa[0].string ãªæ„Ÿã˜ã§è¦‹ã‚Œã‚‹ã‚ˆã†ã§ã™ã€‚ aã‚¿ã‚°ã®hrefã®å€¤ãŒæ¬²ã—ã„ã¨ãã¯ã€ aaa = soup.findAll('a') ahref = aaa[0]['href'] ã‚¿ã‚°ã‚’æŽ¢ã™ã¨ãã«æ£è¦è¡¨ç¾ã‚’åˆ©ç”¨ã™ã‚‹ lists
tenfu4tea 2009/07/07
python

BeautifulSoup

scraping
ãƒªãƒ³ã‚¯
XML ã‚’ç°¡å˜ã«èªã¿è¾¼ã¿ãŸã„ã‚“ã ã‘ã© - Beautiful Soup ã§æ‚©ã¿ä¸ãƒ»ãƒ»ãƒ» - mitszoã®æ—¥è¨˜
tenfu4tea 2009/07/07
python

BeautifulSoup
ãƒªãƒ³ã‚¯
sh1.2 pyblosxom : pythonã§ã‚¹ã‚¯ãƒ¬ã‚¤ãƒ”ãƒ³ã‚°
HTML::Selector::XPath ã‚’ãƒªãƒªãƒ¼ã‚¹: blog.bulknews.net å·oãƒ»-ãƒ»ï¼‰ï¼œ2nd life - ruby ã®ã‚¹ã‚¯ãƒ¬ã‚¤ãƒ”ãƒ³ã‚°ãƒ„ãƒ¼ãƒ«ã‚ãƒƒãƒˆ scrAPI ã‚’è¦‹ã¦ã€pythonã§ã‚‚ElementTreeã‚’ä½¿ã£ãŸã‚‰ã§ãã‚‹ã‚“ã˜ã‚ƒãªã„ã‹ãªã¨æ€ã£ãŸã‘ã©ã‚‚ã€ ã¡ã‚ƒã‚“ã¨ã—ãŸXMLã˜ã‚ƒãªã„ã¨parseæ™‚ã«ã‚¨ãƒ©ãƒ¼ã«ãªã£ã¦ã—ã¾ã†ã€‚ã˜ã‚ƒã‚ã€ElementTreeã« æ¸¡ã™å‰ã«HTMLã‚’XHTMLã«å¤‰æ›ã—ãŸã‚‰ã„ã„ã®ã‹ã¨æ€ã£ã¦æ¨™æº–ãƒ©ã‚¤ãƒ–ãƒ©ãƒªã‚’æŽ¢ã™ã‚‚ã€ã©ã†ã‚„ ã‚‰æ¨™æº–ã§ãã†ã„ã†ã“ã¨ã‚’ã™ã‚‹ãƒ©ã‚¤ãƒ–ãƒ©ãƒªã¯ãªã„ã‚‰ã—ã„ã€‚googleã•ã‚“ã«ãŠå°‹ãã—ã¦ã¿ãŸæ‰€ ä¸‹è¨˜ã®ã‚¨ãƒ³ãƒˆãƒªã‚’ç™ºè¦‹ã€‚ Python ã§ HTML ãƒ•ã‚¡ã‚¤ãƒ«ã‹ã‚‰æƒ…å ±ã‚’å–ã‚Šå‡ºã™ã«ã¯ - å‚€å„¡å¸«ã®é¤¨ - æ¥½å¤©ãƒ–ãƒã‚°ï¼ˆBlogï¼‰ ã¾ã•ã«åŒã˜ã‚ˆã†ãªæ‚©ã¿ã§è‰²ã€…æŽ¢ã—ã¦ã„ã‚‰ã£ã—ã‚ƒã£ã¦ã€ã“ã“ã§BeautifulSoupã‚’çŸ¥ã‚Šã¾ã— ãŸã€‚çµæ§‹æ˜”ã‹ã‚‰ã‚ã£ãŸãƒ¢ã‚¸ãƒ¥ãƒ¼ãƒ«
tenfu4tea 2009/07/07
[

python

BeautifulSoup
ãƒªãƒ³ã‚¯
Google App Engineã§ã‚‚XPathãŒä½¿ãˆã‚‹ï¼XPathEvaluator Extension for BeautifulSoup(BSXPath)ã‚’ãƒªãƒªãƒ¼ã‚¹ - é¢¨æŸ³ãƒ¡ãƒ¢
é£½ãã‚‹å‰ã«ãã‚Œãªã‚Šã«å½¢ã«ãªã£ãŸã®ã§ãƒªãƒªãƒ¼ã‚¹ã—ã¦ãŠãã¾ã™ Python 2.5*ã¨BeautifulSoup 3.0.7* or 3.1.0*ã®ç’°å¢ƒã§ã¨ã‚Šã‚ãˆãšå‹•ãXPathEvaluatorã§ã™ã€‚ ã‚¢ãƒ¼ã‚«ã‚¤ãƒ–ãƒ•ã‚¡ã‚¤ãƒ«(ZIP)ï¼šBSXPath.pyï¼š XPathEvaluator Extension for BeautifulSoup ä¸Šè¨˜ãƒ•ã‚¡ã‚¤ãƒ«(BSXPath.pyï¼‰ã‚’ä½¿ã£ãŸã‚µãƒ³ãƒ—ãƒ«ã¯ã“ã¡ã‚‰ ã€2009/04/05è¿½è¨˜ã€‘ BSXPath.pyã‚’ä½¿ã£ãŸã‚µãƒ¼ãƒ“ã‚¹ã‚’å…¬é–‹ã—ã¾ã—ãŸã€‚ ä»»æ„ã®ã‚µã‚¤ãƒˆã®ãƒ•ã‚£ãƒ¼ãƒ‰ãƒ‘ã‚¿ãƒ¼ãƒ³ã‚’ä½œæˆãƒ»å…±ç”¨ã§ãã‚‹ã‚µãƒ¼ãƒ“ã‚¹ ä½¿ã„æ–¹ from BSXPath import BSXPathEvaluator,XPathResult #*** æº–å‚™ document = BSXPathEvaluator(<html>) # html: HTMLãƒ†ã‚ã‚¹ãƒˆ # â€»BSXPathEvalu
tenfu4tea 2009/07/05
Google App Engine

XPath

BeautifulSoup

python
ãƒªãƒ³ã‚¯
Beautiful Soup: We called him Tortoise because he taught us.
You didn't write that awful page. You're just trying to get some data out of it. Beautiful Soup is here to help. Since 2004, it's been saving programmers hours or days of work on quick-turnaround screen scraping projects. Beautiful Soup is a Python library designed for quick turnaround projects like screen-scraping. Three features make it powerful: Beautiful Soup provides a few simple methods and
tenfu4tea 2009/07/05
python

BeautifulSoup

HTML

xml

scraping
ãƒªãƒ³ã‚¯
BlogSlime â€“ Just another WordPress site
ã‚³ãƒ³ãƒ†ãƒ³ãƒ„ã¸ã‚¹ã‚ãƒƒãƒ— ç™»éŒ²ã¯ç„¡åŠ¹åŒ–ã•ã‚Œã¾ã—ãŸã€‚
tenfu4tea 2009/07/05
python

BeautifulSoup

scraping
ãƒªãƒ³ã‚¯
Python ã§ HTML ãƒ•ã‚¡ã‚¤ãƒ«ã‹ã‚‰æƒ…å ±ã‚’å–ã‚Šå‡ºã™ã«ã¯ - å‚€å„¡å¸«ã®é¤¨.Pythonï¼šæ¥½å¤©ãƒ–ãƒã‚°
2006.10.22 Python ã§ HTML ãƒ•ã‚¡ã‚¤ãƒ«ã‹ã‚‰æƒ…å ±ã‚’å–ã‚Šå‡ºã™ã«ã¯ ã‚«ãƒ†ã‚´ãƒªï¼šPython æ¥½å¤©ãƒ–ãƒã‚°ã®ã‚¢ã‚¯ã‚»ã‚¹ãƒã‚°ã®ãƒšãƒ¼ã‚¸ã‚’ ElementTree ã§å‡¦ç†ã—ã‚ˆã†ã¨æ€ã£ãŸã®ã ãŒã€ ExpatError: mismatched tag: line 244, column 2 ã®ã‚ˆã†ãªã‚¨ãƒ©ãƒ¼ãŒå‡ºã¦ XML ã¨ã—ã¦è§£æžã™ã‚‹ã“ã¨ã§ããªã„ã€‚ã¨ã„ã†ã“ã¨ã§ã€ã‚ã£ã•ã‚Šåˆ¥ã®ã‚„ã‚Šã‹ãŸã‚’æŽ¢ã™ã“ã¨ã«ã—ãŸã€‚ã¡ãªã¿ã« Python ã® ElementTree ã¯ ruby ã® rexml ã‚ˆã‚Šé€Ÿã„ã‚‰ã—ã„ã€‚proto.xml ã® AbstractLightInfantry ãªãƒ¦ãƒ‹ãƒƒãƒˆã‚’èª¿ã¹ã‚‹ã€ã¨ã„ã†ã‚ˆã‚Š ElementTree (Python) vs. REXML (Ruby)ã€‚REXML ã¨ ElementTree ã®ãƒ‘ãƒ¼ã‚¹æ™‚é–“ã€‚ ãƒ—ãƒªãƒŸãƒ†ã‚£ãƒ–ã«ã‚„ã‚‹ãªã‚‰ã°ã€æ¨™æº–ãƒ©ã‚¤ãƒ–ãƒ©ãƒªã«å«ã¾ã‚Œã¦ã„ã‚‹ SGMLPar
tenfu4tea 2009/07/05
python

scraping

BeautifulSoup
ãƒªãƒ³ã‚¯
1