æ¥ç¨®åˆ¥ä¼æ¥å辞書データを公開ã—ã¾ã—㟠- Y's note
Web解æžHacks ―オンラインビジãƒã‚¹ã§æœ€å¤§ã®åŠ¹æžœã‚’ã‚ã’るテクニック & ツール 作者: Eric T. Peterson,æ ªå¼ä¼šç¤¾ãƒ‡ã‚¸ã‚¿ãƒ«ãƒ•ã‚©ãƒ¬ã‚¹ãƒˆ,木下哲也,有é™ä¼šç¤¾ç¦é¾èˆˆæ¥å‡ºç‰ˆç¤¾/メーカー: オライリー・ジャパン発売日: 2006/11/08メディア: å˜è¡Œæœ¬ï¼ˆã‚½ãƒ•ãƒˆã‚«ãƒãƒ¼ï¼‰è³¼å…¥: 3人 クリック: 78回ã“ã®å•†å“ã‚’å«ã‚€ãƒ–ãƒã‚° (21件) を見る ä¼æ¥å辞書 æ¥ç¨®ã¨ä¼æ¥åã®è¾žæ›¸ãƒ‡ãƒ¼ã‚¿ãŒæ¬²ã—ã‹ã£ãŸã‚“ã§Yahoo!Financeã®ãƒ‡ãƒ¼ã‚¿ã‚’Crawlã—ã¦ä½œã‚Šã¾ã—ãŸã€‚å¸å›½ãƒ‡ãƒ¼ã‚¿ãƒãƒ³ã‚¯ã‚„å››å£å ±ã®ãƒ‡ãƒ¼ã‚¿ãŒä½¿ãˆã‚‹ã¨è‰¯ã‹ã£ãŸã‚“ã§ã™ãŒã€Crawlã§ããã†ã«ç„¡ã‹ã£ãŸã®ã§è«¦ã‚ã¾ã—ãŸã€‚残念ãªãŒã‚‰2600社ã»ã©ã®ãƒ‡ãƒ¼ã‚¿ã—ã‹é›†ã¾ã£ã¦ãŠã‚‰ãšã€å€‹äººçš„ã«ã¯ã‚‚ã£ã¨ã„ã‚ã‚“ãªãƒ‡ãƒ¼ã‚¿ãŒæ¬²ã—ã„ã§ã™ã€‚ä»–ã«è‰¯ã„方法をã”å˜çŸ¥ã®æ–¹ã„らã£ã—ゃã„ã¾ã—ãŸã‚‰ã”連絡ã„ãŸã ã‘ã‚‹ã¨å¹¸ã„ã§ã™ã€‚ Yahoo!ファイナンス - æ ªä¾¡ã‚„ãƒ‹ãƒ¥ãƒ¼ã‚¹ã€ä¼æ¥æƒ…
furl: 使ã„易ã„Pythonã®URLライブラリ - karasuyamatenguã®æ—¥è¨˜
https://github.com/gruns/furl インストール $ git clone https://github.com/gruns/furl.git $ cd furl $ ls API.md furl.py furl.pyc LICENSE.md README.md tests/setup.pyãªã©ã¯ãªã„。 python2.7以上 python2.6ã§ã‚‚使ãˆã‚‹ã‚ˆã†ã«ã—ãŸãƒ•ã‚©ãƒ¼ã‚¯ï¼šhttps://github.com/tengu/furl $ python Python 2.6.6 (r266:84292, Sep 15 2010, 16:22:56) [GCC 4.4.5] on linux2 Type "help", "copyright", "credits" or "license" for more information. >>> from furl impor
The jonki
皆ã•ã‚“ã¯Pythonã®pathlib使ã£ã¦ã¾ã™ã‹ï¼Ÿç§ã¯éžå¸¸ã«ã‚ˆã使ã£ã¦ã„ã¾ã™ï¼Žä¾‹ãˆã°æ©Ÿæ¢°å¦ç¿’ã§ã¯å¦ç¿’ã®å‰ã«å‰å‡¦ç†ã‚’多ãè¡Œã†ã‚±ãƒ¼ã‚¹ãŒéžå¸¸ã«å¤šã„ã§ã™ãŒï¼Œã“ã®ã‚ˆã†ãªæ™‚ã«pathlibを知ã£ã¦ãŠãã¨ä¾¿åˆ©ã§ã™ï¼Žpathlibã¯æ„外ã¨Python 3.4（2014年～）ã‹ã‚‰ã¨ãã‚Œãªã‚Šã«æ–°ã—ã„ãŸã‚，å¤ãã‹ã‚‰ã®Pythonユーザー㯠os.pathã®æ–¹ã‚’よã使ã£ã¦ã„ã‚‹ã‹ã‚‚ã—ã‚Œã¾ã›ã‚“．ãŸã pathlibã¯æ–‡å—列ã§ã¯ãªãPathクラスã¨ã—ã¦æ‰±ã£ã¦ãれるã“ã¨ã§ï¼Œä¾‹ãˆã°Linux/Windowsã®ãƒ‘ス表記ã®é•ã„ã‚’å¸åŽã—ã¦ãã‚ŒãŸã‚Šã—ã¾ã™ï¼Ž pathlibã¨os.pathã®æ¯”較ã¯å…¬å¼ã®pathlibドã‚ュメントã«è²ã‚‹ã¨ã—ã¦ï¼Œç§ãŒã‚ˆã使ã†pathlibã®ã‚¯ãƒ©ã‚¹ã‚’紹介ã—ã¾ã™ï¼Žã¾ãŸä»Šå›žæ”¹ã‚ã¦ãƒ‰ã‚ュメントを眺ã‚ã¦çŸ¥ã£ãŸä¾¿åˆ©é–¢æ•°ã‚‚多ã„ã®ã§ï¼Œå…¬å¼ãƒ‰ã‚ュメントã«ç›®ã‚’通ã™ã®ã‚‚オススメã—ã¾ã™ï¼Ž 今回ã¯ä¸‹è¨˜ã®ã‚ˆã†ãªè¤‡æ•°ã®ç´ 性ã®ç•°ãªã‚‹ãƒ‡ãƒ¼
Nothing is impossible : ç°¡å˜ï¼ãŸã£ãŸï¼˜è¡Œã®ã‚³ãƒ¼ãƒ‰ã§ HTMLå–得＆解æžã‚’ã™ã‚‹Pythonスクリプト
June 07, 201010:49 カテゴリwork ç°¡å˜ï¼ãŸã£ãŸï¼˜è¡Œã®ã‚³ãƒ¼ãƒ‰ã§ HTMLå–得＆解æžã‚’ã™ã‚‹Pythonスクリプト ç°¡å˜ï¼ãŸã£ãŸï¼‘３行ã®ã‚³ãƒ¼ãƒ‰ã§ HTMLå–得＆解æžã‚’ã™ã‚‹Perlスクリプト を見ã¦Pythonãªã‚‰ã‚‚ã£ã¨ç°¡å˜ã ãªãƒ¼ã¨æ€ã£ãŸã®ã§æ›¸ã„ã¦ã¿ã‚‹ã€‚ import urllib2 from lxml import etree url = 'http://www.yahoo.co.jp' opener = urllib2.build_opener() opener.addheaders = [('User-agent','Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0)')] tree = etree.parse(opener.open(url),parser=etree.HTMLParser()
urllib2ã§ãƒ—ãƒã‚ã‚·ã‚’å‚ç…§ã—ãªã„よã†ã«ã™ã‚‹ - IT担当@è°·æ ¹åƒè¾ºã‚Š
Pythonurllib.urlopenã¯ã‚¹ãƒ†ãƒ¼ã‚¿ã‚¹404ã§ã‚‚例外を発生ã—ã¦ãã‚Œãªã„。urllib2.urlopenã¯ãã®ã¾ã¾ã ã¨ç’°å¢ƒå¤‰æ•°ã®ãƒ—ãƒã‚ã‚·è¨å®šã‚’å‚ç…§ã—ã¦ã™ã‚‹ã‚ˆã†ã§ã€ã¡ã‚‡ã£ã¨å›°ã‚‹å ´åˆãŒã‚ã£ãŸã€‚ã¨ã„ã†ã‚ã‘ã§ã€urllib2.urlopenã§ãƒ—ãƒã‚ã‚·ã‚’è¨å®š|å‚ç…§ã—ãªã„よã†ã«ã™ã‚‹æ–¹æ³•ã€‚ #!/usr/bin/env python import urllib2 #今回ã¯ãƒ—ãƒã‚ã‚·è¨å®šã‚’空ã«ã—ã¦ãŠã #proxies = {'http': 'http://www.example.com:3128/'} proxies = {} #プãƒã‚ã‚·ãƒãƒ³ãƒ‰ãƒ©ãƒ¼ã®ä½œæˆã—㦠handler = urllib2.ProxyHandler(proxies) #プãƒã‚ã‚·ãƒãƒ³ãƒ‰ãƒ©ãƒ¼ã‚’指定ã—ã¦URL Openerを作æˆã—㦠opener = urllib2.build_opener(handler) #作æˆã—ãŸURL
1
リリースã€éšœå®³æƒ…å ±ãªã©ã®ã‚µãƒ¼ãƒ“スã®ãŠçŸ¥ã‚‰ã›
最新ã®äººæ°—エントリーã®é…ä¿¡
j次ã®ãƒ–ックマーク
kå‰ã®ãƒ–ックマーク
lã‚ã¨ã§èªã‚€
eコメント一覧を開ã
oページを開ã
nessy.info
urllib2ã‹ã‚‰ã®æŽ¥ç¶šã«Torを使ã†[Python][Mac] - Qiita![urllib2ã‹ã‚‰ã®æŽ¥ç¶šã«Torを使ã†[Python][Mac] - Qiita](https://cdn-ak-scissors.b.st-hatena.com/image/square/1c5e3e39937fa8a95d66485ba8f36ddf05cb0666/height=288;version=1;width=512/https%3A%2F%2Fqiita-user-contents.imgix.net%2Fhttps%253A%252F%252Fqiita-user-contents.imgix.net%252Fhttps%25253A%25252F%25252Fcdn.qiita.com%25252Fassets%25252Fpublic%25252Farticle-ogp-background-afbab5eb44e0b055cce1258705637a91.png%253Fixlib%253Drb-4.0.0%2526w%253D1200%2526blend64%253DaHR0cHM6Ly9xaWl0YS11c2VyLXByb2ZpbGUtaW1hZ2VzLmltZ2l4Lm5ldC9odHRwcyUzQSUyRiUyRnFpaXRhLWltYWdlLXN0b3JlLnMzLmFtYXpvbmF3cy5jb20lMkYwJTJGMTE2MDU0JTJGcHJvZmlsZS1pbWFnZXMlMkYxNDczNzEzMTIzP2l4bGliPXJiLTQuMC4wJmFyPTElM0ExJmZpdD1jcm9wJm1hc2s9ZWxsaXBzZSZmbT1wbmczMiZzPTAwNjdlMTExM2NmOWQ4M2UyYWY5NmZjZjgxYWY4ZmI2%2526blend-x%253D120%2526blend-y%253D467%2526blend-w%253D82%2526blend-h%253D82%2526blend-mode%253Dnormal%2526s%253D493f0eb75e6e3596dff7eb0af3a38368%3Fixlib%3Drb-4.0.0%26w%3D1200%26fm%3Djpg%26mark64%3DaHR0cHM6Ly9xaWl0YS11c2VyLWNvbnRlbnRzLmltZ2l4Lm5ldC9-dGV4dD9peGxpYj1yYi00LjAuMCZ3PTk2MCZoPTMyNCZ0eHQ9dXJsbGliMiVFMyU4MSU4QiVFMyU4MiU4OSVFMyU4MSVBRSVFNiU4RSVBNSVFNyVCNiU5QSVFMyU4MSVBQlRvciVFMyU4MiU5MiVFNCVCRCVCRiVFMyU4MSU4NiU1QlB5dGhvbiU1RCU1Qk1hYyU1RCZ0eHQtYWxpZ249bGVmdCUyQ3RvcCZ0eHQtY29sb3I9JTIzMUUyMTIxJnR4dC1mb250PUhpcmFnaW5vJTIwU2FucyUyMFc2JnR4dC1zaXplPTU2JnR4dC1wYWQ9MCZzPWQ5ZmQ4NjFjYTRlZDU5OGM3OWQ4NjM5ZGNjMzZlNzkz%26mark-x%3D120%26mark-y%3D112%26blend64%3DaHR0cHM6Ly9xaWl0YS11c2VyLWNvbnRlbnRzLmltZ2l4Lm5ldC9-dGV4dD9peGxpYj1yYi00LjAuMCZ3PTgzOCZoPTU4JnR4dD0lNDBzaGlyYWlzaGlfcHkmdHh0LWNvbG9yPSUyMzFFMjEyMSZ0eHQtZm9udD1IaXJhZ2lubyUyMFNhbnMlMjBXNiZ0eHQtc2l6ZT0zNiZ0eHQtcGFkPTAmcz1jN2ExYzM4YmUzMDVjZjljZWQ0NDQ5OTc1NjgxOTllMg%26blend-x%3D242%26blend-y%3D480%26blend-w%3D838%26blend-h%3D46%26blend-fit%3Dcrop%26blend-crop%3Dleft%252Cbottom%26blend-mode%3Dnormal%26s%3D9d4b4106ff66a051a06b976d96eba234)
urllib2ã‚’Mock化ã—ã¦unittestã™ã‚‹ - Qiita
{{#tags}}- {{label}}
{{/tags}}