Scrapyã§ã‘日記をクãƒãƒ¼ãƒªãƒ³ã‚°ã™ã‚‹ (2. Pipelineã§PostgreSQLã«ä¿å˜ã™ã‚‹) - ã‘日記å‰å›žã«å¼•ã続ãã€Scrapyを使ã£ã¦ã“ã®æ—¥è¨˜ã®ã‚¯ãƒãƒ¼ãƒªãƒ³ã‚°ã‚’è¡Œã„ã¾ã™ã€‚ github.com 今回ã¯ã‚¯ãƒãƒ¼ãƒªãƒ³ã‚°ã§å¾—られãŸå€¤ã‚’ã€ãƒãƒªãƒ‡ãƒ¼ã‚·ãƒ§ãƒ³ã—ã¦PostgreSQLã«ä¿å˜ã™ã‚‹Pipelineを実装ã—ã¾ã™ã€‚Spiderã®å®Ÿè£…ã¯å‰å›žã®æŠ•ç¨¿ã‚‚å‚考ã«ã—ã¦ã¿ã¦ãã ã•ã„。 ohke.hateblo.jp ã“ã¡ã‚‰ã®æ›¸ç±ã‚’å‚考ã«ã—ã¦ã¾ã™ã€‚ Pipeline Scrapyã«ãŠã‘ã‚‹Pipelineã¯ã€SpiderãŒã‚¯ãƒãƒ¼ãƒªãƒ³ã‚°ãƒ»ã‚¹ã‚¯ãƒ¬ã‚¤ãƒ”ングã—ãŸå€¤ã«å¯¾ã—ã¦ã€ãƒãƒªãƒ‡ãƒ¼ã‚·ãƒ§ãƒ³ãƒã‚§ãƒƒã‚¯ã‚„永続化ãªã©ã®å¾Œå‡¦ç†ã‚’è¡Œã†ãŸã‚ã®ä»•çµ„ã¿ã§ã™ã€‚ SpiderãŒå–å¾—ã—ãŸå€¤ã‚’Itemã«è©°ã‚ã¦è¿”ã™ã¨ã€å„ªå…ˆé †ä½ã«å¾“ã£ã¦è¤‡æ•°ã®ã‚¿ã‚¹ã‚¯ãŒå®Ÿè¡Œã•ã‚Œã¾ã™ã€‚ ã“ã“ã§ã¯ä¾‹ã¨ã—ã¦ã€å‰å›žä½œæˆã—ãŸarchive_spiderを使ã„ã€å–å¾—ã—ãŸè¨˜äº‹ã‚¿ã‚¤ãƒˆãƒ«ãƒ»æŠ•ç¨¿æ—¥ã®ãƒ•ã‚©ãƒ¼ãƒžãƒƒãƒˆã‚’ãƒã‚§ãƒƒã‚¯ã™ã‚‹Pipelineã¨ã€PostgreSQLã«ä¿å˜ã™ã‚‹Pipelineを作
{{#tags}}- {{label}}
{{/tags}}