mixi Engineers’ Blog » æ–°RSS Crawlerã®è£å´ã“ã®ãƒ–ãƒã‚°ã§ã¯åˆã‚ã¾ã—ã¦ã®é•·é‡Žé›…広(kazeburo)ã§ã™ã€‚mixi開発部・é‹ç”¨ã‚°ãƒ«ãƒ¼ãƒ—ã§ã‚¢ãƒ—リケーションã®é‹ç”¨ã‚’担当ã—ã¦ã„ã¾ã™ã€‚ 12月12日よりmixiã®RSSã®CrawlerãŒæ”¹å–„ã•ã‚Œã€å¤–部ブãƒã‚°ã®åæ˜ ãŒä»Šã¾ã§ã¨æ¯”ã¹æ ¼æ®µã«ã¯ã‚„ããªã£ã¦ã„ã‚‹ã®ã«æ°—付ã‹ã‚ŒãŸæ–¹ã‚‚多ã„ã‹ã¨æ€ã„ã¾ã™ã€‚ã“ã®æ”¹å–„ã•ã‚ŒãŸRSS Crawlerã®è£å´ã«ã¤ã„ã¦æ›¸ããŸã„ã¨æ€ã„ã¾ã™ 以å‰ã®Crawlerã«ã¤ã„㦠以å‰ã®Crawler㯠cronã‹ã‚‰brokerã¨å‘¼ã°ã‚Œã‚‹ãƒ—ãƒã‚°ãƒ©ãƒ ã‚’èµ·å‹• brokerã¯member DBã‹ã‚‰å…¨ä»¶ã€idã‚’incrementã—ãªãŒã‚‰å–å¾—ã—ã€å¤–部ブãƒã‚°ãŒè¨å®šã•ã‚Œã¦ã„ã‚Œã°crawlerã‚’èµ·å‹•(fork) crawlerã¯RSSã‚’å–å¾—ã—DBã«æ ¼ç´ã—ã¦çµ‚了 ã“ã®ã‚ˆã†ãªè¨è¨ˆã«ãªã£ã¦ã„ã¾ã—ãŸã€‚ ã“ã®è¨è¨ˆã®å•é¡Œã¨ã—ã¦ã€member DBを全件走査ã™ã‚‹ã¨ã„ã†ç„¡é§„ãªå‹•ä½œã¨ã€ä¸€ä»¶ä¸€ä»¶crawlerã‚’èµ·å‹•ã™ã‚‹ãŸã‚オーãƒ
{{#tags}}- {{label}}
{{/tags}}