Etsy Engineering | Turbocharging Solr Index Replication with BitTorrent
Note: In 2020 we updated this post to adopt more inclusive language. Going forward, we'll use "primary/replica" in our Code as Craft entries. Many of you probably use BitTorrent to download your favorite ebooks, MP3s, and movies. At Etsy, we use BitTorrent in our production systems for search replication. Search at Etsy Search at Etsy has grown significantly over the years. In January of 2009 we
RoughOverviewOfLuceneSearchProcess
Rough overview of Lucene 2.9 search process
Twitterã€ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ 検索をLuceneã§æ§‹ç¯‰ã€‚50å€é«˜é€Ÿã«ï¼
Twitterã®ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ 検索機能ãŒã€ã‚ªãƒ¼ãƒ—ンソースã®Luceneベースã«ãªã£ãŸã¨ã€Twitter Engineeringブãƒã‚°ã¸ã®ã‚¨ãƒ³ãƒˆãƒªã€ŒTwitter's New Search Architectureã€ã§ç´¹ä»‹ã•ã‚Œã¦ã„ã¾ã™ã€‚ ã“ã‚Œã¾ã§Twitterã¯ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ 検索ã«MySQLベースã®ç‹¬è‡ªã‚·ã‚¹ãƒ†ãƒ を利用ã—ã¦ãã¾ã—ãŸãŒã€è¦æ¨¡ã®æ‹¡å¤§ãŒé›£ã—ããªã£ã¦ããŸãŸã‚ã€6カ月å‰ã«æ–°ã‚·ã‚¹ãƒ†ãƒ ã®æ§‹ç¯‰ã‚’決定。オープンソースã®æ¤œç´¢ã‚¨ãƒ³ã‚¸ãƒ³ã§ã‚ã‚‹Luceneã‚’é¸æŠžã—ãŸã¨ã®ã“ã¨ã§ã™ã€‚ 従æ¥ã®50å€ã‚‚高速ã«ï¼ 検索エンジンã«å¯¾ã™ã‚‹è¦ä»¶ã¯ä»¥ä¸‹ã®ã‚ˆã†ã«éžå¸¸ã«åŽ³ã—ã„ã‚‚ã®ã§ã—ãŸã€‚ Our demands on the new system are immense: With over 1,000 TPS (Tweets/sec) and 12,000 QPS (queries/sec) = over 1 billion
第4回　全文検索エンジン「Lucene/Solrã€ã®ç”¨é€”ã¨è‰¯ã•
æƒ…å ±ã‚¤ãƒ³ãƒ•ãƒ©ã®ç™ºå±•ã«ä¼´ã„，ç§ãŸã¡ãŒæŽ¥ã™ã‚‹æƒ…å ±ã®çµ¶å¯¾é‡ã¯å¢—åŠ ã®ä¸€é€”ã‚’ãŸã©ã£ã¦ã„ã¾ã™ã€‚ãã®ãŸã‚，目的ã¨ã™ã‚‹æƒ…å ±ã‚’ã™ã°ã‚„ãピンãƒã‚¤ãƒ³ãƒˆã§å…¥æ‰‹ã™ã‚‹ã®ãŒå›°é›£ãªçŠ¶æ³ã‚‚増ãˆã¦ã„ã¾ã™ã€‚ 一方ã§æƒ…å ±æä¾›å´ã«ã¨ã£ã¦ã‚‚ï¼Œæƒ…å ±ã‚’ç¢ºå®Ÿã«åˆ©ç”¨è€…ã«å±Šã‘ã‚‹ã“ã¨ãŒãƒ“ジãƒã‚¹ã®æˆåŠŸã«é‡è¦ãªè¦ç´ ã¨ãªã£ã¦ãã¦ãŠã‚Šï¼Œã“れを実ç¾ã™ã‚‹ãŸã‚ã®åŠªåŠ›ãŒæ—¥ã€…続ã‘られã¦ã„ã¾ã™ã€‚ ã“ã®ã‚ˆã†ãªçŠ¶æ³ã§ï¼Œé«˜é€Ÿã§æŸ”軟性ãŒé«˜ã„検索処ç†ã®ãƒ‹ãƒ¼ã‚ºãŒé«˜ã¾ã£ã¦ãã¦ãŠã‚Šï¼Œå…¨æ–‡æ¤œç´¢ã‚¨ãƒ³ã‚¸ãƒ³ãŒæ³¨ç›®ã‚’集ã‚ã¦ã„ã¾ã™ã€‚ã“ã“ã§ã¯ï¼Œã‚ªãƒ¼ãƒ—ンソースã®å…¨æ–‡æ¤œç´¢ã‚¨ãƒ³ã‚¸ãƒ³ã§ã‚る「Lucene/Solrã€ã‚’紹介ã—ã¾ã™ã€‚ Lucene/Solrã¨ã¯ Lucene/Solrã¯ï¼ŒApache Software Foundation（ASF）ã®Luceneプãƒã‚¸ã‚§ã‚¯ãƒˆã§é–‹ç™ºã•ã‚Œã¦ã„るソフトã§ã™ã€‚Luceneã¯Pure Javaã§å®Ÿè£…ã•ã‚ŒãŸå…¨æ–‡æ¤œç´¢ã‚¨ãƒ³ã‚¸ãƒ³ã§ï¼Œå˜ç‹¬ã§ã¯å®Ÿè¡Œä¸å¯èƒ½ãªãƒ©ã‚¤ãƒ–ラリã®å½¢å¼ã§æä¾›
Welcome to Apache Solr
Solr is the blazing-fast, open source, multi-modal search platform built on the full-text, vector, and geospatial search capabilities of Apache Luceneâ„¢. Learn more about Solr. Solr is highly reliable, scalable and fault tolerant, providing distributed indexing, replication and load-balanced querying, automated failover and recovery, centralized configuration and more. Solr powers the search and na
全文検索サーãƒ: ã“ã‚Œã‹ã‚‰Solrを始ã‚る人ã®ãŸã‚ã®Apache Solr概è¦ã¨ä¾¿åˆ©ãªæƒ…å ±ãƒªã‚¹ãƒˆé›†
ã¯ã˜ã‚ã¾ã—ã¦ã€‚ プãƒãƒ€ã‚¯ãƒˆ&サービス事æ¥éƒ¨ リーダーã®ä¹…ä¿ã§ã™ã€‚ 今日ã¯ã€å½“社ã§åˆ©ç”¨ã—ã¦ã„ã‚‹OSSã®å…¨æ–‡æ¤œç´¢ã‚¢ãƒ—リケーションã§ã‚ã‚‹Apache Solrã«ã¤ã„ã¦ã”紹介ã—ãŸã„ã¨æ€ã„ã¾ã™ã€‚ Googleã§Solrを検索ã—ã¦ã‚‚ã€æ—¥æœ¬èªžåœã®ã‚³ãƒ³ãƒ†ãƒ³ãƒ„ã¯ã¾ã ã¾ã å°‘ãªã„よã†ã§ã™ã€‚ 当社ãŒSolrを使ã„始ã‚ãŸæ˜¨å¹´ã¯ç¾åœ¨ã‚ˆã‚Šã‚‚ã•ã‚‰ã«å°‘ãªãã€çµæ§‹è‹¦åŠ´ã—ã¾ã—ãŸã€‚ 今回ã¯ã‚„や雑多ãªå†…容ã¨ãªã‚Šã¾ã™ãŒã€æ–°ã—ãSolrを使ã†éš›ã«å¿…è¦ã¨è€ƒãˆã‚‰ã‚Œã‚‹æƒ…å ±ã‚’ã¾ã¨ã‚ã¦ã¿ã¾ã—ãŸã€‚ 本エントリーã§ã¯ã€Solr1.3を対象ã¨ã—ã¦ã„ã¾ã™ã€‚ Solr1.3ãŒç¾åœ¨ã®å®‰å®šç‰ˆã§ã€Solr1.4-devãŒé–‹ç™ºç‰ˆã¨ãªã‚Šã¾ã™ã€‚ 目次 Solrã¨ã¯ 機能一覧 実績/事例 Solrを使ã£ãŸã‚·ã‚¹ãƒ†ãƒ ã®é–‹ç™ºæ–¹æ³• ãŠã™ã™ã‚ã™ã‚‹æ–¹ データé‡/性能ã¨ãƒãƒ¼ãƒ‰ã‚¦ã‚§ã‚¢ マルãƒã‚³ã‚¢æ§‹æˆ 様々ãªæ¤œç´¢ スケールアウト 検索ã¨æ›´æ–° Solrを始ã‚ã‚‹ãŸã‚ã®æƒ…å ±ãƒªã‚¹ãƒˆ å…¨
1
ランã‚ング
ランã‚ング
ランã‚ング
リリースã€éšœå®³æƒ…å ±ãªã©ã®ã‚µãƒ¼ãƒ“スã®ãŠçŸ¥ã‚‰ã›
最新ã®äººæ°—エントリーã®é…ä¿¡
j次ã®ãƒ–ックマーク
kå‰ã®ãƒ–ックマーク
lã‚ã¨ã§èªã‚€
eコメント一覧を開ã
oページを開ã
Welcome to Apache ManifoldCFâ„¢!
Google Code Archive - Long-term storage for Google Code Project Hosting.
Lucidworks Search Hub
{{#tags}}- {{label}}
{{/tags}}