AmazonãŒeコマース検索を Lucene ã«ã‚ˆã‚Šã€ã©ã†ã‚¹ã‚±ãƒ¼ãƒ«ã•ã›ã¦ã„ã‚‹ã‹ at Berlin Buzzwords 2019
AmazonãŒeコマース検索を Lucene ã«ã‚ˆã‚Šã€ã©ã†ã‚¹ã‚±ãƒ¼ãƒ«ã•ã›ã¦ã„ã‚‹ã‹ at Berlin Buzzwords 2019 2021-11-26 æƒ…å ±æ¤œç´¢ãƒ»æ¤œç´¢æŠ€è¡“ Advent Calendar 2021 1 日目ã®è¨˜äº‹ã§ã™ã€‚ æ—©ã‚ã«æ›¸ã終ãˆãŸã®ã§ã€ã‚«ãƒ¬ãƒ³ãƒ€ãƒ¼ç™»éŒ²æ—¥ã® 2021/12/01 よりもã¯ã‚„ã‚ã§ã™ãŒã€è¨˜äº‹ã‚’公開ã—ã¦ã—ã¾ã„ã¾ã™ã€‚ Berlin Buzzwords ã¯ãƒ‰ã‚¤ãƒ„ã§æ¯Žå¹´é–‹å‚¬ã•ã‚Œã¦ã„ã‚‹ OSS を利用ã—ãŸæ¤œç´¢ã€ãƒ‡ãƒ¼ã‚¿å‡¦ç†ã€ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã«ç„¦ç‚¹ã‚’ã‚ã¦ãŸã‚«ãƒ³ãƒ•ã‚¡ãƒ¬ãƒ³ã‚¹ã§ã™ã€‚ 検索関係ã®ã‚·ã‚¹ãƒ†ãƒ ã«æºã‚ã£ã¦ã„ã‚‹å ´åˆã€æ¯Žå¹´é¢ç™½ã„内容ãŒç›®ç™½æŠ¼ã—ãªã®ã§ãœã²ã¨ã‚‚見ã¦ã»ã—ã„。 今回㯠Berlin Buzzwords 2019 ã§ç™ºè¡¨ã•ã‚ŒãŸã€ŒAmazon ã§ã¯ Lucene ã‚’ã©ã†æ´»ç”¨ã—㦠e コマース検索をスケールã•ã›ã¦ã„ã‚‹ã‹ã€ã®è¬›æ¼”動画を社内勉強会ã§ç´¹ä»‹ã™ã‚‹ãŸã‚ã«è¦–è´ã—ãŸã®ã§ã€ãã®ãƒ¡
Elasticsearchã‚’ç†è§£ã™ã‚‹ãŸã‚ã«Luceneを使ã£ãŸæ¤œç´¢ã‚¨ãƒ³ã‚¸ãƒ³æ§‹ç¯‰ã«å…¥é–€ã—ã¦ã¿ãŸ - 好奇心ã«æ®ºã•ã‚Œã‚‹ã€‚
Java / Lucene / Elasticsearch Elasticsearchã‚’ç†è§£ã™ã‚‹ãŸã‚ã«Luceneを使ã£ãŸæ¤œç´¢ã‚¨ãƒ³ã‚¸ãƒ³æ§‹ç¯‰ã«å…¥é–€ã—ã¦ã¿ãŸ Elasticsearchã‚’ç†è§£ã™ã‚‹ç‚ºã«Luceneã«å…¥é–€ã—ã¾ã—ãŸã€‚今回ã¯ç°¡å˜ãªæ¤œç´¢ã‚¨ãƒ³ã‚¸ãƒ³ã‚’構築ã—ã¾ã™ Overview ã“ã‚“ã«ã¡ã¯ pon ã§ã™ã€‚Elasticsearchã§æ€ã‚ã¬æŒ™å‹•ã«ã§ãã‚ã™ã¨ã€Javaã™ã‚‰ã‚„ã£ãŸã“ã¨ã®ãªã„僕ã«å‡ºæ¥ã‚‹ã“ã¨ã¯ãƒãƒƒãƒˆã®æµ·ã‚’彷徨ã†ã ã‘ã§ã—ãŸã€‚ã“ã‚Œã¯ã‚ˆããªã„ã¨æ€ã„ã€Elasticsearchã®ä»•çµ„ã¿ã‚’ã‚る程度ç†è§£ã§ãるよã†ã« Lucene ã«å…¥é–€ã—ã¾ã—ãŸã€‚今回ã¯Luceneã®ãƒ‘ッケージを利用ã—ã¦ç°¡å˜ãªæ¤œç´¢ã‚¨ãƒ³ã‚¸ãƒ³ã‚’å‹•ã‹ã—ã¦ã¿ã‚ˆã†ã¨æ€ã„ã¾ã™ã€‚Elasticsearch内部ã§ã©ã®ã‚ˆã†ã«Luceneを使ã£ã¦ã„ã‚‹ã®ã‹çŸ¥ã‚ŠãŸã„人ã¯å¿…見ã§ã™ã€‚ Lucene ã¨ã¯ https://lucene.apache.org/ E
Introduction to Apache Lucene
社内㮠Lucene 勉強会ã§ä½¿ã£ãŸè³‡æ–™ã§ã™ã€‚Apache Lucene https://lucene.apache.org/ ã®æ¦‚è¦ã«ã¤ã„ã¦ç™ºè¡¨ã—ã¾ã—ãŸã€‚ サンプルコード: https://github.com/takuyaa/hello-lucene
1. Luceneã®æ¦‚è¦
1.1. Luceneã«ã¤ã„㦠Luceneã¯Jakartaプãƒã‚¸ã‚§ã‚¯ãƒˆ1 ã«ã‚ˆã£ã¦é–‹ç™ºã•ã‚ŒãŸã€ 100% PureJavaã®ã‚¤ãƒ³ãƒ‡ãƒƒã‚¯ã‚¹ã‚’作æˆã™ã‚‹ã‚¿ã‚¤ãƒ—ã®å…¨æ–‡æ¤œç´¢ã‚¨ãƒ³ã‚¸ãƒ³ã§ã™ã€‚ （インデックスã¨ã¯ã€é«˜é€Ÿã§æ¤œç´¢ã™ã‚‹ãŸã‚ã«ã¤ã‘られãŸç´¢å¼•ã®ã“ã¨ã§ã™ã€‚） Luceneãã®ã‚‚ã®ã¯ãƒ©ã‚¤ãƒ–ラリã§ã‚り完çµã—ãŸãƒ—ãƒã‚°ãƒ©ãƒ ã§ã¯ã‚ã‚Šã¾ã›ã‚“ãŒã€ LuceneãŒæä¾›ã™ã‚‹APIを用ã„ã‚‹ã“ã¨ã§ã€ç°¡å˜ã«ä½¿ã„ã‚„ã™ã„全文検索プãƒã‚°ãƒ©ãƒ を作るã“ã¨ãŒå‡ºæ¥ã¾ã™ã€‚ ã¾ãŸJavaã§æ›¸ã‹ã‚Œã¦ã„ã‚‹ãŸã‚ã€Webアプリケーションã¸ã®é©å¿œãŒç°¡å˜ã«è¡Œãˆã¾ã™ã€‚ Lucene自体ã¯æ—¥æœ¬èªžã‚’解æžã™ã‚‹ã“ã¨ãŒå‡ºæ¥ã¾ã›ã‚“ãŒã€å½¢æ…‹ç´ 解æžãƒ—ãƒã‚°ãƒ©ãƒ を利用ã™ã‚‹ã“ã¨ã§æ—¥æœ¬èªžã‚’検索ã™ã‚‹ã“ã¨ã‚‚å¯èƒ½ã«ãªã‚Šã¾ã™ã€‚ å½¢æ…‹ç´ è§£æžã¨ã¯æ–‡å—列をå“詞毎ã«åˆ†è§£ã™ã‚‹æŠ€è¡“ã§ã™ã€‚ 例ãˆã° 「今日ã¯è‰¯ã„天気ã§ã™ã€ ã¨ã„ã†æ–‡å—列ã«å¯¾ã—ã¦å½¢æ…‹ç´ 解æžã‚’è¡Œã†ã¨ 「今日ã€ã€Œã¯ã€ã€Œè‰¯ã„ã€ã€Œå¤©æ°—ã€ã€Œã§ã™ã€
1
リリースã€éšœå®³æƒ…å ±ãªã©ã®ã‚µãƒ¼ãƒ“スã®ãŠçŸ¥ã‚‰ã›
最新ã®äººæ°—エントリーã®é…ä¿¡
j次ã®ãƒ–ックマーク
kå‰ã®ãƒ–ックマーク
lã‚ã¨ã§èªã‚€
eコメント一覧を開ã
oページを開ã
Inverted index deep dive
Differences Between Solr and Lucene | Baeldung
Lucene: The Good Parts | Parse.ly
Practical Apache Lucene 8
Learning Lucene · Florian Hopf
Introduction to Apache Lucene | Baeldung
how-does-a-query-work.key
Multi-value Support for KnnVectorField · Issue #12313 · apache/lucene
Berlin Buzzwords 2019: Michael Sokolov & Mike McCandless–E-Commerce search at scale on Apache Lucene
https://2019.berlinbuzzwords.de/sites/2019.berlinbuzzwords.de/files/media/documents/bbuzzamazonlucene2019.pdf
{{#tags}}- {{label}}
{{/tags}}