一定期間更新ãŒãªã„ãŸã‚広告を表示ã—ã¦ã„ã¾ã™
lucene-gosen + Solr 3.1 | é–¢å£å®å¸ã®Luceneブãƒã‚°
一定期間更新ãŒãªã„ãŸã‚広告を表示ã—ã¦ã„ã¾ã™
2010-05-27
Solr(ã¨ã„ã†ã‹Lucene)ã§æ—¥æœ¬èªžã‚’使ãˆã‚‹ã‚ˆã†ã«ã™ã‚‹ã«ã¯ 大ããã‚ã‘ã¦ã€N-グラム(CJKAnalyzer)ã‹å½¢æ…‹ç´ 解æž(JapaneseAnalyzer) を使ã†æ–¹æ³•ãŒã‚る。 N-グラムã¯æ±äº¬éƒ½ã§æ¤œç´¢ã™ã‚‹ã¨äº¬éƒ½ãŒå¼•ã£ã‹ã‹ã£ãŸã‚Šã¨æ®‹å¿µãªã®ã§ã€ å½¢æ…‹ç´ è§£æžã‚’使ã„ãŸã„ã®ã ãŒã€Lucene-jaã§ã¯å½¢æ…‹ç´ 解æžã«senを使ã‚ãªãゃã„ã‘ãªã„。 senã¯ãƒã‚®ãƒ¼ãªã®ã§(辞書ã«ç™»éŒ²ã™ã‚‹å˜èªžæ•°ãŒå°‘ãªã„å ´åˆã¯å•é¡Œãªã„) Lucene-jaを改変ã—ã¦GoSen（senよりã‹ã¯ãƒžã‚·ï¼‰ç”¨ã®ãƒ©ãƒƒãƒ‘ーを作らãªãゃã„ã‘ãªã„。 antを入れã¦ãŠãã¾ã—ょã†ï¼ˆeclipseãªã‚‰æ¨™æº–ã§ã¯ã„ã£ã¦ã‚‹ï¼‰ ダウンãƒãƒ¼ãƒ‰ http://itadaki.svn.sourceforge.net/viewvc/itadaki/GoSen/ よりè½ã¨ã™ã€‚SVNãŒãªã„å ´åˆã¯ã—ãŸã®ã»ã†ã§tar.gzå½¢å¼ã§ãƒ€ã‚¦ãƒ³ãƒãƒ¼ãƒ‰ã§ãã‚‹ $GoSen_HOM
[Solr] GoSenを使ã†
Javaã§å½¢æ…‹ç´ 解æžãƒ©ã‚¤ãƒ–ラリã¯ã‚‚ã†Senã—ã‹ãªã„状æ³ã€ã€ã ã¨æ€ã£ã¦ã„ã¾ã—ãŸãŒã€(ã¡ã‚‡ã£ã¨é€”ä¸ã§æŠ•ã’出ã•ã‚Œã¦ã„ã‚‹æ„Ÿã¯ã‚ã‚‹ã‚‚ã®ã®)GoSenã®ã»ã†ãŒè¾žæ›¸ä½œæˆã‚‚Javaã ã‘ã§ã§ãã‚‹ç‰ã€æ•´å‚™ã•ã‚Œã¦ã„ã¦è‰¯ã•ãã†ã§ã™ã€‚ ãŸã ã€Senã¯ãƒˆãƒ¼ã‚¯ãƒŠã‚¤ã‚¶ã ã‘ã‚’æä¾›ã—ã¦ã„ã‚‹ã®ã§ã€Solrã§ä½¿ã†ã«ã¯Lucene-jaã¨ã„ã†ã®ã‚’別途å–ã£ã¦ãã¦ã€ãã“ã«å…¥ã£ã¦ã„ã‚‹"アナライザ"経由ã§ä½¿ã‚ãªãã¦ã¯ãªã‚Šã¾ã›ã‚“。 ã¤ã¾ã‚Šã€(Lucene-jaã®)アナライザãŒä½¿ã†ãƒˆãƒ¼ã‚¯ãƒŠã‚¤ã‚¶ã‚’ã€Senã‹ã‚‰GoSenã«å¤‰ãˆã‚Œã°ã‚ˆã„。。ã®ã§ã™ãŒã€GoSenã¯Senã‹ã‚‰å¤šå°‘構æˆãŒå¤‰ã‚ã£ã¦ã„ã‚‹ãŸã‚「ãŸã jarを入れ替ãˆã€ã‚‹ã ã‘ã§ã¯å‹•ãã¾ã›ã‚“。 ç´°ã‹ãã¯ã¾ãŸåˆ¥ã«æ›¸ã“ã†ã¨æ€ã„ã¾ã™ãŒã€hideakiã•ã‚“ã®ãƒ–ãƒã‚°ã‚’å‚考ã«ã€ ・Lucene-ja(ã®SenTokenizer.javaã‚’)書ãæ›ãˆ ・無ã„ã¨ä¸ä¾¿ãªbuild.xmlã‚’ä½œæˆ ã¨ã—ãŸlucene-j
Luceneã¨GoSen - Vox
ç§ã‚‚Gosenã«å…¥ã‚Œæ›¿ãˆã‚ˆã†ã¨ã—ãŸã®ã§ã™ãŒã€ã€ã€ã†ã¾ãå‹•ãã¾ã›ã‚“。 クラスもã„ã‚ã„ã‚ã¨æ›¸ãæ›ãˆã‚‰ã‚Œã¦ã„ã¦æ•´åˆæ€§ãŒã¨ã‚Œã¾ã›ã‚“ã—ã€å¤‰ã‚ã£ãŸAPIã®ã©ã‚Œã‚’使ãˆã°ã‚ˆã„ã‹ã‚‚ã‚ã‹ã‚Šã¾ã›ã‚“。 ã‚ã‹ã‚‹ã‚ˆã†ã§ã—ãŸã‚‰ã©ã†ã‚„ã£ã¦å‹•ã„ãŸã®ã‹æ›¸ã„ã¦ãれるã¨åŠ©ã‹ã‚Šã¾ã™ã€‚ Tokenã®getPosã¨ã‹ã€ã€ã€ã€‚ 変更ã¯ã€StreamTaggerã®ã‚³ãƒ³ã‚¹ãƒˆãƒ©ã‚¯ã‚¿ã®å¼•æ•°ã‚’〠input, configFileã‹ã‚‰ã€ SenFactory.getStringTagger(configFile), inputã« tokenãŒnet.java.sen.Tokenãªã®ã‚’〠net.java.sen.dictionary.Tokenã« org.apache.lucene.analysis.Tokenã®ã‚³ãƒ³ã‚¹ãƒˆãƒ©ã‚¯ã‚¿ã‚’ final Morpheme m = token.getMorpheme(); return new T
GoSen - Itadaki
Introduction GoSen is a comprehensive rewrite and upgrade of Sen, a pure Java LGPL morphological analysis library for Japanese which in turn was based on MeCab. GoSen is at present a de facto fork of Sen. It would be extremely useful if the work performed to create GoSen could be folded back into the base Sen project; unfortunately, the original authors of Sen seem to be uncontactable at the prese
Itadaki
Centralized Workload Automation and Job Scheduling Orchestrate your entire tech stack with our no-code connectors and low-code REST API adapter Orchestrates any process from a single point of control. Build reliable, low-code workflows in half the time. Develop end-to-end business and IT processes faster with hundreds of drag-and-drop actions. Coordinate enterprise-wide MFT processes using dozens
Google App Engine Java ã§å½¢æ…‹ç´ 解æžå™¨ã®æ¯”較 | Altus-Five Labs
以å‰ã€Google App Engine Java ã§å½¢æ…‹ç´ 解æžå™¨ã‚’作æˆã—ã¾ã—ãŸã€‚以å‰ã®è¨˜äº‹ã¯ã“ã¡ã‚‰ã€‚ 今回ã¯ã€ã“ã‚Œã«æ”¹è‰¯ã‚’åŠ ãˆã¾ã—ãŸã€‚ 改良å‰ã«ä½¿ç”¨ã—ã¦ã„ãŸè¾žæ›¸ã¯ã€IPAdic ã§ã—ãŸãŒã€ã“れを NAIST-jdic ã«å…¥ã‚Œæ›¿ãˆã¦ã¿ã¾ã—ãŸã€‚ ãã—ã¦ã€ã›ã£ã‹ããªã®ã§ã€IPAdic 㨠NAIST-jdic ã®é•ã„を見ã¦ã¿ã‚ˆã†ã¨ã€ä¸¡æ–¹ã®è¾žæ›¸ã§è§£æžã—ã¦ã€çµæžœã‚’並ã¹ã¦è¡¨ç¤ºã™ã‚‹ã‚ˆã†ã«ã—ã¦ã€ãれをやるãªã‚‰ã€ã¤ã„ã§ã«ã€Yahoo!JAPAN WEB API ã®æ—¥æœ¬èªžå½¢æ…‹ç´ 解æžã®è§£æžçµæžœã‚‚並ã¹ã¦è¡¨ç¤ºã§ãるよã†ã«ã—ã¾ã—ãŸã€‚ ã”興味ã®ã‚ã‚‹æ–¹ã€è©¦ã—ã¦ã¿ã¦ãã ã•ã„。 http://agolabs.appspot.com/ * IPAdic 㨠NAIST-jdic ã®é•ã„ã§ã€ä¸€ç•ªã‚ã‹ã‚Šã‚„ã™ã„ã®ã¯ã‚¢ãƒ«ãƒ•ã‚¡ãƒ™ãƒƒãƒˆã§ã™ã€‚ â—‡ 辞書ã«ã¤ã„ã¦ å½¢æ…‹ç´ è§£æžå™¨ã¨ã„ãˆã°ã€ChaSen ã‚„ Mecab ã§ã™ãŒã€ã“れらã®ã‚¨ãƒ³ã‚¸
SenよりGoSenã®æ–¹ãŒé…ã„？ - kaisehã®ãƒ–ãƒã‚°
å½¢æ…‹ç´ è§£æžã‚¨ãƒ³ã‚¸ãƒ³Senを改良ã—ãŸGoSenã¨ã„ã†ãƒ©ã‚¤ãƒ–ラリãŒã‚ã‚Šã¾ã™ã€‚ Significantly improved text analysis speed http://itadaki.org/wiki/index.php/GoSen ã¨æ›¸ã„ã¦ã‚ã‚‹ã®ã§ã€ã©ã®ç¨‹åº¦é€Ÿããªã£ãŸã®ã‹ãªã¨æ€ã£ã¦Senã¨æ¯”ã¹ã¦ã¿ãŸã‚“ã§ã™ãŒã€é€†ã«Senよりé…ã„ã¨ã„ã†ä¸æ€è°ãªçµæžœã«ãªã‚Šã¾ã—ãŸã€‚ GoSenã®è¨ˆæ¸¬æ–¹æ³• SVNリãƒã‚¸ãƒˆãƒªã‹ã‚‰æœ€æ–°ç‰ˆã‚’ãƒã‚§ãƒƒã‚¯ã‚¢ã‚¦ãƒˆ /testdata/dictionaryã§antを実行ã—ã€è¾žæ›¸ãƒ•ã‚¡ã‚¤ãƒ«ã‚’ä½œæˆ GoSen付属ã®benchmark.SenBenchを実行 Senã®è¨ˆæ¸¬æ–¹æ³• sen-1.2.2.1.zipをダウンãƒãƒ¼ãƒ‰ /dicã§antを実行ã—ã€è¾žæ›¸ãƒ•ã‚¡ã‚¤ãƒ«ã‚’ä½œæˆ ä¸Šè¨˜ã®benchmark.SenBenchã‚’Senå‘ã‘ã«ä¸€éƒ¨æ›¸ãæ›ãˆã¦å®Ÿè¡Œ 実行環境ã¯Intel iMac 2GHz
GAE/J 㧠GoSen ã‚’å‹•ã‹ã—ã¦å½¢æ…‹ç´ è§£æž | Altus-Five Labs
Google App Engine Java ã®ã‚¢ãƒ—リを作ã£ã¦ã¿ã¾ã—ãŸã€‚ ã¡ã‚‡ã£ã¨å‰ã«æ¤œç´¢ã‚¨ãƒ³ã‚¸ãƒ³ã®é–‹ç™ºã«è§¦ã‚Œã‚‹æ©Ÿä¼šãŒã‚ã£ãŸã®ã§ã€ä»Šå›žã®æ‰‹ç¿’ã„ã¯ã€å½¢æ…‹ç´ 解æžå™¨ã‚’ GAE/J ã§å‹•ã‹ã™ã“ã¨ã‚’テーマã«ã—ã¾ã—ãŸã€‚ ã¾ãšã¯ã€ä¸‹è¨˜ãƒšãƒ¼ã‚¸ã«æ›¸ã‹ã‚Œã¦ã„ã‚‹ 「Eclipse を使用ã—ã¦ï¼ˆã¾ãŸã¯ä½¿ç”¨ã›ãšã«ï¼‰App Engine Java プãƒã‚¸ã‚§ã‚¯ãƒˆã‚’作æˆã™ã‚‹æ–¹æ³•ã€ ã«ã—ãŸãŒã£ã¦é–‹ç™ºç’°å¢ƒã‚’作æˆã—ã¾ã™ã€‚ http://code.google.com/intl/ja/appengine/docs/java/gettingstarted/introduction.html ãã—ã¦ã€ã²ã¨é€šã‚Šãƒãƒ¥ãƒ¼ãƒˆãƒªã‚¢ãƒ«ã‚’試ã—ã¦ã€é–‹ç™ºç’°å¢ƒã«æ…£ã‚Œã¦ã—ã¾ã„ã¾ã™ã€‚ 実ã¯ã€æœ€åˆã¯ãƒãƒ¥ãƒ¼ãƒˆãƒªã‚¢ãƒ«ã¯è©¦ã•ãªã„ã§ã€ä»–ã« GAE/J を紹介ã—ã¦ã„る記事をå‚考ã«ã—ã¦ã€å¿…è¦ãªã“ã¨ã ã‘ã‚’ã‚„ã‚ã†ã¨ã—ãŸã‚“ã§ã™ã‘ã©ã€å¾Œã‹ã‚‰è€ƒãˆã‚‹ã¨ã€å…ˆã«ãƒãƒ¥ãƒ¼ãƒˆãƒªã‚¢ãƒ«ã‚’通ã—
Javaã§å®Ÿè£…ã•ã‚ŒãŸå½¢æ…‹ç´ 解æžå™¨ GoSen - mtbrã®æ—¥è¨˜
GoSen ãŒã‚ˆã•ã’ãªã®ã§ä½¿ã£ã¦ã¿ã‚‹ã€‚ プãƒã‚¸ã‚§ã‚¯ãƒˆãƒ›ãƒ¼ãƒ ページ（オリジナルã¯åˆ°é”ä¸èƒ½ï¼‰ http://web.archive.org/web/20071224025014/http://itadaki.org/wiki/index.php/GoSen GoSen is a comprehensive rewrite and upgrade of Sen, a pure Java LGPL morphological analysis library for Japanese which in turn was based on MeCab. GoSen is at present a de facto fork of Sen. It would be extremely useful if the work performed to create GoSen could be folde
1
ランã‚ング
ランã‚ング
メンテナンス
リリースã€éšœå®³æƒ…å ±ãªã©ã®ã‚µãƒ¼ãƒ“スã®ãŠçŸ¥ã‚‰ã›
最新ã®äººæ°—エントリーã®é…ä¿¡
j次ã®ãƒ–ックマーク
kå‰ã®ãƒ–ックマーク
lã‚ã¨ã§èªã‚€
eコメント一覧を開ã
oページを開ã
Google Code Archive - Long-term storage for Google Code Project Hosting.
2008-12-31
Javaã§ä½œã‚‰ã‚ŒãŸå½¢æ…‹ç´ 解æžãƒ©ã‚¤ãƒ–ラリ「Senã€ã‹ã‚‰Perlä¾å˜æ€§ã‚’排除ã—ãŸã€ŒGoSenã€
{{#tags}}- {{label}}
{{/tags}}