2017.12.15 Friday
鐃緒申鐃楯ンサ￥申鐃緒申鐃緒申鐃緒申
鐃緒申鐃緒申鐃緒申峭鐃緒申鐃緒申鐃緒申覆鐃緒申鐃緒申畊�鐃緒申鐃宿緒申鐃緒申鐃緒申討鐃緒申泙鐃�
| 鐃緒申鐃楯ンサ￥申鐃宿ワ申鐃� | - | | - | - |
鐃舜醐申鐃緒申鐃淑わ申Lucene鐃瞬ワ申鐃緒申
OSS鐃緒申鐃緒申鐃初イ鐃瞬ワ申鐃緒申Lucene鐃緒申鐃緒申咾鐃緒申離鐃緒申屮廛鐃緒申鐃緒申鐃緒申鐃緒申函鐃�Solr/Tika/Mahout鐃淑ど）につわ申鐃緒申
2017.12.15 Friday
Solr 鐃緒申鐃暑あ鐃緒申
鐃緒申鐃述わ申 Apache Solr 鐃祝関わ申鐃暑教鐃初／鐃緒申鐃藷サワ申謄鐃緒申鵐亜鐃緒申鐃緒申檗鐃緒申箸粒謄鐃緒申鐃緒申咼鐃緒申鐃緒申鷆，鐃緒申討鐃緒申襪�鐃緒申鐃緒申務鐃緒申鐃縮わ申鐃銃ユー鐃緒申鐃緒申鐃祝わ申鐃� Solr 鐃塾誌申念鐃淑使わ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃暑こ鐃夙もた鐃俊わ申鐃俊わ申鐃暑。鐃緒申鐃緒申鐃叔はわ申鐃緒申鐃緒申Solr 鐃緒申鐃暑あ鐃緒申廚鐃緒申鐃緒申里鐃緒申鴇匆陲靴討澆茲�鐃緒申鐃淑わ申鐃緒申鐃緒申鐃緒申鐃緒申辰鐃� Apache Lucene 鐃祝わ申鐃緒申鐃銃はまるが鐃緒申鐃緒申鐃叔は器申単鐃祝￥申Solr 鐃緒申鐃暑あ鐃緒申廚筏鐃緒申椶鐃緒申襪鰹申箸砲鐃緒申襦�
鐃緒申鐃緒申鐃緒申鐃竣醐申鐃緒申鐃緒申鐃緒申岼鐃緒申弩鐃緒申鐃�
鐃春ワ申鐃緒申鐃緒申鐃� f1 鐃緒申 abc 鐃叔始まわ申鐃塾を検削申鐃緒申鐃緒申里鐃� q=f1:abc* 鐃夙わ申鐃緒申鐃所、abc 鐃緒申鐃春ワ申鐃緒申鐃緒申鐃� f1 鐃緒申妨鐃緒申鐃緒申鐃塾を検削申鐃緒申鐃緒申里鐃� q=f1:*abc* 鐃夙わ申鐃緒申里聾鐃緒申鐃叔わ申鐃暑。鐃緒申鐃緒申的鐃緒申鐃緒申鐃峻わ申鐃緒申鐃緒申鐃緒申鐃竣醐申鐃緒申鐃緒申鐃緒申圓鐃緒申鐃瞬逸申鐃竣醐申鐃緒申鐃淑どと呼ばわ申襪�鐃緒申転鐃瞬ワ申鐃緒申妊奪鐃緒申鐃緒申鐃緒申鐃緒申慮鐃緒申鐃緒申鐃緒申鵐献鐃叔は醐申鐃緒申鐃出象の最常申単鐃縮わ申単鐃緒申箸覆蝓�単鐃緒申隆鐃緒申鐃緒申鐃緒申廚鐃緒申鐃緒申椶箸覆襦ｏ申鐃緒申鐃緒申鐃緒申辰董鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申弩鐃緒申鐃緒申廖鐃緒申鐃瞬逸申鐃竣醐申鐃緒申鐃竣とわ申鐃緒申鐃処う鐃淑鰹申念鐃緒申鐃淑わ申鐃緒申鐃緒申鐃緒申鐃出象フワ申鐃緒申鐃緒申匹鐃獣縁申鐃塾常申鐃熟器申鐃緒申鐃緒申鐃竣醐申鐃緒申鐃夙なるし鐃緒申2単鐃緒申幣鐃塾フワ申鐃緒申鐃緒申匹任鐃緒申鐃緒申鐃緒申岼鐃緒申弩鐃緒申鐃緒申箸覆襦ｏ申鐃緒申鐃緒申鐃緒申辰董鐃緒申鐃瞬逸申鐃竣醐申鐃緒申鐃緒申単鐃緒申隆鐃緒申鐃緒申鐃緒申廖砲鬚靴鐃緒申鐃緒申里任鐃緒申鐃出￥申q=f1:*abc* 鐃夙はわ申鐃緒申鐃緒申 q=f1:abc 鐃夙わ申鐃緒申个鐃緒申鐃緒申鐃緒申鐃緒申q=f1:*abc* 鐃叔醐申鐃緒申鐃叔わ申鐃銃わ申鐃緒申茲�鐃祝醐申鐃緒申鐃銃わ申鐃緒申里蓮鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申淵僖鐃緒申鐃緒申鵑�考わ申鐃緒申鐃暑が鐃緒申文鐃緒申鐃緒申鐃緒申呂硫鐃緒申鐃緒申鐃� * 鐃緒申鐃緒申箸鐃緒申鐃銃件申鐃重�鐃緒申 abc 鐃夙わ申鐃緒申単鐃曙検鐃緒申鐃祝なってわ申鐃暑、鐃淑どわ申鐃粛わ申鐃緒申鐃暑。
鐃叔わ申鐃緒申鐃緒申鐃緒申鐃竣はどわ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃竣醐申鐃緒申鐃薯しわ申鐃緒申鐃緒申鐃熟￥申転鐃瞬ワ申鐃緒申妊奪鐃緒申鐃緒申虜鐃緒申鐃緒申鐃緒申鐃竣わ申鐃暑。鐃緒申鐃緒申的鐃祝わ申 EdgeNGramTokenizer鐃淑常申鐃縮にわ申辰討鐃� EdgeNGramTokenFilter鐃祝わ申箸辰謄鐃緒申鐃叔ッワ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申襦ｏ申鐃緒申鐃緒申箸鐃緒申函鐃�abcdefg 鐃夙わ申鐃緒申鐃春ワ申鐃緒申鐃緒申鐃淑醐申鐃緒申鐃熟種申鐃塾よう鐃緒申単鐃緒申分鐃巡さ鐃曙、鐃緒申鐃緒申妊奪鐃緒申鐃緒申鐃緒申鐃緒申鐃暑。
a ab abc abcd abcde abcdef abcdefg
鐃緒申鐃塾フワ申鐃緒申鐃緒申匹鐃緒申个鐃緒申鐃�abc 鐃夙わ申鐃緒申文鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申弩鐃緒申鐃緒申鬚靴鐃緒申鐃緒申鐃出￥申鐃緒申鐃緒申鐃緒申側鐃熟ト￥申鐃緒申鐃淑ワ申鐃緒申鐃緒申鐃緒申鐃緒申鐃縦まわ申 KeywordTokenizer 鐃緒申箸辰董幣鐃緒申砲鐃獣てわ申 LowerCaseFilter 鐃緒申鐃夙み刻申錣誌申討鐃処い鐃緒申鐃緒申鐃塾常申鐃熟ワ申鐃緒申妊奪鐃緒申鐃渋�鐃祝わ申適鐃術わ申鐃暑。鐃淑駕申同鐃緒申鐃祝種申鐃塾よう鐃祝醐申鐃緒申鐃緒申鐃暑。
q=f1:abc
単鐃緒申隆鐃緒申鐃緒申鐃緒申弩鐃緒申鐃緒申鐃緒申鐃緒申椶慮鐃緒申鐃緒申鐃緒申鵐献鐃叔緒申鐃処型鐃塾￥申鐃緒申鐃緒申鐃緒申鐃竣醐申鐃緒申鐃竣￥申鐃緒申岼鐃緒申弩鐃緒申鐃緒申廚鬚靴鐃緒申鐃緒申鐃順、* 鐃緒申箸鐃緒申鐃緒申鐃緒申鐃� Solr 鐃緒申鐃暑あ鐃緒申任鐃緒申襪�鐃緒申鐃緒申鐃緒申鐃緒申鐃熟わか鐃暑が鐃瞬違い鐃叔わ申鐃暑。鐃緒申鐃緒申麓鐃緒申能劼戮鐃緒申鐃緒申鐃緒申鐃竣醐申鐃緒申鐃叔わ申同鐃粛でわ申鐃暑。
鐃緒申鐃緒申鐃緒申鐃竣醐申鐃緒申
同鐃緒申鐃緒申鐃緒申鐃春ワ申鐃緒申鐃緒申鐃緒申佑鐃� abc 鐃叔緒申鐃緒申鐃淑醐申鐃緒申探鐃緒申鐃夙わ申鐃緒申鐃緒申味鐃緒申鐃緒申鐃銃醐申鐃緒申鐃緒申鐃竣醐申鐃緒申鐃薯しわ申鐃緒申鐃夙わ申鐃緒申鐃塾わ申 q=f1:*abc 鐃夙わ申鐃緒申鐃緒申鐃緒申鐃緒申鐃夙�鐃峻わ申鐃緒申里鐃� Solr 鐃緒申鐃暑あ鐃緒申任鐃緒申襪�鐃緒申鐃緒申鐃緒申任鐃緒申襦�Lucene 鐃緒申転鐃瞬ワ申鐃緒申妊奪鐃緒申鐃緒申鐃獣縁申譴�鐃緒申鐃緒申鐃夙わ申鐃曙た鐃緒申鐃瞬で鰹申納鐃緒申鐃緒申討鐃緒申襪鰹申箸鐃緒申鐃緒申僂鐃緒申鐃緒申鐃淑�探鐃緒申鐃緒申鐃緒申襦ｏ申鐃緒申鐃緒申鐃緒申辰董鐃獣縁申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃竣わ申鐃銃わ申鐃暑か鐃宿わ申鐃緒申鐃緒申鐃叔э申鐃緒申鐃祝は￥申転鐃瞬ワ申鐃緒申妊奪鐃緒申鐃緒申鐃緒申単鐃緒申鐃緒申鐃緒申覆瓩件申覆鐃緒申鐃出なわ申覆鐃緒申覆辰討鐃緒申泙鐃緒申鐃緒申鐃緒申里鐃緒申瓠�鐃緒申速鐃緒申鐃緒申鐃薯信常申箸鐃緒申鐃�Lucene鐃祝はわ申鐃塾よう鐃淑醐申鐃緒申鐃緒申鐃術意わ申鐃緒申討鐃緒申覆鐃緒申鐃�API鐃緒申箸辰鐃緒申鐃緒申覆瓩刻申襪鰹申箸浪鐃叔緒申法鐃緒申任鐃� Lucene/Solr 鐃叔醐申鐃緒申鐃緒申鐃竣醐申鐃緒申鐃熟でわ申鐃淑わ申鐃塾わ申鐃夙わ申鐃緒申鐃夙わ申鐃緒申覆鐃緒申箸呂覆鐃緒申鐃緒申鐃淑醐申鐃緒申鐃緒申鐃重常申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申廚砲鐃緒申鐃竣とわ申鐃緒申鐃銃ワ申鐃祝ッワ申鐃緒申箸鐃緒申鐃緒申鐃緒申鐃重�鐃祝はワ申鐃緒申妊奪鐃緒申鐃渋�鐃緒申鐃緒申鐃緒申鐃緒申側鐃緒申鐃緒申鐃緒申 ReverseStringFilter 鐃緒申適鐃術わ申鐃暑。
鐃緒申鐃緒申妊奪鐃緒申鐃渋�鐃叔は￥申KeywordTokenizer+ReverseStringFilter+EdgeNGramTokenFilter 鐃緒申鐃術わ申鐃暑。鐃緒申鐃緒申函鐃�abcdefg 鐃夙わ申鐃緒申文鐃緒申鐃緒申蓮鐃緒申鐃緒申里茲�鐃祝ワ申鐃緒申妊奪鐃緒申鐃緒申鐃緒申展鐃緒申鐃緒申鐃緒申襦�
g gf gfe gfed gfedc gfedcb gfedcba
鐃緒申鐃緒申鐃緒申側鐃緒申 KeywordTokenizer+ReverseStringFilter 鐃緒申適鐃術わ申鐃暑。鐃緒申鐃緒申函鐃�efg 鐃夙わ申鐃緒申文鐃緒申鐃緒申慮鐃緒申鐃緒申鐃緒申弩鐃緒申鐃緒申蓮鐃�q=f1:efg 鐃緒申鐃所げ鐃緒申个茲わ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃春ワ申鐃緒申鐃緒申匹鐃淑醐申鐃緒申鵑�居申転鐃緒申鐃曙た鐃緒申埜鐃緒申鐃緒申鐃緒申鐃暑こ鐃夙で￥申gfe 鐃緒申鐃述ットわ申鐃暑。
鐃春ワ申鐃緒申鐃獣トにわ申鐃淑わ申鐃緒申澹鐃緒申鐃緒申鐃� fq 鐃緒申箸鐃淑わ申
鐃春ワ申鐃緒申鐃獣トにわ申鐃淑わ申鐃緒申澹鐃緒申鐃緒申鐃� fq 鐃緒申箸錣削申鐃�q 鐃術ワ申瓠種申鐃緒申鐃� AND 鐃叔絞わ申鐃緒申濔鐃緒申鐃緒申媛辰鐃緒申討鐃緒申鐃緒申里鐃処く鐃緒申鐃緒申 Solr 鐃緒申鐃暑あ鐃緒申任鐃緒申襪�鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申任鐃緒申襦�fq 鐃祝わ申觚￥申鐃緒申鐃縮の絞わ申鐃緒申澆癲�AND 鐃緒申鐃緒申媛辰砲鐃暑検鐃緒申鐃塾絞わ申鐃緒申澆癲�鐃瞬わ申鐃緒申鐃淑醐申饅弦鐃緒申同鐃緒申鐃叔わ申鐃暑。鐃緒申鐃緒申鐃緒申文鐃緒申僚鐃緒申屐淵鐃藷キング）を見てみわ申鐃塾常申圓楼曚覆襪鰹申箸鐃緒申錣�鐃暑。鐃潤イ鐃緒申離鐃緒申鐃緒申鐃緒申q 鐃術ワ申瓠種申鐃緒申砲鐃� AND 鐃叔絞わ申鐃緒申濔鐃緒申鐃緒申媛辰鐃緒申討鐃緒申泙鐃緒申函鐃緒申鐃緒申鐃熟ワ申鐃緒申鐃緒申鐃竣誌申鐃緒申鐃出象になってわ申鐃殉わ申鐃塾で￥申AND 鐃緒申箸鐃緒申鐃祝￥申鐃緒申塙覆鐃緒申鐃準た鐃俊にワ申鵐�ングわ申鐃循なってわ申鐃殉わ申鐃緒申鐃縦まわ申罅種申鐃緒申鐃緒申鐃緒申藐�鐃緒申函鐃緒申侫鐃緒申鐃緒申奪箸離鐃藷クをクワ申奪鐃緒申鐃緒申襪随申咾鐃淑醐申鐃緒申表鐃緒申鐃順が鐃循なってわ申鐃殉わ申鐃緒申鐃緒申鐃緒申任魯罅種申鐃緒申鐃緒申鐃緒申鐃緒申陲垢鐃緒申鐃緒申鐃緒申鐃緒申鐃殉わ申鐃緒申filterCache 鐃緒申鐃緒申鐃殉わ申鐃夙わ申鐃淑わ申鐃緒申鐃夙わ申鐃緒申鐃縮わ申鐃緒申鐃緒申鐃熟わ申鐃叔わ申鐃暑。
鐃春ワ申鐃緒申鐃獣トにわ申鐃淑わ申鐃緒申澹鐃緒申鐃緒申任蓮鐃�AND 鐃緒申箸錣� fq 鐃緒申箸鐃緒申鐃緒申罰个鐃緒申討鐃緒申鐃緒申鐃緒申鐃�
鐃緒申鐃緒申鐃緒申鐃祝わ申鐃渋�鐃准わ申
鐃瞬ワ申鐃緒申鐃緒申鐃緒申0.5未鐃緒申鐃緒申文鐃緒申鐃渋�鐃准りし鐃緒申鐃瞬却わ申鐃緒申覆鐃緒申茲�鐃祝わ申鐃緒申鐃緒申鐃竣などとわ申鐃獣わ申鐃緒申望鐃緒申 Solr 鐃緒申鐃暑あ鐃緒申任鐃緒申襪�鐃緒申鐃緒申鐃緒申鐃淑ンセンスでわ申鐃所、鐃渋施わ申鐃処う鐃夙わ申鐃緒申奮闘鐃緒申鐃暑こ鐃夙種申鐃塾￥申鐃緒申鐃瞬わ申無鐃縮でわ申鐃暑。
鐃緒申鐃緒申鐃緒申鐃舜随申鐃塾パワ申瓠種申鐃緒申鐃緒申呂鐃緒申譴�鐃駿ワ申鐃夙ワ申鐃緒申屮鐃叔ワ申戞鐃緒申鐃緒申鐃� TFIDFSimilarity 鐃叔わ申鐃曙、鐃緒申率鐃緒申妊鐃駿￥申鐃緒申鐃緒申 BM25Similarity 鐃叔わ申鐃曙、鐃緒申鐃緒申鐃緒申罰鐃淑醐申鐃叔わ申鐃暑。鐃緒申鐃緒申鐃緒申鐃熟ワ申鐃緒申鐃緒申鐃緒申鐃所し鐃緒申鐃夙わ申鐃祝￥申鐃緒申文鐃緒申鐃緒申鐃粛随申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申箸隆鐃熟�鐃駿合い鐃緒申表鐃緒申鐃緒申鐃緒申鐃緒申里任鐃緒申襪�鐃初、鐃緒申鐃緒申鐃所が鐃術わ申辰討鐃緒申泙鐃緒申鐃緒申鐃淳わ申鐃緒申咾鐃緒申襪鰹申箸飽鐃縮ｏ申鐃緒申覆鐃緒申鐃緒申鐃緒申鐃緒申鐃� A 鐃叔ワ申鐃緒申鐃緒申 0.4 鐃緒申鐃緒申鐃緒申鐃緒申鐃淑醐申颪�ワ申鐃緒申鐃緒申 A 鐃緒申鐃緒申鐃祝器申連鐃緒申鐃銃わ申鐃暑が鐃緒申鐃緒申鐃緒申鐃緒申 B 鐃叔ワ申鐃緒申鐃緒申 0.6 鐃緒申鐃緒申鐃緒申鐃緒申鐃淑醐申颪�ワ申鐃緒申鐃緒申 B 鐃祝わ申鐃緒申鐃緒申鐃銃器申連鐃緒申鐃銃わ申鐃緒申箸聾鐃緒申鐃緒申覆鐃緒申鐃緒申箸鐃緒申鐃緒申鐃緒申箸鐃緒申鐃緒申鐃緒申鐃緒申砲鐃緒申蠅�鐃暑。
鐃緒申鐃緒申鐃塾ハワ申鐃初イ鐃緒申
鐃熟ワ申鐃初イ鐃夙居申能鐃淑醐申鐃緒申鐃緒申鐃緒申鐃緒ー鐃宿わ申泙鐃淑醐申颯好縫撻奪箸鐃緒申擇鐃出わ申鐃緒申鐃緒申鐃緒申鐃緒ー鐃宿わ申鐃緒申鐃緒申鐃淑わ申鐃緒申立鐃縦よう鐃緒申表鐃緒申鐃緒申鐃暑機能鐃祝につわ申鐃銃￥申Solr 鐃緒申鐃緒申鐃獣てわ申鐃緒申魯鐃緒申薀わ申筏鐃叔緒申鐃夙わず鐃祝￥申Web鐃緒申鐃竣リケ鐃緒申鐃緒申鐃緒申鐃緒申JavaScript鐃殉わ申砲任鐃緒申鐃出ってわ申鐃殉わ申鐃緒申鐃夙わ申鐃緒申鐃塾もた鐃殉に醐申鐃緒申 Solr 鐃緒申鐃暑あ鐃緒申任鐃緒申襦�Solr 鐃祝ハワ申鐃初イ鐃夙居申能鐃緒申鐃緒申鐃暑こ鐃夙わ申鐃塾らず鐃祝種申鐃緒申鐃叔種申鐃緒申鐃緒申鐃銃わ申鐃殉わ申鐃術ワ申鐃緒申鐃緒申Solr鐃祝ハワ申鐃初イ鐃夙居申能鐃緒申鐃緒申鐃暑こ鐃夙わ申鐃塾ってわ申鐃暑が鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃処い鐃夙随申鐃緒申鐃銃種申鐃緒申鐃叔種申鐃緒申鐃緒申鐃銃わ申鐃殉わ申鐃術ワ申鐃緒申鐃藷がわ申鐃緒申茲�鐃緒申鐃緒申鐃緒申鐃峻わ申鐃塾わ申覆鐃緒申辰鐃緒申箸鐃緒申鐃緒申鐃緒申箸任鐃緒申鐃緒申鐃緒申任箸鐃緒申鐃渋常申覆鐃緒申鐃緒申鐃峻は￥申鐃淑わ申鐃緒申鐃塾よう鐃緒申発鐃循になわ申里鐃緒申茲�鐃緒か鐃緒申覆鐃緒申鐃�Solr 鐃塾ハワ申鐃初イ鐃夙居申能鐃熟わ申鐃緒申曚匹茲�鐃叔わ申鐃銃わ申鐃暑。鐃緒申鐃緒申鐃叔器申張鐃緒申鐃緒申鐃緒申鐃塾ワ申鐃獣トをあわ申鐃銃上げ鐃緒申覆鐃出￥申鐃緒申鐃夙わ申鐃出￥申鐃緒申鐃緒申鐃緒申側鐃緒申CPU鐃緒申戮魏爾鐃緒申襪随申瓠�鐃醇ー鐃緒申鐃緒申鐃塾ブラウ鐃緒申鐃祝わ申JavaScript鐃叔ハワ申鐃初イ鐃夙わ申鐃緒申鐃順、鐃緒申鐃粛わ申鐃緒申鐃暑か鐃盾し鐃緒申覆鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申離鐃緒申奪箸鐃塾�鐃叔￥申鐃緒申鐃塾居申能鐃緒申鐃緒申鐃緒申鐃緒申 Solr 鐃緒申鐃緒申鐃祝よく鐃叔わ申鐃緒申鐃熟ワ申鐃初イ鐃夙居申能鐃緒申箸鐃淑わ申鐃叔ワ申鐃獣トをアプリケ鐃緒申鐃緒申鐃緒申鐃祝種申鐃緒申鐃緒申鐃銃わ申鐃殉ってわ申鐃暑こ鐃夙に居申鐃重わ申鐃銃わ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃�
- 鐃緒申鐃緒申鐃緒申鐃緒申鐃緒ー鐃宿わ申鐃淑わ申戮鐃渋随申鐃緒申泙泙鐃緒申任鐃緒申長鐃塾ワ申鐃祝ペットわ申任鐃春の個随申鐃緒申鐃暑こ鐃夙わ申鐃叔わ申鐃暑。Solr 鐃叔はワ申鐃祝ペットにもス鐃緒申鐃緒申鐃緒申鐃縦わ申鐃緒申譟�鐃緒申鐃緒申鐃緒申鐃塾高い鐃緒申鐃祝ペットわ申鐃緒申鐃瞬わ申鐃緒申襦Ｆ縁申鐃緒申鐃叔緒申鬟▲廛螢縁申鐃緒申鐃緒申鐃緒申粘鐃縦ワ申鐃緒申鐃緒申箸鐃緒申鐃夙￥申鐃緒申鐃祝ペットわ申鐃緒申鐃緒申鐃緒申鐃叔￥申鐃緒申鐃緒申鐃緒申鐃緒申鐃薯すべわ申転鐃緒申鐃緒申鐃銃わ申鐃淑わ申鐃緒申个覆鐃淑わ申鐃緒申鐃緒申鐃緒申転鐃緒申鐃緒申鐃緒申 Solr 鐃緒申鐃盾し鐃緒申覆鐃緒申鐃緒申鐃�RDB 鐃緒申鐃盾し鐃緒申覆鐃緒申鐃緒申鐃�Solr 鐃塾ハワ申鐃初イ鐃夙居申能鐃叔削申鐃緒申鐃緒申鐃緒申鐃緒申鐃祝ペットわ申鐃緒申鐃順き鐃淑ワ申鐃緒申鐃緒申鐃祝なるこ鐃夙わ申多鐃緒申鐃緒申鐃粛ットワー鐃緒申鐃緒申戮慮鐃緒申鐃緒申箸覆襦�
- Solr 鐃叔わ申表鐃緒申鐃宿わ申鐃緒申慮鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申能鐃叔わ申鐃暑が鐃緒申鐃熟ワ申鐃初イ鐃夙でわ申同鐃緒申表鐃緒申鐃宿わ申鐃緒申慮鐃緒申鐃緒申鐃緒申妊魯鐃緒申薀わ申鐃宿緒申鐃緒申鐃緒申鐃叔緒申任鐃緒申襦ｏ申鐃緒申廛螢縁申鐃緒申鐃緒申鐃緒申粘鐃縦ワ申鐃緒申鐃熟￥申同鐃緒申表鐃緒申鐃宿わ申鐃出縁申鐃薯しなわ申鐃緒申亳鐃緒申鐃緒申縫劵奪箸鐃緒申討鐃熟ワ申鐃初イ鐃緒申表鐃緒申鐃緒申鐃叔わ申鐃淑わ申鐃緒申腓�鐃出てわ申鐃銃わ申鐃殉わ申鐃緒申鐃殉わ申鐃出縁申鐃緒申鐃緒申表鐃緒申鐃宿わ申襦種申襪�鐃術わ申辰鐃緒申鐃順、Solr 鐃叔わ申辰討鐃緒申鐃緒申鐃緒申鐃緒申侫鐃緒申鐃緒申鐃緒申鐃術刻申鐃叔醐申鐃緒申鐃緒申魯鐃緒申薀わ申箸鐃宿わ申鐃緒申鐃緒申弍鐃緒申任鐃緒申討鐃緒申泙鐃緒申鐃緒申鐃緒申鐃緒申廛螢縁申鐃緒申鐃緒申鐃緒申粘鐃縦ワ申鐃緒申鐃緒申鐃緒申両鐃緒申蓮鐃�Solr 鐃緒申鐃緒申鐃緒申鐃術刻申鐃緒申鐃緒申鐃竣リケ鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃祝影駈申鐃緒申鐃銃わ申鐃殉わ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申兒鐃緒申砲覆襦�
- Solr 鐃塾ワ申鐃祝ペットわ申単鐃曙境鐃緒申鐃緒申鐃准わ申覆鼻鐃緒申鐃緒申鐃緒申鐃獣縁申未妊鐃緒申縫撻奪鐃緒申鐃緒申鐃緒申鐃緒申任鐃緒申鐃処う鐃祝なってわ申鐃暑。鐃緒申鐃緒申法鐃�Solr 鐃叔は醐申鐃緒申鐃緒申鐃緒申鐃緒ー鐃宿わ申鐃春レー鐃緒申鐃塾常申隋�鐃春レー鐃緒申鐃緒申鐃緒申鐃竣わ申鐃銃わ申鐃緒申鐃緒申里潺魯鐃緒申薀わ申箸鐃緒申鐃緒申鐃緒申蝓�単鐃緒申単鐃夙でハワ申鐃初イ鐃夙わ申鐃緒申鐃緒申鐃緒申箸鐃緒申辰鐃緒申戮鐃緒申鐃緒申鐃緒申罎�鐃緒申能鐃叔わ申鐃暑。同鐃粛のわ申鐃夙をアプリケ鐃緒申鐃緒申鐃緒申鐃叔わ申蕕誌申茲�鐃夙わ申鐃緒申弌鐃緒申憤廚任鐃緒申鐃�NLP的鐃緒申能鐃薯アプリケ鐃緒申鐃緒申鐃緒申鐃祝誌申鐃緒申鐃緒申鐃淑わ申鐃緒申个覆鐃淑わ申鐃緒申
- Solr 鐃叔はワ申鐃祝ペットわ申鐃緒申鐃淑わ申鐃緒申鐃緒申鐃緒申鐃緒申表鐃緒申鐃緒申鐃緒申蠅刻申襪鰹申箸鐃緒申任鐃緒申鐃緒申鐃緒申鐃緒申魯魯鐃緒申薀わ申鐃宿緒申鐃緒申鐃緒申茲�鐃夙わ申鐃緒申鐃緒申鐃緒申鐃春ワ申鐃緒申鐃緒申匹鐃緒申鐃銃�100文鐃緒申鐃淑ど）￥申
鐃夙わ申鐃緒申鐃緒申鐃夙で￥申Solr 鐃塾ハワ申鐃初イ鐃夙居申能鐃熟醐申鐃緒申鐃緒申鐃竣リケ鐃緒申鐃緒申鐃緒申鐃塾わ申鐃夙わ申茲�鐃緒申慮鐃緒申鐃緒申鐃術意わ申鐃緒申討鐃緒申蝓�鐃緒申鐃術よく鐃叔わ申鐃銃わ申鐃暑。鐃緒申鐃緒申鐃緒申鐃術意わ申鐃緒申箸鐃緒申鐃緒申里呂鐃緒申鐃緒申討鐃緒申両鐃緒申鐃緒申辰討鐃緒申鐃緒申鐃叔醐申鐃叔わ申鐃暑。
鐃淑わ申鐃緒申鐃緒申鐃緒申鐃緒申粍鐃緒申鐃宿緒申鐃緒申鐃緒申縫魯鐃緒申薀わ申肇鐃緒申縫撻奪箸鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃醇ー鐃緒申鐃緒申鐃塾ワ申鐃緒申奪鐃緒申砲鐃緒申鐃緒申鐃緒申文鐃緒申表鐃緒申鐃緒申鐃祝醐申鐃緒申鐃緒申鐃緒申鐃緒ー鐃宿わ申鐃緒申鐃緒申鐃淑わ申鐃緒申立鐃縦よう鐃緒申表鐃緒申鐃緒申鐃暑機能鐃熟￥申鐃緒申鐃緒申鐃叔わ申鐃緒申鐃熟ワ申鐃初イ鐃夙居申能鐃夙は異なる。鐃緒申鐃緒申鐃叔わ申鐃緒申鐃熟ワ申鐃初イ鐃夙居申能鐃熟￥申鐃緒申鐃緒申鐃緒申粍鐃緒申鐃宿緒申鐃緒申鐃緒申法鐃緒申罅種申鐃緒申鐃緒申鐃重�鐃准わ申文鐃緒申鬚垢个笋�鐃緒申鐃薯してわ申蕕�鐃緒申鐃緒申離鐃緒申鐃緒申鐃緒申筏鐃叔緒申鐃緒申鐃緒申鐃緒申鐃緒申襦ｏ申罅種申鐃緒申鐃緒申魯魯鐃緒申薀わ申肇鐃緒申縫撻奪箸鐃淑醐申鐃薯クワ申奪鐃緒申鐃緒申襪�鐃宿わ申鐃緒申鐃塾誌申鐃粛にわ申鐃暑た鐃潤、Solr 鐃塾ハワ申鐃初イ鐃夙居申能鐃熟わ申鐃緒申鐃術駈申的鐃緒申鐃緒申鐃術わ申鐃処う鐃淑わ申鐃緒申鐃緒申鐃緒申鐃緒申鐃淑の写随申鐃薯検削申鐃緒申粍鐃緒申鐃緒申鐃宿緒申鐃緒申鐃緒申鐃処う鐃緒申EC鐃緒申鐃緒申鐃夙の醐申鐃緒申鐃緒申鐃竣ワ申里茲�鐃淑わ申里禄鐃緒申鐃緒申法鐃�
鐃緒申鐃緒申鐃叔上げ鐃緒申鐃淑鰹申鐃祝も、RDB 鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃曙た鐃銃￥申鐃瞬ワ申鬚修里泙鐃� Solr 鐃塾ワ申鐃緒申妊奪鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申泙縫泪奪團鵐阿鐃� Solr 鐃緒申 JOIN 鐃緒申箸鐃緒申鐃緒申襪�鐃緒申筺�鐃銃子鰹申鐃舜のフワ申鐃緒申鐃獣トわ申鐃緒申鐃叔器申張鐃暑あ鐃暑あ鐃暑、鐃緒申鐃緒申鐃緒申鐃緒申蠅駕申鐃楯に常申縫鐃緒申屮襯�鐃緒申鐃緒申鐃銃￥申鐃緒申鐃緒申鐃叔わ申鐃緒申鐃獣てわ申鐃殉わ申鐃緒申鐃暑あ鐃緒申覆匹發�鐃暑。
Solr 鐃緒申 OSS 鐃祝なっわ申10年鐃緒申超鐃緒申鐃暑ソ鐃春トワ申鐃緒申鐃緒申鐃夙なっわ申鐃緒申鐃緒申能鐃盾十分豊鐃駿で￥申鐃緒申蠅随申鐃緒申鐃緒申箸鐃渋随申鐃緒申呂鐃緒申任鐃� Solr 鐃緒申鐃緒申鐃獣てわ申鐃暑こ鐃夙わ申多鐃緒申鐃緒申鐃緒申鐃竣リケ鐃緒申鐃緒申鐃緒申鐃叔器申張鐃緒申鐃緒申鐃祝わ申鐃述マニュア鐃緒申鐃緒申鐃緒申鐃緒申鐃叔鰹申鐃緒申鐃緒申鐃暑機能鐃緒申鐃淑わ申鐃緒申鐃緒申鐃夙わ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃銃ワ申鐃緒申鐃緒申鳳鐃獣わ申鐃緒申里砲覆辰討鐃緒申襪�鐃緒申鐃緒申鐃緒申鐃駿考わ申鐃銃みるこ鐃夙をお器申鐃潤し鐃緒申鐃緒申鐃緒申
鐃緒申鐃銃￥申鐃緒申年鐃熟わ申鐃緒申鐃初く鐃旬居申鐃緒申鐃緒申鐃叔醐申箸覆鐃叔わ申鐃順う鐃緒申鐃緒申鐃緒申鐃緒申鐃駿わ申鐃緒申鐃淑わ申鐃淑っわ申鐃塾にもか鐃緒申鐃緒申蕕削申鐃緒申鐃叔�鐃盾ご鐃緒申鐃宿わ申鐃緒申鐃緒申鐃緒申鐃緒申鐃所が鐃夙わ申鐃緒申鐃緒申鐃緒申鐃殉わ申鐃緒申鐃緒申鐃緒申鐃粛￥申鐃処い鐃緒申年鐃薯お迎わ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申
2017.08.25 Friday
LUCENE-6819: Good bye index-time boost
Lucene/Solr 7.0 鐃塾ワ申蝓種申鐃緒申鐃緒申鐃宿種申鐃緒申泙鐃淑わ申鐃熟まわ申鐃緒申鐃夙わ申鐃銃わ申鐃暑。
鐃緒申鐃緒申笋�鐃緒申鐃祝なってわ申鐃緒申里鐃緒申鐃�LUCENE-6819 鐃祝わ申觸わ申鐃緒申任鐃緒申襦�
Deprecate index-time boosts?
https://issues.apache.org/jira/browse/LUCENE-6819
鐃緒申鐃緒申鐃夙ワ申鐃緒申鐃緒申鐃緒申鐃夙￥申鐃瞬ワ申鐃緒申妊鐃緒申鐃緒申鵐飴鐃緒申屐鐃緒申鐃緒申函塀鼎鐃緒申佞鐃緒申砲鐃淳わ申茲�鐃竣￥申鐃緒申辰反鐃緒申匹澆鐃緒申鐃夙「ワ申鐃緒申鐃緒申鐃緒申暴鼎鐃緒申佞鐃緒申鐃緒申鐃緒申鐃叔わ申鐃暑か鐃初イ鐃緒申妊鐃緒申鐃緒申鵐飴鐃緒申暴鼎鐃緒申佞鐃緒申鐃緒申覆鐃緒申討發わ申鵑犬鐃粛￥申鐃竣ととらえ鐃銃わ申鐃殉わ申鐃緒申鐃盾い鐃暑か鐃盾し鐃緒申覆鐃緒申鐃緒申鐃緒申鐃緒申鐃藷、ワ申鐃緒申妊鐃緒申鐃緒申鵐飴鐃緒申鼎鐃緒申佞鐃緒申肇鐃緒申鐃緒申鐃緒申鐃重わ申鐃春わ申鐃叔は￥申鐃順き鐃緒申鐃緒申味鐃緒申鐃緒申的鐃緒申鐃循なる。[1]
鐃旬居申鐃緒申鐃叔は￥申LUCENE-6819 鐃夙器申連鐃緒申鐃緒申他鐃塾緒申鐃緒申鐃夙刻申錣誌申鐃�Lucene 7.0 鐃淑降わ申 fieldNorm 鐃緒申鐃宿のよう鐃祝なるか鐃緒申鐃緒申単鐃祝駕申鐃盾し鐃処う鐃緒申
LUCENE-6819鐃緒申鐃塾ワ申鐃緒申鐃獣トでは￥申鐃緒申鐃緒申鐃夙ワ申鐃縮り、鐃緒申鐃緒申妊鐃緒申鐃緒申鵐飴鐃緒申鐃�boost鐃緒申澆鐃処う鐃緒申鐃夙わ申鐃緒申鐃緒申里任鐃緒申襦ｏ申發�鐃緒申鐃緒申鐃駿わ申鐃緒申鐃緒申鐃緒申鐃夙￥申fieldNorm 鐃夙わ申鐃緒申鐃緒申鐃銃ドワ申鐃緒申鐃緒申箸粒謄侫鐃緒申鐃緒申鐃宿（わ申鐃緒申鐃緒申鐃緒申omitNorms=true鐃塾フワ申鐃緒申鐃緒申匹鐃緒申鐃緒申鐃祝わ申鐃夙わ申1鐃出ワ申鐃夙でワ申鐃藷コ￥申鐃叔ワ申鐃藷グわ申鐃曙た鐃粛の￥申鐃緒申鐃塾種申鐃緒申鐃緒申boost鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申箸鐃緒申鐃緒申鐃塾でわ申鐃暑。
fieldNorm = lengthNorm * boost
鐃緒申鐃淑みにわ申鐃塾種申鐃熟￥申BM25Similarity 鐃緒申鐃出場す鐃緒申鐃緒申鐃緒申痢鐃�Lucene/Solr 鐃緒申標鐃緒申任鐃緒申辰鐃緒申戰鐃緒申肇鐃緒申鐃瞬ワ申妊鐃祝わ申鐃緒申鵐�ング計誌申鐃淑各ドワ申鐃緒申鐃緒申箸離鐃緒申鐃緒申鐃緒申鐃出わ申鐃緒申鐃緒申鐃緒申抃彁鐃緒申砲剖鐃緒申鐃緒申鐃渋醐申鐃緒申討鐃緒申襦�Lucene/Solr 鐃熟ワ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申戰戞鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃塾よう鐃祝計誌申鐃緒申鐃曙た fieldNorm 鐃緒申鐃縮ｏ申鐃緒申討鐃緒申蝓�BM25 鐃叔刻申慮鐃緒申鐃緒申討鐃緒申鐃淑醐申鐃縦刻申呂箸辰鐃緒申鵬鐃縮ｏ申鐃緒申鐃銃わ申鐃暑。[2]
鐃緒申鐃銃￥申鐃緒申鐃曙か鐃緒申boost鐃緒申鐃緒申鐃緒申弌鐃緒申鐃緒申里茲�鐃祝なる。
fieldNorm = lengthNorm
lengthNorm 鐃熟デフワ申鐃緒申箸納鐃緒申里茲�鐃祝計誌申鐃緒申鐃緒申襦�
lengthNorm = 1 / sqrt(numTerms)
numTerms鐃緒申鐃緒申鐃緒申鐃春ワ申鐃緒申鐃緒申匹鐃獣縁申鐃緒申鐃叔わ申鐃暑。鐃緒申鐃緒申鐃緒申鐃獣て￥申lengthNorm 鐃緒申単鐃緒申鐃緒申鐃�1鐃塾誌申鐃緒申 1 / sqrt(1) = 1 / 1 = 1鐃緒申単鐃緒申鐃緒申鐃�2鐃塾誌申鐃緒申 1 / sqrt(2) = 1 / 1.414213562373095鐃緒申 = 0.70710678118655鐃緒申鐃夙わ申鐃緒申鐃緒申鐃祝なわ申里如鐃�0 < lengthNorm <= 1 鐃夙なる。鐃緒申鐃緒申鐃緒申鐃緒申Lucene 6.x 鐃緒申鐃緒申鐃叔は￥申boost 鐃緒申 lengthNorm 鐃祝わ申鐃緒申鐃獣わ申 fieldNorm 鐃緒申鐃緒申存鐃緒申鐃淑わ申鐃緒申个覆蕕削申鐃�boost 鐃緒申鐃粛はユー鐃緒申鐃緒申鐃緒申鐃所次鐃緒申覆里悩念鐃� Float.MAX_VALUE 鐃祝なってわ申鐃殉わ申鐃緒申鐃夙わ申佑鐃緒申鐃緒申襦ｏ申鐃緒申鐃緒申鐃� 0 鐃緒申鐃緒申 Float.MAX_VALUE 鐃塾刻申鐃緒申鐃緒申涌鐃緒申錣削申鐃�1鐃出ワ申鐃夙にマッピングわ申鐃銃わ申鐃緒申里鐃� Lucene 6.x 鐃叔わ申鐃緒申焚鐃緒申沺法鐃�
鐃緒申鐃緒申鐃緒申鐃緒申鐃循とわ申匹離罅種申鐃緒申鐃緒申魯鐃緒申鐃叔ワ申鐃緒申鐃藷グ誌申鐃重わ申鐃春わ申鐃淑どわ申鐃淑わ申鐃塾で￥申鐃緒申泪鐃緒申譟種申鐃緒申鐃淑�鐃緒申鐃緒申辰鐃緒申鐃緒申覆鐃緒申鐃�boost鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃叔緒申鐃緒申鐃粛わ申鐃緒申1鐃出ワ申鐃夙わ申半分鐃緒申弔鐃緒申討鐃緒申鐃塾わ申鐃緒申鐃緒申鐃循とわ申匹離罅種申鐃緒申鐃緒申鐃�boost=1鐃淑ので￥申鐃緒申鐃祝わ申辰鐃緒申鐃緒申覆鐃緒申鐃緒申鐃緒申帖鐃緒申鐃緒申鐃緒申戮併箸鐃緒申鐃緒申砲覆辰討鐃緒申襦�
鐃緒申鐃緒申鐃叔￥申LUCENE-6819 鐃叔は￥申
- Lucene 6.x 鐃叔わ申 boost 鐃緒申鐃緒申隼鐃緒申箸坊鐃緒申鐃緒申 API 鐃緒申 @deprecated 鐃夙わ申鐃緒申boost鐃緒申1鐃叔なわ申鐃粛わ申鐃緒申鐃緒申鐃緒申鐃緒申茲�鐃夙わ申鐃緒申函鐃緒申崗鐃緒申鐃出￥申鐃緒申鐃緒申鐃叔使わ申鐃淑わ申鐃淑わ申彁櫃侶拗鐃宿緒申鐃緒申鐃緒申鐃暑。
- Lucene 7.0 鐃叔は￥申boost 鐃緒申鐃緒申隼鐃緒申箸坊鐃緒申鐃緒申 API 鐃緒申鐃緒申 boost 鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃�fieldNorm 鐃祝わ申 lengthNorm 鐃緒申鐃塾わ申里鐃緒申鐃熟随申鐃緒申鐃緒申茲�鐃祝なっわ申鐃緒申
LUCENE-6819 鐃叔はまわ申 fieldNorm 鐃緒申1鐃出ワ申鐃夙わ申有鐃緒申鐃緒申鐃術わ申鐃緒申討鐃緒申覆鐃緒申鐃緒申鐃緒申鐃緒申任鐃緒申離鐃緒申鐃緒申奪箸任蓮鐃緒申侫鐃緒申鐃緒申鐃緒申長鐃緒申単鐃緒申鐃緒申砲鐃�SmallFloat.intoTobyte4(numTerms)鐃叔ワ申鐃藷コ￥申鐃宿わ申鐃緒申鐃緒申存鐃緒申鐃緒申茲�鐃祝緒申鐃緒申鐃緒申鐃曙た鐃緒申鐃緒申鐃夙わ申鐃緒申単鐃緒申鐃緒申鐃�1000鐃塾とわ申鐃熟￥申SmallFloat.intoTobyte4(1000)鐃緒申87鐃夙なり、鐃緒申鐃曙が鐃緒申録鐃緒申鐃緒申襦ｏ申妊鐃緒申鐃緒申匹砲鐃�SmallFloat.byte4ToInt()鐃緒申鐃夙わ申鐃暑。SmallFloat.byte4ToInt(87)鐃緒申984鐃夙なる。鐃緒申鐃淑みに￥申1鐃緒申40鐃熟ワ申鐃藷コ￥申鐃宿わ申鐃銃わ申1鐃緒申40鐃緒申鐃緒申呂鐃緒申鐃緒申鐃術わ申鐃淑わ申鐃祝￥申長鐃緒申41鐃緒申鐃緒申鐃緒申鐃緒申縫鐃緒申鵐魁鐃緒申匹砲鐃緒申鐃緒申鐃緒申鐃緒申腓�鐃緒申鐃淑わ申焚鐃緒申沺法鐃�
Lucene 6.x 鐃叔わ申 boost / sqrt(numTerms) 鐃塾計誌申鐃緒申未鐃�1鐃出ワ申鐃夙に逸申鐃縮わ申鐃緒申撞鐃熟随申鐃緒申鐃銃わ申鐃緒申鐃緒申鐃緒申Lucene 7.0鐃淑降でわ申 numTerms 鐃緒申鐃緒申鐃塾ままワ申鐃藷コ￥申鐃宿わ申鐃緒申鐃�1鐃出ワ申鐃夙に居申録鐃緒申鐃緒申襦ｏ申鐃熟わ申 BM25Similarity 鐃緒申標鐃緒申覆里如鐃�1 / sqrt(numTerms) 鐃緒申彁鐃緒申鐃緒申鐃緒申味鐃緒申鐃塾わ申鐃淑わ申鐃緒申鐃夙わ申鐃緒申鐃緒申鐃夙わ申鐃緒申
Lucene/Solr 7.0 鐃淑降わ申 omitNorms 鐃緒申鐃緒申鐃緒申鐃緒申僂鐃初ず有鐃緒申鐃叔わ申鐃暑。
鐃緒申鐃藷ウワ申鐃獣トの種申鐃緒申鐃駿駈申鐃緒申鐃緒申鐃緒申鐃緒申忙鐃緒申僂鐃緒申鐃�鐃緒申鐃初イ鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申討鐃緒申鐃塾で￥申鐃緒申錣誌申鐃緒申匹鐃緒申鐃淳わ申鐃緒申鐃緒申
[1] 鐃緒申鐃藷ウワ申鐃獣ト種申鼎離肇譟種申縫鵐哀鐃緒申鐃緒申鐃緒申鐃�Solr鐃緒申鐃緒申鐃竣では￥申鐃緒申鐃塾よう鐃緒申鐃緒申鐃緒申粉鐃緒申辰鐃緒申鐃叔�鐃祝駈申鐃緒申鐃銃わ申鐃殉わ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃淳はわ申鐃緒申鐃初か鐃緒申鐃緒申
[2] 鐃緒申鐃藷ウワ申鐃獣ト種申鼎離肇譟種申縫鵐哀鐃緒申鐃緒申鐃緒申鐃�Apache Mahout 鐃緒申 Spark鐃叔はわ申鐃緒申覽￥申鐃緒申惱鐃�鐃竣では￥申鐃緒申鐃緒申鐃舜緒申鐃塾わ申鐃殉わ申鐃殉なワ申妊鐃巡ア鐃暑ゴ鐃所ズ鐃緒申鐃緒申鐃叔�鐃祝駕申鐃盾し鐃銃わ申鐃殉わ申鐃緒申鐃駿￥申鐃緒申鐃獣ワ申鐃淑居申鐃緒申鐃舜緒申鐃塾駕申鐃緒申砲箸匹泙蕕削申鐃緒申楜鐃緒申鐃緒申砲鐃緒申鐃処う鐃淑￥申鐃緒申鐃緒申鐃緒申鐃藷ジワ申離鐃藷キングの醐申鐃祝なるス鐃緒申鐃緒申鐃竣誌申鐃塾考わ申鐃緒申鐃淑どわ申泙漾鐃緒申鐃緒申侫肇鐃緒申鐃緒申鐃緒申鐃夙�鐃塾実際の醐申鐃緒申鐃緒申鐃緒申立鐃緒申鐃緒申鐃銃わ申鐃緒申鐃遵し鐃銃わ申鐃殉わ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃淳はわ申鐃緒申鐃初か鐃緒申鐃緒申
2017.01.21 Saturday
Solr 鐃叔ワ申鵐�ング学緒申鐃緒申鐃塾醐申鐃緒申鐃緒申
鐃叔駈申鐃祝（￥申鐃祝脚醐申鐃緒申鐃緒申咾討鐃緒申鐃緒申屮鐃藷キング学緒申鐃緒申Learning-to-Rank鐃緒申鐃淑駕申LTR鐃緒申略鐃緒申鐃緒申鐃夙もあ鐃緒申法廚鐃�Solr鐃叔試す鐃緒申法鐃緒申匆陲靴茲�鐃緒申
Solr鐃叔ワ申鵐�ング学緒申鐃夙わ申鐃緒申鐃夙￥申鐃殉わ申覆鐃緒申鐃所ー鐃緒申鐃緒申鐃緒申鐃� Solr 6.4.0 鐃祝含まわ申鐃� SOLR-8542 鐃緒申廚鐃緒申發�鐃駿わ申鐃緒申鐃盾い鐃暑か鐃盾し鐃緒申覆鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申任蓮鐃緒申鐃�鐃緒申19鐃緒申 Lucene/Solr 鐃駿駈申鐃緒申鐃竣わ申鐃緒申鐃緒申鐃殉￥申鐃緒申鐃塾誌申鐃旬種申長鐃緒申発表鐃緒申鐃緒申NLP4L鐃緒申箸辰鐃緒申鐃祝�鐃緒申里鐃遵げ鐃緒申鐃緒申鐃緒申鐃淑駕申鐃緒申鐃緒申由鐃緒申鐃緒申SOLR-8542鐃緒申鐃熟るか鐃祝使わ申鐃緒申鐃緒申鐃緒申単鐃緒申鐃緒申鐃緒申鐃緒申鐃�
- 鐃舜緒申鐃緒申鐃暑ゴ鐃所ズ鐃準が鐃緒申属
- GUI鐃緒申鐃緒申属鐃緒申鐃銃わ申鐃緒申鐃熟�鐃緒申鐃緒申遒�鐃緒申単
- 鐃緒申鐃春デ￥申鐃緒申鐃塾緒申鐃緒申鐃緒申鐃緒申単
- 鐃旬わ申鐃緒申鐃殉ニュア鐃緒申鐃緒申鐃緒申楔鐃夙英醐申砲鐃緒申鐃渋�
鐃殉わ申鐃緒申NLP4L鐃熟ワ申鵐�ング学緒申鐃緒申鐃緒申文鐃叔紹介さわ申鐃緒申鐃緒申的鐃緒申鐃緒申徴鐃叔わ申鐃緒申TF鐃緒申IDF鐃緒申TF*IDF鐃淑どわ申鐃緒申鐃緒申鐃緒申里鐃緒申个鐃緒申鐃�SOLR-8542鐃熟わ申鐃緒申鐃緒申鐃緒申徴鐃熟逸申鐃緒申鐃淑わ申鐃淑逸申鐃緒申予鐃緒申鐃淑わ申鐃緒申鐃緒申鐃祝￥申鐃緒申鐃緒申鐃�SOLR-8542鐃熟ワ申妊鐃緒申鐃緒申鐃術わ申鐃緒申鐃緒申分鐃緒申Solr鐃祝逸申存鐃緒申鐃緒申箸鐃緒申鐃緒申鐃緒申腓�鐃緒申鐃緒申鐃緒申NLP4L鐃叔わ申鐃緒申鐃緒申鐃緒申鐃淑�鐃緒申Lucene鐃緒申戰鐃叔行わ申譟�LTR鐃塾種申鐃竣わ申鐃緒申分鐃塾種申鐃緒申鐃緒申鐃緒申鐃緒申僖鐃緒申箸任鐃緒申襦ｏ申鐃緒申鐃緒申鐃緒申辰鐃�Elasticsearch鐃出縁申鐃緒申鐃緒申鐃重�鐃緒申単鐃叔わ申鐃暑。鐃緒申鐃緒申鐃緒申鐃�SOLR-8542鐃緒申鐃緒申鐃緒申優鐃緒申討鐃緒申鐃緒申鐃淑�鐃盾あ鐃所、鐃緒申鐃術わ申鐃緒申鐃緒申徴鐃緒申Solr鐃塾ワ申鐃緒申鐃所式鐃叔書けわ申箸鐃緒申鐃緒申鐃�NLP4L鐃緒申鐃緒申鐃緒申鐃緒申優鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申箸鐃緒申鐃緒申襦�
LTR鐃塾学緒申鐃叔￥申鐃緒申鐃祝つわ申鐃緒申
LTR鐃熟駈申鐃春わ申鐃緒申惱鐃緒申鐃緒申鐃旬とわ申鐃暑。鐃緒申鐃春デ￥申鐃緒申鐃塾ワ申鐃潤ー鐃緒申鐃熟￥申鐃瞬わ申鐃暑ク鐃緒申鐃緒申砲弔鐃緒申討鐃緒申譴常申鐃緒申文鐃書がどのわ申鐃初い鐃緒申連鐃緒申鐃銃わ申鐃暑か鐃竣とわ申鐃緒申鐃緒申戰鐃緒申NLP4L鐃叔わ申relevance degree鐃夙呼わ申任鐃緒申鐃祝わ申鐃縦わ申鐃緒申鐃銃わ申鐃緒申鐃熟�鐃塾レコ鐃緒申鐃宿でわ申鐃暑。鐃緒申鐃塾件申鐃緒申鐃塾デ￥申鐃緒申鐃緒申惱鐃緒申鐃緒申襯�鐃暑ゴ鐃所ズ鐃緒申鐃�Pointwise鐃緒申鐃竣ワ申鐃緒申鐃緒申鐃夙呼ばわ申襦Ｂ常申砲鐃瞬わ申鐃暑ク鐃緒申鐃緒申砲弔鐃緒申鐃淑醐申鐃准ワ申鐃緒申鐃宿わ申鐃初が鐃緒申鐃緒申連鐃駿わ申鐃盾い鐃緒申鐃竣とわ申鐃緒申鐃緒申戰襪�鐃縦わ申鐃緒申鐃叔￥申鐃緒申鐃薯扱わ申Pairwise鐃緒申鐃瞬わ申鐃暑ク鐃緒申鐃緒申砲弔鐃緒申鐃淑醐申饅弦腓�鐃緒申連鐃駿緒申砲匹里茲�鐃祝リス鐃夙わ申鐃緒申襪�鐃竣とわ申鐃緒申鐃緒申戰襪�鐃縦わ申鐃緒申鐃叔￥申鐃緒申鐃薯扱わ申Listwise鐃緒申鐃緒申鐃暑。
鐃緒申鐃述わ申3鐃緒申鐃旬の「駈申鐃春デ￥申鐃緒申鐃塾緒申鐃緒申鐃緒申法鐃竣につわ申鐃銃￥申NLP4L鐃叔わ申鐃緒申属鐃塾「ワ申鐃塾テ￥申鐃緒申鐃緒申鐃�GUI鐃竣わ申箸辰鐃緒申鐃祝￥申函鐃緒申屮鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃�aka 鐃緒申鐃緒申奪鐃緒申鐃緒申鐃緒申鐃�NLP4L鐃叔わ申鐃緒申鐃縮に「ワ申鐃緒申廛鐃獣ワ申鐃緒申鐃緒申鐃緒申鐃竣と呼わ申鐃緒申名鐃塾ワ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃夙駈申鐃縮わ申鐃銃わ申鐃緒申砲鐃緒申薀�鐃緒申奪鐃緒申鐃叔ワ申鐃竣誌申鐃緒申鐃銃器申連鐃駿わ申動鐃緒申鐃出わ申鐃緒申鐃緒申鐃祝￥申鐃緒申儖佞鐃緒申鐃銃わ申鐃暑。鐃旬居申鐃緒申鐃叔わ申鐃緒申鐃緒申鐃塾器申略鐃緒申鐃塾わ申鐃緒申鐃緒申鐃峻の「ワ申鐃塾テ￥申鐃緒申鐃緒申鐃�GUI鐃竣わ申箸辰鐃緒申鐃祝￥申鐃塾わ申紊駕申襦ｏ申鐃緒申鐃緒申鐃緒申鐃緒申屮鐃緒申鐃緒申謄鐃叔人種申妊鐃緒申離董鐃緒申鐃緒申鐃緒申鐃峻わ申鐃塾はなにわ申鐃緒申鐃緒申鐃術わ申鐃緒申鐃旬居申鐃緒申鐃緒申鐃宿わ申妊鐃藷キング学緒申鐃塾種申鐃緒申鐃緒申鐃薯しわ申鐃初、鐃緒申鐃述醐申圓痢鐃�鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃初ク鐃緒申奪鐃緒申鐃叔ワ申鐃竣誌申鐃緒申鐃銃器申連鐃駿わ申動鐃緒申鐃出わ申鐃緒申鐃緒申鐃緒申法鐃緒申挑鐃緒し鐃銃わ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申
鐃淑駕申鐃緒申NLP4L鐃叔のワ申鵐�ング学緒申鐃塾種申鐃塾鰹申鐃竣でわ申鐃暑。鐃緒申鐃塾緒申鐃瞬で以刻申鐃緒申鐃緒申鐃緒申覆鐃暑。
- Solr 6.3.0 鐃塾ワ申鐃藷スト￥申鐃緒申
- LTR鐃塾わ申鐃緒申鐃�Solr鐃竣ラグ鐃緒申鐃緒申離咼鐃宿わ申鐃緒申鐃緒申
- livedoor 鐃祝ュー鐃緒申鐃緒申鐃緒申鐃術ワ申鐃緒申鐃緒申録
- NLP4L鐃塾ワ申鐃藷スト￥申鐃緒申筏鐃銃逸申鐃緒申鐃緒申鐃緒申鐃緒申
- 鐃緒申鐃春デ￥申鐃緒申鐃塾削申鐃緒申
- 鐃緒申徴鐃緒申鐃�
- 鐃緒申鵐�ング学緒申
- 鐃緒申妊鐃塾デプワ申鐃緒申
- 鐃緒申鵐�ング学緒申鐃緒申妊鐃緒申箸辰鐃緒申鐃緒申鵐�ングの実削申
鐃緒申鐃述わ申鐃縮り、NLP4L鐃祝は詳細わ申LTR鐃塾わ申鐃緒申鐃�鐃殉ニュア鐃緒申鐃緒申鐃緒申属鐃緒申鐃緒申里任鐃緒申鐃緒申任鐃緒申蕕随申鐃銃居申鐃緒申鐃祝わ申鐃緒申必鐃竣わ申覆鐃緒申鐃緒申發件申鐃淑わ申鐃緒申鐃緒申鐃旬居申鐃緒申鐃叔わ申鐃出常申文鐃書セットとわ申鐃緒申livedoor鐃祝ュー鐃緒申鐃緒申鐃緒申鐃術ワ申鐃緒申鐃術わ申鐃暑こ鐃夙で￥申鐃緒申連鐃緒申鐃緒申鐃緒申鐃祝￥申鐃緒申鐃緒申鐃緒申的鐃緒申鐃緒申鐃緒申鐃緒申鐃銃わ申鐃暑。鐃緒申味鐃塾わ申鐃緒申鐃緒申鐃熟￥申鐃緒申鐃緒申鐃緒申鐃緒申未鐃祝ワ申鐃藷スト￥申鐃緒申鐃緒申鐃緒申鐃緒申覆鐃緒申弌鐃�Solr鐃叔ワ申鵐�ング学緒申鐃塾実際わ申鐃塾醐申鐃緒申鐃暑こ鐃夙わ申鐃叔わ申鐃暑。鐃緒申鐃旬細わ申鐃塾りた鐃緒申鐃緒申鐃祝わ申NLP4L鐃塾マニュア鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申
Solr 6.3.0 鐃塾ワ申鐃藷スト￥申鐃緒申
適鐃緒申鐃淑デワ申鐃曙ク鐃夙ワ申砲鐃�Solr 6.3.0鐃緒申鐃旬居申鐃緒申鐃緒申筆鐃緒申鐃塾最随申鐃祝わ申鐃緒申鐃緒申鐃緒申鐃緒申鐃宿￥申展鐃緒申鐃緒申鐃暑。鐃旬居申鐃緒申鐃叔わ申/opt/nlp4l/solr-6.3.0鐃叔ワ申鐃曙ク鐃夙ワ申鐃�Solr鐃緒申展鐃緒申鐃緒申鐃緒申箸鐃緒申鐃緒申辰鐃淑わ申襦�
$ pwd /opt/nlp4l $ wget http://ftp.tsukuba.wide.ad.jp/software/apache/lucene/solr/6.3.0/solr-6.3.0.tgz $ tar xvzf solr-6.3.0.tgz
Solr鐃緒申動鐃緒申鐃緒申collection1鐃夙わ申鐃緒申名鐃緒申鐃塾ワ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申襦�
$ cd solr-6.3.0 $ ./bin/solr start $ ./bin/solr create_core -c collection1 -d sample_techproducts_configs
LTR鐃塾わ申鐃緒申鐃�Solr鐃竣ラグ鐃緒申鐃緒申離咼鐃宿わ申鐃緒申鐃緒申
適鐃緒申鐃淑デワ申鐃曙ク鐃夙ワ申砲鐃�github鐃叔醐申鐃緒申鐃緒申鐃緒申討鐃緒申鐃�NLP4L/solr鐃竣ワ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃宿￥申鐃俊ワ申鼻鐃�Solr鐃祝デプワ申鐃緒申鐃緒申鐃暑。
$ pwd /somewhere/NLP4L $ git clone https://github.com/NLP4L/solr.git $ cd solr $ mvn package $ cp target/nlp4l-solr-1.1-SNAPSHOT.jar /opt/nlp4l/solr-6.3.0/server/solr-webapp/webapp/WEB-INF/lib
NLP4L/solr鐃緒申typesafe鐃述わ申config鐃初イ鐃瞬ワ申蠅�必鐃竣なので￥申鐃淑駕申鐃塾よう鐃緒申鐃緒申鐃所、鐃俊ワ申鼻鐃�Solr鐃祝デプワ申鐃緒申鐃緒申鐃暑。
$ cd /somewhere $ wget https://github.com/typesafehub/config/archive/v1.3.1.tar.gz $ tar xvzf v1.3.1.tar.gz $ cd config-1.3.1 $ sbt package $ cp config/target/config-1.3.0-20170120T044439.jar /opt/nlp4l/solr-6.3.0/server/solr-webapp/webapp/WEB-INF/lib
Solr鐃緒申鐃緒申属鐃緒申Jetty鐃緒申webapp鐃緒申鐃緒申鮗，里茲�鐃祝行わ申鐃緒申
$ cd /opt/nlp4l/solr-6.3.0 $ vi server/solr-webapp/webapp/WEB-INF/web.xml
fileReceiver org.nlp4l.solr.servlet.FileReceiver root_path /opt/nlp4l/solr-6.3.0/server/solr/collection1 fileReceiver /nlp4l/receive/file
鐃殉わ申鐃緒申鐃緒申鐃緒申鐃叔緒申鐃緒申鐃縦э申鐃淑駕申鐃塾よう鐃緒申JSON鐃緒申鐃緒申侫鐃緒申鐃緒申鐃緒申鐃術意わ申鐃暑。
$ vi server/solr/collection1/conf/ltr_features.conf
{
"features": [
{
"name": "TF in title",
"class": "org.nlp4l.solr.ltr.FieldFeatureTFExtractorFactory",
"params": { "field": "title" }
},
{
"name": "TF in body",
"class": "org.nlp4l.solr.ltr.FieldFeatureTFExtractorFactory",
"params": { "field": "body" }
},
{
"name": "IDF in title",
"class": "org.nlp4l.solr.ltr.FieldFeatureIDFExtractorFactory",
"params": { "field": "title" }
},
{
"name": "IDF in body",
"class": "org.nlp4l.solr.ltr.FieldFeatureIDFExtractorFactory",
"params": { "field": "body" }
},
{
"name": "TF*IDF in title",
"class": "org.nlp4l.solr.ltr.FieldFeatureTFIDFExtractorFactory",
"params": { "field": "title" }
},
{
"name": "TF*IDF in body",
"class": "org.nlp4l.solr.ltr.FieldFeatureTFIDFExtractorFactory",
"params": { "field": "body" }
}
]
}
鐃殉わ申鐃緒申solrconfig.xml鐃緒申焚鐃緒申里茲�鐃緒申鐃峻緒申鐃緒申鐃暑。
$ vi server/solr/collection1/conf/solrconfig.xml
標鐃緒申鐃� /select 鐃所ク鐃緒申鐃緒申鐃夙ハワ申疋鐃緒申defaults鐃術ワ申瓠種申鐃緒申飽焚鐃緒申鐃緒申媛辰鐃緒申襦�
edismax
title body
NLP4L-LTR鐃緒申鐃緒申鐃緒申鐃縦э申鐃出リク鐃緒申鐃緒申鐃夙に縁申鐃緒申鐃緒申鐃暑た鐃緒申離螢�鐃緒申鐃緒申鐃夙ハワ申疋鐃緒申焚鐃緒申里茲�鐃緒申鐃緒申鐃所す鐃暑。
ltr_features.conf
鐃叔醐申法鐃�PRank鐃緒申鐃緒申鐃緒申鐃銃び出わ申PRankQParserPlugin鐃薯次のよう鐃緒申鐃緒申鐃所す鐃緒申鐃�PRank鐃淑鰹申鐃緒申RankingSVM鐃緒申鐃緒申鐃緒申鐃叔緒申法鐃�
collection1/conf/ltr_features.conf collection1/conf/ltr_model.conf
鐃殉わ申Solr鐃緒申鐃暑あ鐃緒申任鐃緒申襪�鐃緒申Elevation Component鐃緒申連鐃緒申鐃緒申鐃緒申發鰹申鐃緒申悩鐃緒申鐃緒申鐃銃わ申鐃緒申鐃緒申鐃緒申
livedoor 鐃祝ュー鐃緒申鐃緒申鐃緒申鐃術ワ申鐃緒申鐃緒申録
livedoor 鐃祝ュー鐃緒申鐃緒申鐃緒申鐃術ワ申鐃緒申Solr鐃緒申鐃緒申録鐃緒申鐃暑た鐃緒申法鐃緒申泙鐃緒申鐃緒申鐃緒申鐃緒申泙鐃緒申鐃緒申蠅刻申鐃緒申API鐃緒申鐃縮わ申鐃銃ワ申鐃緒申鐃緒申鐃緒申鐃術刻申鐃緒申鐃緒申里鐃緒申箴�鐃緒申鐃緒申鐃緒申鐃緒申鐃楯なのでワ申鐃叔ワ申鐃緒申鐃緒申鐃峻緒申鐃緒申鐃銃わ申鐃殉わ申鐃祝￥申
$ vi server/solr/collection1/conf/managed-schema
url
鐃緒申鐃緒申鐃緒申鐃緒申廚鐃�copyField鐃緒申鐃緒申麓鐃緒申鐃緒申鐃緒申討鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃�Solr鐃緒申鐃緒申鐃緒申儿鐃緒申鐃粛�鐃緒申鐃緒申鐃緒申鐃暑た鐃緒申縫鐃緒申鐃緒申離鐃緒申鐃緒申鐃宿まわ申鐃熟再居申動鐃緒申圓鐃緒申鐃�
鐃緒申鐃緒申鐃緒申livedoor 鐃祝ュー鐃緒申鐃緒申鐃緒申鐃術ワ申鐃緒申鐃緒申鐃所し鐃緒申Solr鐃緒申鐃緒申録鐃緒申鐃暑。
$ cd /somewhere $ wget http://www.rondhuit.com/download/livedoor-news-data.tar.gz $ tar xvzf livedoor-news-data.tar.gz $ /opt/nlp4l/solr-6.3.0/bin/post *.xml
NLP4L鐃塾ワ申鐃藷スト￥申鐃緒申筏鐃銃逸申鐃緒申鐃緒申鐃緒申鐃緒申
NLP4L/nlp4l 鐃竣ワ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申 github 鐃緒申鐃緒申焚鐃緒申里茲�鐃緒申鐃緒申鐃所し鐃緒申動鐃緒申鐃暑。
$ cd /somewhere/NLP4L $ git clone https://github.com/NLP4L/nlp4l.git $ cd nlp4l $ cp conf/application.conf.sample conf/application.conf $ vi conf/application.conf $ ./activator run
鐃緒申鐃緒申鐃緒申Web鐃瞬ラウ鐃緒申鐃緒申鐃緒申 http://localhost:9000/ 鐃祝ワ申鐃緒申鐃緒申鐃緒申鐃緒申鐃暑。NLP4L-LTR鐃夙わ申鐃緒申鐃緒申縫紂種申鐃緒申鐃緒申咫鐃緒申鐃緒申名鐃緒申鐃緒申鐃宿緒申鐃緒申鐃緒申鐃緒申鐃祝ュー鐃緒申Config鐃薯クワ申奪鐃緒申鐃緒申襦ｏ申鐃緒申鐃緒申董鐃緒申New鐃緒申鐃緒申鵐�をクワ申奪鐃緒申鐃緒申鐃夙￥申鐃緒申鐃緒申鐃緒申Config鐃緒申鐃緒申鬚垢鐃処う鐃緒申促鐃緒申鐃緒申襦ｏ申鐃緒申鐃宿緒申鮖温佑鐃緒申鐃緒申蠅刻申襦�
| 鐃術ワ申瓠種申鐃縮� | 鐃緒申鐃緒申 | 鐃旬居申鐃緒申鐃叔わ申鐃緒申鐃緒申鐃緒申 |
|---|---|---|
| Name | 鐃緒申鐃緒申鐃緒申鐃緒申鐃縮常申鐃� | test |
| Annotation Type | 鐃緒申鐃塾テ￥申鐃緒申鐃緒申鐃塾種申鐃縮￥申鐃緒申鐃淳わ申pointwise鐃緒申鐃緒申鐃緒申鐃駿なわ申鐃緒申鐃緒申鐃緒申聾鐃緒申澆鐃�NLP4L鐃緒申鐃舜緒申鐃緒申鐃暑ゴ鐃所ズ鐃準がPointwise鐃塾わ申里鐃緒申鐃緒申鐃緒申鐃緒申覆鐃緒申鐃緒申箸鐃緒申鐃緒申鐃縮ｏ申任呂覆鐃緒申鐃緒申尊檗鐃�NLP4L鐃緒申鐃緒申鐃楯￥申鐃夙わ申鐃銃わ申鐃緒申RankingSVM鐃緒申Pairwise鐃叔わ申鐃暑が鐃緒申Pointwise鐃緒申鐃緒申鐃塾デ￥申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申Pairwise鐃緒申鐃術器申鐃緒申鐃銃わ申鐃暑。 | pointwise |
| Relevance Degree | pointwise鐃祝て人種申任弔鐃緒申鐃緒申鐃緒申凌鐃緒申鬚い鐃緒申弔鐃緒申蕕わ申鐃緒申弔泙任箸鐃緒申襪�鐃緒申 | 0 to 3 |
| Trainer Factory Class | 鐃舜緒申鐃緒申鐃暑ゴ鐃所ズ鐃緒申離侫鐃緒申鐃緒申肇螢�鐃初ス名鐃緒申鐃緒申蠅刻申襦�PRankTrainerFactory鐃殉わ申鐃緒申RankingSVMTrainerFactory鐃緒申鐃緒申鐃駿る。 | org.nlp4l.ltr.support.procs.PRankTrainerFactory |
| - settings | 鐃舜緒申鐃塾件申鐃緒申鐃瞬わ申鐃緒申鐃緒申 | { "numIterations": 2000 } |
| Search URL | 鐃緒申鐃春デ￥申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃粛種申妊鐃緒申離董鐃緒申鐃緒申鐃藷すわ申檗鐃熟�鐃緒申鐃緒申箸覆鐃�Solr鐃緒申URL鐃緒申 | http://localhost:8983/solr/collection1/select?q=${query}&wt=json&hl=true&hl.fl=title,body&f.body.hl.snippets=3&hl.simple.pre=<b style="background-color:yellow">&hl.simple.post=</b> |
| Feature Extract URL | 鐃緒申徴鐃緒申个鐃緒申鐃楯わ申連鐃緒申鐃緒申箸覆鐃�Solr鐃緒申URL鐃緒申solrconfig.xml鐃緒申鐃緒申鐃所し鐃緒申鐃所ク鐃緒申鐃緒申鐃夙ハワ申疋鐃緒申URL鐃薯記載わ申鐃暑。 | http://localhost:8983/solr/collection1/features |
| Feature Extract Config | 鐃緒申徴鐃緒申仍鐃緒申忙鐃緒申箸鐃緒申襦�Solr側鐃緒申鐃緒申鐃瞬わ申鐃曙たJSON鐃緒申鐃緒申侫鐃緒申鐃緒申鐃縮常申鐃� | ltr_features.conf |
| Document Unique Field | Solr鐃塾ワ申法鐃緒申鐃緒申鐃緒申鐃緒申離侫鐃緒申鐃緒申鐃緒申名鐃緒申 | url |
| Document Title Field | Solr文鐃緒申離鐃緒申鐃緒申肇鐃春ワ申鐃緒申鐃緒申鐃縮常申鐃緒申夕鐃祝わ申襯�鐃塾テ￥申鐃緒申鐃緒申鐃渋施誌申鐃祝￥申鐃緒申鐃緒申鐃夙ワ申箸鐃緒申堂鐃緒申鐃宿緒申鐃緒申鐃緒申鐃緒申侫鐃緒申鐃緒申鐃緒申名鐃緒申鐃緒申蠅刻申襦� | title |
| Document Body Field | Solr文鐃緒申鐃緒申鐃淑醐申侫鐃緒申鐃緒申鐃緒申名鐃緒申鐃粛種申砲鐃暑ア鐃塾テ￥申鐃緒申鐃緒申鐃渋施誌申鐃祝￥申鐃緒申文鐃夙わ申鐃銃駕申鐃緒申表鐃緒申鐃緒申鐃緒申鐃春ワ申鐃緒申鐃緒申鐃縮常申鐃緒申鐃所す鐃暑。 | body |
| Deployer Factory Class | 鐃舜緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申妊鐃春ワ申鐃緒申鐃緒申鐃�Solr鐃祝デプワ申鐃緒申鐃緒申鐃緒申箸鐃緒申忙鐃緒申僂鐃緒申襯�鐃初ス鐃塾フワ申鐃緒申鐃夙リ。 | org.nlp4l.ltr.support.procs.HttpFileTransferDeployerFactory |
| - settings | 鐃遵記鐃緒申鐃初ス鐃緒申URL鐃緒申 | { "deployToUrl": "http://localhost:8983/solr/nlp4l/receive/file", "deployToFile": "conf/ltr_model.conf" } |
[Save]鐃旬ワ申鐃緒申鬟�ワ申奪鐃緒申鐃緒申鐃�[Load]鐃薯クワ申奪鐃緒申鐃緒申鐃夙￥申鐃緒申鐃縮常申鐃緒申鐃緒申test鐃夙わ申鐃緒申名鐃緒申鐃緒申Config鐃緒申鐃緒申鐃緒申鐃宿わ申鐃曙た鐃緒申鐃夙わ申鐃緒申鐃緒申鐃曙、Query鐃緒申Annotation鐃緒申Feature鐃緒申Training鐃夙わ申鐃緒申鐃緒申縫紂種申鐃緒申椶鐃緒申鐃緒申鐃暑。
鐃緒申鐃春デ￥申鐃緒申鐃塾削申鐃緒申
鐃緒申鐃春デ￥申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申Query鐃殉わ申鐃緒申Annotation鐃緒申縫紂種申鐃夙わ申鐃緒申鐃淑わ申鐃緒申鐃述わ申鐃縮り、鐃旬居申鐃緒申鐃叔はワ申鐃塾テ￥申鐃緒申鐃緒申鐃�GUI鐃緒申箸辰鐃緒申鐃緒申侫如鐃緒申鐃緒申虜鐃緒申鐃緒申鐃祝￥申鐃緒申鐃緒申鐃緒申鐃緒申襦ｏ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申淵鐃緒申鐃竣ワ申奪鐃緒申鐃緒申鐃緒申鐃緒申砲鐃緒申薀�鐃緒申奪鐃緒申鐃叔ワ申鐃竣誌申鐃緒申鐃暑こ鐃夙で駈申鐃春デ￥申鐃緒申鐃緒申族鐃緒申鐃緒申儖佞鐃緒申鐃緒申鐃緒申鐃緒申蓮鐃�Query鐃緒申縫紂種申鐃�[Import]鐃旬ワ申鐃緒申鬟�ワ申奪鐃緒申鐃緒申謄鐃緒申鐃緒申侫鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申匹鐃緒申襦�
Query鐃緒申縫紂種申砲魯侫鐃緒申鐃緒申鐃緒申鐃緒申鐃薯すわ申椒鐃緒申鵑�わ申鐃所、鐃緒申鐃緒申鬟�ワ申奪鐃緒申鐃緒申鐃夙ワ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申椶鐃緒申譴随申謄鐃緒申鐃緒申肇侫鐃緒申鐃緒申鐃緒申鐃緒申鐃駿わ申茲�鐃祝なる。鐃緒申鐃塾テワ申鐃緒申鐃夙フワ申鐃緒申鐃緒申砲鐃�1鐃緒申1鐃緒申鐃緒申鐃緒申魑�載わ申鐃銃わ申鐃緒申鐃緒申鐃緒申鐃塾フワ申鐃緒申鐃緒申鐃緒申鐃緒申鐃宿わ申鐃緒申函鐃緒申鐃緒申泙里茲�鐃祝ワ申鐃緒申鐃所が表鐃緒申鐃緒申鐃緒申襦�
鐃緒申鐃塾ワ申鐃緒申鐃緒申離鐃藷クをクワ申奪鐃緒申鐃緒申鐃緒申連鐃緒申鐃緒申鐃�Solr鐃祝てワ申鐃緒申鐃所が鐃渋行わ申鐃曙、Annotation鐃緒申鐃縮に件申未鐃宿緒申鐃緒申鐃緒申鐃暑。鐃緒申鐃塾駕申鐃縮でわ申Search鐃銃ワ申鐃緒申鐃夙ボッワ申鐃緒申鐃緒申鐃緒申鐃薯しわ申鐃緒申鐃緒申鐃所が表鐃緒申鐃緒申鐃緒申討鐃緒申襪�鐃緒申Query鐃緒申縫紂種申鐃緒申鐃熟わ申覆鐃緒申討癲�Annotation鐃緒申縫紂種申鐃緒申鐃緒申鐃叔わ申鐃緒申Search鐃銃ワ申鐃緒申鐃夙ボッワ申鐃緒申鐃緒申直鐃旬ワ申鐃緒申鐃緒申鐃緒申鐃緒申鐃銃わ申同鐃緒申鐃叔わ申鐃暑。
Annotation鐃緒申鐃縮にて各ワ申鐃緒申鐃緒申鐃緒申屬鐃緒申譴進醐申鐃塾器申連鐃駿わ申佑鐃緒申覆鐃緒申蕁�鐃緒申側鐃緒申表鐃緒申鐃緒申鐃緒申討鐃緒申鐃緒申鐃緒申凌鐃緒申鐃重�鐃准わ申鐃緒申鐃緒申任鐃緒申鐃緒申鐃�1鐃緒申鐃緒申分鐃緒申鐃緒申辰鐃緒申蕁�[Save]鐃旬ワ申鐃緒申鐃緒申鐃渋醐申鐃緒申鐃�[Next]鐃叔種申鐃塾ワ申鐃緒申鐃緒申某覆燹ｏ申鐃緒申未蟒�了鐃緒申鐃緒申鐃初次鐃塾ワ申鐃銃ップでわ申鐃緒申鐃緒申徴鐃緒申个某覆燹�
鐃緒申徴鐃緒申鐃�
Feature鐃緒申縫紂種申鐃緒申鐃緒申鬚垢襦ｏ申鐃緒申鐃夙駕申鐃殉のよう鐃淑プワ申鐃緒申鐃曙ス鐃出￥申鐃緒申鐃緒申鐃緒申襦�[Extract]鐃緒申鐃緒申徴鐃緒申个鐃緒申鐃緒申呂鐃緒申襪�鐃緒申鐃緒申鐃叔にプワ申鐃緒申鐃曙ス鐃出￥申鐃緒申鐃出随申鐃祝なってわ申鐃緒申箸鐃緒申蓮鐃緒申泙鐃�[Clear]鐃旬ワ申鐃緒申鬟�ワ申奪鐃緒申鐃緒申討鐃緒申鐃�[Extract]鐃緒申圓鐃緒申鐃緒申鐃塾誌申鐃緒申鐃緒申DONE鐃緒申表鐃緒申鐃緒申鐃緒申襦�
鐃緒申鵐�ング学緒申
Trainig鐃緒申縫紂種申鐃緒申鐃緒申鬚掘鐃緒申鐃渋�鐃祝わ申鐃緒申鐃緒申New鐃緒申鐃薯クワ申奪鐃緒申鐃緒申襦ｏ申鐃緒申鐃緒申Solr鐃緒申鐃緒申鐃瞬わ申鐃緒申鐃緒申鐃緒申侫鐃緒申鐃緒申鐃緒申ltr_features.conf鐃祝にわ申鐃緒申鐃緒申鐃獣わ申鐃緒申徴鐃緒申鐃緒申鐃瞬ワ申鐃緒申鐃獣ワ申鐃旬ッワ申鐃緒申鐃緒申鐃緒申鐃緒申襦ｏ申鐃緒申離鐃緒申鐃緒申奪鐃緒申椒奪鐃緒申鐃緒申鐃重�鐃緒申鐃緒申鐃緒申徴鐃緒申鐃緒申鐃緒申鐃�[Start]鐃薯クワ申奪鐃緒申鐃緒申襦ｏ申鐃緒申鐃緒申任鐃舜緒申鐃塾進行常申鐃緒申鐃緒申鐃竣ワ申鐃緒申鐃曙ス鐃出￥申鐃叔種申鐃緒申鐃曙、鐃緒申了鐃緒申鐃緒申伐鐃緒申里茲�鐃祝ワ申妊鐃春ワ申鐃緒申鐃緒申鐃緒申鐃緒申討鐃宿緒申鐃緒申鐃緒申鐃暑。鐃緒申鐃緒申鐃叔わ申PRank鐃緒申鐃緒申鐃薯しわ申鐃塾で￥申鐃緒申鐃緒申徴鐃緒申鐃出わ申鐃緒申鼎澆函鐃�3鐃縦わ申鐃緒申鐃粛￥申鐃緒申鐃塾随申鐃緒申鐃緒申鐃�3鐃祝わ申鐃緒申鐃緒申鐃夙わ申由鐃緒申砲鐃緒申屬鐃緒申鐃暑。
{
"model" : {
"name" : "prank",
"type" : "prank",
"weights" : [ {
"name" : "TF in title",
"weight" : -113
}, {
"name" : "TF in body",
"weight" : -14
}, {
"name" : "IDF in body",
"weight" : -322.44384765625
} ],
"bs" : [ -2818, -2374, 6450 ]
}
}
鐃緒申妊鐃塾デプワ申鐃緒申
鐃緒申鵐�ング学緒申鐃緒申鐃緒申了鐃緒申鐃緒申鐃�[Deploy]鐃旬ワ申鐃緒申表鐃緒申鐃緒申鐃緒申鐃塾で￥申鐃緒申鐃緒申鬟�ワ申奪鐃緒申鐃緒申襪鰹申箸鐃熟�鐃緒申鐃緒申鐃�Solr鐃緒申HTTP鐃緒申転鐃緒申鐃緒申鐃緒申襦�
Solr側鐃叔はわ申鐃塾学緒申鐃緒申妊鐃緒申有鐃緒申鐃緒申鐃緒申鐃暑た鐃緒申法鐃緒申鐃緒申鐃緒申離鐃緒申鐃緒申鐃宿わ申必鐃竣でわ申鐃暑。Solr鐃塾器申鐃緒申鐃緒申鐃縮わ申鐃初コ鐃緒申鐃塾ワ申鐃緒申鐃緒申匹鐃峻わ申鐃塾わ申鐃緒申単鐃緒申鐃緒申
鐃緒申鵐�ング学緒申鐃緒申妊鐃緒申箸辰鐃緒申鐃緒申鵐�ングの実削申
NLP4L-LTR鐃緒申SOLR-8542鐃夙は異なり、Solr標鐃緒申離鐃緒申鵐�わ申箸辰童討喀个鐃緒申里鐃�rq={!rerank 鐃緒申}鐃術ワ申瓠種申鐃緒申鐃緒申鐃緒申僂鐃緒申襦ｏ申鐃緒申劼鐃�solrconfig.xml鐃緒申鐃緒申鐃所し鐃緒申prank queryParser鐃緒申討喀个鐃緒申砲麓鐃緒申里茲�鐃祝醐申鐃緒申鐃緒申孫圓鐃緒申襦�
http://localhost:8983/solr/collection1/select?indent=on&q=鐃述駕申鐃� 鐃緒申鐃緒申&rq={!rerank reRankQuery=$rqq}&rqq={!prank}鐃述駕申鐃� 鐃緒申鐃緒申&debugQuery=on
Solr標鐃緒申離鐃緒申鵐�は￥申鐃緒申鐃緒申鐃述わ申solrconfig.xml鐃緒申鐃緒申鐃緒申砲鐃緒申鐃緒申鐃緒申鐃緒申忘能鐃緒申鐃縮常申鐃�edismax鐃緒申鐃緒申鐃緒申鐃渋行わ申鐃緒申鐃緒申鐃祝常申未鐃�200鐃緒申鐃緒申鐃緒申鐃�reRankDocs鐃塾デフワ申鐃緒申函砲砲弔鐃緒申謄鐃藷キング学緒申鐃緒申妊鐃祝器申鼎鐃緒申鐃緒申謄鐃藷キングわ申圓鐃緒申鐃緒申妊丱奪鐃緒申鐃緒申鐃塾ワ申鐃緒申鐃緒申鐃旬削申鐃緒申鮓�わ申蛤能鐃緒申2鐃峻は種申鐃塾よう鐃祝なってわ申鐃暑。
14.37461 = combined first and second pass score using class org.apache.solr.search.ReRankQParserPlugin$ReRankQueryRescorer 10.37461 = first pass score
鐃叔緒申旅圓鐃�2鐃淑鰹申鐃緒申鐃緒申鐃緒申離鐃緒申鐃緒申鐃緒申鐃緒申造鐃�14.37461鐃祝なってわ申鐃暑こ鐃夙を示わ申鐃緒申鐃緒申鐃塾行わ申鐃緒申1鐃淑鰹申鐃塾ワ申鐃緒申鐃緒申覆鐃緒申鐃緒申任鐃緒申名鐃緒申edismax鐃祝のワ申鐃緒申鐃緒申鐃緒申10.37461鐃叔わ申鐃暑こ鐃夙を示わ申鐃銃わ申鐃暑。3鐃緒申鐃旬以降わ申edismax鐃塾ワ申鐃緒申鐃緒申鐃旬細なのでわ申鐃緒申鐃叔はワ申鐃緒申鐃獣プわ申鐃処う鐃緒申
鐃緒申2鐃淑鰹申鐃塾ワ申鐃緒申鐃所、鐃縦まわ申PRank鐃塾ワ申鐃緒申鐃緒申之彁鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃竣わ申2.0鐃叔わ申鐃所、鐃緒申鐃塾詳細は駕申鐃緒申鐃塾ブワ申鐃獣ワ申鐃叔種申鐃緒申鐃緒申討鐃緒申襦�
2.0 = second pass score
2.0 = is the index of bs(-2818.0,-2374.0,6450.0) > -2338.074707 sum of:
-113.0 = weight: -113.0 * feature: 1.0 sum of:
0.0 = no matching terms
0.0 = no matching terms
1.0 = freq: 1
-84.0 = weight: -14.0 * feature: 6.0 sum of:
2.0 = freq: 2
3.0 = freq: 3
1.0 = freq: 1
-2141.0747 = weight: -322.44385 * feature: 6.640147 sum of:
2.762864 = log(numDocs: 7368/docFreq: 465)
0.55211145 = log(numDocs: 7368/docFreq: 4242)
3.3251717 = log(numDocs: 7368/docFreq: 265)
2.0鐃夙わ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申2鐃旬￥申reRankWeight鐃塾デフワ申鐃緒申函砲鐃緒申鐃�4.0鐃夙なり、鐃叔緒申鐃緒申鐃緒申鐃緒申鐃緒申廚鐃�14.37461鐃夙なる。2.0鐃夙わ申鐃緒申鐃緒申鐃緒申鐃緒申鐃熟どわ申鐃緒申辰瞳彁鐃緒申鐃緒申譴随申鐃緒申箸鐃緒申鐃緒申函鐃緒申鐃叔ワ申鐃粛随申鐃緒申鐃曙た鐃重みわ申箸辰瞳彁鐃緒申鐃緒申鐃緒申鐃縮わ申-2338.074707鐃夙なるが鐃緒申鐃緒申鐃緒申篭鐃緒申鐃緒申佑鐃�[-2374.0,6450.0]鐃緒申鐃熟逸申鐃緒申砲鐃緒申襪随申鐃�2.0鐃夙なる。
鐃殉とわ申
livedoor鐃祝ュー鐃緒申鐃緒申鐃緒申鐃術ワ申鐃熟フワ申鐃緒申鐃緒申豹鐃緒申鐃淑醐申鐃緒申鐃夙も少鐃淑わ申鐃塾で緒申分鐃淑駈申鐃春デ￥申鐃緒申鐃緒申鐃緒申里鐃緒申颪靴鐃緒申鐃緒申鐃緒申賊鐃緒申僂鐃緒申鐃銃わ申鐃緒申侫鐃緒申鐃緒申鐃宿随申鐃緒申文鐃緒申鐃緒申箸鐃緒申腓�鐃淑デ￥申鐃緒申鐃祝わ申鐃緒申鐃銃￥申鐃緒申鵐�ング学緒申鐃緒申鐃縮常申鐃�Similarity鐃緒申鐃緒申鐃出わ申鐃暑ス鐃緒申鐃緒申鐃緒申鐃緒申鐃宿わ申鐃緒申鐃緒申鐃緒申鐃暑こ鐃夙わ申鐃緒申鐃峻でわ申鐃暑。鐃緒申鐃述試し鐃銃わ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申
2016.07.09 Saturday
鐃緒申鐃緒申鐃春レー鐃緒申鐃緒申丱帖鐃緒申鐃� KEA 鐃緒申 Lucene 鐃緒申納鐃緒申鐃緒申鐃緒申鐃�
鐃緒申鐃緒申鐃春レー鐃緒申鐃緒申丱帖鐃緒申鐃� KEA 鐃緒申 Lucene 鐃初イ鐃瞬ワ申鐃緒申箸辰銅鐃緒申鐃緒申鐃緒申鐃� KEA-lucene 鐃緒申発鐃緒申鐃緒申鐃塾で紹介しわ申鐃緒申鐃緒申Solr 鐃緒申 Elasticsearch 鐃緒申鐃術わ申鐃瞬わ申鐃緒申 Lucene API 鐃緒申鐃駿駈申鐃緒申鐃銃わ申鐃緒申佑盪駕申佑砲覆鐃夙思わ申鐃緒申
KEA 鐃夙は￥申
KEA鐃熟ニュー鐃緒申鐃緒申鐃緒申鐃宿のワイ鐃緒申鐃緒申鐃緒申悗燃鐃夙�鐃緒申鐃緒申討鐃緒申襦�鐃緒申鐃緒申鐃緒申鐃緒申能颪�れた文鐃書からキ鐃緒申鐃春レー鐃緒申鐃淑ワ申鐃緒申鐃緒ー鐃宿）わ申動鐃緒申个鐃緒申鐃竣ワ申鐃緒申鐃緒申鐃叔わ申鐃暑。KEA鐃緒申Keyphrase Extraction Algorithm鐃緒申略鐃叔わ申鐃所、KEA鐃竣ワ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃暑ア鐃暑ゴ鐃所ズ鐃準そ鐃塾わ申里鐃舜わ申鐃緒申鐃盾あ鐃暑。
文鐃緒申鐃緒申娉辰鐃緒申譴随申鐃緒申鐃緒申侫譟種申鐃緒申蓮鐃緒申鐃緒申鐃淑醐申鐃塾逸申味的鐃潤タ鐃叔￥申鐃緒申鐃叔わ申鐃所、文鐃緒申龍鐃獣種申鐃獣誌申鐃緒申鐃緒申泪蝓種申箸鐃緒申鐃緒申鐃暑。鐃緒申鐃塾わ申鐃潤、文鐃緒申鐃緒申匹濆鐃緒申鐃緒申鐃瞬わ申鐃淑わ申鐃緒申鐃祝わ申鐃緒申文鐃緒申離瓮随申如鐃緒申鐃緒申任鐃緒申襯�鐃緒申鐃春レー鐃緒申鐃塾リス鐃夙わ申覆鐃緒申鐃緒申鐃緒申鐃緒申任鐃緒申鐃緒申泙鐃緒申鐃緒申鐃緒申討鐃縦わ申鐃準こ鐃夙わ申鐃叔わ申鐃暑。鐃緒申鐃夙わ申鐃出限わ申譴随申鐃緒申屬任鐃緒申鐃縦器申鐃淑�鐃薯してわ申鐃緒申鐃夙わ申鐃処う鐃緒申鐃緒申鐃緒申調鐃緒申鐃祝関件申鐃緒申鐃緒申鐃緒申鐃緒申文鐃緒申鐃緒申椶鐃緒申鐃緒申忙鐃緒申僂澆鐃緒申鐃銃わ申鐃暑が鐃緒申鐃緒申鐃駿てわ申鐃旬わ申鐃縮わ申鐃銃わ申鐃緒申鐃緒申屬呂覆鐃緒申鐃緒申鐃緒申鐃淑とわ申鐃熟￥申文鐃緒申某鐃緒申鐃緒申討鐃緒申襯�鐃緒申鐃春レー鐃緒申鐃緒申泙鐃緒申覆鐃緒申鐃銃￥申鐃舜件申鐃緒申鐃緒申鐃緒申鐃緒申文鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃宿み始わ申襪鰹申箸鐃緒申任鐃緒申襦�
鐃舜緒申鐃緒申文鐃淑どではわ申鐃緒申鐃緒申文鐃緒申鐃緒申鐃峻にわ申辰謄鐃緒申鐃緒申侫譟種申鐃緒申鐃緒申娉辰鐃緒申鐃銃わ申鐃緒申鐃塾わ申多鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃淑わ申鐃緒申鐃緒申未鐃淑醐申鐃緒申鐃緒申劼魯鐃緒申鐃緒申侫譟種申鐃緒申鐃緒申弔鐃緒申鐃緒申討鐃緒申覆鐃緒申鐃塾わ申鐃循とわ申匹任鐃緒申襦�KEA鐃熟わ申鐃塾よう鐃緒申文鐃書から自動的鐃祝ワ申鐃緒申鐃春レー鐃緒申鐃緒申鐃緒申个鐃緒申茲�鐃夙わ申鐃緒申鐃竣ワ申鐃緒申鐃緒申鐃叔わ申鐃暑。KEA鐃緒申鐃緒申鐃峻にわ申螢�鐃緒申鐃春レー鐃緒申鐃緒申鐃春加わ申鐃曙た文鐃緒申鐃緒申匹濆鐃緒申鐃叔わ申鐃緒申鐃緒申徴鐃緒申惱鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申侫譟種申鐃緒申鐃緒申弔鐃緒申鐃緒申討鐃緒申覆鐃縮わ申里鐃淑醐申颪�らキ鐃緒申鐃春レー鐃緒申鐃緒申動鐃緒申个鐃緒申鐃夙わ申鐃緒申鐃緒申鐃緒申鐃春わ申鐃所機鐃緒申鐃舜緒申鐃竣ワ申鐃緒申鐃緒申鐃叔わ申鐃暑。KEA鐃熟醐申鐃緒申扮儻鐃緒申鐃緒申鐃旬醐申覆鼻砲亡愀鐃緒申覆鐃銃逸申鐃緒申能鐃淑ワ申鐃暑ゴ鐃所ズ鐃緒申箸覆辰討鐃緒申襦�
鐃緒申鐃緒申鐃春レー鐃緒申鐃緒申个半鐃緒申鷂〆鐃緒申隆愀鐃�
鐃旬稿わ申Lucene鐃緒申鐃緒申妊奪鐃緒申鐃緒申鐃緒申薀�鐃緒申鐃春レー鐃緒申鐃緒申鐃緒申个鐃緒申茲�鐃夙わ申鐃緒申鐃獣なので￥申鐃緒申鐃緒申鐃春レー鐃緒申鐃緒申个半鐃緒申鷂〆鐃緒申隆愀鐃緒申砲弔鐃緒申討眇�鐃緒申討鐃緒申鐃緒申鐃緒申鐃�
鐃殉わ申KEA鐃塾削申圓鐃熟ワ申鐃緒申鐃緒ー鐃宿とわ申鐃緒申鐃緒申鐃春ではなわ申鐃緒申鐃緒申鐃緒申鐃春レー鐃緒申鐃夙わ申鐃緒申鐃緒申鐃春わ申箸辰討鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申椶鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申錙種申匹箸鐃緒申鐃緒申判鐃緒申廚福淵鐃緒申鐃緒申鐃�1鐃縦わ申単鐃緒申鐃熟�鐃循わ申鐃暑が鐃緒申鐃緒ー鐃宿ではなわ申鐃春レー鐃緒申鐃緒申鐃緒申鐃緒申砲箸鐃緒申鐃緒申鐃緒申佞鐃夙わ申鐃緒申鐃夙で￥申鐃緒申鐃緒申鐃夙なわ申1鐃縦以常申鐃獣縁申鐃緒申連鐃淑わ申鐃淑醐申颪�わ申鐃緒申个任鐃緒申鐃夙わ申鐃緒申鐃緒申鐃夙わ申鐃緒申調鐃緒申鐃緒申討鐃緒申襦�
Lucene鐃緒申鐃緒申妊奪鐃緒申鐃緒申鐃緒申薀�鐃緒申鐃春レー鐃緒申鐃緒申鐃緒申个任鐃緒申鐃緒申箸鐃緒申鐃夙￥申鐃緒申鐃藷検削申鐃祝はどわ申覆鐃緒申鐃緒申鐃緒申箸鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃殉わ申鐃竣わ申鐃盾か鐃瞬のわ申鐃緒申鐃緒申鐃緒申離鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申覆泙鐃緒申鐃縮常申鬟�￥申鐃夙ワ申鐃緒申廛蝓種申函砲任鐃緒申襦�Lucene鐃緒申鐃緒申妊奪鐃緒申鐃緒申呂匹鐃緒申鐃緒申討鐃獣縁申鐃獣縁申未鐃淑醐申鐃緒申鵑�器申鐃緒申鐃緒申鐃緒申討鐃緒申鐃塾で￥申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申単鐃緒申単鐃縮となってわ申鐃殉わ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃夙なわ申侫譟種申鐃緒申鐃緒申鐃銃逸申鐃出でわ申鐃緒申鐃熟�続鐃緒申鐃緒申複鐃緒申鐃緒申単鐃曙が鐃緒申鐃駿にワ申鐃緒申鐃緒申鐃緒申鐃夙でわ申鐃緒申鐃緒申鐃獣とわ申鐃所が鐃緒申鐃淳わ申鐃緒申鐃緒申鐃緒申鐃盾し鐃緒申鐃緒申鐃銃醐申鐃緒申鐃緒申同鐃粛でわ申鐃暑。
鐃殉わ申鐃緒申鐃緒申鐃緒申粍鐃緒申鐃緒申鐃宿緒申鐃緒申鐃緒申鐃夙わ申鐃祝￥申鐃熟ワ申鐃初イ鐃夙居申能鐃緒申鐃緒申鐃緒申發件申鐃緒申魯魯鐃緒申薀わ申筏鐃叔緒申醗鐃緒申鐃緒申鐃緒申鐃淑醐申鐃塾ワ申鐃緒申鐃春レー鐃緒申鐃緒申表鐃緒申鐃緒申鐃暑こ鐃夙でユー鐃緒申鐃緒申文鐃緒申鐃緒申鐃緒申僚鐃緒申鐃緒申箸鐃緒申襪鰹申箸鐃粛わ申鐃緒申鐃暑。鐃緒申鐃緒申砲魯侫鐃緒申鐃緒申奪函聞覆鐃緒申鐃淳醐申鐃緒申鐃祝のワ申鐃緒申鐃夙わ申鐃暑こ鐃夙わ申佑鐃緒申鐃緒申鐃塾で￥申鐃緒申鐃緒申鐃春レー鐃緒申鐃緒申鐃緒申个任鐃緒申襪鰹申箸離鐃緒申奪箸鐃緒申腓�鐃緒申鐃緒申
KEA鐃塾緒申鐃緒申鐃緒申鐃緒申
KEA鐃緒申鐃緒申文鐃熟鰹申鐃緒申鐃書しわ申鐃緒申鐃夙わ申鐃書いてわ申鐃緒申錣縁申任呂覆鐃緒申里如鐃緒申鐃緒申屬里鐃緒申鐃緒申鐃緒申砲呂鐃緒申勸鐃緒申匹鬚�器申鐃潤す鐃暑。鐃旬稿ではのわ申鐃塾わ申Lucene鐃初イ鐃瞬ワ申鐃緒申箸辰鐃�KEA鐃塾種申鐃緒申鐃緒申鐃緒申發刻申鐃塾で￥申鐃緒申鐃曙が鐃緒申鐃緒申任鐃緒申鐃処う鐃緒申鐃緒申造鐃緒申鐃緒申鐃緒申鐃峻わ申鐃緒申鐃夙にわ申鐃処う鐃緒申
KEA鐃祝わ申鐃緒申鐃緒申鐃緒申鐃緒申蓮岾惱鐃緒申鐃緒申鐃緒申廚函屮鐃緒申鐃緒申侫譟種申鐃緒申鐃出駕申鐃緒申鐃竣わ申鐃緒申鐃縮わ申鐃緒申襪�鐃緒申両鐃峻に駈申鐃縮な緒申鐃緒申鐃夙わ申鐃銃ワ申鐃緒申鐃春レー鐃緒申鐃塾醐申鐃緒申鐃所ス鐃夙ワ申鐃獣プわ申鐃緒申廛鐃緒申鐃緒申鐃緒申鐃渋醐申澆鐃緒申襦ｏ申鐃緒申鐃緒申侫譟種申鐃緒申鐃緒申鐃熟居申鐃緒申的鐃祝リス鐃夙ワ申鐃獣プわ申鐃緒申襦ｏ申鐃緒申里茲�鐃祝リス鐃夙ワ申鐃獣プわ申鐃曙た多鐃緒申鐃塾ワ申鐃緒申鐃春レー鐃緒申鐃緒申鐃巡か鐃初、鐃舜緒申鐃緒申鐃熟ワ申鐃緒申鐃春レー鐃緒申鐃祝なわ申覆鐃巡す鐃緒申鐃淑まわ申鐃熟なわ申砲鐃緒申鐃緒申砲鐃舜緒申鐃緒申鐃暑。鐃緒申鐃緒申鐃銃ワ申鐃緒申鐃春レー鐃緒申鐃緒申仍鐃緒申漏惱鐃緒申鐃緒申鐃緒申鐃塾�鐃緒申妊鐃薯参照わ申鐃銃￥申多鐃緒申鐃塾ワ申鐃緒申鐃春レー鐃緒申鐃緒申鐃緒申鬟好鐃緒申鐃緒申鼎鐃緒申鐃緒申謄鐃緒申鐃緒申鐃緒申鐃緒申腓�鐃緒申鐃緒申里鐃緒申鐃緒申縫鐃緒申鐃緒申侫譟種申鐃緒申鐃緒申鐃緒申表鐃緒申鐃緒申鐃暑。鐃渋際のワ申鐃緒申鐃春レー鐃緒申鐃緒申仍鐃緒申呂鐃緒申里茲�鐃祝緒申鐃緒申佞鐃緒申鐃緒申譴随申鐃緒申鐃緒申侫譟種申鐃緒申鐃緒申鐃塾リス鐃夙わ申鐃緒申適鐃緒申鐃淑とわ申鐃緒申鐃緒申足鐃准わ申鐃峻わ申鐃緒申
鐃旬稿で駕申鐃盾す鐃緒申KEA鐃塾種申鐃緒申鐃熟￥申Lucene鐃緒申鐃順い鐃祝鰹申鐃術わ申鐃暑。鐃舜緒申鐃塾プワ申鐃緒申鐃緒申鐃叔は￥申鐃緒申鐃塾の￥申鐃緒申鐃峻にわ申螢�鐃緒申鐃春レー鐃緒申鐃緒申鐃縦わ申鐃緒申譴随申鐃淑醐申鐃緒申鐃緒申辰鐃�Lucene鐃緒申鐃緒申妊奪鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃遵そ鐃緒申鐃緒申鐃緒申鐃叔ワ申侫鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申襦Ｌわ申里痢淵鐃緒申鐃緒申侫譟種申鐃緒申鐃緒申弔鐃緒申鐃緒申討鐃緒申覆鐃緒申鐃淑醐申颪�らキ鐃緒申鐃春レー鐃緒申鐃緒申鐃緒申个鐃緒申鐃竣ワ申鐃緒申鐃緒申鐃叔は￥申鐃緒申鐃緒申文鐃緒申鐃�Lucene鐃緒申鐃緒申妊奪鐃緒申鐃緒申鐃熟随申鐃緒申討鐃緒申薀�鐃緒申鐃春レー鐃緒申鐃緒申鐃緒申个鐃緒申襦�
鐃緒申鐃緒申鐃春レー鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申
KEA鐃叔はワ申鐃緒申鐃春レー鐃緒申鐃塾醐申鐃緒申箸鐃緒申董鐃�1鐃縦わ申鐃緒申鐃緒申鐃�3鐃縦わ申連続鐃緒申鐃緒申単鐃緒申鐃緒申鐃藷する。鐃緒申鐃夙わ申鐃出￥申鐃緒申鐃塾よう鐃緒申文鐃書がわ申鐃獣わ申鐃夙わ申鐃処う鐃緒申
Tokyo governor likes to go to Yugawara.
鐃緒申鐃緒申函鐃�KEA鐃叔は種申鐃塾よう鐃緒申10鐃縦の醐申鐃緒申箸覆襯�鐃緒申鐃春レー鐃緒申鐃緒申鐃緒申鵑垢襦�
- tokyo
- governor
- like
- go
- yugawara (*)
- tokyo governor (*)
- governor like
- tokyo governor like
- like to go
- go to yugawara
鐃緒申鐃緒申鐃春レー鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申砲鐃緒申鐃緒申討蓮鐃緒申鐃緒申肇奪廛錙種申匹鐃緒申鐃熟まわ申侫譟種申鐃緒申筌刻申肇奪廛錙種申匹能鐃緒申鐃緒申侫譟種申鐃緒申聾鐃緒申鐃夙なわ申覆鐃緒申鐃緒申鐃獣て￥申単鐃夙わ申to鐃塾みならず鐃緒申like(s) to鐃緒申to go鐃淑どは醐申鐃緒申箸鐃緒申謄螢刻申肇鐃緒申奪廚鐃緒申鐃淑わ申鐃緒申鐃殉わ申鐃緒申鐃藷検削申鐃緒申NLP鐃叔よく鐃峻わ申鐃緒申文鐃緒申鐃緒申単鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申發鰹申鐃緒申奮鐃緒申嚢圓鐃緒申襦ｏ申鐃獣て￥申Tokyo鐃緒申Yugawara鐃緒申tokyo鐃緒申yugawara鐃祝￥申likes鐃熟ワ申鐃銃ミングわ申鐃緒申鐃�like鐃祝なる。
KEA鐃祝わ申鐃緒申鐃緒申鐃叔ワ申粒惱鐃�
KEA鐃叔わ申単鐃緒申戰鐃緒申鐃淑�鐃緒申鐃緒申鐃術わ申鐃銃駈申鐃春わ申鐃緒申如鐃緒申鐃緒申鐃緒申鐃緒申圓砲鐃所キ鐃緒申鐃春レー鐃緒申鐃緒申鐃縦わ申鐃緒申譴進醐申鐃叔￥申鐃緒申鐃祝わ申鐃初キ鐃緒申鐃春レー鐃緒申鐃緒申鐃緒申砲鐃緒申鐃緒申襯�鐃緒申鐃春レー鐃緒申鐃祝なわ申覆鐃巡す鐃緒申鐃緒申P[yes]鐃祝となわ申砲鐃緒申鐃緒申鐃�P[no]鐃祝わ申惱鐃緒申鐃緒申襦ｏ申鐃緒申鐃重�鐃祝は種申鐃塾よう鐃淑種申鐃緒申鐃術わ申鐃暑。
P[yes] = Y / (Y + N) * Pt[t|yes] * Pd[d|yes]
P[no] = N / (Y + N) * Pt[t|no] * Pd[d|no]
鐃緒申鐃緒申鐃緒申"Y / (Y + N)"鐃緒申"N / (Y + N)"鐃緒申鐃緒申分鐃熟ワ申鐃緒申鐃春レー鐃緒申鐃緒申鐃巡か鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申率鐃叔わ申鐃暑。鐃緒申鐃緒申鐃淑醐申妊鐃緒申鐃緒申鐃緒申螢刻申鐃緒申鐃緒申弔鐃緒申鐃曙た鐃緒申里鐃緒申鐃緒申鐃緒申侫譟種申鐃緒申鐃緒申箸鐃緒申鐃夙￥申鐃縦わ申鐃塾よう鐃祝なる。
Y / (Y + N) = 2 / 10
N / (Y + N) = 8 / 10
KEA鐃叔わ申文鐃緒申D鐃緒申離侫譟種申鐃�P鐃緒申表鐃緒申鐃緒申鐃緒申里鐃�2鐃縦わ申鐃緒申徴鐃縮わ申鐃術わ申鐃銃わ申鐃暑。1鐃縦わ申鐃�TF*IDF鐃叔わ申鐃所、鐃緒申鐃塾よう鐃祝計誌申鐃緒申鐃緒申襦�
TFIDF = freq(P,D) / size(D) (-log(df(P) / N))
freq(P,D)鐃緒申文鐃緒申D鐃緒申縫侫譟種申鐃�P鐃緒申鐃出醐申鐃緒申鐃緒申鐃緒申鐃緒申size(D)鐃緒申文鐃緒申鐃獣縁申鐃緒申鐃緒申df(P)鐃熟フレー鐃緒申P鐃緒申泙鐃淑醐申鐃緒申鐃緒申N鐃緒申鐃緒申文鐃緒申鐃緒申任鐃緒申襦ｏ申覆鐃�log鐃緒申鐃緒申鐃�2鐃夙わ申鐃暑。
2鐃縦わ申鐃緒申鐃縦э申未鐃�first occurrence鐃緒申鐃緒申名鐃緒申鐃緒申離鐃祝と呼ばわ申鐃緒申里任鐃緒申襦ｏ申鐃緒申鐃熟フレー鐃緒申P鐃緒申文鐃緒申D鐃祝最緒申鐃緒申仂譴刻申鐃緒申鐃瞬わ申size(D)鐃叔鰹申辰鐃緒申鐃塾でわ申鐃暑。鐃緒申鐃夙わ申鐃緒申鐃緒申鐃緒申鐃緒申tokyo鐃緒申1/7鐃緒申governor鐃緒申2/7鐃夙なる。
2鐃縦わ申鐃緒申徴鐃縮わ申鐃緒申鐃塾実随申鐃夙なるが鐃緒申KEA鐃叔わ申連続鐃粛わ申離鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申燃鐃塾ワ申鐃緒申佑鐃緒申箸了鐃緒申鐃緒申率鐃緒申彁鐃緒申鐃緒申襦ｏ申鐃緒申劼亮鐃緒申鐃�Pt[t|yes]鐃淑まわ申鐃緒申Pt[t|no]鐃祝わ申TF*IDF鐃塾誌申鐃緒申鐃塾�鐃緒申Pd[d|yes]鐃淑まわ申鐃緒申Pd[d|no]鐃祝は居申離鐃塾誌申鐃緒申鐃塾�鐃叔わ申鐃暑。
KEA鐃祝わ申鐃緒申鐃暑キ鐃緒申鐃春レー鐃緒申鐃緒申鐃�
未鐃塾わ申文鐃緒申D鐃緒申鐃初キ鐃緒申鐃春レー鐃緒申鐃緒申个鐃峻わ申鐃祝は￥申D鐃緒申鐃緒申鐃緒申鵑靴鐃緒申鐃緒申鐃緒申侫譟種申鐃緒申鐃緒申鐃祝つわ申鐃緒申鐃緒申鐃述わ申2鐃縦わ申鐃緒申徴鐃縮わ申彁鐃緒申鐃緒申鐃�P[yes]鐃緒申P[no]鐃緒申鐃潤、鐃叔緒申的鐃祝種申鐃塾種申鐃緒申箸辰謄鐃緒申鐃緒申鐃緒申鮖蚕个鐃緒申胴濬鐃祝ワ申鐃緒申鐃夙わ申鐃緒申適鐃緒申鐃淑とわ申鐃緒申鐃緒申足鐃准りす鐃暑。
score(P,D) = P[yes] / (P[yes] + P[no])
鐃淑わ申鐃緒申未鐃緒申文鐃緒申魯鐃叔ワ申亡泙泙鐃銃わ申鐃淑わ申鐃緒申鐃潤、TF*IDF鐃緒申彁鐃緒申鐃緒申鐃楯は￥申df(P)鐃緒申N鐃緒申1鐃緒申短鐃緒申鐃緒申襦�
Apache Lucene鐃緒申箸辰鐃�KEA鐃竣ワ申鐃緒申鐃緒申鐃�
鐃叔わ申鐃緒申鐃述のワ申鐃暑ゴ鐃所ズ鐃緒申鮓気法鐃�Lucene鐃初イ鐃瞬ワ申鐃緒申侫鐃緒申鐃術わ申鐃緒申KEA鐃竣ワ申鐃緒申鐃緒申鐃緒申KEA-lucene鐃夙呼ぶわ申鐃夙にわ申鐃緒申砲鮗�作し鐃銃みよう鐃緒申鐃緒申鐃緒申鐃叔紹介すわ申廛鐃緒申鐃緒申鐃緒申鐃�Github鐃祝醐申鐃緒申鐃緒申鐃銃わ申鐃暑。鐃淑わ申鐃緒申鐃竣ワ申鐃緒申鐃緒申鐃熟わか鐃緒申笋刻申鐃緒申鐃粛ワ申茲件申鐃緒申妊鐃緒申譽�鐃夙ワ申名鐃淑どわ申鐃春随申的鐃祝ハ￥申鐃宿ワ申鐃緒申鐃叔ワ申鐃藷グわ申鐃緒申討鐃緒申襦�
鐃淑わ申Lucene鐃緒申箸鐃緒申里鐃緒申鐃�
鐃夙わ申鐃緒申鐃緒申KEA鐃緒申鐃緒申鐃緒申鐃緒申鐃塾になわ申Lucene鐃緒申箸鐃緒申里鐃緒申鐃緒申鐃緒申鐃緒申鐃�KEA鐃祝限らず鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申離帖鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申隋�単鐃緒申凌鐃緒申鐃緒申鐃緒申鐃緒申鐃所、鐃緒申鐃緒申単鐃緒申鐃殉わ申文鐃緒申凌鐃緒申鐃緒申鐃緒申鐃緒申鐃所、鐃緒申鐃緒申鐃緒申鐃緒申鐃淑醐申鐃緒申単鐃緒申剖鐃緒申擇辰鐃緒申蠅刻申襪鰹申箸鐃緒申茲�鐃峻わ申鐃暑。Lucene鐃熟わ申鐃緒申鐃緒申鐃獣わ申鐃緒申鐃緒申鐃緒申圓鐃緒申里砲茲�鐃緒申鐃緒申鐃緒申鐃曙たAPI鐃緒申鐃緒申鐃緒申鐃銃わ申鐃暑。鐃緒申鐃緒申砲鐃�Lucene鐃緒申転鐃瞬ワ申鐃緒申妊奪鐃緒申鐃緒申憤焚鐃獣縁申縫鐃緒申鐃叔ッワ申鐃緒申鐃夙呼ぶ）わ申単鐃曙辞鐃緒申箸鐃緒申討鐃粛ワ申鐃緒申鐃緒申鐃緒申辰鐃�KEA-lucene鐃塾わ申鐃緒申忙鐃緒申僂鐃緒申鐃�Lucene API鐃緒申焚鐃緒申望匆陲靴茲�鐃緒申
Analyzer
Lucene鐃叔は￥申文鐃熟わ申単鐃緒申剖鐃緒申擇鐃塾わ申Analyzer鐃緒申鐃初ス鐃緒申鐃術わ申鐃暑。KEA-lucene鐃叔は￥申鐃夙￥申鐃緒申鐃淑ワ申鐃緒申鐃塾わ申鐃緒申鐃�StandardTokenizer鐃薯、常申文鐃緒申鐃舜わ申鐃緒申鐃緒申鐃緒申鐃塾わ申鐃緒申鐃�LowerCaseFilter鐃薯、わ申鐃緒申鐃緒申単鐃緒申N-gram鐃薯サポ￥申鐃夙わ申鐃暑た鐃緒申鐃�ShingleFilter鐃緒申箸辰討鐃緒申襦ｏ申鐃叔逸申覆鐃緒申鐃�KEA鐃塾ワ申鐃夙ップワー鐃宿の考わ申鐃緒申鐃緒申Lucene鐃緒申StopFilter鐃叔は実醐申鐃叔わ申鐃淑わ申鐃塾で￥申KEAStopFilter鐃夙わ申鐃緒申鐃夙種申TokenFilter鐃緒申鐃緒申鐃緒申鐃緒申討鐃緒申襦ｏ申鐃緒申鐃緒申萄能鐃重�鐃祝種申鐃塾よう鐃緒申KEAAnalyzer鐃緒申鐃夙み上げ鐃緒申鐃緒申
public class KEAAnalyzer extends Analyzer {
private final int n;
public KEAAnalyzer(int n){
this.n = n;
}
@Override
protected TokenStreamComponents createComponents(String fieldName) {
Tokenizer source = new StandardTokenizer();
TokenStream lcf = new LowerCaseFilter(source);
if(n == 1){
TokenStream stf = new KEAStopFilter(lcf, n, Commons.stopWords, Commons.beginStopWords, Commons.endStopWords);
return new TokenStreamComponents(source, stf);
}
else{
assert n >= 2;
ShingleFilter shf = new ShingleFilter(lcf, n, n);
shf.setOutputUnigrams(false);
KEAStopFilter keasf = new KEAStopFilter(shf, n, Commons.stopWords, Commons.beginStopWords, Commons.endStopWords);
return new TokenStreamComponents(source, keasf);
}
}
}
KEA鐃緒申鐃緒申文鐃祝わ申鐃夙￥申conjunctions, articles, particles, prepositions, pronouns, anomalous verbs, adjectives 鐃緒申鐃緒申鐃� adverbs 鐃塾鰹申鐃淑詞か鐃初ス鐃夙ップワー鐃宿リス鐃夙わ申鐃緒申鐃緒申鐃銃わ申鐃暑。鐃緒申鐃緒申鐃�Lucene鐃緒申鐃所ス鐃夙ワ申鐃獣プわ申鐃銃わ申鐃暑ス鐃夙ップワー鐃宿わ申鐃緒申呂襪�鐃緒申多鐃緒申鐃緒申KEA-lucene鐃叔わ申Lucene鐃塾ワ申鐃夙ップワー鐃宿わ申鐃夙種申鐃祝ワ申鐃夙ップワー鐃宿わ申鐃宿加わ申鐃緒申鐃緒申
鐃緒申鐃緒申鐃�KEA-lucene鐃叔わ申単鐃緒申N-gram鐃緒申N鐃緒申1鐃緒申鐃緒申3鐃緒申鐃術わ申鐃銃醐申鐃縮のフワ申鐃緒申鐃緒申匹縫鐃緒申鐃叔ッワ申鐃緒申鐃緒申録鐃緒申鐃暑た鐃潤、Lucene鐃緒申PerFieldAnalyzerWrapper鐃薯次のよう鐃祝誌申鐃術わ申鐃銃わ申鐃暑。
public static Analyzer getKEAAnalyzer(String fieldName){
Map amap = new HashMap<>();
amap.put(Commons.getFieldName(fieldName, 1), new KEAAnalyzer(1));
amap.put(Commons.getFieldName(fieldName, 2), new KEAAnalyzer(2));
amap.put(Commons.getFieldName(fieldName, 3), new KEAAnalyzer(3));
return new PerFieldAnalyzerWrapper(new StandardAnalyzer(), amap);
}
単鐃曙辞鐃緒申箸鐃緒申鐃�Lucene鐃緒申鐃緒申妊奪鐃緒申鐃緒申鐃緒申鐃術わ申鐃緒申
Lucene鐃緒申単鐃緒申鬟�￥申鐃祝わ申鐃緒申転鐃瞬ワ申鐃緒申妊奪鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃暑。鐃緒申鐃緒申鐃獣縁申貅�鐃緒申箸鐃緒申道箸鐃緒申里麓造房鐃緒申鐃緒申任鐃緒申鐃緒申鐃緒申砲鐃緒申覆辰討鐃緒申鐃夙わ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申侫鐃緒申鐃緒申鐃緒申field鐃緒申単鐃緒申鐃叔初か鐃緒申埜鐃殉わ申鐃緒申鐃緒申鐃緒申鐃緒申砲麓鐃緒申里茲�鐃祝わ申鐃暑。鐃緒申鐃緒申鐃緒申ir鐃緒申Lucene鐃緒申鐃緒申妊奪鐃緒申鐃緒申鬟�￥申鐃竣ンしてわ申鐃緒申IndexReader鐃塾ワ申鐃瞬ワ申鐃緒申鐃緒申鐃夙でわ申鐃暑。
Terms terms = MultiFields.getTerms(ir, field);
TermsEnum te = terms.iterator();
for(BytesRef rawPhrase = te.next(); rawPhrase != null; rawPhrase = te.next()){
String phrase = rawPhrase.utf8ToString();
:
}
Lucene鐃塾ワ申鐃緒申妊奪鐃緒申鐃緒申呂鐃緒申鐃獣縁申鐃獣縁申譴�鐃所ス鐃夙ワ申鐃獣プわ申鐃緒申討鐃緒申鐃緒申鐃緒申鐃叔はなわ申鐃緒申鐃緒申鐃述わ申2鐃縦わ申鐃緒申徴鐃縮わ申彁鐃緒申鐃緒申襪随申鐃緒申必鐃竣となわ申鐃緒申鐃緒申鐃縮わ申鐃緒申存鐃緒申鐃緒申討鐃緒申襦ｏ申鐃緒申箸鐃緒申鐃�freq(P,D)鐃緒申文鐃緒申D鐃緒申縫侫譟種申鐃�P鐃緒申鐃出醐申鐃緒申鐃緒申鐃緒申鐃叔わ申鐃暑が鐃緒申鐃緒申鐃緒申鐃�MultiFields鐃緒申getTermDocsEnum()鐃潤ソ鐃獣ドわ申鐃緒申僂鐃緒申銅鐃緒申鐃緒申鐃緒申鐃�PostingsEnum鐃緒申鐃瞬ワ申鐃緒申鐃緒申鐃夙わ申鐃出わ申nextDoc()鐃緒申文鐃緒申D鐃緒申鐃緒申鐃所し鐃緒申鐃遵、freq()鐃緒申討喀个鐃緒申鐃緒申箸納鐃緒申鐃緒申任鐃緒申襦�
鐃殉わ申df(P)鐃熟フレー鐃緒申P鐃緒申泙鐃淑醐申鐃緒申鐃緒申N鐃緒申鐃緒申文鐃緒申鐃緒申任鐃緒申襪�鐃緒申鐃緒申麓鐃緒申里茲�鐃祝わ申鐃銃種申鐃緒申鐃叔わ申鐃暑。
int dfreq = ir.docFreq(new Term(field, phrase)); : int n = ir.numDocs();
鐃緒申鐃緒申砲魯侫譟種申鐃緒申竜鐃塾ワ申鐃竣誌申鐃緒申鐃暑た鐃緒申縫櫂鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申必鐃竣になってわ申鐃暑が鐃緒申鐃緒申鐃緒申鐃�MultiFields鐃緒申getTermPositionsEnum()鐃潤ソ鐃獣ドわ申箸辰鐃�PostingsEnum鐃緒申鐃瞬ワ申鐃緒申鐃緒申鐃夙わ申鐃緒申鐃緒申紂�advance()鐃潤ソ鐃獣ドわ申文鐃緒申鐃緒申鐃緒申蠅件申鐃緒申鐃�nextPosition()鐃叔最緒申離侫譟種申鐃緒申離櫂鐃緒申鐃緒申鐃緒申鐃緒申鐃暑。KEA-lucene鐃叔わ申1-gram, 2-gram, 3-gram鐃緒申鐃緒申立鐃緒申鐃緒申鐃春ワ申鐃緒申鐃緒申匹砲鐃緒申討鐃緒申鐃塾で￥申nextPosition()鐃叔種申鐃緒申鐃緒申鐃緒申鐃楯ワ申鐃緒申鐃緒申鐃熟わ申鐃塾まま居申離鐃竣誌申鐃緒申鐃術わ申鐃緒申鐃緒申鐃緒申覆鐃緒申鐃�
鐃緒申妊鐃塾学緒申鐃淑ワ申妊鐃春ワ申鐃緒申鐃緒申僚鐃緒申蓮鐃�
KEA-lucene鐃叔わ申KEAModelBuilder鐃緒申鐃緒申妊鐃塾学緒申鐃緒申圓辰討鐃緒申襦ｏ申鐃緒申離廛鐃緒申鐃緒申鐃緒申鐃�鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃叔わ申鐃暑教鐃春デ￥申鐃緒申鐃緒申MAUI.tar.gz鐃緒申展鐃緒申鐃緒申鐃緒申鐃緒申砲鐃緒申鐃緒申鐃祝わ申鐃緒申fao30.tar.gz鐃緒申展鐃緒申鐃緒申鐃緒申砲鐃�data/fao30/鐃叔ワ申鐃曙ク鐃夙ワ申鐃緒申鐃緒申屬鐃緒申鐃暑こ鐃夙わ申鐃緒申鐃緒申暴颪�わ申討鐃緒申鐃塾わ申鐃緒申鐃春わ申鐃銃わ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申
KEA鐃叔はワ申妊鐃塾学緒申鐃緒申単鐃緒申戰鐃緒申鐃緒申鐃夙ってわ申鐃緒申里如鐃緒申惱鐃緒申砲漏銅鐃緒申鐃緒申鐃緒申未鬟�ワ申鐃緒申箸鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃縮の鰹申蟷誌申鐃峻わ申鐃緒申鐃緒申蟷誌申鐃竣誌申鐃緒申鐃銃わ申鐃緒申里聾鐃述わ申KeyphraseExtractor(2)鐃竣ワ申鐃緒申鐃緒申鐃叔わ申鐃所、KEAModelBuilder鐃竣ワ申鐃緒申鐃緒申鐃叔わ申鐃緒申鐃緒申鐃縮わ申鐃緒申討鐃緒申鐃緒申鐃緒申鐃淑ので￥申鐃緒申鐃塾にはワ申妊鐃塾学緒申鐃夙わ申鐃緒申鐃緒申鐃熟ワ申妊鐃春ワ申鐃緒申鐃緒申鐃緒申鐃熟わ申鐃銃わ申鐃緒申鵬瓩�鐃淑わ申鐃緒申
KEAModelBuilder鐃緒申鐃緒申鐃熟わ申鐃緒申鐃叔ワ申侫鐃緒申鐃緒申鐃熟種申鐃塾よう鐃淑ワ申鐃准￥申鐃緒申鐃緒申鐃准わ申離謄鐃緒申鐃緒申肇侫鐃緒申鐃緒申鐃叔わ申鐃暑。
$ head features-model.txt 0.000852285 0.231328 false 0.000284095 0.980489 false 0.000426143 0.0124768 false 0.000426143 0.429134 false 2.01699e-05 0.0479968 false 0.000284095 0.0160665 false 0.000426143 0.726610 false 0.000136409 0.000752663 false 0.000226198 0.379661 false 0.000284095 0.478057 false
1鐃縦のレコ鐃緒申鐃宿わ申1鐃縦のワ申鐃緒申鐃春レー鐃緒申鐃緒申鐃緒申鐃宿緒申鐃緒申討鐃緒申襦ｏ申能鐃塾随申鐃粛わ申TF*IDF鐃叔￥申2鐃緒申鐃旬の随申鐃粛は居申離鐃緒申表鐃緒申鐃銃わ申鐃暑。3鐃緒申鐃旬はワ申鐃緒申鐃春レー鐃緒申鐃緒申true鐃祝わ申鐃楯わ申鐃緒申false鐃祝わ申表鐃緒申鐃緒申鐃暑ク鐃初ス鐃叔わ申鐃暑。
KEAModelBuilder鐃竣ワ申鐃緒申鐃緒申鐃熟上記鐃塾よう鐃淑ワ申妊鐃春ワ申鐃緒申鐃緒申鐃緒申鐃熟わ申鐃暑た鐃緒申剖鐃緒申侫如鐃緒申鐃緒申鐃緒申鐃�Lucene鐃緒申鐃緒申妊奪鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申Lucene鐃緒申鐃緒申妊奪鐃緒申鐃緒申鐃獣縁申貅�鐃緒申箸澆覆鐃緒申鐃�iterate鐃緒申鐃淑わ申鐃緒申鐃緒申徴鐃縮わ申彁鐃緒申鐃緒申弔帖鐃緒申綉�鐃塾ワ申妊鐃春ワ申鐃緒申鐃緒申鐃緒申鐃熟わ申鐃暑。
鐃緒申鐃粛までに緒申鐃緒申鐃緒申鐃瞬を示わ申鐃銃わ申鐃緒申鐃緒申鐃緒申鐃緒申鐃�MacBook Pro鐃緒申Processor 2.3 GHz Intel Core i7鐃祝でわ申5分鐃緒申鐃駿わ申鐃緒申鐃獣わ申鐃緒申Lucene鐃緒申鐃緒申妊奪鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申里楼鐃瞬わ申鐃緒申鐃緒申Lucene鐃緒申鐃緒申妊奪鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申覆鐃緒申鐃緒申妊鐃春ワ申鐃緒申鐃緒申鐃緒申鐃熟わ申鐃緒申里望鐃緒申鐃緒申鐃緒申屬鐃緒申鐃緒申鐃緒申辰討鐃緒申襦�
R鐃祝わ申鐃熟�続鐃粛わ申離鐃緒申鐃緒申
KEA鐃叔わ申鐃緒申徴鐃縮の実随申鐃粛をそのまわ申鐃術わ申鐃緒申里任呂覆鐃緒申鐃�MDLP鐃淑最常申鐃緒申鐃緒申長鐃緒申鐃緒申鐃祝にわ申鐃緒申瓩仁ワ申鐃緒申佑縫泪奪團鵐阿鐃緒申鐃緒申僂鐃緒申襦ｏ申鐃緒申鐃緒申任鐃�MDLP鐃塾計誌申鐃塾わ申鐃緒申鐃�R鐃緒申箸辰銅鐃緒申里茲�鐃祝居申瓩随申鐃�
data <- read.table('features-model.txt')
mdlp(data)$cutp
[[1]]
[1] 0.0003538965 0.0013242950 0.0041024750
[[2]]
[1] 0.0003553105 0.0144056500 0.0697899000
鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申譴随申鐃縮は￥申鐃緒申鐃塾プワ申鐃緒申鐃緒申鐃�KeyphraseExtractor(2)鐃叔誌申鐃術わ申鐃緒申里如鐃�cutp-model.txt鐃夙わ申鐃緒申鐃春ワ申鐃緒申鐃緒申名鐃緒申鐃緒申存鐃緒申鐃銃わ申鐃緒申鐃緒申
$ cat cutp-model.txt 0.0003538965 0.0013242950 0.0041024750 0.0003553105 0.0144056500 0.0697899000
R鐃祝わ申鐃�MDLP鐃竣誌申鐃緒申同鐃緒申鐃縦駈申鐃緒申30分鐃緒申鐃駿わ申鐃緒申鐃獣わ申鐃緒申
Lucene鐃緒申鐃緒申妊奪鐃緒申鐃緒申鐃緒申鐃塾ワ申鐃緒申鐃春レー鐃緒申鐃緒申鐃�
鐃叔はわ申鐃処い鐃緒申Lucene鐃緒申鐃緒申妊奪鐃緒申鐃緒申鐃緒申薀�鐃緒申鐃春レー鐃緒申鐃緒申鐃緒申个鐃緒申討澆茲�鐃緒申鐃竣ワ申鐃緒申鐃緒申鐃緒申KeyphraseExtractor鐃緒申KeyphraseExtractor2鐃叔わ申鐃暑。鐃緒申鐃峻わ申KEAModelBuilder鐃叔削申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申妊奪鐃緒申鐃緒申里鐃緒申鐃緒申遒件申亡鐃緒申里離侫鐃緒申鐃緒申鐃�a0011e00.txt鐃淑わ申鐃塾フワ申鐃緒申鐃緒申名鐃緒申廛鐃緒申鐃緒申鐃緒申鐃緒申縫蓮鐃緒申疋鐃緒申鐃緒申妊鐃緒申鵐阿鐃緒申討鐃緒申鐃祝わ申鐃初キ鐃緒申鐃春レー鐃緒申鐃緒申鐃緒申个鐃緒申鐃緒申里任鐃緒申襦�KeyphraseExtractor2鐃緒申鐃緒申鐃緒申fao780鐃緒申鐃緒申鐃述わ申MAUI.tar.gz鐃緒申展鐃緒申鐃緒申鐃緒申鐃緒申砲鐃緒申鐃緒申鐃緒申鐃縮わ申里鐃淑醐申鐃�t0073e.txt鐃緒申鐃初キ鐃緒申鐃春レー鐃緒申鐃緒申鐃緒申个鐃緒申鐃竣ワ申鐃緒申鐃緒申鐃夙なってわ申鐃暑。
KeyphraseExtractor鐃緒申鐃緒申鐃熟器申存鐃緒申Lucene鐃緒申鐃緒申妊奪鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申未鐃緒申鐃緒申討鐃緒申鐃塾わ申鐃出わ申鐃緒申KeyphraseExtractor2鐃緒申鐃緒申鐃熟随申鐃緒申鐃緒申文鐃書かわ申銅鐃緒申鐃緒申鐃緒申未鐃緒申鐃緒申襪随申鐃緒申Lucene鐃緒申鐃緒申妊奪鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申箸鐃緒申鐃緒申鐃緒申鐃峻ってわ申鐃暑。鐃殉わ申鐃緒申KeyphraseExtractor2鐃緒申鐃緒申鐃熟ワ申妊鐃祝含まわ申覆鐃緒申鐃緒申鐃淑醐申鐃叔わ申鐃暑た鐃緒申法鐃�df(P) / N 鐃塾計誌申鐃緒申分鐃緒申分鐃曙、分鐃述とわ申1鐃緒申鐃獣誌申鐃緒申鐃緒申討鐃緒申鐃夙わ申鐃緒申鐃緒申曚覆襦�
KeyphraseExtractor鐃緒申KeyphraseExtractor2鐃熟とわ申鐃�Lucene鐃緒申鐃緒申妊奪鐃緒申鐃緒申鐃緒申鐃熟随申僂澆鐃淑醐申鐃緒申鐃緒申鐃所し鐃緒申鐃緒申鐃緒申文鐃緒申砲鐃緒申鐃緒申襯�鐃緒申鐃春レー鐃緒申鐃緒申鐃緒申鐃所ス鐃夙ワ申鐃獣プわ申鐃淑わ申鐃初ス鐃緒申鐃緒申鐃緒申彁鐃緒申鐃緒申襦ｏ申鐃緒申鐃緒申鐃緒申辰鐃獣縁申貅�鐃緒申鐃�iterate鐃緒申鐃緒申鐃緒申鐃�Lucene鐃緒申TermVector鐃緒申箸鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃�Lucene鐃宿ワ申鐃緒申鐃緒申鐃緒申鐃熟随申麓鐃緒申里茲�鐃緒申FieldType鐃緒申setStoreTermVectors(true)鐃緒申討鐃叔わ申鐃暑。
static Document getDocumentWithTermVectors(String fn, String content) throws IOException {
Document doc = new Document();
doc.add(new StringField(FILE_NAME, fn, Field.Store.YES));
doc.add(new StoredField(DOC_SIZE_FIELD_NAME, Commons.getDocumentSize(content)));
FieldType ft = new FieldType();
ft.setStored(true);
ft.setIndexOptions(IndexOptions.DOCS_AND_FREQS_AND_POSITIONS);
ft.setStoreTermVectors(true);
doc.add(new Field(Commons.getFieldName(FIELD_NAME, 1), content, ft));
doc.add(new Field(Commons.getFieldName(FIELD_NAME, 2), content, ft));
doc.add(new Field(Commons.getFieldName(FIELD_NAME, 3), content, ft));
return doc;
}
鐃緒申鐃緒申鐃春レー鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申劼離鐃緒申鐃緒申鐃緒申彁鐃緒申鐃緒申砲鐃緒申score(P,D)鐃緒申鐃竣誌申鐃緒申鐃緒申濬鐃祝ワ申鐃緒申鐃夙わ申鐃緒申襦�KEA-lucene鐃叔はわ申鐃塾わ申鐃緒申鐃�Lucene鐃緒申PriorityQueue鐃緒申鐃術わ申鐃銃わ申鐃暑。鐃夙わ申鐃緒申鐃叔￥申KEA鐃叔わ申鐃緒申徴鐃縮とわ申鐃緒申連続鐃粛ではなわ申離鐃緒申鐃粛わ申箸辰討鐃緒申襪随申瓠�score(P,D)鐃緒申多鐃緒申鐃塾ワ申鐃緒申鐃春レー鐃緒申鐃緒申鐃緒申屬鐃銃縁申鐃緒申砲覆鐃緒申鐃楯わ申鐃緒申文鐃叔誌申摘鐃緒申鐃緒申討鐃緒申襦ｏ申鐃緒申両鐃緒申鐃�TF*IDF鐃緒申箸辰鐃銃縁申鐃緒申莨￥申鐃峻わ申鐃夙わ申鐃緒申鐃緒申鐃夙なので￥申PriorityQueue鐃塾種申鐃緒申鐃熟種申鐃塾よう鐃祝なってわ申鐃暑。
static class KeyphraseScorePQ extends PriorityQueue{ public KeyphraseScorePQ(int maxSize) { super(maxSize); } @Override public boolean lessThan(KeyphraseScore arg0, KeyphraseScore arg1) { if(arg0.score < arg1.score) return true; else if(arg0.score == arg1.score){ // tie breaker return arg0.tfidf < arg1.tfidf; } else return false; } }
鐃殉わ申PriorityQueue鐃醇下鐃縮のワ申鐃緒申鐃春レー鐃緒申鐃緒申鐃巡が鐃緒申鐃緒申鐃緒申鐃緒申鐃縮のワ申鐃緒申鐃春レー鐃緒申鐃緒申鐃緒申離鐃緒申屮侫譟種申鐃緒申任鐃緒申辰鐃緒申鐃緒申呂呂鐃緒申鐃緒申鐃緒申茲�鐃祝種申鐃緒申鐃緒申鐃緒申必鐃竣もあ鐃暑。
鐃渋行件申未鮓�てみよう鐃緒申KeyphraseExtractor鐃緒申孫圓鐃緒申鐃緒申鐃出わ申鐃曙た鐃緒申鐃緒申鐃春レー鐃緒申鐃塾常申鐃�20鐃緒申麓鐃緒申里茲�鐃叔わ申鐃暑。鐃淑わ申鐃緒申鐃緒申鐃緒申鐃緒申2鐃縦の随申鐃粛は￥申鐃緒申鐃緒申鐃緒申鐃緒申TF*IDF鐃緒申徴鐃縮わ申表鐃緒申鐃銃わ申鐃緒申淵鐃緒申鐃緒申鐃緒申鐃銃縁申鐃緒申了鐃緒申鐃�TFIDF鐃粛わ申鐃盾い鐃緒申鐃緒申鐃緒申未砲鐃緒申討鐃緒申鐃塾わ申鐃緒か鐃緒申鐃緒申鐃緒申鐃緒申法鐃�
animal (0.311211,0.001698) standards setting (0.102368,0.014469) sps (0.102368,0.009091) chains (0.102368,0.008121) food chains (0.102368,0.008038) food safety (0.102368,0.008004) sps standards (0.102368,0.006865) value chain (0.102368,0.005468) setting process (0.102368,0.005250) standards setting process (0.102368,0.004846) livestock food (0.102368,0.004823) oie (0.102368,0.004501) poor to cope (0.102368,0.004442) animal health (0.102368,0.004255) animal production (0.089053,0.000425) consultation (0.076506,0.004025) assisting the poor (0.076506,0.002827) sanitary and technical (0.076506,0.001615) requirements assisting (0.076506,0.001615) dynamics of sanitary (0.076506,0.001615)
鐃緒申鐃緒申鐃緒申个鐃緒申夕鐃叔つわ申鐃緒申譴随申鐃緒申鐃緒申侫譟種申鐃緒申麓鐃緒申里茲�鐃叔わ申鐃緒申鐃�fao30鐃叔￥申鐃緒申鐃緒申複鐃緒申鐃塾人間わ申鐃竣わ申鐃竣わ申鐃祝ワ申鐃緒申鐃春レー鐃緒申鐃緒申弔鐃緒申討鐃緒申鐃塾で￥申鐃緒申鐃叔もキ鐃緒申鐃春レー鐃緒申鐃緒申認鐃緒申鐃緒申鐃曙た鐃春レー鐃緒申鐃薯こわ申鐃叔はリス鐃夙ワ申鐃獣プわ申鐃銃わ申鐃緒申法鐃�
$ cat $(find fao30 -name a0011e00.key)|sort|uniq animal health animal production animal products capacity building consumers developing countries development policies disease surveillance domestic markets empowerment fao food chains food safety food security hygiene information dissemination livestock markets meat hygiene mechanics phytosanitary measures poverty public health regulations risk analysis risk management rural population standards technical aid technology trade veterinary hygiene world
両鐃峻に駈申鐃縮わ申鐃銃醐申鐃緒申襯�鐃緒申鐃春レー鐃緒申鐃熟種申鐃塾よう鐃祝なる。
food chains, food safety, animal health, animal production
鐃処し鐃緒申鐃緒申鐃緒申率鐃緒申鐃盾い鐃夙は醐申鐃緒申鐃淑わ申鐃緒申鐃緒申鐃緒申个鐃緒申譴随申鐃緒申鐃緒申侫譟種申鐃緒申魯侫譟種申鐃緒申箸鐃緒申鐃緒申埃鐃緒申鐃緒申覆鐃塾わ申鐃緒申鐃淑わ申鐃処う鐃祝醐申鐃緒申鐃暑。鐃緒申動鐃緒申个鐃緒申譴随申侫譟種申鐃緒申箸鐃緒申討呂鐃緒申鐃緒申鐃緒申鐃峻ってわ申鐃緒申里任呂覆鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃�
鐃殉わ申KeyphraseExtractor2鐃緒申孫圓鐃緒申鐃縮わ申里鐃淑醐申颪�らキ鐃緒申鐃春レー鐃緒申鐃緒申个鐃緒申鐃緒申鐃縮は種申鐃塾よう鐃叔わ申鐃暑。同鐃緒申鐃緒申鐃緒申鐃�20鐃緒申鐃宿緒申鐃緒申鐃緒申討鐃緒申襦�
post harvest (0.628181,0.004842) vegetables (0.311211,0.002956) root crops (0.311211,0.002523) fruits (0.311211,0.002316) vegetables and root (0.311211,0.002161) food losses (0.311211,0.001900) harvest food losses (0.311211,0.001582) post harvest food (0.311211,0.001582) fresh produce (0.102368,0.011087) packing (0.102368,0.007199) decay (0.102368,0.005210) containers (0.102368,0.004370) prevention of post (0.089053,0.001231) fruits vegetables (0.089053,0.000472) handling (0.076506,0.002345) storage (0.076506,0.002177) tubers (0.076506,0.001889) marketing (0.076506,0.001474) roots (0.076506,0.001389) potatoes (0.029596,0.003984)
鐃緒申鐃緒申鐃叔￥申鐃粛種申任弔鐃緒申鐃曙た鐃緒申鐃緒申鐃春レー鐃緒申鐃熟以駕申鐃叔わ申鐃暑。
$ cat t0073e.key Fruits Marketing Packaging Postharvest losses Postharvest technology Root crops Vegetables
鐃緒申鐃緒申鐃緒申鐃暑構鐃緒申鐃緒申鐃淑フレー鐃緒申鐃緒申鐃緒申个鐃緒申鐃銃わ申鐃暑。鐃緒申鐃藷検削申鐃塾ワ申鐃緒申鐃緒ー鐃宿ワ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃淑どわ申鐃術わ申鐃緒申砲禄鐃淑�鐃緒申鐃緒申鐃駿とわ申鐃獣てもい鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申
鐃殉とわ申
鐃旬稿は駈申鐃春わ申鐃所機鐃緒申鐃舜緒申鐃叔ワ申鐃緒申鐃春レー鐃緒申鐃緒申鐃緒申个鐃緒申鐃�KEA鐃薯、わ申鐃緒申鐃緒申Lucene鐃初イ鐃瞬ワ申鐃緒申鐃緒申僂鐃緒申襪鰹申箸納鐃緒申鐃緒申鐃緒申鐃緒申鐃�KEA鐃竣ワ申鐃緒申鐃緒申鐃熟ワ申鐃暑ゴ鐃所ズ鐃準が鐃緒申単鐃緒申鐃銃なので￥申鐃緒申鐃緒申鐃春レー鐃緒申鐃緒申鐃緒申粒銅鐃緒申鐃緒申鐃緒申未鐃緒申鐃緒申襪随申鐃緒申Lucene API鐃緒申匹里茲�鐃祝使わ申鐃緒申里鐃緒申鐃緒申廛鐃緒申鐃緒申鐃準か鐃緒申鐃宿み種申鐃巡す鐃緒申鐃塾ではなわ申鐃緒申鐃夙考わ申鐃銃わ申鐃暑。
鐃宿者わ申鐃旬稿わ申鐃縮わ申鐃緒申Lucene鐃初イ鐃瞬ワ申鐃舜駈申味鐃緒申鐃緒申辰鐃緒申蝓�鐃初イ鐃瞬ワ申鐃舜わ申鐃塾種申鐃薯少わ申鐃叔も広鐃緒申鐃銃わ申鐃緒申鐃緒申鐃緒申鐃緒申鐃淑ら幸鐃緒申鐃叔わ申鐃暑。
鐃緒申鐃緒申
鐃旬稿わ申筆鐃緒申鐃緒申鐃叔緒申離廛鐃緒申鐃緒申鐃緒申離弌鐃緒申鐃緒申鐃緒申任蓮鐃緒申焚鐃緒申旅鐃緒申椶砲弔鐃緒申討六鐃緒申屬鐃緒申鐃緒申鵑�わ申鐃緒申鐃緒申鐃緒申討鐃緒申覆鐃緒申鐃�
- 鐃緒申鐃銃ミング￥申Lucene鐃緒申Porter Stemmer鐃淑どわ申箸鐃緒申鐃熟わ申鐃叔わ申鐃暑。
- MDLP鐃緒申鐃緒申鐃緒申鐃祝わ申鐃緒申箸鐃緒申鐃�R鐃緒申箸辰討鐃緒申襦�R鐃緒申MDLP鐃緒申鐃緒申鐃緒申GPL鐃淑ので￥申鐃緒申鐃緒申鐃緒申分鐃熟わ申鐃述種申鐃庶か鐃緒申GPL鐃初イ鐃緒申鐃藷スの種申鐃緒申鐃緒申箸鐃緒申鐃処う鐃祝わ申鐃緒申鐃緒申鐃緒申
- 鐃緒申鐃旬醐申如鐃緒申鐃緒申覆姫儻鐃淑鰹申鐃塾テワ申鐃緒申鐃夙わ申鐃出わ申鐃銃試す鐃緒申鐃緒申鐃春デ￥申鐃緒申鐃緒申必鐃竣なのと￥申鐃緒申鐃夙ップワー鐃宿種申鐃緒申離鐃緒申紂種申縫鵐阿鐃宿�鐃竣になわ申鐃緒申鐃緒申鐃緒申鐃�
- 鐃宿加わ申鐃緒申徴鐃縮￥申鐃叔随申鐃緒申KEA鐃緒申鐃緒申鐃緒申鐃緒申鐃述わ申2鐃縦わ申鐃緒申徴鐃縮わ申鐃宿加わ申鐃緒申鐃緒申文鐃祝は随申鐃緒申鐃緒申討鐃緒申覆鐃緒申鐃縦э申未鐃緒申鐃緒申鐃処う鐃緒申鐃緒申
KEA-lucene鐃緒申Lucene鐃舜緒申鐃峻醐申鐃緒申鐃祝わ申鐃緒申鐃銃ハ￥申鐃宿ワ申鐃緒申鐃叔ワ申鐃藷グをしてわ申鐃暑が鐃緒申鐃緒申鐃緒申的鐃淑わ申里鐃重�鐃緒申NLP4L鐃緒申鐃縮わ申鐃緒申鐃藷供わ申鐃緒申予鐃緒申任鐃緒申襦�
2015.06.24 Wednesday
鐃緒申鐃旬醐申Wikipedia鐃緒申鐃緒申鐃緒申鐃緒申鐃曙辞鐃緒申亮鐃銃逸申鐃緒申鐃�
鐃緒申鐃旬醐申Wikipedia鐃緒申鐃緒申 Lucene / Solr / Elasticsearch 鐃叔使わ申鐃緒申鐃緒申鐃緒申貅�鐃緒申鐃銃逸申鐃緒申鐃緒申鐃緒申鐃緒申鐃祝￥申鐃述介する。
鐃緒申鐃祝わ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃銃わ申鐃緒申鐃緒申法鐃叔行っわ申鐃緒申發件申鐃緒申鐃緒申鐃緒申鐃緒申鐃熟わ申鐃緒申鐃暑外鐃緒申鐃祝限って醐申鐃春わ申鐃緒申鐃緒申鐃緒申鐃緒申里如鐃緒申呂襪�鐃緒申鐃緒申鐃駿わ申鐃処い鐃緒申測鐃獣てはわ申鐃淑わ申鐃緒申鐃緒申鐃緒申鐃緒申鐃祝￥申鐃殉わ申鐃緒申鐃緒申鐃緒申 NLP4L 鐃緒申鐃縮わ申鐃銃醐申鐃緒申鐃緒申鐃銃わ申鐃緒申里如鐃獣�鐃叔わ申遒誌申襦ｏ申泙鐃緒申鐃緒申鐃緒申鐃緒申錣�鐃緒申弌鐃緒申鐃緒申楔鐃�Wikipedia鐃祝限らず鐃緒申鐃緒申鐃叔わ申鐃暑。
鐃緒申鐃旬醐申文鐃緒申麓鐃緒申里茲�鐃祝ワ申鐃緒申鐃緒申鐃淑醐申箸鐃緒申慮豸誌申留儻鐃緒申鐃緒申鐃祝のワ申鐃緒申侫鐃緒申戰奪鐃淑醐申鐃緒申鵑�近い鐃緒申離鐃緒申鐃緒申鐃瞬わ申鐃緒申峠颪�わ申襪鰹申箸鐃緒申鐃緒申砲砲鐃緒申襦�
鐃緒申鐃藷タ￥申鐃銃ワ申鐃緒申鐃緒申函扮鐃�: entertainment鐃祝とは￥申鐃粛￥申鐃緒申擇鐃緒申泙鐃緒申鐃緒申擇鬚い鐃緒申鐃緒申鐃�Wikipedia鐃瞬ワ申鐃藷タ￥申鐃銃ワ申鐃緒申鐃緒申函廚鐃緒申抜鐃緒申鐃�
鐃緒申鐃緒申鐃緒申文鐃緒申鐃緒申鐃緒申未房鐃緒申鐃緒申鐃緒申童澆鐃緒申剖瓩わ申鐃塾ワ申砲鐃緒申襯�鐃緒申鐃緒申鐃淑醐申肇鐃緒申鐃春ワ申鐃駿ッワ申文鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申離撻鐃緒申箸鐃緒申鐃� Lucene/Solr 鐃祝使わ申鐃緒申謄鐃緒申鐃緒申肇侫鐃緒申鐃緒申鐃祝緒申鐃熟わ申鐃暑こ鐃夙わ申佑鐃緒申襦ｏ申鐃緒申鐃緒申鐃緒申鐃緒申瓩わ申鐃緒申暴颪�わ申討鐃緒申襪刻申戮討離撻鐃緒申鐃宿�鐃緒申鐃緒申鐃緒申同鐃緒申鐃緒申味鐃緒申鐃緒申弔箸聾造鐃淑わ申鐃緒申鐃緒申鐃夙わ申鐃出￥申鐃緒申鐃塾よう鐃緒申文鐃熟では間逸申辰鐃緒申鐃縮わ申鐃緒申鐃銃わ申鐃殉わ申鐃緒申
鐃緒申鐃緒申團紂種申鐃緒申鐃緒申鐃�FORTRAN鐃塾わ申鐃緒申鐃緒申鐃叔わ申鐃夙駈申砲覆辰鐃緒申鐃�
文鐃熟わ申鐃緒申鐃緒申鐃緒申鐃縮に種申鐃緒申鐃緒申鐃銃ワ申鐃緒申鐃緒申鐃淑醐申肇鐃緒申鐃春ワ申鐃駿ッワ申文鐃緒申鐃緒申龍鐃緒申鐃緒申鐃縦器申戮襪鰹申箸任鐃緒申能鐃緒申鐃盾し鐃緒申覆鐃緒申鐃緒申鐃淑醐申呂鐃緒申鐃緒申未房鐃緒申鐃緒申鐃緒申襪鰹申箸鐃獣�鐃叔わ申任鐃緒申襪鰹申箸任呂覆鐃緒申鐃�
NLP4L 鐃祝は縁申単鐃緒申肇鐃緒申鐃緒申鐃緒申文鐃緒申 Transliteration 鐃塾プワ申鐃緒申鐃緒申鐃夙学緒申鐃叔￥申鐃緒申鐃緒申鐃縦わ申鐃銃わ申鐃暑。
鐃緒申鐃塾プワ申鐃緒申鐃緒申鐃緒申箸鐃緒申肇鐃緒申鐃緒申鐃緒申文譴�鐃緒申鐃獣縁申鐃緒申鐃瞬わ申鐃緒申鐃緒申任鐃緒申襦ｏ申鐃緒申凌鐃緒申鐃緒申佑鐃淑醐申呂鐃緒申藹�鐃獣わ申鐃緒申鐃緒申侫鐃緒申戰奪鐃淑醐申鐃緒申鐃緒申鐃緒申咾鐃緒申鐃淑醐申鐃緒申鵑�誌申鐃銃わ申鐃緒申弌鐃重�鐃緒申鐃祝件申瓩随申埆鐃緒申鐃塾ワ申焚鐃緒申覆鐃祝緒申鐃獣わ申鐃緒申鐃緒申鐃緒申鐃淑醐申肇鐃緒申鐃春ワ申鐃駿ッワ申文鐃緒申鐃緒申鐃銃縁申鐃緒申鐃縮ｏ申鐃緒申鐃縦とわ申鐃緒申鐃緒申鐃緒申貅�鐃緒申暴鐃緒申呂鐃緒申襦�
鐃緒申鐃熟種申鐃緒申鐃縮り。
- 鐃緒申鐃旬醐申Wikipedia鐃叔￥申鐃緒申鐃緒申 Lucene 鐃緒申鐃緒申妊奪鐃緒申鐃緒申鐃緒申鐃熟随申鐃緒申襦�鐃緒申鐃緒申鐃緒申呂鐃緒申鐃緒申鐃�鐃緒申
- Lucene 鐃緒申鐃緒申妊奪鐃緒申鐃緒申鐃緒申薀�鐃緒申鐃緒申鐃淑醐申肇鐃緒申鐃春ワ申鐃駿ッワ申文鐃緒申鐃緒申離撻鐃緒申鐃緒申鐃出わ申鐃暑。鐃緒申鐃緒申鐃緒申呂鐃緒申鐃緒申鐃�鐃緒申
鐃淑常申亮鐃緒申鐃緒申鐃緒申楔鐃�Wikipedia鐃緒申鐃緒申鐃緒申个鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃淑醐申鐃緒申鐃緒申鐃緒申鐃淑どわ申鐃緒申鐃緒申鐃緒申鐃叔わ申鐃暑。
鐃緒申砲鐃緒申鐃緒申鐃緒申鐃緒申鵐拭鐃緒申謄鐃緒申鐃緒申鐃夙やイ鐃藷タフワ申鐃緒申鐃緒申鐃塾よう鐃祝￥申鐃緒申鐃緒申鐃緒申鐃淑醐申鐃宿緒申鐃緒申匹譴�鐃緒申鐃緒申鐃緒申蘯￥申里茲�鐃祝種申鐃緒申鐃叔わ申鐃緒申里盒縮ｏ申鐃緒申鐃緒申鐃�
entertainment,鐃緒申鐃藷タ￥申鐃銃ワ申鐃緒申鐃緒申,鐃緒申鐃藷タ￥申鐃銃ワ申鐃緒申鐃緒申鐃� interface,鐃緒申鐃藷タフワ申鐃緒申鐃緒申,鐃緒申鐃藷タ￥申鐃春ワ申鐃緒申鐃緒申 pennsylvania,鐃准ンシワ申丱縫鐃�,鐃准ンシワ申戰縫鐃�
鐃緒申鐃殉わ申鐃夙わ申鐃出醐申鐃緒申鐃塾再醐申率鐃緒申鐃緒申鐃緒申腓わ申鐃緒申鐃塾�鐃縦わ申鐃緒申鐃緒申鐃緒申
2015.01.15 Thursday
Lucene 鐃緒申鐃淳ット誌申鐃緒申動鐃緒申鐃緒申鐃緒申鐃緒申鐃�
Lucene 鐃緒申鐃緒申妊奪鐃緒申鐃緒申離鐃緒申潺奪隼鐃緒申鐃銃逸申鐃祝つわ申鐃銃詳述わ申鐃曙た鐃潤ー鐃緒申鐃�鐃緒申文鐃祝を見つわ申鐃緒申鐃塾でわ申鐃緒申鐃緒申鐃緒申鐃緒申悩椶鐃緒申茲�鐃緒申鐃潤ー鐃暑そ鐃塾わ申里蓮鐃�Lucene 鐃緒申鐃淳ッワ申鐃緒申鐃緒申 Uwe 鐃潤が鐃叔駈申鐃� Java 9 鐃塾ワ申鐃淳ットにわ申辰謄妊鐃緒申譽�鐃夙ワ申悗鐃� fsync() 動鐃庶が鐃緒申鐃殉わ申鐃緒申鐃緒申鐃淑わ申鐃淑っわ申鐃緒申鐃夙につわ申鐃銃最駈申鐃� Lucene 鐃緒申鐃淳ワ申縫謄鐃緒申両鐃緒申鐃緒申砲弔鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃祝はワ申鐃淳ワ申縫謄鐃緒申鵬鐃緒申鐃緒申法鐃緒申鐃巡う鐃緒申鐃緒申里箸覆辰討鐃緒申襦�
鐃叔駈申鐃� Java 9 鐃塾ワ申鐃淳ッワ申 (e5b66323ae45) 鐃緒申鐃叔ワ申鐃曙ク鐃夙ワ申悗鐃� fsync 鐃緒申鐃祝駕申鐃緒申鐃緒申鐃緒申砲弔鐃緒申鐃�
鐃緒申鐃緒申砲鐃緒申蓮鐃�
Apache Lucene 鐃緒申鐃淳ッワ申鐃緒申鐃緒申鐃緒申表鐃緒申鐃緒申鐃緒申討鐃緒申泙鐃緒申鐃�Apache Lucene鐃緒申Solr鐃緒申Elasticsearch鐃緒申両鐃緒申鐃緒申鐃処ご鐃緒申鐃銃ワ申鐃夙わ申鐃緒申鐃夙わ申鐃緒申Hotspot鐃殉わ申鐃緒申鐃醇心鐃緒申鐃緒申鐃所が鐃緒申鐃縦わ申鐃獣わ申鐃緒申鐃夙はわ申存鐃塾わ申鐃夙思わ申鐃殉わ申鐃緒申鐃緒申鐃緒申鐃叔￥申JDK 9鐃塾プワ申咼紂種申妊咼鐃緒申40鐃緒申鐃緒申鐃術わ申鐃緒申茲�鐃緒申分鐃緒申鐃緒申鐃塾テワ申鐃夙ワ申鐃緒申侫鐃緒申鐃緒申鐃緒申鐃緒申鐃獣プデ￥申鐃夙わ申鐃殉わ申鐃緒申鐃緒申鐃緒申鐃緒申麓鐃緒申Jigsaw鐃殉わ申鐃緒申鐃緒申鐃緒申鐃緒申認鐃緒申鐃暑こ鐃夙わ申鐃緒申的鐃叔わ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃縦ワ申辰討發鰹申離咼鐃宿でわ申鐃緒申鐃所が発鐃緒申鐃緒申鐃淑わ申鐃塾でわ申鐃緒申
鐃夙わ申鐃緒申鐃緒申鐃緒申念鐃淑わ申鐃緒申OpenJDK 9鐃塾最駈申離鐃緒申潺奪箸任鐃緒申鐃緒申蠅�発鐃緒申鐃緒申鐃銃わ申鐃緒申鐃�http://hg.openjdk.java.net/jdk9/jdk9/jdk/rev/e5b66323ae45鐃祝￥申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃塾わ申https://bugs.openjdk.java.net/browse/JDK-8066915鐃叔わ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申亡鐃熟�鐃緒申鐃緒申鐃緒申分鐃緒申鐃緒申鐃叔わ申https://issues.apache.org/jira/browse/LUCENE-6169鐃夙わ申鐃緒申鐃緒申鐃緒申奪匹鐃塾�鐃銃まわ申鐃緒申鐃緒申
鐃殉わ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃殉わ申鐃緒申Apache Lucene鐃緒申 write once 鐃緒申鐃竣ワ申鐃緒申鐃緒申鐃淑わ申鐃駿てのフワ申鐃緒申鐃緒申念鐃緒申戮鐃緒申鐃緒申颪�刻申鐃淳わ申鐃峻わ申鐃緒申砲鐃夙ってわ申鐃殉わ申鐃緒申Lucene鐃塾緒申鐃緒申痢屮鐃緒申潺奪肇櫂鐃緒申鐃夙」で「ワ申鐃淳ット」わ申鐃緒申鐃緒申楼鐃緒申的鐃淑フワ申鐃緒申鐃緒申名鐃祝書き刻申鐃淳￥申鐃緒申鐃曙か鐃初こ鐃塾フワ申鐃緒申鐃緒申覆鐃緒申鐃俊わ申鐃駿ての器申連鐃春ワ申鐃緒申鐃緒申砲鐃�fsync鐃緒申孫圓鐃緒申鐃緒申鐃祝なわ申泙鐃緒申鐃緒申鐃緒申鐃熟フワ申鐃緒申鐃緒申鐃緒申鐃粛ワ申任鐃�fc.force()鐃薯コ￥申鐃暑す鐃緒申鐃緒申鐃緒申鐃獣縁申任鐃緒申鐃緒申鐃緒申離鐃緒申潺奪箸虜能鐃重�鐃淑「パブワ申奪鐃緒申鐃竣は￥申Files.move(Path, Path, StandardCopyOption.ATOMIC_MOVE)鐃竣わ申箸辰鐃緒申鐃緒申肇鐃塾ワ申諭鐃緒申鐃叔行わ申鐃殉わ申鐃緒申
鐃緒申鐃緒申鐃緒申法鐃緒申鐃緒申鐃重のよう鐃緒申鐃順き鐃緒申鐃緒申鐃緒申任鐃淑わ申鐃渋りう鐃殉わ申鐃緒申鐃緒申鐃殉わ申鐃緒申鐃緒申鐃緒申鐃塾よう鐃緒申鐃緒申鐃所が発鐃緒申鐃緒申鐃緒申函鐃�POSIX OS鐃叔はワ申諭鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃淑わ申鐃淑わ申鐃叔緒申鐃緒申鐃緒申鐃緒申鐃殉わ申鐃緒申Linux鐃緒申MAN鐃准￥申鐃緒申鐃緒申http://linux.die.net/man/2/fsync鐃祝にはわ申鐃駿てに以駕申鐃塾居申鐃述わ申鐃緒申鐃緒申泙鐃緒申鐃�
鐃緒申fsync() 鐃塾ワ申鐃緒申鐃緒申魯侫鐃緒申鐃緒申鐃塾わ申鐃緒申妊鐃緒申譽�鐃夙ワ申鐃緒申離鐃緒申鐃夙リが鐃叔ワ申鐃緒申鐃緒申鐃祝書き刻申鐃殉れた鐃緒申鐃夙わ申必鐃緒申鐃緒申鐃緒申鐃楯証わ申鐃緒申鐃塾ではなわ申鐃緒申鐃緒申鐃塾わ申鐃潤、鐃叔ワ申鐃曙ク鐃夙ワ申離侫鐃緒申鐃緒申覽�鐃述子にわ申 fsync() 鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申必鐃竣わ申鐃緒申鐃暑。鐃緒申
鐃緒申鐃緒申的鐃祝￥申鐃緒申鐃淳わ申Apache Lucene鐃叔わ申焚鐃緒申亮鐃緒申鐃銃縁申鐃緒申鐃緒申箸鬚靴討鐃緒申泙鐃緒申鐃緒申妊鐃緒申譽�鐃夙ワ申鐃緒申FileChannel 鐃緒申READ鐃術）をオ￥申鐃竣ンし￥申 fc.force() 鐃薯コ￥申鐃暑し鐃殉わ申鐃緒申鐃緒申鐃緒申鐃緒申鵝◆鐃銃逸申遒刻申襪鰹申箸楼鐃緒申鐃緒申鐃緒申鐃淑�鐃緒申鐃獣てわ申鐃緒申鐃塾の）実際にわ申Java API鐃祝わ申鐃塾居申鐃述わ申鐃淑わ申鐃緒申鐃潤、鐃緒申鐃緒申鐃熟￥申有鐃緒申鐃淑随申測鐃竣に器申鼎鐃緒申討鐃緒申鐃緒申圓鐃緒申鐃緒申箸砲覆鐃殉わ申鐃緒申Windows鐃叔はわ申鐃殉わ申鐃緒申鐃緒申鐃淑わ申鐃淑ど￥申*鐃祝￥申IOException鐃緒申鐃純外鐃緒申必鐃緒申発鐃緒申鐃緒申鐃殉わ申鐃緒申
鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申砲覆鐃塾わ申鐃緒申鐃緒申鐃述のワ申鐃淳ットではわ申鐃塾ワ申鐃竣ワ申鐃緒申鐃緒申鐃緒申OpenJDK 9鐃緒申FileSystemException鐃叔わ申鐃殉わ申鐃緒申鐃緒申鐃淑わ申鐃緒申鐃夙でわ申鐃緒申FileSystemException鐃熟デワ申鐃曙ク鐃夙ワ申任鐃緒申鐃緒申匈鐃緒申鐃�Lucene鐃緒申蝓種申鐃緒申蓮鐃緒申鐃緒申劼里茲�鐃祝￥申鐃純外鐃薯すべて種申鐃緒申鐃緒申鐃緒申襪随申鐃緒申鐃緒申鐃竣なのでわ申鐃緒申鐃緒申鐃銃ワ申鐃夙ワ申鐃緒申侫鐃叔は￥申鐃緒申鐃淑わ申鐃夙わ申Linux鐃緒申MacOSX鐃叔わ申動鐃緒申鐃銃わ申鐃殉わ申鐃塾でわ申鐃緒申
鐃叔随申鐃塾ワ申鐃緒申鐃宿わ申http://goo.gl/vKhtsW鐃祝わ申鐃緒申泙鐃緒申鐃�
鐃宿わ申鐃緒申鐃銃もサ鐃楯￥申鐃夙わ申鐃緒申討鐃緒申鐃�OS鐃塾デワ申鐃曙ク鐃夙ワ申鐃�fsync鐃緒申鐃叔わ申鐃緒申茲�鐃祝わ申鐃銃わ申鐃緒申鐃緒申鐃緒申鐃塾でわ申鐃緒申鐃緒申鐃述のワ申鐃淳ットわ申8u40鐃緒申7u80鐃塾ワ申蝓種申鐃緒申砲鐃緒申瓩件申鐃緒申鐃緒申覆鐃緒申里任鐃緒申鐃�Java 9鐃淑わ申鐃緒申鐃舜案わ申討鐃叔わ申鐃緒申里任鐃緒申鐃緒申鐃�
- Java 7鐃緒申Java 8鐃塾器申存鐃塾ワ申鐃殉ワ申謄鐃緒申鐃緒申鐃緒申鐃縦わ申鐃緒申鐃宿わ申鐃緒申鐃銃わ申FileChannel鐃緒申鐃緒申READ鐃緒申WRITE鐃薯しわ申鐃緒申鐃緒申鐃緒申単鐃緒申縫鐃緒申蕁種申鐃夙�鐃緒申鐃緒申鐃緒申鐃緒申里任鐃緒申腓�鐃緒申鐃緒申鐃緒申鐃緒申OS鐃緒申libc鐃熟わ申鐃塾よう鐃祝わ申鐃銃緒申鐃緒申鐃緒申圓辰討鐃緒申泙鐃緒申鐃� 鐃春ワ申鐃緒申鐃暑、鐃叔ワ申鐃曙ク鐃夙リ、鐃叔バワ申鐃緒申鐃淑ど￥申鐃春ワ申鐃緒申鐃暑記鐃述子はどわ申鐃叔もオ鐃緒申鐃竣ワ申任鐃緒申泙鐃緒申鐃緒申鐃緒申鐃緒申竜鐃緒申匯劼任呂任鐃緒申覆鐃緒申鐃緒申鐃緒申發�鐃所、鐃純外鐃巡エ鐃初ー鐃緒申発鐃緒申鐃緒申鐃緒申鐃緒申發�鐃緒申泙鐃緒申鐃�
- 鐃叔ワ申鐃曙ク鐃夙ワ申鐃�fsync鐃緒申鐃暑た鐃緒申凌鐃緒申鐃緒申鐃�API鐃緒申鐃宿加わ申鐃緒申覆匹離侫鐃緒申鐃緒申襯随申鐃緒申廚任發�鐃緒申鐃初く鐃緒申能鐃祝￥申Files.fsync(Path)鐃塾よう鐃祝でわ申鐃順う鐃緒申鐃緒申 Windows鐃叔はデワ申鐃曙ク鐃夙ワ申任呂鐃緒申譴�鐃緒申鐃殉わ申鐃緒申鐃緒申鐃淑わ申鐃塾でわ申鐃順う鐃緒申鐃緒申鐃遵記鐃塾ワ申鵐�にわ申鐃緒申IOUtils.fsync()鐃塾よう鐃淑件申鐃叔わ申鐃緒申
鐃春醐申鐃緒申鐃出縁申鐃緒申法鐃祝関わ申鐃暑ア鐃宿バワ申鐃緒申鐃薯下わ申鐃緒申鐃緒申
Uwe
*鐃祝わ申鐃緒申鐃緒申鐃緒申鐃塾フワ申鐃緒申鐃暑シ鐃緒申鐃銃ワ申離鐃緒申泪鐃銃ワ申鐃緒申鐃緒申鐃熟フワ申鐃緒申鐃暑が鐃塾実に醐申鐃緒申鐃緒申茲�鐃祝わ申鐃銃わ申鐃暑た鐃潤、鐃渋際のとわ申鐃緒申鐃緒申鐃緒申鐃緒申任呂鐃緒申鐃殉わ申鐃緒申鐃獣わ申鐃緒申鐃緒申辰箸鐃緒申鐃殉わ申鐃淑デワ申鐃曙ク鐃夙ワ申鐃緒申匹濆鐃緒申鐃緒申僂乏鐃緒申鐃緒申函鐃�Access Denied鐃竣わ申Java IOException鐃祝マッピングわ申鐃緒申泙鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃所あ鐃緒申泙鐃緒申鐃祝￥申
2014.12.19 Friday
Solr鐃緒申箸辰鐃緒申鐃緒申鐃緒申儻鐃緒申鐃緒申
Solr鐃緒申箸辰憧鐃獣縁申鐃緒申鐃緒申鐃緒申儻鐃緒申鐃出わ申鐃緒申鐃緒申法鐃緒申匆陲靴茲�鐃緒申
鐃緒申鐃緒申鐃術醐申箸蓮鐃�鐃緒申鐃緒申鐃緒申鐃術醐申鐃竣とは￥申Wikipedia鐃祝わ申鐃出￥申鐃瞬わ申鐃緒申鐃緒申鐃緒申凌鐃緒申箸暴鐃緒申鐃緒申鐃緒申鐃峻や、鐃緒申鐃緒申鐃緒申鐃緒申粒鐃緒申鐃緒申分鐃庶、鐃夙鰹申鐃緒申鐃塾間でのみ誌申鐃術わ申鐃曙、鐃緒申鐃術わ申鐃緒申鐃緒申奸鐃緒申儻豬駕申廚任鐃緒申襦ｏ申鐃緒申鐃緒申鐃緒申楜鐃緒申鐃緒申任蓮鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申分鐃緒申鐃淑醐申鐃緒申鐃熟随申鐃緒申譴随申鐃緒申鐃叔ッワ申鐃緒申鐃夙￥申鐃縮わ申分鐃緒申鐃淑醐申鐃緒申鐃熟随申鐃緒申譴随申鐃緒申鐃叔ッワ申鐃緒申鐃緒申鐃緒申咾鐃緒申鐃緒申澆鐃緒申鐃緒申鐃緒申鐃緒申鐃塾ワ申鐃緒申妊奪鐃緒申鐃緒申亡泙泙鐃淑わ申単鐃曙集鐃緒申鐃宿緒申鐃緒申鐃緒申襪鰹申箸鐃緒申鐃緒申鐃緒申儻鐃緒申鐃緒申个鐃緒申襪鰹申箸砲鐃緒申襦�
Solr鐃夙ワ申鐃緒申妊奪鐃緒申鐃緒申僚鐃緒申鐃�鐃緒申鐃緒申鐃叔紹介すわ申鐃緒申法鐃緒申Solr 1.4 鐃淑降でわ申鐃緒申鐃銃逸申遒刻申鐃淑はわ申鐃祝￥申Solr鐃緒申鐃緒申辰討鐃緒申覆鐃緒申佑魯鐃緒申鐃緒申鐃緒申鐃緒申鐃宿わ申鐃緒申鐃術意わ申鐃処う鐃緒申鐃緒申鐃緒申鐃銃駕申鐃緒申鐃緒申schema.xml鐃緒申鐃緒申蠅件申鐃�Solr鐃緒申動鐃緒申鐃暑。
<?xml version="1.0" encoding="UTF-8" ?>
<schema name="example" version="1.5">
<types>
<fieldType name="string" class="solr.StrField" sortMissingLast="true" omitNorms="true"/>
<fieldType name="int" class="solr.TrieIntField" precisionStep="0" omitNorms="true" positionIncrementGap="0"/>
<fieldType name="long" class="solr.TrieLongField" precisionStep="0" positionIncrementGap="0"/>
<fieldType name="date" class="solr.TrieDateField" omitNorms="true" precisionStep="0" positionIncrementGap="0"/>
<fieldType name="text_ja" class="solr.TextField" positionIncrementGap="100" autoGeneratePhraseQueries="false">
<analyzer>
<tokenizer class="solr.JapaneseTokenizerFactory" mode="search"/>
<filter class="solr.JapaneseBaseFormFilterFactory"/>
<filter class="solr.CJKWidthFilterFactory"/>
<filter class="solr.JapaneseKatakanaStemFilterFactory" minimumLength="4"/>
<filter class="solr.LowerCaseFilterFactory"/>
</analyzer>
</fieldType>
</types>
<fields>
<field name="url" type="string" indexed="true" stored="true" required="true" />
<field name="cat" type="string" indexed="true" stored="true"/>
<field name="date" type="date" indexed="true" stored="true"/>
<field name="title" type="text_ja" indexed="true" stored="true"/>
<field name="body" type="text_ja" indexed="true" stored="false" multiValued="true"/>
</fields>
<uniqueKey>url</uniqueKey>
</schema>
文鐃緒申如鐃緒申鐃緒申呂鐃緒申鐃緒申任鐃�livedoor鐃祝ュー鐃緒申鐃緒申鐃緒申鐃術ワ申鐃緒申鐃術わ申鐃暑。鐃淑駕申鐃塾よう鐃緒申wget鐃緒申livedoor鐃祝ュー鐃緒申鐃緒申鐃緒申鐃術ワ申鐃緒申鐃緒申鐃所し鐃緒申展鐃緒申鐃緒申鐃銃わ申鐃緒申鐃緒申
$ wget http://www.rondhuit.com/download/livedoor-news-data.tar.gz $ tar xvzf livedoor-news-data.tar.gz
鐃緒申鐃緒申鐃緒申Solr鐃緒申動鐃緒申鐃緒申展鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申譴随申侫鐃緒申鐃緒申鐃塾わ申鐃緒申鐃述とつ￥申鐃緒申箸鐃緒申討鐃緒申鐃緒申任蓮鐃緒申判鐃緒申命鐃緒申鐃�dokujo-tsushin.xml鐃祝」わ申Solr鐃緒申鐃緒申録鐃緒申鐃暑。
$ ./post.sh dokujo-tsushin.xmlTermsComponent鐃緒申単鐃緒申螢刻申箸鐃緒申鐃緒申
鐃緒申鐃祝￥申Solr鐃緒申TermsComponent鐃緒申箸辰謄鐃緒申鐃叔ッワ申鐃緒申鐃緒申鐃緒申単鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃暑。鐃緒申鐃緒申curl鐃緒申鐃殉ワ申匹鐃渋行わ申鐃緒申函鐃�body鐃春ワ申鐃緒申鐃緒申匹任了鐃緒申鐃緒申鐃緒申戮鐃渋随申鐃緒申鐃祝常申鐃�1鐃緒申鐃緒申鐃獣縁申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃暑。
$ curl "http://localhost:8983/solr/collection1/terms?terms.fl=body&terms.limit=10001&omitHeader=true&wt=json&indent=true" | tail -n 10001|head -n 10000|cut -d , -f1|cut -d \" -f2 > dokujo-tsushin.txt $ head -n 30 dokujo-tsushin.txt 鐃緒申 鐃緒申鐃緒申 鐃緒申 鐃緒申 鐃緒申 鐃緒申 鐃緒申 鐃緒申 鐃緒申 鐃緒申 鐃緒申 鐃緒申 鐃緒申鐃緒申 鐃淑わ申 鐃緒申鐃緒申 鐃緒申鐃緒申 鐃緒申鐃緒申 鐃淑わ申 鐃緒申鐃� 鐃緒申 鐃夙わ申鐃緒申 鐃緒申 鐃緒申 鐃緒申 鐃叔わ申 鐃殉わ申 鐃処う 鐃緒申 鐃緒申鐃緒申 鐃竣わ申
head鐃緒申鐃殉ワ申匹脳鐃緒申30鐃縮わ申鐃術緒申単鐃緒申鐃宿緒申鐃緒申鐃緒申討鐃緒申襪�鐃緒申鐃緒申鐃叔わ申schema.xml鐃春ワ申鐃緒申鐃緒申鮓�てわ申鐃緒申鐃緒申鐃緒申鐃夙わか鐃緒申箸鐃緒申蝓�鐃緒申鐃夙ップワー鐃宿の緒申鐃緒申鐃緒申鐃緒申擇鐃緒申討鐃緒申覆鐃緒申里如鐃緒申鐃緒申茲緒申鐃緒申鐃緒申砲鐃緒申鐃緒申立鐃緒申鐃淑わ申鐃淑わ申鐃緒申鐃緒申鐃緒申鐃緒申鐃術醐申任鐃淑わ申鐃緒申単鐃曙が鐃渋わ申任鐃緒申鐃塾わ申鐃緒か鐃緒申鐃緒申鐃緒申鐃緒申鐃�
鐃緒申鐃祝異なわ申分鐃緒申鐃淑醐申鐃緒申鐃緒申録鐃緒申鐃緒申同鐃粛わ申単鐃緒申鐃緒申鐃緒申鐃宿緒申鐃緒申鐃緒申襦ｏ申鐃緒申里鐃緒申鐃祝わ申鐃緒申鐃叔わ申鐃獣わ申鐃緒申Solr鐃緒申鐃緒申澆鐃緒申謄鐃緒申鐃叔ッワ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃駿居申動鐃緒申鐃緒申鐃縮わ申分鐃緒申鐃淑醐申鐃淑わ申鐃緒申鐃叔わ申鐃緒申箸鐃緒申董屮鐃緒申檗鐃緒申張鐃緒申鐃緒申奪鐃緒申鐃�sports-watch.xml鐃祝」）わ申鐃緒申録鐃緒申鐃暑。鐃緒申鐃緒申鐃緒申同鐃粛わ申TermsComponent鐃緒申箸辰鐃獣縁申鐃緒申鐃緒申鐃緒申鐃緒申鐃暑。
$ ./post.sh sports-watch.xml $ curl "http://localhost:8983/solr/collection1/terms?terms.fl=body&terms.limit=10001&omitHeader=true&wt=json&indent=true" | tail -n 10001|head -n 10000|cut -d , -f1|cut -d \" -f2 > sports-watch.txt $ head -n 30 sports-watch.txt 鐃緒申 鐃緒申 鐃緒申鐃緒申 鐃緒申 鐃緒申 鐃緒申 鐃緒申 鐃緒申 鐃緒申 鐃緒申 鐃緒申 鐃緒申 鐃緒申 鐃緒申鐃緒申 鐃淑わ申 鐃緒申鐃� 鐃淑わ申 鐃緒申鐃緒申 鐃緒申鐃緒申 鐃緒申鐃緒申 鐃緒申 鐃夙わ申鐃緒申 鐃叔わ申 鐃殉わ申 鐃緒申 鐃緒申鐃緒申 鐃緒申鐃緒申 1 鐃緒申鐃緒申 鐃緒申鐃�2鐃縦わ申単鐃曙集鐃緒申鐃緒申鐃俊わ申鐃緒申
鐃叔醐申鐃�2鐃縦わ申単鐃曙集鐃緒申鐃緒申鐃俊わ申鐃銃削申分鐃緒申表鐃緒申鐃緒申鐃緒申廛鐃緒申鐃緒申鐃緒申鐃書く￥申鐃緒申鐃緒申鐃叔は以駕申鐃塾よう鐃淑器申単鐃緒申Scala鐃竣ワ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃�
package terms
import scala.io.Source
object TermsExtractor {
def main(args: Array[String]): Unit = {
val set1 = termsSet("/Users/koji/work/ldcc/dokujo-tsushin.txt")
val set2 = termsSet("/Users/koji/work/ldcc/sports-watch.txt")
println(set1 &~ set2)
println(set2 &~ set1)
}
def termsSet(file: String): Set[String] = {
val src = Source.fromFile(file, "UTF-8")
var result : Set[String] = Set()
try{
src.getLines.foreach{ line: String =>
result = result + line
}
result
}
finally {
src.close
}
}
}
鐃渋行わ申鐃緒申伴鐃緒申里茲�鐃緒申2鐃峻の緒申鐃熟わ申鐃緒申鐃緒申鐃暑。1鐃緒申鐃旬は￥申鐃夙緒申鐃縮随申鐃竣にのみ出醐申鐃緒申鐃緒申単鐃緒申任鐃緒申蝓�2鐃緒申鐃旬は「ワ申鐃楯￥申鐃縦ワ申鐃緒申鐃獣ワ申鐃竣にわ申鐃緒申鐃出醐申鐃緒申鐃緒申単鐃緒申任鐃緒申襦ｏ申兔个鐃緒申討鐃緒申鐃緒申鐃緒申肇奪廛錙種申匹辰櫃鐃獣縁申鐃熟わ申鐃曙い鐃祝消わ申鐃銃わ申鐃暑こ鐃夙わ申鐃緒か鐃暑。
Set(鐃緒申鐃緒申, 味鐃緒申鐃緒申, 鐃銃わ申名, 鐃緒申鐃緒申, 鐃緒申優鐃緒申鐃�, 鐃緒申鐃緒申, 鐃緒申鐃緒申, 鐃准誌申, 鐃緒申名, 鐃緒申鐃緒申, 鐃循わ申鐃緒申, 鐃緒申鐃緒申, 鐃竣わ申鐃緒申鐃緒申鐃緒申, 鐃熟わ申鐃緒申, 鐃緒申鐃緒申鐃宿ワ申鐃緒申, 鐃緒申鐃緒申味, 調鐃駿わ申, 鐃緒申, 鐃緒申筆, 鐃緒申鐃緒申, 鐃旬誌申, 鐃緒申, 鐃淳ッワ申鐃緒申鐃�, 鐃春ワ申, 鐃緒申鐃緒申, 鉄則, 鐃緒申箸鐃緒申鐃�, 鐃緒申鐃緒申鐃�, 鐃緒申鐃緒申, 鐃緒申鐃淳随申鐃緒申, 鐃渋誌申, 鐃緒申妊, 鐃緒申鐃緒申, 鐃緒申鐃緒申鐃緒申鐃獣ワ申鐃曙コ鐃緒申鐃宿リー鐃叔ワ申鐃緒申, 鐃緒申奪鐃�, 鐃緒申鐃緒申, 鐃緒申鐃緒申鐃緒申, 鐃処そ鐃緒申, 鐃殉ワ申鐃緒申, 鐃緒申鐃緒申, 鐃緒申鐃緒申, 鐃緒申, sweet, 余鐃緒申, 鐃緒申鐃緒申, 鐃緒申鐃宿レス, 鐃緒申鐃緒申鐃緒申乏, 鐃緒申谷, 鐃緒申鐃緒申, 法的, 鐃塾随申, 鐃緒申鐃殉わ申, 鐃淳ニワ申鐃緒申鐃緒申, 鐃緒申無, 鐃舜わ申, 眺鐃緒申鐃�, 鐃塾誌申, 鐃緒申鐃緒申, 鐃緒申鐃獣ぱわ申, 鐃緒申鐃緒申鐃淑わ申, 鐃熟ッワ申, 鐃緒申鐃緒申鐃�, 鐃緒申鐃緒申鐃緒申, 鐃渋駕申, 鐃緒申鐃緒申, 鐃緒申鐃緒申, 鐃緒申鐃緒申, 労働鐃緒申, 鐃緒申鐃�, ntt, 鐃淑駕申鐃緒申略) Set(鐃緒申鐃緒申, 鐃緒申鐃緒申鐃緒申, 鐃循とぼわ申, 鐃緒申鐃緒申, 鐃春ワ申, 鐃緒申鐃緒申鐃�, 鐃春ワ申鐃藷シワ申, 連鐃緒申, 鐃緒申, 205, 鐃緒申鐃緒申, 2014, 藤鐃緒申, 長鐃緒申, 鐃緒申, 鐃緒申鐃�, 鐃竣ワ申鐃曙ス鐃緒申, 鐃緒申鐃緒申鐃春ワ申, 鐃盾く, 鐃熟わ申鐃緒申, 鐃緒申鐃緒申, 鐃緒申鐃緒申鐃所ー鐃夙フワ申鐃緒申, 鳥肌, 鐃順審, 沸鐃緒申, 鐃緒申鐃緒申, 鐃緒申鐃順う, 鐃淳緒申, 鐃緒申鐃緒申鐃緒申淵鐃緒申鐃�, 鐃緒申, 鐃緒申鐃緒申鐃初い, 鐃緒申鐃術逸申, 鐃緒申鐃緒申, 鐃出鰹申, 鐃緒申蕕�, 鐃緒申鐃緒申, 鐃緒申鐃緒申, 鐃緒申鐃�, 平鐃祝わ申, 98, 鐃緒申鐃緒申鐃緒申妊鵐粥鐃緒申襯�, 鐃緒申鐃緒申, 鐃緒申, 鐃緒申鐃緒申, 鐃緒申鐃所エ鐃緒申, 鐃緒申鐃竣ワ申鵐哀鐃�, 鐃緒申鐃�, beautiful, 鐃緒申鐃順う鐃緒申覆鐃�, 113, 鐃峻種申, 鐃緒申, 鐃緒申天, 鐃緒申鐃緒申, 鐃緒申, sunday, 鐃緒申端, 鐃緒申鐃緒申鐃緒申鐃暑ス鐃緒申鐃緒申鐃緒申鐃緒申, 鐃緒申評, 鐃緒申鐃暑ー鐃術ワ申, 鐃緒申鐃緒申, 鐃循駕申, 鐃醇ー鐃緒申, 鐃緒申鐃緒申鐃緒申, 鐃粛常申, 鐃術随申, 鐃巡ぎ, cb, 鐃緒申鐃緒申鐃緒申, 鐃緒申鐃緒申, 鐃緒申鐃緒申, mmaplanet, 鐃緒申鐃殉わ申, 哲鐃緒申, 鐃緒申鐃緒申, 鐃緒申團絅�, 鐃緒申鐃緒申痢鐃緒申屮鐃�, 鐃緒申鐃殉ワ申, 鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申, brad, 鐃緒申里, wbc, 鐃緒申鐃緒申, pm, 鐃瞬っつわ申鐃緒申, 抜擢, 鐃緒申鐃重わ申, 鐃緒申鐃春リカ, 鐃淑駕申鐃緒申略)
鐃緒申鐃緒申鐃緒申辰討鐃緒申譴常申鐃緒申分鐃緒申鐃緒申鐃緒申鐃緒申儻鐃叔わ申鐃緒申噺鐃緒申鐃緒申擇鐃祝わ申鐃書がわ申鐃暑が鐃緒申鐃宿わ申鐃初か鐃緒申鐃緒申鐃夙緒申鐃縮随申鐃竣でどわ申鐃初か鐃緒申鐃瞬ワ申鐃楯￥申鐃縦ワ申鐃緒申鐃獣ワ申鐃竣わ申鐃夙わ申鐃緒申2鐃緒申鐃緒申鐃緒申鐃緒申个鐃緒申譴随申覆鐃出￥申鐃循とわ申匹凌佑鐃緒申鐃緒申鬚垢襪�鐃初い鐃祝わ申鐃緒申鐃緒申鐃術醐申辰櫃鐃緒申鐃緒申呂鐃緒申鐃緒申鐃緒申討鐃緒申鐃夙わ申鐃緒申鐃緒申里任呂覆鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃�
2014.12.04 Thursday
word2vec for Lucene 鐃緒申鐃述駕申
Lucene鐃緒申鐃緒申妊奪鐃緒申鐃緒申鬟魁鐃緒申僖鐃緒申箸澆覆鐃緒申鐃銃逸申遒刻申鐃� word2vec for Lucene 鐃緒申発鐃緒申鐃緒申鐃塾でわ申鐃塾使わ申鐃緒申鐃緒申匆陲靴茲�鐃緒申word2vec 鐃緒申 Tomas Mikolov 鐃緒申砲鐃獣わ申鐃緒申董鐃緒申鐃夙�鐃緒申鐃曙た単鐃緒申鐃駿ワ申鐃夙ワ申鐃緒申儡鐃緒申鐃緒申鐃�OSS鐃縦￥申鐃緒申任鐃緒申襦ｏ申鐃緒申螢醐申淵鐃緒申 word2vec 鐃熟種申鐃緒申鐃緒申鐃緒申能颪�れた鐃銃ワ申鐃緒申鐃夙フワ申鐃緒申鐃緒申鐃緒申匹濆鐃緒申漾鐃獣縁申鐃駿ワ申鐃夙ワ申鐃緒申鐃熟わ申鐃緒申茲�鐃祝なってわ申鐃暑。
word2vec for Lucene 鐃熟テワ申鐃緒申鐃夙フワ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申Lucene鐃緒申鐃緒申妊奪鐃緒申鐃緒申鐃緒申鐃緒申魯鐃緒申鐃緒申僖鐃緒申箸鐃緒申鐃緒申僂鐃緒申襦ｏ申鐃緒申螢醐申淵鐃緒申 word2vec 鐃緒申鐃緒申鐃緒申鐃銃ワ申鐃緒申鐃夙フワ申鐃緒申鐃緒申鐃獣縁申鐃獣縁申未鐃淑�鐃緒申鐃緒申鐃書きわ申鐃緒申討鐃緒申鐃宿�鐃竣わ申鐃緒申鐃暑。鐃緒申鐃緒申鐃緒申鐃熟英醐申謄鐃緒申鐃緒申箸覆匹任鐃緒申鐃緒申鐃淑わ申鐃緒申鐃緒申単鐃緒申鐃淑�鐃緒申鐃緒申鐃書きわ申鐃緒申討鐃緒申覆鐃緒申鐃緒申楔鐃淑どではわ申鐃初か鐃緒申鐃緒申MeCab鐃淑どの件申鐃緒申鐃叔駕申鐃熟器申鐃淑�鐃緒申鐃緒申鐃書きツ￥申鐃緒申鐃緒申僂鐃緒申鐃獣縁申鐃緒申分鐃緒申鐃緒申鐃書きわ申鐃曙た鐃銃ワ申鐃緒申鐃夙フワ申鐃緒申鐃緒申鐃緒申儖佞鐃緒申討鐃緒申鐃緒申覆鐃緒申鐃出なわ申覆鐃緒申鐃緒申泙鐃緒申儻鐃叔わ申鐃獣てわ申鐃緒申文鐃緒申鐃緒申鐃緒申文鐃緒申鐃術器申鐃緒申単鐃緒申謄鐃緒申鐃緒申箸鐃縦常申鐃緒申続鐃緒申鐃峻リオ鐃宿￥申鐃緒申鐃緒申泙虜鐃緒申鐃淑ど￥申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申箸鐃宿�鐃竣になってわ申鐃暑。word2vec for Lucene 鐃叔わ申 Lucene鐃緒申鐃緒申妊奪鐃緒申鐃緒申鐃緒申鐃緒申魯鐃緒申鐃緒申僖鐃緒申箸鐃緒申鐃緒申僂鐃緒申襪随申瓠�鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申箸鐃緒申鐃緒申廚任鐃緒申襦�
鐃淑駕申鐃叔は器申単鐃祝試し鐃銃わ申鐃緒申鐃緒申鐃緒申鐃緒申茲�鐃緒申word2vec for Lucene 鐃塾デワ申鐃渋行わ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申襦ｏ申鐃殉わ申鐃淑種申鐃熟￥申
鐃緒申鐃緒申word2vec for Lucene 鐃塾ワ申鐃緒申鐃緒申鐃緒申鐃緒申鐃�
鐃緒申鐃緒申鐃叔ワ申如鐃緒申鐃緒申僚鐃緒申鐃�
鐃緒申鐃緒申Lucene/Solr鐃緒申鐃緒申妊奪鐃緒申鐃緒申僚鐃緒申鐃緒申淵妊鐃叔￥申鐃緒申鐃緒申鐃緒申録鐃緒申
鐃緒申鐃緒申単鐃緒申戰鐃緒申肇鐃塾削申鐃緒申
鐃緒申鐃緒申単鐃緒申戰鐃緒申肇鐃緒申遊鐃緒申
鐃夙わ申鐃緒申鐃緒申鐃緒申鐃叔わ申鐃暑。鐃緒申鐃叔わ申Lucene鐃緒申鐃緒申妊奪鐃緒申鐃緒申鐃緒申鐃獣てわ申鐃緒申鐃緒申鐃熟種申脾駕申鐃緒申鐃緒申鐃緒申鐃緒申鐃祝種申鐃緒申鐃緒申鐃�Lucene鐃緒申鐃緒申妊奪鐃緒申鐃緒申鐃緒申脾器申濃鐃緒申蠅刻申襪鰹申箸砲鐃緒申討鐃処い鐃緒申word2vec for Lucene鐃緒申Lucene 4.10.2鐃駿￥申鐃緒申鐃叔削申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃淑試し鐃銃わ申鐃淑わ申鐃緒申鐃祝わ申鐃緒申鐃銃わ申鐃緒申Lucene 4.x 鐃緒申鐃緒申妊奪鐃緒申鐃緒申鐃銃逸申遒刻申鐃緒申里隼廚鐃緒申襦ｏ申鐃緒申鐃緒申鐃緒申辰董鐃�Solr 4.x 鐃熟わ申鐃緒申鐃緒申鐃塾わ申鐃夙￥申Elasticsearch鐃淑バ￥申鐃緒申鐃緒申鐃熟よく鐃塾わ申覆鐃緒申鐃�1.x鐃熟以降）で削申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申妊奪鐃緒申鐃緒申鐃緒申鐃緒申任鐃緒申襦�
鐃緒申脾居申燃擇鐃緒申鐃緒申鐃縮わ申鐃緒申鐃暑た鐃緒申砲呂鐃緒申鐃淑わ申鐃緒申腓�鐃淑ワ申鐃緒申鐃術ワ申鐃緒申必鐃竣でわ申鐃暑。鐃緒申百鐃緒申文鐃緒申覆鐃緒申腓�鐃緒申Lucene鐃緒申鐃緒申妊奪鐃緒申鐃緒申鐃緒申鐃獣てわ申鐃緒申鐃緒申鐃熟わ申鐃緒申 word2vec for Lucene 鐃緒申遒件申討鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃�
鐃淑駕申鐃緒申鐃薯示わ申鐃緒申鐃緒申鐃緒申単鐃塾わ申鐃緒申鐃� /Users/koji/work 鐃叔ワ申鐃曙ク鐃夙ワ申焚鐃緒申鐃� Solr 鐃縦駈申鐃緒申 word2vec for Lucene 鐃縦駈申鐃薯インスト￥申鐃暑す鐃緒申鐃緒申鐃緒申鐃緒申辰鐃淑わ申襦�
鐃緒申脾縁申鐃�word2vec for Lucene 鐃塾ワ申鐃緒申鐃緒申鐃緒申鐃緒申鐃�$ pwd /Users/koji/work $ git clone https://github.com/kojisekig/word2vec-lucene.git鐃緒申脾駕申鐃緒申妊鐃叔￥申鐃緒申鐃塾緒申鐃緒申
$ pwd /Users/koji/work $ cd word2vec-lucene # 鐃緒申鐃所ジ鐃淑ワ申鐃� word2vec 鐃叔わ申鐃緒申僂鐃緒申鐃銃わ申鐃緒申儻譽鰹申鐃緒申僖鐃� text8 鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃宿わ申鐃緒申 Solr 鐃緒申鐃緒申鐃緒申鐃術器申 $ ant t8-solr $ ls -l text8* -rw-r--r-- 1 koji staff 100000000 6 9 2006 text8 -rw-r--r-- 1 koji staff 100017005 12 3 13:44 text8.txt -rw-r--r-- 1 koji staff 100017078 12 3 13:44 text8.xml -rw-r--r-- 1 koji staff 31344016 12 3 13:40 text8.zip鐃緒申脾鰹申鐃�Lucene/Solr鐃緒申鐃緒申妊奪鐃緒申鐃緒申僚鐃緒申鐃緒申淵妊鐃叔￥申鐃緒申鐃緒申鐃緒申録鐃緒申
鐃緒申鐃藷ソ￥申鐃緒申鐃�2鐃緒申鐃術意わ申鐃銃最緒申離鐃緒申鵐宗鐃緒申鐃緒申Solr鐃緒申動鐃緒申鐃暑。
$ pwd /Users/koji/work # Solr鐃塾ワ申鐃緒申鐃緒申鐃緒申鐃緒申鐃� $ wget http://ftp.meisei-u.ac.jp/mirror/apache/dist/lucene/solr/4.10.2/solr-4.10.2.tgz $ tar xvzf solr-4.10.2.tgz # Solr鐃塾居申動 $ cd solr-4.10.2/example $ java -Dsolr.solr.home=/Users/koji/work/word2vec-lucene/solrhome -Dsolr.dir=/Users/koji/word/solr-4.10.2 -jar start.jar
2鐃縦わ申離鐃緒申鵐宗鐃緒申鐃叔わ申text8鐃緒申鐃緒申鐃術ワ申鐃緒申Solr鐃緒申鐃緒申録鐃緒申鐃暑。
$ pwd /Users/koji/work $ cd word2vec-lucene # Solr鐃緒申鐃緒申鐃緒申鐃術器申鐃緒申鐃緒申鐃術語コ鐃緒申鐃術ワ申鐃緒申Solr鐃緒申鐃緒申録 $ ./post.sh collection1 text8.xml鐃緒申脾器申鐃獣縁申鐃駿ワ申鐃夙ワ申虜鐃緒申鐃�
demo-word2vec.sh 鐃緒申鐃緒申鐃緒申廛箸鐃�Solr鐃緒申鐃緒申名鐃緒申鐃緒申蠅件申鐃�word2vec鐃緒申孫圓鐃緒申襦ｏ申孫垠鐃縮わ申vectors.txt鐃夙わ申鐃緒申鐃春ワ申鐃緒申鐃緒申暴鐃緒申呂鐃緒申鐃暑。
$ pwd /Users/koji/work $ cd word2vec-lucene $ ./demo-word2vec.sh collection1 $ ls -l vectors.txt -rw-r--r-- 1 koji staff 136053041 12 3 15:31 vectors.txt鐃緒申脾居申鐃獣縁申鐃駿ワ申鐃夙ワ申鐃粛件申鐃�
demo-distance.sh 鐃緒申孫圓鐃緒申鐃緒申vectors.txt鐃春ワ申鐃緒申鐃緒申鐃緒申匹濆鐃緒申鐃緒申鐃緒申鐃緒申鐃峻わ申鐃祝なる。鐃緒申鐃緒申鐃緒申単鐃緒申鐃緒申鐃緒申呂鐃緒申鐃夙￥申鐃緒申鐃緒申単鐃緒申忘任鐃潤い鐃淑ワ申鐃緒申鐃緒申鐃緒申鐃竣誌申鐃祝ベワ申鐃夙ワ申鐃緒申鐃緒申単鐃緒申鐃緒申40鐃縦わ申表鐃緒申鐃緒申鐃暑。
$ ./demo-distance.sh
cat
Word: cat
Position in vocabulary: 2601
Word Cosine distance
------------------------------------------------------------------------
cats 0.511078
dog 0.471308
dogs 0.469539
sighthound 0.452233
bobtail 0.436424
tapir 0.424105
demo-analogy.sh 鐃緒申孫圓鐃緒申鐃緒申vectors.txt鐃春ワ申鐃緒申鐃緒申鐃緒申匹濆鐃緒申鐃緒申鐃緒申鐃緒申鐃峻わ申鐃祝なわ申里如鐃�3鐃縦わ申単鐃緒申鬟好據鐃緒申鐃緒申鐃緒申擇鐃緒申鐃緒申鐃熟わ申鐃暑。鐃淑駕申鐃叔わ申man king woman鐃緒申鐃緒申鐃熟わ申鐃銃わ申鐃暑が鐃緒申鐃緒申man鐃緒申鐃出わ申鐃緒申king鐃塾関件申鐃緒申woman鐃緒申適鐃術わ申鐃緒申箸匹鐃緒申覆襪�鐃竣とわ申鐃緒申鐃緒申味鐃叔わ申鐃暑。鐃緒申鐃緒申鐃�queen鐃緒申鐃緒申鐃緒申鐃粛になるが鐃緒申鐃渋行件申未發緒申里茲�鐃祝なる。
$ ./demo-analogy.sh man king woman鐃緒申鐃旬醐申濃遒刻申鐃緒申
鐃淑常申亮鐃緒申魯鐃緒申螢醐申淵鐃緒申 word2vec 鐃叔わ申鐃緒申僂鐃緒申討鐃緒申鐃� text8 鐃夙わ申鐃緒申鐃術醐申鐃緒申鐃緒申鐃緒申鐃緒申僂澆離鐃緒申鐃緒申僖鐃緒申鐃夙っわ申鐃緒申鐃叔わ申鐃暑が鐃緒申鐃淑駕申鐃叔わ申鐃緒申鐃旬醐申痢鐃緒申鐃緒申鐃緒申鐃緒申僂澆任覆鐃緒申縫鐃緒申鐃緒申僖鐃緒申鐃夙っわ申鐃緒申鐃緒申匆陲靴茲�鐃緒申鐃叔ワ申如鐃緒申鐃緒申鐃� livedoor 鐃祝ュー鐃緒申鐃緒申鐃緒申鐃術ワ申鐃緒申鐃術わ申鐃暑。鐃緒申鐃藷ウワ申鐃獣トのワ申鐃緒申鐃夙わ申鐃緒申 Solr 鐃粛ワ申鐃銃ワ申鐃瞬件申鐃緒申鐃祝加刻申鐃緒申鐃緒申 livedoor 鐃祝ュー鐃緒申鐃緒申鐃緒申鐃術ワ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃宿わ申鐃暑。
$ pwd /Users/koji/work $ cd word2vec-lucene $ mkdir work $ cd work $ pwd /Users/koji/work/word2vec-lucene/work $ wget http://www.rondhuit.com/download/livedoor-news-data.tar.gz $ tar xvzf livedoor-news-data.tar.gz $ cd ..
鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申匹鐃緒申鐃� livedoor鐃祝ュー鐃緒申鐃緒申鐃緒申鐃術ワ申鐃緒申Solr鐃緒申鐃緒申録鐃緒申鐃緒申word2vec鐃緒申孫圓鐃緒申襦ｏ申鐃緒申鐃縮常申砲鐃�ldcc鐃緒申鐃緒申蠅刻申襦ｏ申泙鐃緒申鐃�-a鐃緒申鐃竣ワ申鐃緒申鐃緒申Lucene鐃緒申Analyzer鐃緒申鐃初ス鐃緒申鐃緒申蠅刻申襦ｏ申泙鐃緒申焚鐃緒申任鐃�-f鐃緒申鐃竣ワ申鐃緒申鐃叔緒申鐃緒申鐃緒申戰鐃緒申肇鐃春ワ申鐃緒申鐃緒申名鐃緒申鐃緒申蠅件申討鐃緒申鐃淑誌申鐃所し鐃淑わ申鐃夙デフワ申鐃緒申箸鐃�vectors.txt鐃夙なってわ申鐃殉わ申鐃緒申鐃緒申曚漂鐃緒申鐃緒申鐃緒申鐃緒申儻鐃緒申単鐃緒申戰鐃緒申肇鐃春ワ申鐃緒申鐃緒申鐃緒申颪�わ申鐃銃わ申鐃殉わ申鐃祝￥申
$ ./post.sh ldcc work/*.xml $ ./demo-word2vec.sh ldcc -a org.apache.lucene.analysis.ja.JapaneseAnalyzer -f vectors-ldcc.txt $ ./demo-distance.sh -f vectors-ldcc.txt 鐃暑婚 鐃緒申鐃�鐃叔ワ申如鐃緒申鐃緒申奮鐃緒申鐃�Lucene鐃緒申鐃緒申妊奪鐃緒申鐃緒申濃遒刻申鐃緒申鐃緒申鐃緒申鐃緒申鐃�
word2vec for Lucene 鐃緒申鐃緒申鐃循わ申鐃銃わ申鐃緒申妊鐃渋行ワ申鐃緒申鐃緒申廛鐃� demo-word2vec.sh 鐃薯見てわ申蕕�鐃夙わか鐃緒申茲�鐃祝￥申鐃緒申鐃緒申鐃縦わ申鐃塾パワ申瓠種申鐃緒申鐃緒申蓮鐃緒申疋鐃緒申鐃緒申妊鐃緒申鵐阿濃鐃緒申蠅居申鐃銃わ申鐃暑。鐃淑駕申鐃緒申Lucene鐃祝器申連鐃緒申鐃緒申僖鐃潤ー鐃緒申鐃叔わ申鐃暑。鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃�Lucene鐃緒申鐃緒申妊奪鐃緒申鐃緒申帽腓�鐃処う鐃緒申適鐃緒申鐃緒申鐃所し鐃淑わ申鐃緒申鐃緒申Lucene 4.x 鐃緒申鐃緒申妊奪鐃緒申鐃緒申離如鐃緒申鐃緒申鐃�word2vec鐃緒申動鐃緒申鐃熟わ申鐃叔わ申鐃暑。
| 鐃緒申鐃竣ワ申鐃緒申鐃� | 鐃緒申鐃緒申 |
|---|---|
| -index | Lucene鐃緒申鐃緒申妊奪鐃緒申鐃緒申離妊鐃緒申譽�鐃夙ワ申鐃緒申鐃所す鐃暑。 |
| -field | word2vec 鐃緒申孫圓鐃緒申鐃�Lucene鐃緒申鐃緒申妊奪鐃緒申鐃緒申離侫鐃緒申鐃緒申鐃緒申名鐃緒申鐃緒申蠅刻申襦ｏ申鐃緒申離侫鐃緒申鐃緒申鐃宿わ申indexed鐃叔わ申鐃緒申stored鐃叔なわ申鐃緒申个覆鐃淑わ申鐃緒申 |
| -analyzer | -field鐃緒申鐃竣ワ申鐃緒申鐃叔誌申鐃所さ鐃曙た鐃春ワ申鐃緒申鐃緒申匹鐃�stored鐃叔￥申鐃緒申鐃薯こわ申鐃叔誌申鐃所さ鐃曙たLucene鐃緒申Analyzer鐃緒申鐃初ス鐃緒申analyze鐃緒申鐃暑。 |
-analyzer 鐃緒申鐃竣ワ申鐃緒申鐃祝つわ申鐃銃は￥申stored鐃叔￥申鐃緒申鐃叔はなわ申TermVector鐃叔わ申茲�鐃獣わ申鐃塾わ申鐃緒申鐃緒申TermVector鐃緒申鐃緒申存鐃緒申鐃銃わ申鐃緒申Lucene鐃緒申鐃緒申妊奪鐃緒申鐃緒申肋鐃緒申覆鐃緒申鐃緒申鐃緒申鐃渋�鐃緒申的鐃祝も疑鐃緒申鐃緒申辰鐃緒申鐃緒申瓠�stored鐃叔￥申鐃緒申鐃薯こわ申鐃叔誌申鐃所す鐃緒申Lucene鐃緒申Analyzer鐃緒申鐃初ス鐃緒申analyze 鐃緒申鐃緒申鐃緒申鐃祝わ申箸辰鐃緒申鐃緒申任呂覆鐃�indexed鐃叔なわ申鐃緒申个鐃緒申鐃緒申覆鐃緒申鐃緒申箸鐃緒申鐃緒申函鐃緒申淵鐃緒申螢醐申淵鐃緒申鐃緒申鐃叔わ申鐃�word2vec鐃叔はワ申鐃緒申鐃術ワ申鐃緒申2鐃緒申鐃宿わ申任鐃緒申董鐃�1鐃緒申鐃旬わ申鐃宿み刻申鐃淳わ申単鐃緒申表鐃緒申鐃緒申鐃緒申鐃緒申討鐃緒申襪�鐃緒申indexed鐃叔わ申鐃緒申个鐃緒申鐃緒申楼鐃瞬で器申了鐃緒申鐃緒申鐃淑わ申箸鐃緒申辰討鐃�Lucene鐃獣ぽわ申鐃緒申鐃緒申任鐃緒申襦ｏ申泙鐃緒申鐃�word2vec鐃叔駕申鐃熟わ申鐃緒申鐃緒申鐃淑わ申茲�鐃緒申Lucene鐃春ワ申鐃緒申鐃緒申匹呂鐃緒申鐃緒申討鐃�indexed鐃叔わ申鐃緒申stored鐃夙考わ申鐃緒申鐃緒申里如鐃渋随申鐃緒申鐃�Lucene鐃緒申鐃緒申妊奪鐃緒申鐃緒申鐃緒申鐃緒申福鐃緒申砲呂鐃緒申両鐃緒申麓鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申呂鐃緒申任鐃緒申襦�
鐃緒申鐃緒申鐃緒申鐃緒申文鐃緒申鐃緒申鐃獣てわ申鐃緒申Lucene鐃緒申鐃緒申妊奪鐃緒申鐃緒申鐃緒申鐃獣てわ申鐃緒申鐃緒申鐃熟￥申鐃叔ワ申如鐃緒申鐃緒申鐃銃逸申鐃緒申鐃叔э申鐃緒申鐃緒申鐃緒申函鐃緒申鐃緒申鐃�word2vec for Lucene鐃緒申鐃緒申鐃緒申鐃緒申Lucene鐃緒申鐃緒申妊奪鐃緒申鐃緒申鐃叔試し鐃銃わ申鐃緒申鐃緒申鐃緒申鐃緒申鐃宿わ申雰鐃縮になっわ申鐃緒申鐃緒申鐃緒申鐃銃わ申鐃緒申鐃緒申鐃緒申鐃緒申个鐃緒申蠅�鐃緒申鐃緒申鐃緒申
2014.01.30 Thursday
鐃銃ワ申鐃緒申鐃夙ワ申鐃塾テ￥申鐃緒申鐃緒申鐃縦￥申鐃緒申 brat 鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申
brat 鐃緒申 OSS 鐃塾テワ申鐃緒申鐃夙ワ申鐃塾テ￥申鐃緒申鐃緒申鐃縦￥申鐃緒申任鐃緒申襦�GUI鐃淑ビワ申鐃遵ア鐃緒申鐃緒申鐃緒申鐃緒申鐃祝とでわ申鐃緒申鐃緒申鐃緒申離鐃緒申離董鐃緒申鐃緒申鐃緒申鐃緒申鐃塾わか鐃緒申笋刻申鐃緒申淵鐃緒申鐃竣ワ申淵侫鐃緒申鐃緒申泪奪箸鐃緒申鐃緒申鐃�NLP鐃竣ワ申鐃緒申鐃緒申爐�鐃初扱鐃緒申鐃巡す鐃緒申鐃緒申鐃祝￥申導鐃緒申鐃塾器申単鐃緒申鐃緒申鐃緒申鐃出らし鐃緒申鐃塾でわ申鐃緒申鐃叔紹介しよう鐃緒申
brat 鐃塾ワ申鐃藷スト￥申鐃緒申Apache 鐃淑どわ申 Web 鐃緒申鐃緒申鐃出常申鐃銃逸申鐃緒申鐃緒申鐃緒申楹鐃重�鐃祝使わ申鐃緒申法鐃夙￥申鐃縦随申的鐃祝わ申鐃緒申鐃獣わ申立鐃緒申鐃遵げ鐃銃使わ申鐃緒申法鐃緒申鐃緒申鐃所、鐃緒申鐃緒申鐃叔は醐申圓鐃述介する。鐃緒申鐃塾常申腑わ申鵐好函鐃緒申鐃熟器申単鐃叔￥申brat 鐃緒申適鐃緒申鐃淑デワ申鐃曙ク鐃夙ワ申縫鐃緒申鐃緒申鐃緒申鐃緒申鐃宿わ申鐃緒申展鐃緒申鐃緒申鐃暑。
$ mkdir work $ cd work $ wget http://weaver.nlplab.org/~brat/releases/brat-v1.3_Crunchy_Frog.tar.gz $ tar xvzf brat-v1.3_Crunchy_Frog.tar.gz鐃緒申鐃緒申鐃銃￥申鐃緒申鐃塾よう鐃祝ワ申鐃藷スト￥申鐃緒申離鐃緒申鐃緒申鐃竣トわ申孫圓鐃緒申銅鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申仆鐃緒申鐃緒申任鐃緒申襦�
$ cd brat-v1.3_Crunchy_Frog $ ./install.sh # brat 鐃祝ワ申鐃緒申鐃緒申鐃藷すわ申罅種申鐃縮常申鮨卦鐃緒申鐃緒申蠅刻申襦� Please the user name that you want to use when logging into brat editor # 鐃術ワ申鐃緒ー鐃宿わ申鐃緒申鐃緒申襦� Please enter a brat password (this shows on screen) annotate # 鐃潤ー鐃暑ア鐃宿レス鐃緒申鐃緒申鐃緒申襦� Please enter the administrator contact email [email protected]鐃緒申鐃緒申鐃術ワ申鐃塾緒申鐃緒申
鐃緒申鐃祝ワ申鐃塾テ￥申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申仂櫃離鐃緒申鐃緒申僖鐃緒申鐃� data 鐃叔ワ申鐃曙ク鐃夙ワ申硫鐃緒申鐃緒申儖佞鐃緒申襦ｏ申鐃緒申鐃緒申任鐃� livedoor鐃祝ュー鐃緒申鐃緒申鐃緒申鐃術ワ申鐃緒申箸辰鐃緒申鐃薯示わ申鐃緒申
$ wget http://www.rondhuit.com/download/ldcc-20120915.tar.gz $ tar xvzf ldcc-20120915.tar.gz鐃緒申鐃緒申鐃術ワ申鐃春ワ申鐃緒申鐃緒申鐃� UTF-8 鐃緒申鐃緒申存鐃緒申鐃曙、.txt 鐃塾鰹申張鐃述でなわ申鐃緒申个覆鐃淑わ申鐃緒申鐃緒申鐃緒申法鐃緒申鐃緒申里茲�鐃祝ワ申鐃塾テ￥申鐃緒申鐃緒申鐃緒申孫圓鐃緒申鐃� .txt 鐃春ワ申鐃緒申鐃緒申劼箸弔劼箸弔鐃緒申弍鐃緒申鐃緒申鐃緒申鐃緒申 .ann 鐃春ワ申鐃緒申鐃緒申鬚△蕕�鐃緒申鐃緒申鐃術意わ申鐃銃わ申鐃緒申必鐃竣わ申鐃緒申鐃暑。
$ find text -name '*.txt' | sed -e 's|\.txt|.ann|g' | xargs touch鐃緒申有表鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃� brat 鐃塾居申動
brat 鐃熟件申鐃緒申鐃緒申鐃緒申里茲�鐃淑刻申造的鐃緒申鐃塾テ￥申鐃緒申鐃緒申鐃緒申弔鐃緒申襪鰹申箸鐃緒申任鐃緒申襪�鐃緒申鐃旬居申鐃緒申鐃叔は醐申有表鐃緒申鐃緒申鐃緒申鐃緒申弔鐃緒申鐃緒申鐃薯示わ申鐃緒申鐃叔フワ申鐃緒申箸両鐃緒申屬任發わ申鐃緒申弔鐃緒申慮鐃粛�表鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃所さ鐃緒申討鐃緒申襪�鐃緒申鐃緒申鐃緒申鐃叔わ申鐃夙種申鐃緒申鐃緒申鐃緒申鐃緒申鐃所し鐃銃みる。livedoor鐃祝ュー鐃緒申鐃緒申鐃緒申鐃術ワ申鐃緒申 tar 鐃緒申展鐃緒申鐃緒申鐃緒申鐃夙わ申鐃祝でわ申鐃緒申 text 鐃叔ワ申鐃曙ク鐃夙ワ申鐃縦常申鐃緒申法鐃緒申鐃緒申里茲�鐃緒申2鐃縦わ申鐃緒申鐃緒申侫鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申襦�
$ cd text $ cat > annotation.conf <<EOF > [entities] > ORGANIZATION > FACILITY > PERSON > TITLE > LOCATION > > [relations] > [events] > [attributes] > EOF $ $ cat > visual.conf <<EOF > [labels] > > [drawing] > ORGANIZATION bgColor:#8fb2ff > FACILITY bgColor:#aaaaee > PERSON bgColor:#ffccaa > TITLE bgColor:#7fe2ff > LOCATION bgColor:#6fffdf > EOF鐃叔緒申鐃緒申鐃緒申鐃春ワ申鐃緒申鐃緒申魯鐃緒申鐃緒申鐃緒申鐃緒申蝓�2鐃縦わ申魯鐃緒申鐃緒申凌鐃緒申鐃緒申鐃緒申鐃叔わ申鐃暑。鐃淑わ申鐃緒申鐃緒申鐃緒申必鐃竣削申鐃緒申造鐃緒申鐃緒申鐃叔わ申鐃暑。鐃緒申鐃緒申侫鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃所し鐃緒申鐃緒申鐃緒申鐃熟￥申brat 鐃叔ワ申鐃曙ク鐃夙ワ申鐃緒申鐃緒申鐃緒申鐃春ワ申鐃緒申鐃暑が鐃緒申鐃緒申里如鐃緒申鐃緒申鐃緒申鐃薯参照わ申鐃銃わ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申
鐃淑常申鐃緒申鐃緒申蠅�鐃緒申鐃緒申鐃出￥申brat 鐃薯スワ申鐃緒申疋鐃緒申鐃緒申鐃盾ー鐃宿で居申動鐃叔わ申鐃暑。鐃淑わ申鐃緒申brat 鐃緒申 Python 鐃叔書かわ申討鐃緒申鐃塾で￥申Python 鐃塾環駈申鐃緒申必鐃竣でわ申鐃暑。
$ cd ../.. $ python standalone.pybrat 鐃舜のワ申鐃緒申鐃緒申鐃緒申
鐃緒申竜鐃銃逸申鐃緒申鐃宿緒申鐃緒申鐃緒申譴� URL http://127.0.0.1:8001 鐃祝ブラウ鐃緒申鐃緒申鐃初ア鐃緒申鐃緒申鐃緒申鐃緒申鐃暑。鐃緒申鐃緒申函鐃緒申鐃緒申里茲�鐃淑駕申鐃縮わ申表鐃緒申鐃緒申鐃緒申襦�
鐃殉わ申鐃緒申鐃緒申鐃緒申鐃藷してわ申鐃淑わ申鐃塾でわ申鐃緒申鐃熟逸申旦 [Cancel] 鐃薯クワ申奪鐃緒申鐃緒申襦ｏ申鐃緒申鐃緒申鴇鐃塾ブルー鐃緒申鐃緒申分鐃祝マワ申鐃緒申鐃楯ワ申鐃藷タわ申鐃緒申辰胴圓鐃緒申函鐃緒申鐃緒申鐃祝ワ申鐃緒申鐃緒申鐃緒申椒鐃緒申鵑�醐申鐃緒申鐃塾でワ申鐃緒申奪鐃緒申鐃緒申襦ｏ申鐃緒申鐃夙￥申鐃緒申鐃塾ワ申鐃緒申鐃緒申鐃緒申鐃緒申未鐃宿緒申鐃緒申鐃緒申鐃緒申里如鐃緒申鐃緒申離鐃緒申鵐好函鐃緒申鐃緒申鐃祝誌申鐃所し鐃緒申鐃醇ー鐃緒申鐃緒申鐃緒申鐃�editor / annotate鐃祝わ申箸辰謄鐃緒申鐃緒申鐃緒申鵑垢襦�
鐃緒申鐃緒申鐃緒申鐃藷しわ申鐃初コ鐃緒申鐃術ワ申鐃緒申鐃曙ク鐃緒申鐃緒申鐃緒申鐃緒申鐃薯する。鐃緒申鐃緒申砲魯鐃緒申屮鐃緒申鐃緒申魏＿鐃緒申鐃緒申襪�鐃緒申鐃緒申離鐃祝ュー鐃緒申鐃緒申 [Collection] 鐃緒申鐃緒申鐃緒申妊鐃緒申鐃獣ワ申鐃緒申鐃暑。鐃緒申鐃緒申函鐃緒申鐃緒申離鐃緒申鐃緒申僖鐃緒申鐃緒申譽�鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃縮になる。
鐃緒申鐃緒申鐃叔わ申 text 鐃叔ワ申鐃曙ク鐃夙ワ申硫鐃緒申鐃� movie-enter 鐃叔ワ申鐃曙ク鐃夙ワ申硫鐃緒申鐃緒申鐃重�鐃緒申鐃淑フワ申鐃緒申鐃緒申鐃緒申鐃緒申鬚垢襦ｏ申鐃緒申鐃夙￥申鐃緒申鐃塾テワ申鐃緒申鐃夙フワ申鐃緒申鐃暑が表鐃緒申鐃緒申鐃緒申鐃塾で￥申鐃緒申鐃緒申鐃緒申痢峙楮蠅�鐃緒申鐃緒申鐃竣わ申 PERSON 鐃緒申鐃緒申鐃緒申弔鐃緒申襪随申鐃殉ワ申鐃緒申鐃宿ワ申奪鐃緒申鐃緒申襦ｏ申鐃緒申鐃夙￥申鐃緒申鐃塾よう鐃祝ワ申鐃緒申鐃緒申鐃緒申鐃緒申鐃楯ップワ申鐃獣ワ申表鐃緒申鐃緒申鐃緒申襦�
鐃緒申鐃緒申鐃叔わ申鐃緒申鐃緒申 PERSON 鐃緒申鐃緒申鐃薯しわ申 [OK] 鐃薯クワ申奪鐃緒申鐃緒申襦ｏ申鐃緒申鐃薯繰わ申鐃瞬わ申鐃銃わ申鐃緒申鐃夙￥申鐃緒申鐃塾よう鐃祝テワ申鐃緒申鐃夙わ申鐃緒申鐃塾テ￥申鐃緒申鐃緒申鵑気鐃暑。
鐃緒申鐃塾とわ申鐃緒申鐃叔に￥申鐃緒申鐃緒申鐃出ワ申鐃緒申鐃宿わ申鐃出縁申鐃緒申鐃緒申 .ann 鐃春ワ申鐃緒申鐃緒申砲麓鐃緒申里茲�鐃祝ワ申鐃塾テ￥申鐃緒申鐃緒申鐃緒申鐃藷がワ申鐃緒申廛鐃淑フワ申鐃緒申鐃殉ットで居申録鐃緒申鐃緒申討鐃緒申襦�
$ cat movie-enter-5840081.ann T1 PERSON 81 86 鐃旬崎あ鐃緒申鐃緒申 T2 PERSON 87 90 鐃緒申鐃緒申鐃� T3 TITLE 1046 1048 鐃緒申鐃緒申 T4 PERSON 447 450 鐃緒申鐃緒申鐃� T5 PERSON 975 977 鐃旬削申 T6 TITLE 977 979 鐃緒申鐃緒申 T7 PERSON 980 981 鐃緒申 T8 TITLE 981 983 鐃緒申鐃緒申 T9 PERSON 1021 1023 鐃旬削申 T10 PERSON 1196 1197 鐃緒申 T11 PERSON 1245 1247 鐃旬削申 T12 PERSON 1254 1255 鐃緒申 T13 PERSON 947 949 鐃旬削申鐃緒申鐃緒申鐃緒申弔鐃緒申鐃緒申鐃緒申屬乃鐃熟随申鐃緒申鐃銃わ申鐃緒申里如鐃緒申廛鐃緒申鐃緒申鐃緒申鐃緒申匹濆鐃緒申鐃夙わ申鐃熟￥申鐃緒申鐃緒申鐃緒申鐃緒申妊鐃緒申鐃緒申箸鐃緒申鐃宿�鐃竣わ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃�
Solr鐃緒申Mahout鐃塾トレー鐃祝ングワ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申2鐃緒申亮鐃緒申崋圓鐃緒申臀醐申鐃叔わ申鐃緒申
Mahout 鐃夙レー鐃祝ングワ申鐃緒申鐃緒申鐃緒申鐃瞬者わ申鐃緒申鐃藷タビュー鐃緒申鐃緒申鐃熟わ申鐃緒申鐃緒申鐃緒申
2014.01.20 Monday
Heliosearch/Solr鐃緒申鐃春ヒ￥申鐃竣フワ申鐃暑タ
筆鐃峻わ申Yonik鐃塾居申鐃縦わ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申文鐃熟わ申鐃緒申鐃緒申鐃緒申
Solr鐃塾パフワ申鐃緒申鐃殉ンスわ申鐃緒申聞鐃緒申鐃�Heliosearch鐃夙わ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃竣ンソ￥申鐃緒申鐃竣ワ申鐃緒申鐃緒申鐃緒申鐃夙に随申鐃緒申鐃緒申鐃緒申媛辰鐃緒申譴随申鐃叔緒申鐃緒申鐃緒申侫辧鐃緒申鐃�Native鐃春ワ申鐃暑タ鐃緒申鐃緒申
鐃緒申鐃緒申鐃緒申JVM鐃述￥申鐃竣わ申鐃緒申鐃緒申的鐃緒申鐃緒申JVM鐃緒申鐃順き鐃緒申鐃述￥申鐃竣の緒申鐃緒申鐃緒申鐃処し鐃銃わ申鐃殉わ申鐃淑わ申鐃獣わ申鐃緒申鐃述￥申鐃竣わ申鐃順き鐃緒申鐃夙ワ申鐃緒申鐃駿ッワ申鐃緒申鐃曙ク鐃緒申鐃緒申鐃緒申箸鐃緒申颪靴鐃緒申覆蝓�GC鐃楯￥申鐃緒申鐃祝わ申辰鐃縦刻申鐃緒申屮鐃緒申鐃緒申謄爐�鐃緒申澆鐃緒申鐃緒申曚鐃緒申僚鐃緒申鐃緒申鐃緒申鐃緒申擇任鐃緒申覆鐃緒申覆鐃緒申鐃緒申多鐃緒申鐃緒申鐃緒申鐃塾わ申鐃潤ク鐃緒申鐃所／鐃所ク鐃緒申鐃緒申鐃夙ワ申鐃緒申鐃準ア鐃緒申鐃夙わ申発鐃緒申鐃緒申鐃緒申鐃所、SolrCloud鐃盾ー鐃宿わ申zookeeper鐃緒申鐃獣ワ申鐃緒申鐃塾ワ申鐃緒申鐃準ア鐃緒申鐃夙までわ申発鐃緒申鐃緒申鐃緒申鐃叔緒申鐃緒申鐃緒申鐃緒申襦�
鐃緒申鐃春ヒ￥申鐃竣フワ申鐃暑タ鐃緒申鐃祝刻申鐃駿なフワ申鐃暑タ鐃緒申鐃緒申奪鐃緒申鵐圧鐃叔緒申鐃緒申儖佞鐃緒申討鐃緒申鐃�Heliosearch/Solr鐃緒申鐃緒申鐃緒申鐃緒申鐃竣リケ鐃緒申鐃緒申鐃緒申鐃祝わ申辰討鐃緒申鐃緒申鐃淑ワ申鐃緒申鐃緒申鐃術わ申鐃緒申鐃叔緒申鐃緒申鐃緒申鐃緒申襦ｏ申腓�鐃緒申存続鐃緒申鐃瞬わ申長鐃緒申鐃緒申鐃瞬ワ申鐃緒申鐃緒申鐃夙わ申鐃緒申鐃緒申鐃緒申JVM鐃述￥申鐃竣わ申鐃緒申鐃緒申个鐃緒申鐃緒申鐃緒申鐃重�鐃祝器申鐃緒申鐃緒申鐃緒申鐃緒申奪箸鐃緒申鐃緒申鐃緒申襦ｏ申鐃緒申侫辧鐃緒申廛鐃緒申鐃熟ワ申鐃緒申鐃駿ッワ申鐃緒申鐃曙ク鐃緒申鐃緒申鐃初見鐃緒申鐃淑わ申鐃塾わ申鐃緒申
Heliosearch鐃春ワ申鐃暑タ鐃緒申Solr DocSet鐃緒申鐃瞬ワ申鐃緒申鐃緒申鐃夙）はワ申鐃春ヒ￥申鐃竣でワ申鐃緒申鐃緒申鐃緒申鐃夙わ申鐃緒申鐃処う鐃祝なってわ申鐃所、鐃緒申鐃竣になわ申个鐃緒申鐃緒申鵬鐃緒申鐃緒申任鐃緒申鐃処う鐃緒申鐃夙わ申鐃緒申鐃緒申鐃緒申箸鐃緒申鐃緒申茲�鐃祝なっわ申鐃緒申鐃殉わ申鐃緒申JVM GC鐃熟わ申鐃塾よう鐃淑ワ申鐃緒申屮鐃緒申奪鐃緒申離鐃緒申圈鐃緒申鐃緒申鐃緒申濃鐃緒申屬鐃縮居申未砲鐃緒申鐃宿�鐃竣わ申鐃淑わ申鐃淑っわ申鐃緒申鐃緒申鐃塾わ申鐃夙わ申GC鐃緒申長鐃緒申鐃瞬ポ￥申鐃緒申鐃緒申鐃俊緒申鐃緒申鐃緒申鐃所ク鐃緒申鐃緒申鐃夙ワ申鐃暑ー鐃竣ットわ申鐃緒申鐃緒申鐃緒申鐃塾わ申鐃緒申立鐃獣てわ申鐃暑。
鐃銃ワ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃縮わ申鐃緒申鐃緒申鐃塾わ申鐃獣わ申長鐃緒申鐃瞬わ申GC鐃楯￥申鐃緒申鐃緒申童鐃緒申鐃緒申鐃祝はわ申鐃淑りい鐃緒申鐃緒申鐃緒申鐃淑わ申鐃夙わ申遒紘�鐃竣わ申鐃緒申鐃緒申塙佑鐃緒申討鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃�1鐃緒申鐃旬でわ申鐃緒申鐃淑りこ鐃曙が鐃銃醐申鐃緒申鐃緒申討鐃緒申泙辰鐃緒申鐃緒申辧鐃緒申廛鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申里茲�鐃緒申鐃順き鐃淑わ申里任呂覆鐃緒申鐃緒申鐃緒申肋鐃緒申鐃緒申鐃緒申鐃緒申泙辰討鐃緒申襦ｏ申辧鐃緒申廚鐃緒申腓�鐃緒申鐃緒申GC鐃楯￥申鐃緒申鐃緒申鐃俊わ申茲�鐃緒申鐃緒申
鐃銃ワ申鐃夙の詳削申
- Ubuntu Linux鐃緒申鐃緒申鐃出￥申RAM 8G鐃出ワ申鐃夙￥申CPU 4鐃緒申鐃緒申鐃緒申Java 1.7 64鐃俊ット￥申
- 鐃緒申鐃初イ鐃緒申鐃緒申函鐃�8鐃緒申鐃緒申奪匹鐃緒申譴常申譴�1鐃縦わ申ID鐃塾ワ申鐃緒申鐃緒申鐃叔わ申佞離侫鐃緒申襯随申鐃�500鐃緒申鐃緒申砲能鐃緒申鐃�
- filterCache鐃緒申size=1000鐃淑わ申鐃駿てのフワ申鐃暑タ鐃薯エビワ申鐃緒申鐃緒申鵑擦鐃緒申飮鐃緒申鐃緒申鐃塾に緒申分鐃緒申鐃順き鐃緒申鐃緒申
- 鐃緒申鐃緒申妊奪鐃緒申鐃緒申鐃�3.8G鐃出ワ申鐃夙￥申5000鐃緒申鐃緒申
Apache Solr鐃緒申鐃殉ワ申疋薀わ申鐃�
$ java -jar -Xmx4G start.jarHeliosearch/Solr鐃緒申鐃殉ワ申疋薀わ申鐃�
$ java -jar start.jar
Apache Solr鐃渋行誌申鐃緒申OOM鐃純外鐃緒申鐃緒申鬚垢襪随申鐃祝ヒ￥申鐃竣ワ申鐃緒申鐃緒申鐃緒申4G鐃出ワ申鐃夙わ申鐃緒申鐃所す鐃緒申必鐃竣わ申鐃緒申鐃獣わ申鐃緒申鐃緒申棆鐃叔緒申鐃�RAM鐃熟削申鐃緒申8G鐃緒申鐃獣わ申鐃緒申鐃潤、鐃縦わ申離鐃緒申鐃熟ワ申鐃緒申妊奪鐃緒申鐃緒申侫鐃緒申鐃緒申鐃塾ワ申鐃緒申奪鐃緒申鐃緒申僂箸鐃緒申鐃�OS鐃祝残わ申鐃銃わ申鐃緒申鐃緒申鐃緒申鐃獣わ申鐃淑わ申鐃緒申鐃緒申鐃淑わ申鐃緒申速鐃駿わ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申討鐃緒申泙鐃緒申法鐃�
GC鐃塾件申鐃�2鐃緒申鐃緒申鐃緒申鐃緒申螢�鐃緒申鐃緒申鐃夙わ申圓辰鐃�GC鐃塾実行件申未鐃淑駕申鐃塾ワ申鐃緒申佞房鐃緒申鐃緒申鐃� 鐃緒申鐃曙ー鐃緒申鐃緒申鐃緒申GC鐃緒申鐃竣わ申鐃緒申鐃緒申鐃瞬￥申鐃緒申鐃緒申鐃熟ヒ￥申鐃竣の実ワ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃熟ヒ￥申鐃竣の実誌申鐃緒申鐃縮を示わ申鐃銃わ申鐃暑。
Solr
Solr鐃叔わ申長鐃緒申鐃瞬ポ￥申鐃緒申鐃緒申謄鐃緒申鐃緒申鐃祝鰹申鐃緒申鐃初見鐃緒申里呂鐃緒申鐃緒申鐃銃易わ申鐃獣わ申鐃緒申鐃緒申鐃緒申鐃緒申有鐃緒申鐃祝なってわ申鐃緒申鐃緒申鐃緒申螢�鐃緒申鐃緒申鐃夙わ申鐃緒申鐃駿てワ申鐃緒申鐃緒申奪鐃緒申鐃緒申鐃緒申鐃縦わ申鐃緒申鐃緒申鐃緒申鐃淳ナワ申任蝋鐃渋�鐃緒申鐃緒申鐃緒申鐃緒申鐃暑が発鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃銃￥申GC鐃緒申鐃順規鐃熟なワ申鐃緒申僖鐃緒申鐃緒申鐃緒申発鐃緒申鐃緒申鐃緒申肇鐃緒申鐃緒申潺淵鐃塾ワ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃淳わ申鐃緒申鐃緒申
鐃緒申鐃緒申鐃駿ッワ申鐃緒申鐃曙ク鐃緒申鐃緒申鐃塾緒申鐃緒申鐃緒申短鐃緒申鐃瞬でわ申鐃準た鐃緒申鐃�Heliosearch GC鐃緒申鐃緒申佞鐃緒申鐃緒申鐃緒申鐃塾誌申鐃緒申瓩わ申鐃縦刻申鐃緒申屬隆鐃緒申鐃緒申鐃�GC鐃楯￥申鐃緒申鐃緒申鐃循とわ申鐃夙�鐃緒申鐃緒申鐃銃わ申鐃初ず鐃緒申鐃循わ申鐃緒申GC鐃楯￥申鐃緒申鐃緒申鐃緒申鐃緒申鐃祝醐申鐃緒申鐃緒申鐃銃わ申鐃暑こ鐃夙わ申鐃緒申鐃旬わ申鐃緒申鐃緒申鐃緒申
鐃緒申鐃塾ワ申鐃緒申佞蓮鐃�2鐃緒申鐃緒申鐃緒申鐃緒申鐃渋行わ申鐃緒申鐃夙わ申鐃塾醐申半鐃緒申1鐃緒申鐃緒申鐃緒申鐃緒申淵曠奪肇鐃緒申櫂奪箸肇鐃緒申鐃獣ワ申鐃遵が鐃緒申鐃緒申紊わ申鐃緒申鐃緒申鐃緒申潺鵐阿鮓�計らう鐃緒申鐃緒申砲鐃緒申圓鐃緒申鐃緒申屬鐃術￥申鐃緒申鐃緒申箸納鐃緒申鐃緒申討鐃緒申襦�
Query Throughput鐃緒申鐃緒申佞魯鐃緒申侫辧鐃緒申廛如鐃緒申鐃緒申鐃渋わ申砲鐃獣て駕申鐃緒申鐃叔わ申鐃暑ガ鐃緒申鐃駿ッワ申鐃緒申鐃曙ク鐃緒申鐃緒申鐃緒申必鐃竣わ申CPU鐃緒申鐃緒申鐃緒申鐃瞬を示わ申鐃銃わ申鐃暑。鐃緒申鐃緒申鐃緒申鵝△鐃緒申鐃熟駈申端鐃淑件申未鐃緒申鐃緒申鐃緒申未離鐃緒申鐃緒申戰奪鐃緒申鐃緒申譽�鐃緒申鐃緒申鐃緒申鐃緒申砲鐃夙�鐃緒申鐃緒申鐃銃わ申鐃緒申鐃緒申魯如鐃緒申鐃緒申鐃渋わ申鬟�フヒ￥申鐃竣にわ申鐃暑こ鐃夙で実醐申鐃緒申鐃暑ス鐃暑ー鐃竣ット醐申鐃緒申鐃緒申鐃緒申鐃重�鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申
鐃竣ワ申鐃緒申鐃緒申鐃淑トップ件申由鐃叔鰹申鐃緒申鐃緒申鐃緒申道鐃祝の常申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申未鐃�5鐃緒申砲錣随申辰瞳鐃渋�鐃緒申鐃緒申鐃緒申
| Apache Solr | Heliosearch | |
| 鐃叔常申 | 3.8GB | 3.6GB |
| 鐃緒申鐃緒申 | 4.3GB | 3.7GB |
鐃緒申鐃緒申隆鐃獣縁申淵謄鐃緒申箸砲鐃所、鐃緒申鐃春ヒ￥申鐃竣フワ申鐃暑タ鐃緒申鐃順き鐃淑異常申鐃粛を減らし鐃緒申鐃緒申鐃塾のワ申鐃緒申鐃所ス鐃暑ー鐃竣ットわ申鐃潤、長鐃緒申鐃瞬わ申GC鐃楯￥申鐃緒申鐃緒申鐃俊緒申鐃緒申鐃銃リク鐃緒申鐃緒申鐃夙わ申予測鐃緒申鐃銃易にわ申鐃暑こ鐃夙わ申判鐃緒申鐃緒申鐃緒申鐃緒申
鐃緒申鐃緒申鐃夙でわ申鐃庶し鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申HeliosearchForum鐃叔器申鐃循わ申聞鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申
Solr鐃緒申Mahout鐃塾トレー鐃祝ングワ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申2鐃緒申亮鐃緒申崋圓鐃緒申臀醐申鐃叔わ申鐃緒申
+ Solr鐃祝わ申鐃瞬ワ申鐃緒申鐃盾検鐃緒申
+ PROFILE
+ LINKS
鐃緒申鐃緒申鐃緒申鐃藷ジワ申鐃緒申鐃緒申 - 鐃緒申咾離櫂鐃緒申鐃緒申
鐃緒申鐃術醐申鐃緒申鐃緒申鐃藷ジワ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃獣器申鐃緒申圓鐃緒申匹泙覆鐃緒申任鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃獣ワ申鐃緒申鐃緒申鐃緒申泙鐃緒申鐃緒申蕁�鐃緒申鐃緒申
>>鐃緒申鐃緒申鐃緒申鐃� 10鐃塾ポワ申鐃緒申鐃�
鐃緒申鐃術醐申鐃緒申鐃緒申鐃藷ジワ申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃獣器申鐃緒申圓鐃緒申匹泙覆鐃緒申任鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申鐃獣ワ申鐃緒申鐃緒申鐃緒申泙鐃緒申鐃緒申蕁�鐃緒申鐃緒申
>>鐃緒申鐃緒申鐃緒申鐃� 10鐃塾ポワ申鐃緒申鐃�
+ Lucene&Solr鐃叔ワ申
+ ThinkIT鐃緒申鐃緒申
+ RECOMMEND
Apache Solr鐃緒申鐃緒申 鐃緒申鐃緒申鐃緒申鐃竣ンソ￥申鐃緒申鐃緒申文鐃緒申鐃緒申鐃緒申鐃藷ジワ申 鐃緒申JUGEM鐃緒申咼紂� »鐃緒申
鐃舜醐申 鐃緒申鐃緒申,鐃緒申鐃緒申 鐃緒申鐃緒申,鐃緒申鐃緒申 鐃緒申平,鐃緒申鐃緒申 鐃緒申,鐃緒申谷 鐃緒申
鐃舜醐申 鐃緒申鐃緒申,鐃緒申鐃緒申 鐃緒申鐃緒申,鐃緒申鐃緒申 鐃緒申平,鐃緒申鐃緒申 鐃緒申,鐃緒申谷 鐃緒申
+ RECOMMEND
Lucene in Action 鐃緒申JUGEM鐃緒申咼紂� »鐃緒申
Erik Hatcher,Otis Gospodnetic,Mike McCandless
FastVectorHighlighter鐃祝つわ申鐃銃駕申鐃盾記鐃緒申鐃緒申鐃銃わ申鐃殉わ申鐃緒申鐃緒申
Erik Hatcher,Otis Gospodnetic,Mike McCandless
FastVectorHighlighter鐃祝つわ申鐃銃駕申鐃盾記鐃緒申鐃緒申鐃銃わ申鐃殉わ申鐃緒申鐃緒申
+ RECOMMEND
+ SELECTED ENTRIES
- Solr 鐃緒申鐃暑あ鐃緒申 (12/15)
- LUCENE-6819: Good bye index-time boost (08/25)
- Solr 鐃叔ワ申鵐�ング学緒申鐃緒申鐃塾醐申鐃緒申鐃緒申 (01/21)
- 鐃緒申鐃緒申鐃春レー鐃緒申鐃緒申丱帖鐃緒申鐃� KEA 鐃緒申 Lucene 鐃緒申納鐃緒申鐃緒申鐃緒申鐃� (07/09)
- 鐃緒申鐃旬醐申Wikipedia鐃緒申鐃緒申鐃緒申鐃緒申鐃曙辞鐃緒申亮鐃銃逸申鐃緒申鐃� (06/24)
- Lucene 鐃緒申鐃淳ット誌申鐃緒申動鐃緒申鐃緒申鐃緒申鐃緒申鐃� (01/15)
- Solr鐃緒申箸辰鐃緒申鐃緒申鐃緒申儻鐃緒申鐃緒申 (12/19)
- word2vec for Lucene 鐃緒申鐃述駕申 (12/04)
- 鐃銃ワ申鐃緒申鐃夙ワ申鐃塾テ￥申鐃緒申鐃緒申鐃縦￥申鐃緒申 brat 鐃緒申鐃緒申鐃緒申鐃緒申鐃緒申 (01/30)
- Heliosearch/Solr鐃緒申鐃春ヒ￥申鐃竣フワ申鐃暑タ (01/20)
+ RECENT COMMENTS
- 鐃淑醐申鐃緒申鐃緒申API鐃塾醐申鐃緒申鐃淳器申鐃緒申鐃緒申鐃緒申鐃獣ワ申鐃銃ワ申鐃夙ワ申鐃緒申鐃緒申
鐃緒申 鐃春誌申乃 (12/13) - Solr 鐃緒申鐃暑あ鐃緒申
鐃緒申 鐃殉っつわ申 (05/22) - Solr 鐃緒申鐃暑あ鐃緒申
鐃緒申 鐃舜醐申 (05/22) - Solr 鐃緒申鐃暑あ鐃緒申
鐃緒申 鐃殉っつわ申 (05/22) - Solr 鐃緒申鐃暑あ鐃緒申
鐃緒申 鐃舜醐申 (05/18) - Solr 鐃緒申鐃暑あ鐃緒申
鐃緒申 鐃殉っつわ申 (05/18) - ReverseStringFilter鐃緒申2.9鐃緒申
鐃緒申 kate spade (03/26) - CJKAnalyzer鐃緒申箸辰洞鐃縦管緒申鐃緒申鐃峻わ申
鐃緒申 salomon shoes (03/25) - Solr鐃緒申鐃緒申能鐃緒申鐃縦ッワ申鐃淳醐申鐃緒申鐃夙は￥申
鐃緒申 addidas nmd (03/24) - boost鐃薯ゼワ申鐃祝わ申鐃銃醐申鐃緒申鐃緒申鐃緒申函鐃緒申鐃緒申鐃�
鐃緒申 pandora jewelry (03/24)
+ RECENT TRACKBACK
- 鐃叔フワ申鐃緒申箸鐃�PhraseQuery鐃緒申鐃緒申鐃緒申鐃緒申鐃淑わ申鐃淑っわ申QueryParser鐃緒申鐃緒申鐃春￥申3.1鐃緒申
鐃緒申 FrontRunner (07/30) - Luke - Lucene鐃緒申鐃緒申妊奪鐃緒申鐃緒申屮薀�鐃緒申
鐃緒申 PukiWiki/TrackBack 0.2 (04/20) - 鐃緒申鐃述￥申Apache Solr鐃緒申鐃緒申鐃�
鐃緒申 kazuho鐃塾ワ申鐃緒申屬鐃緒申鐃� (02/22) - 鐃緒申鐃述￥申Apache Solr鐃緒申鐃緒申鐃�
鐃緒申 鐃緒申鐃緒申鐃緒申 (02/22) - 鐃夙種申QueryParser鐃塾削申鐃緒申鐃淑ｏ申鐃緒申
鐃緒申 鐃緒申椶覆鐃淑緒申房 (05/22) - NGramTokenizer鐃緒申EdgeNGramTokenFilter
鐃緒申 techlog (03/29) - 鐃熟わ申鐃緒申討鐃�Lucene鐃緒申文鐃緒申鐃緒申鐃竣ワ申鐃緒申鐃緒申鐃�
鐃緒申 鐃緒申鐃醇開発 (02/25) - Lucene鐃叔ベワ申鐃緒申分鐃緒申鐃�experimental鐃緒申
鐃緒申 鐃緒申鐃処か鐃緒申望鐃緒申平鐃� (10/06) - Lucene鐃緒申Senna鐃緒申鐃緒申咫鐃緒申鐃縦э申豸￥申鐃�
鐃緒申 鐃緒申鐃醇開発 (07/10) - Lucene鐃緒申属鐃叔ワ申了箸鐃緒申鐃緒申塀蘓器申垳鐃緒申鐃緒申鐃�
鐃緒申 nagaShima鐃緒申鐃緒申鐃緒申 (06/27)
+ CATEGORIES
- Google鐃夙削申鐃緒申 (2)
- Hadoop (2)
- Hello, Lucene 鐃緒申鐃緒申鐃緒申垳鐃緒申鐃緒申廛鐃緒申鐃緒申鐃緒申鐃緒申鐃� (5)
- Lucene/Solr鐃緒申鐃淳ワ申縫謄鐃� (10)
- Lucene鐃緒申RIA (3)
- Lucene鐃夙は￥申 (22)
- Lucene鐃緒申鐃緒申妊奪鐃緒申鐃� (10)
- Lucene鐃緒申鐃初ス鐃緒申鐃緒申 (94)
- Lucene鐃緒申鐃緒申鐃緒申鐃緒申鐃� (11)
- Lucene鐃緒申鐃淳ナ￥申 (16)
- Lucene鐃縦￥申鐃緒申 (36)
- Lucene鐃叔ワ申 (5)
- Lucene鐃術フワ申鐃緒申鐃殉ワ申 (16)
- Lucene鐃緒申蝓種申鐃� (26)
- Lucene鐃緒申発鐃縦駈申 (9)
- Lucene鐃緒申由鐃緒申鐃緒申 (27)
- NLP (10)
- Solr (28)
- solr-ruby (3)
- 鐃緒申鐃緒申他鐃緒申分鐃緒申鐃緒申能鐃緒申 (42)
- 鐃緒申鐃緒申他鐃緒申OSS鐃緒申鐃緒申鐃緒申鐃藷ジワ申 (12)
- 鐃緒申鐃緒申鐃駿ワ申 (2)
- 鐃緒申鐃緒申鐃緒申鐃初ー | 鐃緒申鐃旬ッワ申 | 鐃緒申鐃術ワ申鐃緒申鐃緒申 (3)
- 鐃竣ワ申鐃夙わ申鐃緒申鐃術わ申鐃緒申鐃緒申鐃緒申鐃淑わ申Lucene鐃緒申鐃順原則 (5)
- 鐃緒申鐃緒申鐃緒申鐃緒申 (1)
- 鐃緒申劼鐃塾�鐃緒申鐃遵げ (5)
- 鐃緒申劵曄鐃緒申鐃准￥申鐃緒申 (2)
- 鐃緒申鐃緒申鐃舜緒申 (1)
- 鐃緒申鐃緒申鐃叔駕申鐃緒申 (7)
- 鐃緒申鐃述￥申Apache Lucene鐃緒申鐃緒申鐃� (8)
- 鐃緒申鐃述￥申Apache Solr鐃緒申鐃緒申鐃� (4)
- 超鐃順規鐃熟醐申鐃緒申 (1)
- 鐃峻駈申鐃緒申連 (9)
- 鐃術語集 (6)
+ ARCHIVES
- December 2017 (1)
- August 2017 (1)
- January 2017 (1)
- July 2016 (1)
- June 2015 (1)
- January 2015 (1)
- December 2014 (2)
- January 2014 (2)
- September 2013 (1)
- August 2013 (1)
- April 2013 (2)
- December 2012 (1)
- August 2012 (3)
- July 2012 (1)
- June 2012 (1)
- May 2012 (1)
- March 2012 (2)
- February 2012 (2)
- January 2012 (1)
- December 2011 (3)
- November 2011 (1)
- October 2011 (2)
- September 2011 (3)
- August 2011 (1)
- July 2011 (4)
- June 2011 (4)
- May 2011 (4)
- April 2011 (5)
- March 2011 (3)
- February 2011 (1)
- January 2011 (4)
- December 2010 (4)
- November 2010 (6)
- October 2010 (6)
- September 2010 (3)
- August 2010 (3)
- July 2010 (3)
- June 2010 (6)
- May 2010 (4)
- April 2010 (7)
- March 2010 (8)
- February 2010 (7)
- January 2010 (2)
- December 2009 (6)
- November 2009 (10)
- October 2009 (8)
- September 2009 (5)
- August 2009 (6)
- July 2009 (10)
- June 2009 (8)
- May 2009 (6)
- April 2009 (5)
- March 2009 (14)
- February 2009 (3)
- January 2009 (2)
- December 2008 (4)
- November 2008 (9)
- October 2008 (10)
- September 2008 (13)
- August 2008 (9)
- July 2008 (15)
- June 2008 (7)
- May 2008 (9)
- April 2008 (8)
- March 2008 (8)
- February 2008 (12)
- January 2008 (8)
- December 2007 (6)
- November 2007 (10)
- October 2007 (7)
- September 2007 (5)
- August 2007 (3)
- July 2007 (4)
- June 2007 (5)
- May 2007 (3)
- April 2007 (3)
- March 2007 (5)
- February 2007 (6)
- January 2007 (4)
- December 2006 (4)
- November 2006 (6)
- October 2006 (2)
- September 2006 (3)
- August 2006 (2)
- July 2006 (4)
- June 2006 (2)
- May 2006 (5)
- April 2006 (9)
- March 2006 (8)
- February 2006 (22)
+ MOBILE
+ SPONSORED LINKS
