論文解説 Attention Is All You Need (Transformer) - ディープラーニングブãƒã‚°ã“ã‚“ã«ã¡ã¯ Ryobot (りょã¼ã£ã¨) ã§ã™ï¼Ž 本紙㯠RNN ã‚„ CNN を使ã‚ãš Attention ã®ã¿ä½¿ç”¨ã—ãŸãƒ‹ãƒ¥ãƒ¼ãƒ©ãƒ«æ©Ÿæ¢°ç¿»è¨³ Transformer ã‚’æ案ã—ã¦ã„る． ã‚ãšã‹ãªè¨“ç·´ã§åœ§å€’的㪠State-of-the-Art ã‚’é”æˆã—，è¯éº—ã«ã‚¿ã‚¤ãƒˆãƒ«å›žåŽã—ãŸï¼Ž ã¾ãŸæ³¨æ„ã‚’éžå¸¸ã«ã‚·ãƒ³ãƒ—ルãªæ•°å¼ã«ä¸€èˆ¬åŒ–ã—ãŸã†ãˆã§ï¼ŒåŠ 法注æ„・内ç©æ³¨æ„・ソースターゲット注æ„・自己注æ„ã«åˆ†é¡žã—ãŸï¼Žã“ã®ã†ã¡è‡ªå·±æ³¨æ„ã¯ã‹ãªã‚Šæ±Žç”¨çš„ã‹ã¤å¼·åŠ›ãªæ‰‹æ³•ã§ã‚ã‚Šä»–ã®ã‚らゆるニューラルãƒãƒƒãƒˆã«è»¢ç”¨ã§ãる． WMT'14 ã® BLEU スコアã¯è‹±ä»: 41.0, 英独: 28.4 ã§ç¬¬ 1 ä½ Attention Is All You Need [Åukasz Kaiser et al., arXiv, 2017/06] Transformer: A Novel Neural Network Architecture f
http://cl.naist.jp/~kevinduh/papers/han12chinese.pdf
Syntactic Based Reordering Rules for Chinese-to-Japanese Machine Translation
https://dlgateway.acm.org/delivery.cfm?urlpath=10.1145/1870000/1868886/p244-isozaki.pdf?ip=113.35.183.247&id=1868886&acc=OPEN&key=4D4702B0C3E38B35.4D4702B0C3E38B35.4D4702B0C3E38B35.6D218144511F3437&__acm__=1541272341_85ba2b21dd090047a75ceea0d86ab437
統計的機械翻訳ã«ãŠã‘ã‚‹RIBESã«ã‚ˆã‚‹æœ€é©åŒ–ã®åŠ¹æžœ
目的言語ã®æ§‹æ–‡è§£æžå™¨ã‚’用ã„ãŸæ©Ÿæ¢°ç¿»è¨³ã®ãƒ—レオーダリング
目的言語ã®æ§‹æ–‡è§£æžå™¨ã‚’用ã„ãŸæ©Ÿæ¢°ç¿»è¨³ã®ãƒ—レオーダリング
http://www.mibel.cs.tsukuba.ac.jp/~tei/FIT2014.pdf
http://www.phontron.com/paper/hatakoshi14nl07.pdf
æƒ…å ±å¦åºƒå ´ï¼šæƒ…å ±å‡¦ç†å¦ä¼šé›»å図書館
Microsoft Word - pantel_web_v2.docx
Sequence to Sequence Learning with Neural Networks
{{#tags}}- {{label}}
{{/tags}}