gpt2-japaneseã®mediumã¢ãã«ã§æ¶ç©ºã®NAISTçãDé²ããã¦Dé²å¾ã®ç¶æ³ãç¬ç½ãã¦ããã
ããã«ã¡ã¯ãåå·ã§ãã
æè¿ä»äºã§GPT-2,3ã«ã¤ãã¦èª¿ã¹ã¦ãã®ã§ãããæ¥æ¬èªGPT-2ãä½ã£ã¦ããããã¸ã§ã¯ãã®ãã¨ãç¥ãã¾ããã
è¦ã¦ã¿ãã¨å¦ç¿æ¸ã¿ã¢ãã«(small, medium)ãå
¬éæ¸ã¿ã§ãfine-tuningç¨ã®ã³ã¼ããªã©ãæã£ã¦ãããããæåãã¾ããã
æ¬è¨äºã¯çæçµæããã²ã¿ã¦ã¿ããã¨ãããã¨ã§è©¦ãã¦ã¿ãã¨ããè¶£æ¨ã®è¨äºã«ãªãã¾ãã
ä½¿ãæ¹ã¯ä¸è¨ãªãã¸ããªã®READMEãèªãã§ããã ããã°è¯ããã¨æãã¾ãã
contextããªãã·ã§ã³ã§æå®ãããã¨ã§ãcontextã«æ²¿ã£ãçæãå¯è½ã¨ã®ãã¨ããªãã»ã©ããªãã°æ¶ç©ºã®NAISTçãDé²ããã¦Dé²å¾ã®ç¶æ³ãç¬ç½ãã¦ããããã¨ãå¯è½ã»ã»ã»ï¼
æ©é試ãã¦ã¿ãï¼ãã®çµæã¯ãã£ã¯ã·ã§ã³ã§ãï¼
python gpt2-generate.py \ --model gpt2ja-medium \ --num_generate 20 \ --context="ç§ã¯å¥è¯å 端ç§å¦æè¡å¤§å¦é¢å¤§å¦ã®åå£«å¾æèª²ç¨ã«é²å¦ãã¦ããã¨ãããã®ã"
GPT-2ã®çæçµæã§ããããæ±ãããå«ã ãªã¨ããè¯å¿ã®åµè²¬ãåºãã®ã§ãçµæããã¡ãã«ç½®ãã¾ããã
20åã®æ¶ç©ºã®NAISTçã«ããå³ããæ·±ãDé²ãçé
¸ã£ã±ãDé²ãéã®Dé²ãè²ã
ãªDé²ããæ¥½ãã¿ãã ããã