2017å¹´ã«Googleã®ç 究è ãçºè¡¨ããæ©æ¢°å¦ç¿ã¢ã¼ããã¯ãã£ãTransformerãã¯ãGPT-4ãLlamaã¨ãã£ã大è¦æ¨¡è¨èªã¢ãã«ã®æ§ç¯ã«éè¦ãªå½¹å²ãæããã¦ãã¾ãããããªTransformerã使ãããã¦ã¼ã¶ã¼ã®è¡åã«åºã¥ããããé«ç²¾åº¦ãªé³æ¥½ã®ã¬ã³ã¡ã³ãã·ã¹ãã ããæ§ç¯ã§ããã¨Googleãè¿°ã¹ã¦ãã¾ãã Transformers in music recommendation https://research.google/blog/transformers-in-music-recommendation/ Transformerã¯ãTokenization(ãã¼ã¯ã³å)ããEmbedding(åãè¾¼ã¿)ããPositional encoding(ä½ç½®ã¨ã³ã³ã¼ãã£ã³ã°)ããTransformer block(Transformerãããã¯)ããSoftmax(ã½ããããã¯ã¹)
{{#tags}}- {{label}}
{{/tags}}