å æ¥ææã§ã調æ´å¤æ°ã®é¸ã³æ¹ãã¨ãããã¼ãã§è©±ãããæ©ä¼ãããã ãã¾ããã ãã£ãããªã®ã§ä½ã£ãè³æãå ¬éãã¾ãã å帰åæãããã¨ãã«ãªã«ã調æ´ããããããããããªãã»ã»ã» é å¼µã£ã¦èª¿æ´ãã¦ãçµå±æªæ¸¬å®äº¤çµ¡ãããããçµå±å®é¨ãããªãã¨ã»ã»ã» ã¿ãããªäººã«ãªã¹ã¹ã¡ã ã¨æãã¾ãã åºæ¬çã«ã¯ææ¸ããããã°è¨äºã®å 容ã«æ²¿ã£ã¦ãã¾ãããããããå°ãã¢ãããã¼ããã¦æè¿ã®è©±é¡ãªã©ã«ã触ãã¦ãã¾ãã çè«çã«ãæ£ãããé¸ææ¹æ³ã¨ããããã¯ãã©ã¡ããã¨ããã°å¶ç´ããããªãã§ã®å®è·µçãªå¤æ°é¸æã®è½ã¨ãæã¨ãã£ãã¤ã¡ã¼ã¸ã§ããããã ãåèã¾ã§ã«ï¼ ã¡ãªã¿ã«ãã»ãã«ãè¬æ¼è³æãå ¬éãã¦ããã¾ãã åããã¦èªãã§ã¿ã¦ãã ããã
ãã¼ã¿ãµã¤ã¨ã³ã¹ ãã¤ãã«3é¨å®çµãæ©æ¢°å¦ç¿è¶ å ¥éè¬åº§ã®æ¬çªç·¨ãå ¬éãã¾ãã!! 2023.03.08 ãã@ç±³å½ãã¼ã¿ãµã¤ã¨ã³ãã£ã¹ã ããã«ã¡ã¯ï¼ç±³å½ãã¼ã¿ãµã¤ã¨ã³ãã£ã¹ãã®ãã(@usdatascientist)ã§ãï¼ ã¤ãã«ï¼æ©æ¢°å¦ç¿è¶ å ¥éã®æ¬çªç·¨ãå ¬éã3é¨ä½ãå®çµãã¾ããï¼ï¼ï¼ãã¡ãã¯ï¼åå¾ç·¨ã®å¾ç¶ã®è¬åº§ã¨ãªãã¾ãï¼ æ¬çªç·¨ã¯ï¼å®éã®æ¥åçã§æ©â¦
å ¨æ¥æ¬ç©ºè¼¸ï¼ANAï¼ãã·ã¹ãã éçºããã¼ã¿åæãã§ããIT人æã®ãå 製ããæ¤è¨ãå§ããã®ã¯ãæ°åã³ããã¦ã¤ã«ã¹ç¦ãåºã¾ãç´åã®2020å¹´åé ã®ãã¨ã ãå社ã¯ãã以åãããæ 客ãµã¼ãã¹ãæ´åãªã©ãITã§é«åº¦åãã¹ãæè³ãé²ãã¦ããã IT人æãä¸éæ¡ç¨ã§ååã«éã¾ããªã ä¾ãã°ANAã®èªç©ºä¾¿ãå©ç¨ããä¹å®¢ã¨ANAã¨ã®æ¥ç¹ã¯1ã¤ã§ã¯ãªããWebãµã¤ããã³ã¼ã«ã»ã³ã¿ã¼ã§èªç©ºå¸ãäºç´ããã¨ããããå§ã¾ãããã§ãã¯ã¤ã³ã«ã¦ã³ã¿ã¼ãã©ã¦ã³ã¸ãæä¹å£ãæ©å ãªã©ã¨ã1人ã®ä¹å®¢ã«åãåãANAã°ã«ã¼ãã®ã¹ã¿ããã¯å ´é¢ãã¨ã«å ¥ãæ¿ããã ã«ã¹ã¿ãã¼ã¸ã£ã¼ãã¼ï¼é¡§å®¢ãæç³»åã«ãã©ãããã»ã¹ï¼ã«æ²¿ã£ã¦ãããããã®ã¹ã¿ãããä¹å®¢ã®æ å ±ãã·ã¹ãã ã§å ±æã§ããã°ãä¾ãã°ãââæ§ãè¡ãã®ä¾¿ã§ã¯åºçºãé ãã¾ãã¦ç³ã訳ããã¾ããã§ããããæ¬æ¥ã¯ãå«ããã®èªçæ¥ã®ãç¥ãã§ãåºãããããã®ã§ããããã¦ããªãæ è¡ã«ãªãã¾ãããã«ã
Kentaro Ebisawa @ebiken æ±äº¬é»åYouTubeãé»æ°ã®åçãã·ãªã¼ãºãç¥ã³ã³ãã³ãã§å¿ è¦ "æ°åã³ããã¦ã£ã«ã¹ææçæ¡å¤§ãåãã¦ããèªå® çã§é»æ°ã«ã¤ãã¦å¦ç¿ããã¦ããæ¹ã åãã«ãçºé»æã»å¤é»æçã«è¨ç½®ããã¦ããé»åæ©å¨ãé»åãããã¯ã¼ã¯ãé»æ°ã®åºç¤ã»åçã«ã¤ãã¦è©³ãã解説ããæ åããç´¹ä»" youtube.com/playlist?list=⦠pic.twitter.com/WJJ7wVkSAO ãªã³ã¯ YouTube æ å解説ãé»æ°ã®åçã æ°åã³ããã¦ã£ã«ã¹ææçæ¡å¤§ãåãã¦ããèªå® çã§é»æ°ã«ã¤ãã¦å¦ç¿ããã¦ããæ¹ã åãã«ãçºé»æã»å¤é»æçã«è¨ç½®ããã¦ããé»åæ©å¨ãé»åãããã¯ã¼ã¯ãé»æ°ã®åºç¤ã»åçã«ã¤ãã¦è©³ãã解説ããæ åããç´¹ä»ãã¾ãã ï¼2001å¹´ã2007å¹´ å¶ä½ï¼ 91
ç»åã¯ãç·åççµ±è¨å±ã社ä¼äººã®ããã®ãã¼ã¿ãµã¤ã¨ã³ã¹æ¼ç¿ãè¬åº§PVããã ç·åçã¯9æ28æ¥ã®14æãããå®è·µçãªãã¼ã¿åæã®ææ³ãå¦ç¿ã§ããã¨ãããããã¼ã¿ãµã¤ã¨ã³ã¹ã»ãªã³ã©ã¤ã³è¬åº§ã社ä¼äººã®ããã®ãã¼ã¿ãµã¤ã¨ã³ã¹æ¼ç¿ããéè¬ãããç»é²æããã³åè¬æã¯ç¡æã æ¬è¬åº§ã§ã¯ããã¸ãã¹ãè¡æ¿ã§ã®æ´»ç¨ãæ³å®ãã¦ããã社ä¼äººã大å¦çã«åãã¦ããã¸ãã¹ãæ¥åä¸ã§ã®åæäºä¾ãä¸å¿ã«å®è·µçãªãã¼ã¿åæï¼çµ±è¨åæï¼ã®ææ³ããããããã解説ããã¨ãããåææ¡ä»¶ã¯è¡¨è¨ç®ã½ããMicrosoft Excelã®åºæ¬çãªæä½ãã§ãããã¨ã ãç·åççµ±è¨å±ã社ä¼äººã®ããã®ãã¼ã¿ãµã¤ã¨ã³ã¹æ¼ç¿ãè¬åº§PVããã è¬å¸«ã¯ãç·åççµ±è¨å±ã®æç°é 人æ°ãç·åççµ±è¨å±ã®é¿åæ³°äºéæ°ãæ ªå¼ä¼ç¤¾é»éã®ä½ä¼¯è«æ°ãæ±äº¬å¤§å¦ã®æ¾å°¾è±æ°ãæ ªå¼ä¼ç¤¾ãã¬ã¤ã³ãããã®å¥¥åæå®æ°ãæ ªå¼ä¼ç¤¾ãã¬ã¤ã³ãããã®ä»æ´¥ç¾©å æ°ãæ¥æ¬èªç©ºæ ªå¼ä¼ç¤¾ã®æ¸è°·ç´æ£æ°ãæ ªå¼
æ±äº¬å¤§å¦ãã¡ãã£ã¨ã³ã£ãããããããã®è¶ è¯è³ªãªææãç¡æå ¬éãã¦ããã®ã§ãã¾ã¨ãã¾ãã Pythonå ¥éè¬åº§ æ±å¤§ã®Pythonå ¥éãç¡æå ¬éããã¦ãã¾ããscikit-learnã¨ãã£ãæ©æ¢°å¦ç¿é¢é£ã«ã¤ãã¦ã説æããã¦ãã¾ãããã³ãããã§ã Pythonããã°ã©ãã³ã°å ¥é æ±äº¬å¤§å¦ æ°çã»æ å ±æè²ç 究ã»ã³ã¿ã¼: utokyo-ipp.github.io æ±å¤§ã®Pythonæ¬ãé常ã«ãªã¹ã¹ã¡ã§ã Pythonã«ããããã°ã©ãã³ã°å ¥éãæ±äº¬å¤§å¦æé¤å¦é¨ããã¹ã: ã¢ã«ã´ãªãºã ã¨æ å ±ç§å¦ã®åºç¤ãå¦ã¶ https://amzn.to/2oSw4ws Pythonããã°ã©ãã³ã°å ¥é - æ±äº¬å¤§å¦ æ°çã»æ å ±æè²ç 究ã»ã³ã¿ã¼ Google Colabã§å¦ç¿åºæ¥ãããã«ãªã£ã¦ãã¾ããç·´ç¿åé¡ãè±å¯ã§ã https://colab.research.google.com/github/utokyo-ip
ã¢ã¡ãªã«ã®ãã¼ã¿ãµã¤ã¨ã³ãã£ã¹ããæ¸ããããã¼ã¿åæã®ããã®çµ±è¨å¦å ¥éãã®æ¥æ¬èªè¨³ãã訳è ã§ããæ±å¤§ã®å½åå çã®ãã¼ã ãã¼ã¸ã§ç¡æå ¬éããã¦ãã¾ãã å ¨418ãã¼ã¸ããã¹ã¦ç¡æã§ããæ®éã«ææã®æ¸ç±ãªãã§ãããçµ±è¨ã®åºç¤åå¼·ã¯ã⦠https://t.co/8egqMi2NJU
OpenAIã¯GPT-3ã®æ¬¡ã®ç 究ãå§ãã¦ãã¾ãï¼ ä¸éãGPT-3ã®ãã¢ã«æ¹§ãä¸ããä¸ï¼OpenAIã¯Scaling Lawã«é¢ãã2æ¬ã®è«æãã²ã£ããã¨å ¬éãã¾ããï¼ Scaling Lawãä¸è¨ã§èª¬æãããªããTransformerã®æ§è½ã¯ãã£ã3ã¤ã®å¤æ°ã®ã¹ãä¹åã«æ¯é ããã¦ãããã¨ãããã®ã§ãï¼ Scaling Lawã¯ããåä½ã ããªãèå³æ·±ã話ã§çµããããããã¾ããï¼å®éã«è±èªåã§ããã¾ã話é¡ã«ããã£ã¦ãã¾ããï¼ãããï¼ãã®æ³åã®æ¬å½ã®åãã«æ°ã¥ãã¦ããç 究è ããã¦ï¼ãªã話é¡ã«ãªããªãã®ãå°æãã¦ãã¾ãï¼ I am curious why people are not talking more about the OpenAI scaling law papers. For me, they seem very significant. What I heard so far:
ãµãã¨ã³ã¹ã®çæ è¦³å¯ @Sapiensism ããºãã¼ã®æ¬²æ±ãã©ãããããã±ã³ãªãã¯ã®æ¬²æ±ãã©ããã (D.Kenrick 2010) ã¸ãçç©å¦ç観ç¹ã«æ¬ ãéç§å¦çã ã£ãããºãã¼ã®çè«ãå»ãã¦ãé²åå¿çå¦è ã¯çç©å¦çã»äººé¡å¦ç証æ ã«åºã¥ãæ°ãã人éã®æ¬²æ±é層çè«ãæ示ããã欧米ã®ãã¼ã±ã¿ã¼çéã§ã¯ãã§ã«ãã£ã¡ã®ãã©ãããã常èåãã¤ã¤ããã pic.twitter.com/c6piUQLe2P ãµãã¨ã³ã¹ã®çæ è¦³å¯ @Sapiensism æ¿èªæ¬²æ±ãèªå·±å®ç¾æ¬²æ±ã¨ãã£ãããºãã¼ãææ¡ãã解å度ã®ä½ãæ¦å¿µã¯åé¤ããã¦ãã¾ããæ¿èªãèªå·±å®ç¾ã¯ããã¨ããçç©ã«ã¨ã£ã¦ç®çã§ãªãæ段ã人é¡ã®æ¬²æ±ã¡ã«ããºã ãå å²æ代ã«é²åããä¸ã§ãæ¿èªãèªå·±å®ç¾ã¯æ§ã ãªçç©å¦ç価å¤ãããããã¾ããã人éãã究極çã«ãæ±ãã¦ããã®ã¯ãã£ã¡ã§ãã ãµãã¨ã³ã¹ã®çæ è¦³å¯ @Sapiensism ããã¯ããã§ã«å¿çå¦ã®ä¸ç
ç»åã¯ãæ»è³å¤§å¦ã大å¦çã®ããã®ãã¼ã¿ãµã¤ã¨ã³ã¹ï¼â ¡ï¼ãè¬åº§PVï½ gaccoï¼ç¡æã§å¦ã¹ã大å¦è¬åº§ããã ãªã³ã©ã¤ã³è¬åº§ãµã¤ããgaccoï¼ã¬ãã³ï¼ãã§ã¯11æ16æ¥ãããæ»è³å¤§å¦ãã¼ã¿ãµã¤ã¨ã³ã¹å¦é¨ã«ããããªãã¹ãæ°å¼ã使ããªããã¨ããæ¹éã§æ§æããã大å¦çã®ããã®ãã¼ã¿ãµã¤ã¨ã³ã¹ï¼â ¡ï¼ããéè¬ããããåè¬æã¯ç¡æã æ¬è¬åº§ã§ã¯ãæ©æ¢°å¦ç¿ã®è«¸ææ³ã¨ãã®å¿ç¨ã«ã¤ãã¦èª¬æãããã¾ããæ©æ¢°å¦ç¿ã¨ã¯ä½ãï¼ãã¨ãã説æããå§ãããã®å¾ã«æ©æ¢°å¦ç¿ã®å¿ç¨äºä¾ãç´¹ä»ãå¿ç¨äºä¾ãå ã«è¦ããã¨ã«ãã£ã¦ãæ©æ¢°å¦ç¿ã®æç¨æ§ãç解ã§ããæ©æ¢°å¦ç¿ã®ææ³ãããç©æ¥µçã«å¦ã¹ãã¨ãã¦ããã 次ã«ãåé¡åé¡ã¨å帰åé¡ã®å ·ä½çãªææ³ã説æããåæã«ç¹å¾´éã®è¨è¨ã»é¸æãªã©ãå®è·µçãªãã¯ããã¯ã«ã¤ãã¦ãç´¹ä»ãããæå¾ã«ãè¿å¹´ãçºå±ã®èãããã¥ã¼ã©ã«ãããã¯ã¼ã¯ã«ã¤ãã¦ã説æãã¦ããããã¾ããæ¬è¬åº§ã¯ãæ©æ¢°å¦ç¿ã®åéã®ãªãã§ãæ
ããã¼ã¿ãµã¤ã¨ã³ãã£ã¹ãã¨åä¹ãã®ã¯åãã¾ããã¨ããããèªåã¯ãããå¤ãå¤ã§ããããåãåºããå°é寺å樹ããã¯ç¾å¨ãï¼¤ï½ ï¼®ï¼¡ã®ï¼¡ï¼©æ¬é¨ãã¼ã¿ãµã¤ã¨ã³ã¹ç¬¬ä¸ã°ã«ã¼ãã«æå±ãã¦ããã 確ãã«ãã¼ã¿ãµã¤ã¨ã³ãã£ã¹ãã«ã¯æ°å¦ãç©çå¦ã®ä¿®å£«ãå士ã¨ãã£ãçç³»ã®ããã¯ã°ã©ã¦ã³ããæãã人ãå¤ãä¸ãå°é寺ããã¯çµæ¸å¦é¨åºèº«ã§æ°å¦ã®ç¥èããäºæ¬¡é¢æ°ã®é ç¹ããããããããã ã¨ããã ãããªå°é寺ããã ãKaggle Grandmasterï¼ã«ã°ã« ã°ã©ã³ããã¹ã¿ã¼ï¼ã¨ãã称å·ãæã£ã¦ãããä¸çã§ã¯163人ãæ¥æ¬ã§ã¯10人ç¨åº¦ããããªãï¼2019å¹´11æç¾å¨ï¼ã ãè£è¶³èª¬æãKaggleï¼ã«ã°ã«ï¼ã¨ã¯ããã¼ã¿ãµã¤ã¨ã³ãã£ã¹ããæ©æ¢°å¦ç¿ã¨ã³ã¸ãã¢ãéã¾ãä¸çæ大ã®ã³ãã¥ããã£ã大ããªç¹å¾´ã¯ã誰ã§ãåå å¯è½ãªã³ã³ããã£ã·ã§ã³ããããã¨ã ãä¸çä¸ã®ä¼æ¥ãç 究æ©é¢ãªã©ãæä¾ããããã°ãã¼ã¿ã¨èª²é¡ã«å¯¾ããã¢ãã«ã®ç²¾åº¦ã
è³ã®ä¸ã®é»æ°ä¿¡å·ãèªã¿åãã話ããã¨ã°ã«å¤æãããã¨ã«ã¢ã¡ãªã«ã®ç 究ã°ã«ã¼ããæåããè³ã®é害ãªã©ã«ãã£ã¦ãã¨ã°ãåºãªã人ã¨ã®ã¹ã ã¼ãºãªææã®çéã«ã¤ãªããæè¡ã¨ãã¦æ³¨ç®ããã¦ãã¾ãã ç 究ã°ã«ã¼ãã¯ãè³å ã§åºãããé»æ°ä¿¡å·ãæ¤ç¥ããè£ ç½®ã人ã«åãä»ããæ°ç¾ã®æç« ã声ã«åºãã¦èªãã§ããããã¨ã§ã声ã«åºãéã«åãèããããã®ã©ãåããã®ã«ã©ã®ãããªä¿¡å·ãé¢ãã£ã¦ããããAIï¼äººå·¥ç¥è½ã使ã£ã¦è©³ãã解æãã¾ããã ããã¦ãã®è§£æãåºã«è³å ã®ä¿¡å·ã解èªãã¦é³å£°ã«å¤æããã³ã³ãã¥ã¼ã¿ã¼ã®ã·ã¹ãã ãä½ã試ããã¨ãããè³å ã®ä¿¡å·ãåºã«100ä½ãã®æç« ãé³å£°ã«ãããã¨ãã§ããã¨ãããã¨ã§ãã æç« ã«ãã£ã¦ã¯ã»ã¨ãã©ã®äººãæ£ç¢ºã«èãåããã¨ãããã¨ã§ãç 究ã°ã«ã¼ãã¯ãè³ã®ä¿¡å·ãèªã¿åã£ã¦æç« ãé³å£°ã«å¤æãããã¨ãã§ããã®ã¯åãã¦ã ã¨ãã¦ãã¾ãã ç 究ã°ã«ã¼ãã¯ãç¾æç¹ã§ã¯éãããæç« ããé³å£°ã«ã§ãã¦ããã
ã©ã³ãã³ã°
ã©ã³ãã³ã°
ãç¥ãã
ãªãªã¼ã¹ãé害æ å ±ãªã©ã®ãµã¼ãã¹ã®ãç¥ãã
ææ°ã®äººæ°ã¨ã³ããªã¼ã®é ä¿¡
å¦çãå®è¡ä¸ã§ã
j次ã®ããã¯ãã¼ã¯
kåã®ããã¯ãã¼ã¯
lãã¨ã§èªã
eã³ã¡ã³ãä¸è¦§ãéã
oãã¼ã¸ãéã
{{#tags}}- {{label}}
{{/tags}}