ãAmazon Forecastããæ£å¼ãªãªã¼ã¹ãéå»ã®æç³»åãã¼ã¿ãä¸ããã ãã§æ©æ¢°å¦ç¿ã«ããäºæ¸¬ããã¦ããããå°éç¥èä¸è¦ã®ãµã¼ãã¹ Amazon Forecastã¯ããªãããã®æç³»åãã¼ã¿ããã³ãã®æç³»åãã¼ã¿ã«å½±é¿ãä¸ããã§ãããå¨è¾ºæ å ±ãä¾ãã°ããåºèã®å£²ãä¸ãã®æç³»åãã¼ã¿ããã³ããã®åºèã®å ´æã®å¤©åãæ°æ¸©ã交ééãææ¥ãç¥ç¥æ¥ãªã©å£²ãä¸ãã«å½±é¿ããã¨æãããå¨è¾ºæ å ±ãä¸ããã¨ãäºæ¸¬ã«å¿ è¦ãªæ©æ¢°å¦ç¿ã¢ãã«ã®æ§ç¯ãã¢ã«ã´ãªãºã ã®é¸å®ãã¢ãã«ã®æ£ç¢ºæ§ã®æ¤è¨¼ãæ¹åãªã©ãå ¨ã¦èªåã§å®è¡ãã売ãä¸ãã«é¢ããäºæ¸¬ã®ãã¼ã¿ãåºåãã¦ãããã¨ãããµã¼ãã¹ã§ãã ä¸è¬ã«ãæ©æ¢°å¦ç¿ãæ´»ç¨ããã«ã¯ãå¦ç¿ç¨ã®ãã¼ã¿ã¨æ¤è¨¼ç¨ã®ãã¼ã¿ãç¨æããå¦ç¿ç¨ã®ãã¼ã¿ããæ±ããããäºæ¸¬çµæãæ¤è¨¼ç¨ãã¼ã¿ã§æ¤è¨¼ãã¦æ£ç¢ºæ§ãè©ä¾¡ããããé©åãªã¢ãã«ãã¢ã«ã´ãªãºã ãé¸æãããã¨ãã£ãä½æ¥ãçºçãã¾ãã Amazon Fo
é±æ«Kagglerã¨ãã¦avazuã®CTRäºæ¸¬ã³ã³ãã«åå ãã¾ãããKaggleã¯æ©æ¢°å¦ç¿çã®ISUCONã ã¨æã£ã¦ãããã°ããã§ããã³ã³ãèªä½ã¯çµãã£ã¦ããã®ã§ãlate submiteã§ãã¾ãæå³ã¯ãªãããããã¾ãããç·´ç¿ã§ããleaderboardä¸ã§ä¸ä½10%以å ã«è¡ããã®ã§ãããã¾ã§ã®è©¦è¡é¯èª¤ãã¡ã¢ãã¦ããã¾ããè¬ãã¦ãã¦(?)ãæã£ã¦ããã¬ãå¢ãããªãã¨ä¸ä½ã«è¡ããªããã®ãã¨æã£ã¦ãã¾ããããåºæ¬ã«å¿ å®ã«ããã°ãããããã®é ä½(ä¸ä½7.6%)ã«è¡ãã¾ããããä»ã®äººã®å·¥å¤«ãå£éè¦ããã¨ããæå³ã§ãç¾å ´ã®æ©æ¢°å¦ç¿ããå§ããã¨ã³ã¸ãã¢ã«ãè¦ãã§ãããã§ããã åå ã®åæ© ç®æ¨æ: é å¼µããããã«ä¸ä½10%以å ã«å ¥ã 試è¡é¯èª¤ Athenaã¨Redashã«ããæ¢ç´¢çãã¼ã¿è§£æ ãã³ããã¼ã¯ãã¾ãè¶ ãã ç·å½¢åé¡å¨ã§ã·ã³ãã«ãªç¹å¾´é æç³»åè¦ç´ ãå¿ãã¦ãã¦éå¦ç¿çºç ç¹å¾´éã¨ã³ã¸ãã¢ãªã³
æ©æ¢°å¦ç¿ããããããã ãã©ããã¼ã¿ããªãï¼ä»ã®ãã¼ã¿ä½¿ã£ã¦ã¿ããï¼ ãããªæ¹ã®ããã«ãæ©æ¢°å¦ç¿ã«ä½¿ãããªã¼ãã³ãã¼ã¿ãéãã¾ããã ä»ã«ãããã®ãã¼ã¿ã»ãããªã¹ã¹ã¡ï¼ã¨ãããã®ãããã°ãæ¯éãç´¹ä»ãã¦é ããã¨å¬ããã§ããm(__)m UC Irvine Machine Learning Repository ã«ãªãã©ã«ãã¢å¤§å¦ã¢ã¼ãã¤ã³æ ¡ãå ¬éããããã¼ã¿ã»ããã351件ã®ãã¼ã¿ã»ãããããå¾è¿°ãã DATA GO ã«æ¯ã¹ãã°å°ãªãããã»ã¨ãã©ãMachine Learningç¨ã®ãã¼ã¿ã»ã»ãããªã®ã§ãããªããªã¹ã¹ã¡ã UCI Machine Learning Repository ãã®æåãªãããã®è±ï¼irisï¼ã®ãã¼ã¿ã»ãããããããè¦ããã¨ãã§ãã¾ãã å½ç«æ å ±å¦ç 究æ æ å ±å¦ç 究ãã¼ã¿ãªãã¸ã㪠ãã¼ã¿ã»ããä¸è¦§ yahoo,楽天,ãã³ãã³ãªã©ã®ãã¼ã¿ãããã¾ãã DATA.GO.
大éã®ããã¸ã§ã¯ããé²è¡ãããã¼ã¯ã¼ã¯ã¹ããå¹´ã 試è¡é¯èª¤ããªãããã©ãçããããã¡ã¤ã«ï¼ãã©ã«ã管çææ³ããç´¹ä»ãã¾ãã ããã«ã¡ã¯ããã©ã³ãã¼ã®å·æã§ãã ä»æ¥ã¯ãPCã使ã£ã¦ä»äºãããæ¹ã®å¤ããæ©ã¾ãããã§ããããã¡ã¤ã«ããã©ã«ãã®ç®¡çã«ã¤ãã¦ããã¼ã¯ã¼ã¯ã¹ã試è¡é¯èª¤ã®æ«ã«ãã©ãçãã管çæ³ããç´¹ä»ãã¾ãï¼ ããããå¶ä½ã®ç¾å ´ã§ã¯ãä¼ç»æ¸ããµã¤ãããããPSDãã¼ã¿ãhtmlãã¼ã¿ãªã©ããã¾ãã¾ãªææç©ã»ä¸éææç©ãæ±ãã¾ãããã®ä¸ãããããã®ãã¡ã¤ã«ã«ã¤ãã¦ãå¤æ´ã»ä¿®æ£ã®åæ°åã ããã¼ã¸ã§ã³éãã®ãã¡ã¤ã«ãå¢ãã¦ããâ¦ã¨ãªãã¨ããã¡ã¤ã«ããã©ã«ãã®ç®¡çã¯ãå°å³ãªãããå®ã¯ã¨ã¦ãéè¦ãªããã·ã§ã³ãªã®ã§ãã ç¹ã«ãå¶ä½ããªã¥ã¼ã ã®å¤ã大è¦æ¨¡æ¡ä»¶ããå¤äººæ°ãé¢ããããã¸ã§ã¯ãã®å ´åããã¡ã¤ã«ããã©ã«ãã®ä¸èº«ãã¡ã³ãã¼å士ã§æ£ããå ±æã§ãã¦ãããã©ããã¯ãå質ãä½æ¥å¹çã«ã大ãã«å½±é¿ãã¾ãã
ããã¸ã§ã¯ããéå§ããåã«ãå¸å ´èª¿æ»ãªã©ã§çµ±è¨ãã¼ã¿ãåæã仮説ããã¦ãäºã¯éè¦ã§ããããããã®èª¿æ»å¯¾è±¡ãä¸çè¦æ¨¡ãå ¨å½è¦æ¨¡ã«ãªãã¨ã³ã¹ããæããããã¦ï¼ç¹ã«å人ãä¸å°ä¼æ¥ã®å ´åï¼ç¾å®çã§ã¯ããã¾ããã ããã§æ´»ç¨ãããã®ãå½ãå£ä½ãæ°éä¼æ¥ãå ¬éãã¦ããç¡æã®çµ±è¨ãã¼ã¿ã§ããä»æ¥ã¯ãããªãã¼ã±ãã£ã³ã°æ å½è ãªããã£ã¨å¿ è¦ã®æ å ±å ¬éãè¡ãªã£ã¦ãããµã¤ãããç´¹ä»ãã¾ãã 1. ç·åççµ±è¨å± ç·åççµ±è¨å±ã§ã¯æ§ã ãªçµ±è¨ãã¼ã¿ãå ¥æå¯è½ã§ãã å½ç¨èª¿æ» 人å£æ¨è¨ å´ååèª¿æ» å°å£²ç©ä¾¡çµ±è¨èª¿æ» åå°çµ±è¨èª¿æ» ãã®ãããªãã¼ã¿ã¯PDFçãä¸è¬çã§ããExcelå½¢å¼ã§ãã¦ã³ãã¼ãã§ããã®ãé åã§ããããã®ä»ã«ã以ä¸URLããæ°å¤ãã®çµ±è¨ãã¼ã¿ãå ¥æã§ãã¾ãã ã¾ããçµ±è¨å±ã§ã¯ã¡ã¼ã«é ä¿¡ãµã¼ãã¹ãè¡ãªã£ã¦ãã¾ããèå³ã®ããæ¹ã¯ç»é²ããããããã¾ãã www.stat.go.jp 2. æ³åç æ³åçã§ã
ã¯ããã« RSpecã使ã£ã¦ãã¹ããè¨è¿°ãã¦ããéããã¹ãã®å®è¡åã«ãã¼ã¿ããã¼ãã«ã«ç»é²ãã¦ããããã±ã¼ã¹ãå¤ã ãããã¨æãã¾ããRSpecå ã§ActiveRecordã使ã£ã¦ãã¼ã¿ãç»é²ãããã¨ãã§ãã¾ãããè¤æ°ã®ãã¹ãã±ã¼ã¹ã§åããã¼ã¿ã使ãããå ´åããã¼ã¿ã®å®ç¾©ã¯ä¸ç®æã§è¡ãããã¨ããã§ãã ãã®æ§ãªå ´åãFactory Girlã使ç¨ããã¨ãä¸ç®æã§ãã¹ããã¼ã¿ãå®ç¾©ã§ãã¾ããä»åã¯ãã®FactoryGirlã®ä½¿ãæ¹ã«ã¤ãã¦æ¸ãããã¨æãã¾ãã 使ãæ¹ ä½¿ãæ¹ã®å¤§ã¾ããªæµãã¨ãã¦ã¯ã FactoryGirlã使ç¨ã§ããããã«ãã å®ç¾©ãã¡ã¤ã«ã«ãã¼ã¿ãå®ç¾©ãã å¿ è¦ã¨ãããã¹ãã±ã¼ã¹ã«ã¦ãã¡ã¤ã«ãèªã¿è¾¼ã¿ããã¼ã¿ãé©æå å·¥ãã¦ç»é²ãã ã¨ããæãã¨ãªãã¾ããå°ããã®å®ç¾©ãããã¼ã¿ããFactoryãã¨ãè¨ãã¾ãã以ä¸ãæé ã§ãã 1.Gemfile Gemfileã«ä»¥ä¸ãè¨è¿°ãã
å人éçºè ã®ç¢éãã¨ãããã¯6æ12æ¥ã10æ¥ã«å ¬éãããã次ä¸ä»£çµ±è¨å©ç¨ã·ã¹ãã ãã®APIãæ´»ç¨ããå½å¢èª¿æ»ãªã©ã®æ¿åºãæã¤çµ±è¨ãã¼ã¿ãCSVå½¢å¼ã§ãã¦ã³ãã¼ãã§ããWebãµã¼ãã¹ãçµ±è¨ããããå ¬éããã 次ä¸ä»£çµ±è¨å©ç¨ã·ã¹ãã ã¯ãçµ±è¨ã®ãªã¼ãã³ãã¼ã¿ã®é«åº¦åã«åããçµ±è¨ã»ã³ã¿ã¼ãç·åççµ±è¨å±ã¨ååãã¦æä¾ãã¦ããã·ã¹ãã ãæ¿åºã®çµ±è¨ãã¼ã¿ã«ãe-Statãã§ãã¼ã¿ãã¼ã¹åããã¦ããçµ±è¨ãã¼ã¿ããXMLãJSONãªã©ã§åºåããRESTæ¹å¼ã®APIãæä¾ãã¦ããã çµ±è¨ããã¯åAPIãæ´»ç¨ããå½å¢èª¿æ»ãäºæ¥æã»ä¼æ¥çµ±è¨èª¿æ»ãå ¨å½ç©ä¾¡çµ±è¨èª¿æ»ã家è¨æ¶è²»ç¶æ³èª¿æ»ãªã©ã«ã¤ãã¦ã調æ»çµæãWebãã©ã¦ã¶ä¸ã«è¡¨ç¤ºããããæ¡ä»¶ãçµãè¾¼ãã§åé¡ããããCSVåãã¦ãã¦ã³ãã¼ãå¯è½ãä»å¾ã¯ãã°ã©ãçæãã¯ãã¹éè¨æ©è½ãªã©ã®å®è£ ãæ¤è¨ãã¦ããã é¢é£è¨äº ãPM2.5ã¾ã¨ããæ£å¼å ¬éãç¾å¨å°ã®PM2.5æ¿åº¦
ãµã¼ãã¹çµäºã®ãç¥ãã NAVERã¾ã¨ãã¯2020å¹´9æ30æ¥ããã¡ã¾ãã¦ãµã¼ãã¹çµäºãããã¾ããã ç´11å¹´éãNAVERã¾ã¨ãããå©ç¨ã»ãæ顧ããã ãèª ã«ãããã¨ããããã¾ããã
大è¦æ¨¡ãã¼ã¿ãå ¬éããã¦ãããµã¤ãã«ã¤ãã¦ä»¥ä¸ã®Quoraã§id:makimotoããã質åãã¦ãã¾ãããData: Where can I get large datasets open to the public? - Quora以ä¸ãç´¹ä»ããã¦ãããµã¤ãã®ä¸è¦§ã§ããä¸é¨ææã®ãã®ãããããã§ããUCI Machine Learning RepositoryPublic Data Sets : Amazon Web ServicesCRAWDADno titleCity of Chicago | Data PortalGovLoop | Social Data Network for Governmentdata.gov.uk | Opening up governmentData.Medicare.GovData.Seattle.Gov | Seattleâs Data SiteOp
ã©ã³ãã³ã°
ã©ã³ãã³ã°
ã©ã³ãã³ã°
ãªãªã¼ã¹ãé害æ å ±ãªã©ã®ãµã¼ãã¹ã®ãç¥ãã
ææ°ã®äººæ°ã¨ã³ããªã¼ã®é ä¿¡
å¦çãå®è¡ä¸ã§ã
j次ã®ããã¯ãã¼ã¯
kåã®ããã¯ãã¼ã¯
lãã¨ã§èªã
eã³ã¡ã³ãä¸è¦§ãéã
oãã¼ã¸ãéã
{{#tags}}- {{label}}
{{/tags}}