Handling a tremendous amount of images with Fastly / Yamagoya Traverse 2020
Summary cloud-init is the Ubuntu package that handles early initialization of a cloud instance. It is installed in the official Ubuntu live server images since the release of 18.04, Ubuntu Cloud Images and also in the official Ubuntu images available on EC2. Some of the things it configures are: setting a default locale setting hostname generate ssh private keys adding ssh keys to user's .ssh/auth
Senna+MySQLãããè¶ é«éã«ããããã å½è æ¯50ï½100åç¨ã®ã¹ãã¼ãã¢ããï¼ã¯ã¨ãª/ãã¼ãã«æ§é ã«ããï¼ã®ãããã§ãã MySQL(ç¹ã«FullText boolean mode)ã®limitã®å®è£ ã¯ããæå³å¹çã®æªãå®è£ ã«ãªã£ã¦ããã ä¾ãã°ãlimit 100000,100ã¨ãã£ãã¯ã¨ãªãæããã¨100100è¡åã®ãã¼ã¿ããã£ã¹ã¯ããèªã¿è¾¼ãã®ã§ããã ã¾ããwhereãªã©ã®æ¡ä»¶ã«ä¸è´ãã100000件ã®ã¬ã³ã¼ããå ã«ç¢ºå®ãããªããã°ãããªã訳ã§å½ç¶ã¨ããã°å½ç¶ã§ããã order byã¨ã使ã£ã¦ãããªãããã ç¡è«SQL_CALC_FOUND_ROWSãªãã使ã£ã¦ãã¨å ¨ä»¶ç¢ºå®ãããªãããããªããã大å¤ã å½ç¶ãããã¯indexã使ç¨ãã¦ããªãæã®æåã ã¨æãã indexã®ã¿ã使ãããã¯ã¨ãªã®æåã¯æªç¢ºèªã ãã©ã ãã¦ãããããæ¬é¡ã ã§ã¯ãSenna+MySQLã®æåã¯
GoogleãâLarge-scale cluster management at Google with Borgâã¨é¡ããè«æãçºè¡¨ãã¦ï¼ããã¾ã§ã»ã¨ãã©èªãããªãã£ãæè¡ã®è©³ç´°ãæããã«ããã Borgã¯ã¯ã©ã¹ã¿ããã¼ã¸ã£ã§ãããæ°ä¸å°ã®ãµã¼ãããæ§æãããã¯ã©ã¹ã¿ç¾¤ä¸ã§åä½ãï¼æ°åã¨ããã¢ããªã±ã¼ã·ã§ã³ããéä¿¡ãããæ°åä¸ã®ã¸ã§ããï¼ãã¾ãã¾ãªãµã¼ãã¹ã«ä»£ãã£ã¦åãå ¥ãï¼ãããã®ã¹ã±ã¸ã¥ã¼ã«ï¼éå§ï¼åæ¢ï¼åèµ·åãè¡ããBorgã®ç®çã¯ï¼éçºè ã«ä»£ãã£ã¦ãªã½ã¼ã¹ç®¡çä½æ¥ãå®è¡ãããã¨ã«ããï¼å½¼ãèªèº«ã®ä½æ¥ã«éä¸ã§ããããã«ãããã¨ï¼ãã¼ã¿ã»ã³ã¿ã®æ ãè¶ãã¦ãªã½ã¼ã¹ä½¿ç¨å¹çãæ大åãããã¨ï¼ãã®ï¼ã¤ã§ããã次ã®å³ã¯ï¼Borgã®ã¡ã¤ã³ã¢ã¼ããã¯ãã表ãã¦ããã ãã®ã¢ã¼ããã¯ãã£ã®æ§æè¦ç´ ã¯æ¬¡ã®ã¨ããã§ããã ã»ã« -ã¦ãããã¨ãã¦æ±ããããã·ã³ã®éåã ã»ã«ã«ã¯é常10,000å°ç¨ã®ãµ
FlumeJava: Easy, Efficient Data-Parallel Pipelines Craig Chambers, Ashish Raniwala, Frances Perry, Stephen Adams, Robert R. Henry, Robert Bradshaw, Nathan Weizenbaum Google, Inc. {chambers,raniwala,fjp,sra,rrh,robertwb,nweiz}@google.com Abstract MapReduce and similar systems significantly ease the task of writ- ing data-parallel code. However, many real-world computations re- quire a pipeline of M
ãç¥ãã
é害
ã©ã³ãã³ã°
ãªãªã¼ã¹ãé害æ å ±ãªã©ã®ãµã¼ãã¹ã®ãç¥ãã
ææ°ã®äººæ°ã¨ã³ããªã¼ã®é ä¿¡
j次ã®ããã¯ãã¼ã¯
kåã®ããã¯ãã¼ã¯
lãã¨ã§èªã
eã³ã¡ã³ãä¸è¦§ãéã
oãã¼ã¸ãéã
{{#tags}}- {{label}}
{{/tags}}