2016/11/24
Google翻訳ã¨ä¸è¨³
Google翻訳ãä¸è¨³ã«ä½¿ã£ã¦ææ©ãæè¡ææ¸ã翻訳ãã¦ã¿ã¾ãããã¨ããä¾:
訳ãããæç« ã¯ãã¡ã: Hadoop: Fair Scheduler
ããããããããã¯ããããå½¢ã®ããæ¹ãå¢ãã¦ããã¨æãã®ã§è©¦ã¿ã¨ãã¦é¢ç½ãã åæã«ãç¾å¨ã®æ©æ¢°ç¿»è¨³ã§å¼±ãããªã¨ãã(å¾ã£ã¦ãä¸è¨³ããä¿®æ£ããéã«æ°ãã¤ããã¹ãã¨ãã)ã è¦ãã¦ãæ°ãããããã¤ã³ãããã¯ã·ã§ã³ãã®ç¯ããããã¤ãä¾ãæãã¦ã¿ãã
(å¼ç¨ã¯ç¾æç¹ã§ã®è¨³ãå¾ã ã«ãã£ã¼ãããã¯ãåãã¦æ¹åãããã¨æãã®ã§å¾ã§è¦ãæ㯠å¤ãã£ã¦ããå¯è½æ§ãã)
ç¾è¨³:
ããã©ã«ãã§ã¯ããã§ã¢ã¹ã±ã¸ã¥ã¼ã©ã¯ã¹ã±ã¸ã¥ã¼ãªã³ã°ãã§ã¢ãã¹æ±ºå®ãã¡ã¢ãªä¸ã§ã®ã¿è¡ãã¾ããGhodsiãã«ãã£ã¦éçºãããDominant Resource Fairnessã®æ¦å¿µã使ç¨ãã¦ãã¡ã¢ãªã¨CPUã®ä¸¡æ¹ã§ã¹ã±ã¸ã¥ã¼ã«ãè¨å®ãããã¨ãã§ãã¾ãã
åæ:
By default, the Fair Scheduler bases scheduling fairness decisions only on memory. It can be configured to schedule with both memory and CPU, using the notion of Dominant Resource Fairness developed by Ghodsi et al.
"on memory" ã¯å ¸åçã«ã¯ãã¼ã¿ãæä½ããéã«ãããã¡ã¢ãªã«ä¹ã£ã¦ãããã¨ãæãã ãã¡ã¢ãªä¸ã§ãã¨è¨³ããããã¨ãå¤ãã ããã©ãããã®on㯠"base X on Y"ããYã«åºã¥ãã¦Xãæ§ç¯ãã/Xã®åºç¤ã«Yãç½®ãã ã®onã§ãã£ã¦ãã¡ã¢ãªã«ã®ã¿åºã¥ãã¦(ã¹ã±ã¸ã¥ã¼ãªã³ã°ã®å ¬å¹³æ§ã決å®ãã)ãã¨ããæã ã
on memoryãå ´æã示ãå¯è©å¥ã¨åãã°ãã¡ã¢ãªä¸ã§æ±ºå®ãè¡ããã¨ãã解éã æ§æçã«ã¯å¯è½ã§ããã
ãã¡ãã®è§£éãå´ä¸ãããçç±ã¯ã次ã®æã®æå³ã¨ã®ã¤ãªããã«ããã次ã®æã§ã¯ã¡ã¢ãªã¨CPUã®ä¸¡æ¹ã èæ ®ãã¦ã¹ã±ã¸ã¥ã¼ã«ãããã¨ãå¯è½ã ã¨è¨ã£ã¦ãããåæãèªã人éã¯ã æåã®æã§ã¯ã£ããæå³ã確å®ãã¦ããªãã¦ãã次ã®æãèªãã 段éã§
ããã£ãã¡ã¢ãªã®ã¿ã¨è¨ã£ã¦ãã¦ã次ã«ã¡ã¢ãªã¨CPUã®ä¸¡æ¹ã£ã¦ã®ãæã¡åºãã¦æ¥ããã ããã ã¹ã±ã¸ã¥ã¼ãªã³ã°æ±ºå®ã®ãã©ã¡ã¼ã¿ã¨ãã¦ãã¡ã¢ãªã®ã¿ããããã¯ã¡ã¢ãªã¨CPUã®ä¸¡æ¹ãã¨ãã ãªãã·ã§ã³ããããã ãªã
ã¨ç解ããã
ç¾è¨³ã§ãå 容ãè¯ãèããã°ãã®è§£éã«è³ããã¨ã¯å¯è½ã ã¨æãããã©ã ç§ã¯ä¸èªãã¦ããããåæãèªãã§ãã¾ã£ããä¾ãã°ããæ¸ãã¦ãã£ãã ä¸èªã§ç解ã§ãããã§ã¯ãªããã¨æãã
ããã©ã«ãã§ã¯ããã§ã¢ã¹ã±ã¸ã¥ã¼ã©ã¯ã¹ã±ã¸ã¥ã¼ãªã³ã°ãã§ã¢ãã¹æ±ºå®ãã¡ã¢ãªã®ã¿ã«åºã¥ãã¦è¡ãã¾ããGhodsiãã«ãã£ã¦éçºãããDominant Resource Fairnessã®æ¦å¿µã使ç¨ãã¦ãã¡ã¢ãªã¨CPUã®ä¸¡æ¹ã§ã¹ã±ã¸ã¥ã¼ã«ãè¨å®ãããã¨ãã§ãã¾ãã
åæ2æç®ã«alsoã¯å ¥ã£ã¦ããªãããã©ãå ã®è±æã§ã¯2æç®åé ã«It can beãæ¥ã¦ å¥ã®å¯è½æ§ã«è¨åãã¦ãããã¨ãããåããã®ã«å¯¾ããæ¥æ¬èªã§ã¯ãã§ãã¾ããã 2æç®æ«ã«æ¥ã¦ãã¾ãã®ã§ãããããè£ãªããã¨ã§æµããããããããã§ããã
ç¾è¨³
ã¹ã±ã¸ã¥ã¼ã©ã¯ã¢ããªã±ã¼ã·ã§ã³ãããã¥ã¼ãã«ã¾ã¨ãããããã®ãã¥ã¼éã§ãªã½ã¼ã¹ãå ¬å¹³ã«å ±æãã¾ãã
åæ
The scheduler organizes apps further into âqueuesâ, and shares resources fairly between these queues.
ããã¯åæã§ã®ç¿»è¨³ã¨ãã¦ã¯åé¡ã¯ãªããåé¡ã¯ããã®åã®ãã©ã°ã©ãã§ã
ãã¢ããªã®ãã¥ã¼ãå½¢æããããã©ã«ãã®Hadoopã¹ã±ã¸ã¥ã¼ã©ã¨ã¯ç°ãªãã(Unlike the default Hadoop scheduler, which forms a queue of apps,)ã
ã¨è¨ã£ã¦ããç¹ã ããã¢ããªã®ãã¥ã¼ãä½ãããã©ã«ãã®ã¹ã±ã¸ã¥ã¼ã©ã¨ã¯éããã¨è¨ã£ã¦ãããªããã ãã¢ããªã±ã¼ã·ã§ã³ããã¥ã¼ã«ã¾ã¨ããã¨æ¥ãã®ã§èªè ã¯æ··ä¹±ããã
å ã®ãã¥ã¼ã¨ä»åºã¦ããããã¥ã¼ãã¯éããã®ãæãã¦ãã¦ãåæã§ã¯ãªã¼ãããã¦ããã®ã ããã強調ããæå³ãããã®ã ããããã©ãããã²ã¨ã¤ãåæã§ã¯ å ã«åºã¦ãããã¥ã¼ãåæ°ã§ãå¾ã«åºã¦ãããã¥ã¼ãè¤æ°ã§ãããã¨ãã 両è ãéããã®ã示ãã¨ããéè¦ãªæãããã«ãªã£ã¦ããã
ä¸è¬ã«ã¯åæ°å½¢/è¤æ°å½¢ã¯è¨³åºããã«ãæèã§ç¤ºåããã«æ¢ãããã¨ãå¤ãã ãã®æã§ãããããã®ãã¥ã¼éããããå¾ã«æ¥ã¦ãããè¤æ°å½¢ã§ãããã¨ã¯ç¤ºåããã¦ããã ã®ã ããã©ãæèã®æµãã§æ°ãéè¦ãªæ å ±ãæ ã£ã¦ããå ´åã¯ãé½ã«è¨³åºãã¦ããã° èªè ãä½åº¦ãèªã¿ç´ãããåæã«å½ãã£ããããå¿ è¦ãæ¸ãã ããã
ã¹ã±ã¸ã¥ã¼ã©ã¯ã¢ããªã±ã¼ã·ã§ã³ã(è¤æ°ã®|ããã¤ãã®)ããã¥ã¼ãã«ã¾ã¨ããï½
å¯¾ç §ããã強調ããããã«ãåãã©ã°ã©ãã®ããã©ã«ãã®ã¹ã±ã¸ã¥ã¼ã©ã«ã¤ãã¦ãã¢ããªãä¸ã¤ã®ãã¥ã¼ã«ä¸¦ã¹ãããã©ã«ãã®â¦ãã¨ãã¦ãããã¨ãã§ããã ããã
ã¾ãããã®å¾ã«ãããã©ã«ãã§ã¯"default"ã¨ããåä¸ã®ãã¥ã¼ã使ãããã¨åºã¦ããã®ã ããã©ã ããã«ç¶ãã¦è¤æ°ã®ãã¥ã¼ã«æ¯ãåããæ¹æ³ãããã¤ã説æãããã ç§ã訳ãã¨ãããããã®æµãã示ããã㫠次ã®æããããã©ã«ãã§ã¯ãåä¸ã®ãã¥ã¼ãå ±æãã¾ãããã¢ããªã±ã¼ã·ã§ã³ããã ã¨ãã£ãå ·åã«åæã«ãªãæ¥ç¶è©ãè£ããããããªãã (åæã«ç¡ãè¨èãã©ãã¾ã§è£ãã¹ãããã¨ããã®ã¯é£ããåé¡ã ãã æè¡ææ¸ã®å ´åã¯èªè ã®æ³ååã«è¨´ããããã¯æå³ããªãã¹ãæ確ã«ä¼éããæ¹ãåªå ãããã ããããã è«çã®æµãã示ããããªè£éã¯ããã¨æå¹ã ã¨æãã)
ç¾è¨³
ãã§ã¢ã¹ã±ã¸ã¥ã¼ã©ã¯ããã¹ã¦ã®ã¢ããªã±ã¼ã·ã§ã³ãããã©ã«ãã§å®è¡ãããã¨ãã§ãã¾ãããconfigãã¡ã¤ã«ã使ç¨ãã¦ãå®è¡ä¸ã®ã¢ããªãå®è¡ããã¢ããªæ°ãã¦ã¼ã¶ãã¨ããã³ãã¥ã¼ãã¨ã«å¶éãããã¨ãã§ãã¾ãã
åæ
The Fair Scheduler lets all apps run by default, but it is also possible to limit the number of running apps per user and per queue through the config file.
å¾åã®ãå®è¡ä¸ã®ã¢ããªãå®è¡ããã¢ããªãã¯å¤åç·¨éãã¹ã ããããã©ã ããã§è¦ããã®ã¯ "lets all apps run" ã®æ¹ã ãä½ãããªããã°å ¨é¨èµ°ãããâconfigã§å¶éããããã¨ãã§ãããã¨ããã®ãããã®æµãã ãã ãAã§ãã¾ãããBãã§ãã¾ããã§ã¯ä¸¦ç½®ã®å°è±¡ãå¼·ããåæã«ããæµããæ¶ãã¦ããã®ã èªã¿ã¥ããã®è¦å ã ããã¨æãã
ãã§ã¢ã¹ã±ã¸ã¥ã¼ã©ã¯ãããã©ã«ãã§ã¯ãã¹ã¦ã®ã¢ããªã±ã¼ã·ã§ã³ãå®è¡ãã¾ããã configãã¡ã¤ã«ã使ç¨ãã¦ãåæã«å®è¡ããã¢ããªæ°ãã¦ã¼ã¶æ¯ããã¥ã¼æ¯ã«å¶éãããã¨ã ã§ãã¾ãã
ç¾è¨³
ããã¯ãä¸åº¦ã«ä½ç¾ãã®ã¢ããªã±ã¼ã·ã§ã³ãéä¿¡ããªããã°ãªããªãå ´åããä¸åº¦ã«å¤æ°ã®ã¢ããªã±ã¼ã·ã§ã³ãå®è¡ããã¨ãä¸éãã¼ã¿ãé常ã«å¤ãçæãããããã³ã³ããã¹ãåãæ¿ããå¤ããããããã¨ãããã©ã¼ãã³ã¹ãåä¸ãããããã«å½¹ç«ã¡ã¾ãã
åæ
This can be useful when a user must submit hundreds of apps at once, or in general to improve performance if running too many apps at once would cause too much intermediate data to be created or too much context-switching.
ç¾è¨³ã¯ä¸çªå¤å´ã®ãããã¯ããããã©ã¼ãã³ã¹ãåä¸ãããããã«å½¹ç«ã¡ã¾ãããã§ä¸»èªè¿°èªã® 対å¿ãåãã¦ãããã«è¦ããããã«ãæ ¡æ£æã«ãã¤ãèªã¿æµãã¦ãã¾ãã®ãããããªããããã© éãè¯ãèªãã§ã¿ãã¨ç¿»è¨³ã®æ¥æ¬èªã§ç¯éã®ã¤ãªãããè¯ãåãããªããªã£ã¦ããã äºã¤ãã®ãããã¨ãã¯æå³çã«ãå½¹ç«ã¡ã¾ããã«ã¯ã¤ãªãããªãã
åæã®æ§é ã¯æ¬¡ã®éã:
useful +- when a user must submit ... at once +- (in general) to improve performance +- if running too many apps at once would cause +- too much intermediate data ... +- or too much context switching
whenç¯ã¨to improveã®å¥ã並置ããã¦ãã(æå³çã«ã¯ãåãªã並置ã¨ããããã åè ãå¾è ã§ä¸è¬å説æãã¦ããã¨èããæ¹ãè¯ãã ãã)ã
ã¨ãããã¨ã¯ç¿»è¨³æã¯æ¬¡ã®ããã«è§£éããã®ãæ£ãããã¨ã«ãªãã
ããã¯ã - ä¸åº¦ã«ä½ç¾ãã®ã¢ããªã±ã¼ã·ã§ã³ãéä¿¡ããªããã°ãªããªãå ´å - ä¸åº¦ã«å¤æ°ã®ãããã©ã¼ãã³ã¹ãåä¸ããããã ã«å½¹ç«ã¡ã¾ã
翻訳æãããåãã°(æ¥ç¶èªã®åé¡ãé¤ãã¦ã¯)ééãã¨ã¯è¨ããããªããã èªç¶è¨èªã§ã¯ãã¹ãããã¾ã表ç¾ã§ããªãã®ã§ã人éãä»ã®ç¿»è¨³ãä¸èªããã¨
ããã¯ã - ä¸åº¦ã«ä½ç¾ãã®ã¢ããªã±ã¼ã·ã§ã³ãéä¿¡ããªããã°ãªããªãå ´åã - ä¸åº¦ã«å¤æ°ã®ã¢ããªã±ã¼ã·ã§ã³ãå®è¡ãã ã¨ã - ä¸éãã¼ã¿ãé常ã«å¤ãçæããããã - ã³ã³ããã¹ãåãæ¿ããå¤ãããã[ããã®ã§]ã ããã©ã¼ãã³ã¹ãåä¸ãããããã«å½¹ç«ã¡ã¾ãã
ã¨ããå ·åã«èªãã§ãã¾ãã®ã§ã¯ãªããããã
ããã¯ãæ¨æ§é ãã·ãªã¢ã©ã¤ãºããã«ããã£ã¦ãèªé ã®éãã«ãã£ã¦ææ§æ§ãçãã¦ãã¾ãä¾ã§ããã æ¥æ¬èªã®å ´åãæã«åå²ããå¾ãè¿°èªã§åæµãããªãã¨ãªããªãã®ã§ãåãæ¹ãé£ããã æ¥ç¶è©ã¨å¥èªç¹ã工夫ãããã主èªè¿°èªã®å¡ãå¾ãã«æã£ã¦ããã¨ãã£ãæã使ããï¼
ä¸åº¦ã«ä½ç¾ãã®ã¢ããªã±ã¼ã·ã§ã³ãéä¿¡ããªããã°ãªããªãå ´åãããä¸è¬çã«ã¯ãä¸åº¦ã«å¤æ°ã®ã¢ããªã±ã¼ã·ã§ã³ãå®è¡ãã¦ä¸éãã¼ã¿ãé常ã«å¤ãçæããããã³ã³ããã¹ãåãæ¿ããå¤ããªããããæã®æ§è½ãåä¸ãããã®ã«ãããã¯å½¹ã«ç«ã¡ã¾ãã
ãããã¯ãin general以éãä¸è¬åãã説æã§ããã¨ããæå³ãæ±²ãã§æã åå²ãããï¼
ããã¯ãä¸åº¦ã«ä½ç¾ãã®ã¢ããªã±ã¼ã·ã§ã³ãéä¿¡ããªããã°ãªããªãå ´åã«ä¾¿å©ã§ãã ããä¸è¬çã«ã¯ãä¸åº¦ã«å¤æ°ã®ã¢ããªã±ã¼ã·ã§ã³ãå®è¡ãã¦ãä¸éãã¼ã¿ãé常ã«å¤ãçæãããããã³ã³ããã¹ãåãæ¿ããå¤ããªããããæã®æ§è½ãåä¸ãããã®ã«å½¹ã«ç«ã¤ã§ãããã
å ±éç¹ã¨ãã¦ãªãã¨ãªãè¦ãã¦ããã®ã¯ã以ä¸ã®ç¹ã®å¼±ãã ã
- æããã©ã°ã©ããã¾ããã ãæµãããèªè ã«ç¤ºãããã®é©åãªè¨³èªã®é¸æ
- 翻訳æãèªãã§èªè ãé ã®ä¸ã«æ§é ãæããããã¨ããèªè è¦ç¹ããã®é æ ®
æ©æ¢°ç¿»è¨³ãããããç¹ã«å¾è ã«å¼±ãã®ã¯è´ãæ¹ãªãã¨ãè¨ããã®ã§ã ä¸è¨³ããç´ãã¦ããéã«ç¿»è¨³è ãç¹ã«æ³¨æãã¹ãç¹ã¨èããæ¹ãè¯ãã¨æãã
翻訳è ã¯ãªã¾ãåæãèªã¿è¾¼ãã§ããããã«ãä¸è¨³ã®æ¥æ¬èªãå°ã ããããã¦ã 好æçã«è§£éãã¦è¦éãã¦ãã¾ãã¨ããå±éºããããããããªãã ãæµããã示ã訳èªã®é¸æã¯ãæã¨ãã¦æ¬å½ã«äºç´°ãªæ¥ç¶è©ãå¥èªç¹ã® éãã ã£ããããããããªãä¸è¦ã©ãã§ããããããªéããèªä¿¡ãæã£ã¦ä¿®æ£ã§ããã«ã¯ã åæãä½ãè¨ã£ã¦ããã®ããæ確ã«ææ¡ãã¦ããå¿ è¦ãããã ãã®ç¹ã§ãåç §ã¨ã³ããªãè¨ãããã«ãæ©æ¢°ç¿»è¨³ã使ããããã¨ãã£ã¦ 翻訳è ã«å¿ è¦ã¨ãããè±èªåãä¸ããã¨ãããã¨ã¯å½åã¯ç¡ãã ããã
shiumachi (2016/11/26 14:14:49):
shiro (2016/11/26 22:18:57):
shiumachi (2016/11/26 23:21:00):