ç»åé ä¿¡ã®è² è·åæ£ãæ¯è¼çç°¡åï¼ï¼ãã®4ï¼
http://d.hatena.ne.jp/yamaz/20060509ã®ç¶ã.
åãã¦ã®æ¹ã¯画像配信の負荷分散も比較的簡単?(その1)ããã©ãã.
Googleã¯images.google.com 1ã¤ã§1,187,630,000(11.8å!)ã®ç»åãä¿æãã¦ãã(ããã«è¦ãã).1ã¤ã®ç»åã10KBã ã£ãã¨ãã¦ã12.5TBã®ç»åãä¿æãã¦ãããã¨ã«ãªã.
Googleããããªãã¨ãã§ãã¦ãã®ã¯GoogleFileSystemãããããã .
http://labs.google.com/papers/gfs.html
GoogleFileSystemã¯ç°¡åã«è¨ãã¨ãã¼ã¿ããã¯ã¢ããæ©è½ã¤ãã®åæ£NFSã®ãããªãã®ã .
GoogleFileSystemã«é¢ãã¦ã¯ä¸è¨URLã®PDFã«è©³ããã®ã§,ãã¡ããåç §ãã¦ã»ããã,åºæ¬çãªèãæ¹ã¯ä»ã¾ã§è² è·åæ£ã®èãæ¹ã¨ãªããå¤ããã¨ã¯ãªã.ã¤ã¾ã
1. ã³ã³ãã¥ã¼ã¿ã¯1ã¤ã®ä»äºããããã®ã«ã¯ååæ©ã
2. ãã£ã¦æ¦ç¥ã¨ãã¦ã¯1å°ã®ãµã¼ãã®ä»äºéãåºå®ãã¦,è² è·ãå¢ãã¦ããµã¼ãã足ãã ãã§ãããããªã¢ã¼ããã¯ãã£ã«ããã°ãã.*1
ã¨ãããã¨ã§GFSã§ã¯1å°ãåãæã¤ç»å容éãä¸å®æ°ãè¶ ããªãããã«é©åº¦ã«ãµã¼ãã追å ãã¦ããã ããã¨æã.
images.google.com <-> GFS sever群
images.google.comã¯çµå±ã®ã¨ããGFSã¨ãã巨大ãªããã¯ã¨ã³ããµã¼ãã«ç»åã®åãåããããã¦ãã¨ãããã¨ã .ããã¯ã¤ã¾ãããã³ãã§HTTPã¢ã¯ã»ã¹ãåãããµã¼ãèªä½ã¯ç»åãä¿æããªãã¨ãããã¨ãªã®ã§,(ãµã¼ããã足ãã°)äºå®ä¸ãããã§ãç»åãä¿æã§ããã¨ãããã¨ã«ãªã.
æ®éã®äººã¯å½ç¶GFSãæã£ã¦ãªãããã©,ããã¨é¡ãããããªãã®ãªãç°¡åã«ä½ãã.ã¤ã¾ã,
1. ããã¯ã¨ã³ããµã¼ãã¨ãã¦d[0..99].hatena.ne.jpã®ãããªãµã¼ããæºåãã.
2. ããã³ãã®d.hatena.ne.jpã¯ã¦ã¼ã¶åããåãåãããããã¯ã¨ã³ããµã¼ãã決å®ãã¦ãã¼ã¿ãåå¾ãã(apacheã®mod_proxyãæ¹é ãããURL解éã®å¥ã®é¨åã«å²ã£ã¦å ¥ãã¢ã¸ã¥ã¼ã«ãä½ãã°ç°¡å).
3. åããã¯ã¨ã³ããµã¼ããä¿æãããã¼ã¿éãå¢ãããããã¯ã¨ã³ããµã¼ãã足ãã¦ã¾ãåæ£ããã.
4. ããã³ããµã¼ãã¯å½ç¶ããã¯ã¨ã³ããµã¼ããããã¦ããã.
å®éã®ã¨ããææã§ã¯ããã¯ã¨ã³ããµã¼ããå¹ã£é£ãã æç¹ã§ãã¼ã¿ããªããªãã®ã¯å°ãã®ã§,ããã¯ã¨ã³ããµã¼ãã¯å®éã«ãã¼ã¿ãä¿æãã¦ãããã¹ã¿ãµã¼ãã®ãã¼ã¿ã®ãããã·ãã£ãã·ã¥ãµã¼ãã¨ãã¦ç¨¼åããã¦ãã.
ããã³ããµã¼ã <-> ããã¯ã¨ã³ããµã¼ã(ãã£ãã·ã¥) <-> ãã¹ã¿ãµã¼ã
ãããããã¨ã«ãããã¹ã¿ãµã¼ãã«ã©ãã ããã¼ã¿éããã£ã¦ãããã¯ã¨ã³ããµã¼ãå´ã«èãããã£ãã·ã¥éãé©åº¦ã«ä¿ã¤ãã¨ãã§ãã.
ç´°ãããã¦ãã¦ãªã©ã¯ããªãã¯ããã£ãã,éçãªç»åã«é¢ãã¦ãä¸è¨ãªããã«ãããã¨ã§ããããç¡éã«ã¹ã±ã¼ã«ã§ãã.ãªã®ã§æ¬ã¨ã³ããªã¯ããã§ãã£ããç· ãããã¨æã.ãã¨1å°ã®ãµã¼ãã®ããã©ã¼ãã³ã¹ãããã¤ã¤ããã©ã¼ãã³ã¹ãé©åº¦ã«ä¿ã¤æ¹æ³(ã¨ãããèãæ¹)ã«ã¤ãã¦ã¯ã¾ãå¥ã¨ã³ããªã§è¿°ã¹ããã¨æã.
(ã²ã¨ã¾ãçµãã)
*1:ããã¯ã¹ã±ã¼ã«ã¢ããã§ã¯ãªã,ã¹ã±ã¼ã«ã¢ã¦ãã®èãæ¹ã .ã¹ã±ã¼ã«ã¢ããã¨ã¯1å°ãããã®ãµã¼ãã®ãã¯ã¼ããããæ¹æ³ã§é常ã³ã¹ãããã©ã¼ãã³ã¹ã¯è¯ããªã.ã¹ã±ã¼ã«ã¢ã¦ãã¯é©åº¦ã«ä»äºãåæ£ããã¦ãµã¼ãã®æ°ãå¢ããæ¹æ³.