[B! scalability][programming] HeavyFeatherã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

HeavyFeather id:HeavyFeather

scalabilityã¨programmingã«é–¢ã™ã‚‹HeavyFeatherã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (6)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

FacebookãŒå¤§è¦æ¨¡ã‚¹ã‚±ãƒ¼ãƒ©ãƒ“ãƒªãƒ†ã‚£ã¸ã®æŒ‘æˆ¦ã§å¦ã‚“ã ã“ã¨ï¼ˆå‰ç·¨ï¼‰ï½ž800å„„æžšã®å†™çœŸãƒ‡ãƒ¼ã‚¿ã¨PHPã®ã‚¹ã‚±ãƒ¼ãƒ©ãƒ“ãƒªãƒ†ã‚£å•é¡Œ
FacebookãŒå¤§è¦æ¨¡ã‚¹ã‚±ãƒ¼ãƒ©ãƒ“ãƒªãƒ†ã‚£ã¸ã®æŒ‘æˆ¦ã§å¦ã‚“ã ã“ã¨ï¼ˆå‰ç·¨ï¼‰ï½ž800å„„æžšã®å†™çœŸãƒ‡ãƒ¼ã‚¿ã¨PHPã®ã‚¹ã‚±ãƒ¼ãƒ©ãƒ“ãƒªãƒ†ã‚£å•é¡Œ å…¨ä¸–ç•Œã§3å„„äººã‚’è¶…ãˆã‚‹ä¼šå“¡ã‚’æŠ±ãˆã€ä¸–ç•Œæœ€å¤§ã®SNSã¨ãªã£ãŸFacebookã€‚åŒç¤¾ã®å·¨å¤§ãªã‚·ã‚¹ãƒ†ãƒ ã¯ã€3ã¤ã®ãƒ‡ãƒ¼ã‚¿ã‚»ãƒ³ã‚¿ãƒ¼ã«ã‚ã‚‹ç´„3ä¸‡å°ã®ã‚µãƒ¼ãƒã¨ã€PHPã€C++ã€Memcacheã€MySQLãªã©ã®ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ç¾¤ã«ã‚ˆã£ã¦æ”¯ãˆã‚‰ã‚Œã¦ã„ã¾ã™ï¼ˆåŒç¤¾ã®ãƒ‡ãƒ¼ã‚¿ã‚»ãƒ³ã‚¿ãƒ¼ã®å·¨å¤§ã•ã¯ã€è¨˜äº‹ã€Œ3å„„ã®ãƒ¦ãƒ¼ã‚¶ãƒ¼ã‚’æŠ±ãˆã‚‹Facebookã®ãƒ‡ãƒ¼ã‚¿ã‚»ãƒ³ã‚¿ãƒ¼ã€‚ç§»å‹•ã¯è‡ªè»¢è»Šã€å¸Œæœ›ã¯100Gbã‚¤ãƒ¼ã‚µãƒãƒƒãƒˆ ã€ã‚’å‚ç…§ï¼‰ã€‚ åŒç¤¾ã®æŠ€è¡“æ‹…å½“ãƒã‚¤ã‚¹ãƒ—ãƒ¬ã‚¸ãƒ‡ãƒ³ãƒˆ Jeff Rothschildæ°ã¯ã€FacebookãŒå®Ÿç¾ã—ã¦ã„ã‚‹å¤§è¦æ¨¡ãªã‚¹ã‚±ãƒ¼ãƒ©ãƒ“ãƒªãƒ†ã‚£ã‚’ã€ã„ã‹ã«ã—ã¦ã“ã‚Œã‚‰ã®ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã§å®Ÿç¾ã—ã¦ã„ã‚‹ã®ã‹ã€10æœˆ8æ—¥ã«ç±³ã‚«ãƒªãƒ•ã‚©ãƒ«ãƒ‹ã‚¢å¤§å¦ã‚µãƒ³ãƒ‡ã‚£ã‚¨ã‚´æ ¡ã§è¡Œã£ãŸã‚»ãƒŸãƒŠãƒ¼ã€ŒHigh Performance at Mas
HeavyFeather 2009/11/14
webservice

programming

PHP

facebook

architecture

scalability
ãƒªãƒ³ã‚¯
è»½é‡ã‚¹ãƒ¬ãƒƒãƒ‰ãƒ–ãƒ¼ãƒ ã ã¨æ€ã†ã®ã§ã€ãã“ã‚‰ã¸ã‚“ã®æƒ…å ±ã‚’ã¾ã¨ã‚ã¦ã¿ã‚‹ - é‡‘åˆ©0ç„¡åˆ©æ¯ã‚ãƒ£ãƒƒã‚·ãƒ³ã‚° â€“ ã‚ãƒ£ãƒƒã‚·ãƒ³ã‚°ã§ãã¾ã™ - subtech
ã¯ã¦ãªã‚°ãƒ«ãƒ¼ãƒ—ã®çµ‚äº†æ—¥ã‚’2020å¹´1æœˆ31æ—¥(é‡‘)ã«æ±ºå®šã—ã¾ã—ãŸ ä»¥ä¸‹ã®ã‚¨ãƒ³ãƒˆãƒªã®é€šã‚Šã€ä»Šå¹´æœ«ã‚’ç›®å‡¦ã«ã¯ã¦ãªã‚°ãƒ«ãƒ¼ãƒ—ã‚’çµ‚äº†äºˆå®šã§ã‚ã‚‹æ—¨ã‚’ãŠçŸ¥ã‚‰ã›ã—ã¦ãŠã‚Šã¾ã—ãŸã€‚ 2019å¹´æœ«ã‚’ç›®å‡¦ã«ã€ã¯ã¦ãªã‚°ãƒ«ãƒ¼ãƒ—ã®æä¾›ã‚’çµ‚äº†ã™ã‚‹äºˆå®šã§ã™ - ã¯ã¦ãªã‚°ãƒ«ãƒ¼ãƒ—æ—¥è¨˜ ã“ã®ãŸã³ã€æ£å¼ã«çµ‚äº†æ—¥ã‚’æ±ºå®šã„ãŸã—ã¾ã—ãŸã®ã§ã€ä»¥ä¸‹ã®é€šã‚Šã”ç¢ºèªãã ã•ã„ã€‚ çµ‚äº†æ—¥: 2020å¹´1æœˆ31æ—¥(é‡‘) ã‚¨ã‚¯ã‚¹ãƒãƒ¼ãƒˆå¸Œæœ›ç”³è«‹æœŸé™:2020å¹´1æœˆ31æ—¥(é‡‘) çµ‚äº†æ—¥ä»¥é™ã¯ã€ã¯ã¦ãªã‚°ãƒ«ãƒ¼ãƒ—ã®é–²è¦§ãŠã‚ˆã³æŠ•ç¨¿ã¯è¡Œãˆã¾ã›ã‚“ã€‚æ—¥è¨˜ã®ã‚¨ã‚¯ã‚¹ãƒãƒ¼ãƒˆãŒå¿…è¦ãªæ–¹ã¯ä»¥ä¸‹ã®è¨˜äº‹ã«ã—ãŸãŒã£ã¦æ‰‹ç¶šãã‚’ã—ã¦ãã ã•ã„ã€‚ ã¯ã¦ãªã‚°ãƒ«ãƒ¼ãƒ—ã«æŠ•ç¨¿ã•ã‚ŒãŸæ—¥è¨˜ãƒ‡ãƒ¼ã‚¿ã®ã‚¨ã‚¯ã‚¹ãƒãƒ¼ãƒˆã«ã¤ã„ã¦ - ã¯ã¦ãªã‚°ãƒ«ãƒ¼ãƒ—æ—¥è¨˜ ã”åˆ©ç”¨ã®ã¿ãªã•ã¾ã«ã¯ã”è¿·æƒ‘ã‚’ãŠã‹ã‘ã„ãŸã—ã¾ã™ãŒã€ã©ã†ãžã‚ˆã‚ã—ããŠé¡˜ã„ã„ãŸã—ã¾ã™ã€‚ 2020-06-25 è¿½è¨˜ ã¯ã¦ãªã‚°ãƒ«ãƒ¼ãƒ—æ—¥è¨˜ã®ã‚¨ã‚¯ã‚¹ãƒãƒ¼ãƒˆãƒ‡ãƒ¼ã‚¿ã¯2020å¹´2æœˆ28
HeavyFeather 2009/09/26
development

LL

programming

scalability

thread
ãƒªãƒ³ã‚¯
ãƒãƒƒãƒˆãƒ¯ãƒ¼ã‚¯ãƒ—ãƒã‚°ãƒ©ãƒ ã®I/Oæˆ¦ç•¥ - sdyuki-devel
å›³è§£æ±‚ã‚€ã€‚ ä»¥ä¸‹ã€Œãƒ—ãƒãƒˆã‚³ãƒ«å‡¦ç†ã€ã¨ã€Œãƒ¡ãƒƒã‚»ãƒ¼ã‚¸å‡¦ç†ã€ã‚’åˆ†ã‘ã¦æ‰±ã£ã¦ã„ã‚‹ãŒã€ã“ã®å·®ãŒé¡•è‘—ã«å‡ºã‚‹ã®ã¯å…¨æ–‡æ¤œç´¢ã‚¨ãƒ³ã‚¸ãƒ³ã‚„éžåŒæœŸã‚¸ãƒ§ãƒ–ã‚µãƒ¼ãƒãƒ¼ãªã©ã€å°ã•ãªãƒ¡ãƒƒã‚»ãƒ¼ã‚¸ã§é‡ã„å‡¦ç†ã‚’ã™ã‚‹ã‚¿ã‚¤ãƒ—ã€‚ã‚¹ãƒˆãƒªãƒ¼ãƒ æŒ‡å‘ã®ãƒ—ãƒãƒˆã‚³ãƒ«ã®å ´åˆã¯ã€Œãƒ—ãƒãƒˆã‚³ãƒ«å‡¦ç†ã€ã‚’ã€Œã‚¹ãƒˆãƒªãƒ¼ãƒ å‡¦ç†ã€ã«ç½®ãæ›ãˆã‚‹ã¨ã„ã„ã‹ã‚‚ã—ã‚Œãªã„ã€‚ ã‚·ãƒ³ã‚°ãƒ«ã‚¹ãƒ¬ãƒƒãƒ‰ï½¥ã‚¤ãƒ™ãƒ³ãƒˆé§†å‹• ã‚³ãƒã‚¯ã‚·ãƒ§ãƒ³Nï¼šã‚¹ãƒ¬ãƒƒãƒ‰ï¼‘ã€‚epoll/kqueue/select ã‚’ï¼‘ã¤ä½¿ã£ã¦ã‚¤ãƒ™ãƒ³ãƒˆãƒ«ãƒ¼ãƒ—ã‚’ä½œã‚‹ã€‚ ãƒžãƒ«ãƒã‚³ã‚¢CPUã§ã‚¹ã‚±ãƒ¼ãƒ«ã—ãªã„ã®ã§ã€ã‚µãƒ¼ãƒãƒ¼ã§ã¯ä»Šæ™‚ã“ã®ãƒ¢ãƒ‡ãƒ«ã¯æµè¡Œã‚‰ãªã„ã€‚ ã‚¯ãƒ©ã‚¤ã‚¢ãƒ³ãƒˆã§éžåŒæœŸãªãƒ¡ãƒƒã‚»ãƒ¼ã‚¸ãƒ³ã‚°ã‚’ã‚„ã‚ŠãŸã„å ´åˆã¯ã“ã®ãƒ¢ãƒ‡ãƒ«ã‚’ä½¿ãˆã‚‹ï¼š ã‚µãƒ¼ãƒãƒ¼ã«ãƒ¡ãƒƒã‚»ãƒ¼ã‚¸ã‚’é€ä¿¡ ã‚¤ãƒ™ãƒ³ãƒˆãƒãƒ³ãƒ‰ãƒ©ã‚’ç™»éŒ²ï¼›ã“ã®ã¨ãã‚¤ãƒ™ãƒ³ãƒˆãƒãƒ³ãƒ‰ãƒ©ã®ãƒã‚¤ãƒ³ã‚¿ã‚’å–ã£ã¦ãŠã ã‚¤ãƒ™ãƒ³ãƒˆãƒãƒ³ãƒ‰ãƒ©->ãƒ•ãƒ©ã‚° ãŒONã«ãªã‚‹ã¾ã§ã‚¤ãƒ™ãƒ³ãƒˆãƒ«ãƒ¼ãƒ—ã‚’å›žã™ ã‚¤ãƒ™ãƒ³ãƒˆãƒãƒ³ãƒ‰ãƒ©->çµæžœ ã‚’è¿”ã™ ï¼‘ã‚³ãƒã‚¯ã‚·ãƒ§ãƒ³ï¼‘ã‚¹ãƒ¬ãƒƒ
HeavyFeather 2009/06/30
programming

performance

algorithm

architecture

design

network

scalability

server
ãƒªãƒ³ã‚¯
Rubyã§Hadoopã‚’ãƒ©ãƒƒãƒ—ã€åˆ†æ•£å‡¦ç†ãƒ„ãƒ¼ãƒ«ã‚ãƒƒãƒˆãŒç™»å ´ ï¼ ï¼ IT
2009/05/12 ç±³æ–°èžç¤¾å¤§æ‰‹ã®ãƒ‹ãƒ¥ãƒ¼ãƒ¨ãƒ¼ã‚¯ãƒ»ã‚¿ã‚¤ãƒ ã‚ºã¯5æœˆ11æ—¥ã€Rubyã«ã‚ˆã‚‹å¤§è¦æ¨¡åˆ†æ•£å‡¦ç†ã®ãƒ„ãƒ¼ãƒ«ã‚ãƒƒãƒˆã€ŒMap/Reduce Toolkitã€ï¼ˆMRToolkitï¼‰ã‚’GPLv3ã®ä¸‹ã«ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã§å…¬é–‹ã—ãŸã¨ç™ºè¡¨ã—ãŸã€‚MRToolkitã¯ã€ã™ã§ã«ç¨¼åƒã—ã¦ã„ã‚‹ã‚¯ãƒ©ã‚¹ã‚¿ä¸Šã®Hadoopã¨åˆã‚ã›ã¦ä½¿ã†ã“ã¨ã§Rubyã§å®¹æ˜“ã«Map/Reduceå‡¦ç†ã‚’è¨˜è¿°ã™ã‚‹ã“ã¨ãŒã§ãã‚‹ä¸€ç¨®ã®ãƒ©ãƒƒãƒ‘ãƒ¼ã€‚å‡¦ç†è‡ªä½“ã¯HadoopãŒè¡Œã†ã€‚ã™ã§ã«Hadoopã‚’ä½¿ã£ã¦ã„ã‚‹ãƒ¦ãƒ¼ã‚¶ãƒ¼ã§ã‚ã‚Œã°ã€ä¸å°è¦æ¨¡ã®ãƒ—ãƒã‚¸ã‚§ã‚¯ãƒˆã«å¯¾ã—ã¦ã€ã™ãã«MRToolkitã‚’é©ç”¨å¯èƒ½ã¨ã—ã¦ã„ã‚‹ã€‚ ãƒ‡ãƒ•ã‚©ãƒ«ãƒˆã§æœ‰ç”¨ãªMapã€Reduceã®å‡¦ç†ãƒ¢ã‚¸ãƒ¥ãƒ¼ãƒ«ãŒå«ã¾ã‚Œã¦ã„ã¦ã€æ•°è¡Œã®Rubyã‚¹ã‚¯ãƒªãƒ—ãƒˆã‚’æ›¸ãã ã‘ã§ã€ä¾‹ãˆã°è†¨å¤§ãªApacheã®ãƒã‚°ã‹ã‚‰IPã‚¢ãƒ‰ãƒ¬ã‚¹åˆ¥ã®é–²è¦§å±¥æ´ã‚’ã¾ã¨ã‚ã‚‹ã¨ã„ã£ãŸå‡¦ç†ãŒå¯èƒ½ã¨ã„ã†ã€‚ç‹¬è‡ªã«Mapã‚„Reduceã®å‡¦ç†ã‚’å®šç¾©ã™ã‚‹ã“ã¨ã‚‚
HeavyFeather 2009/05/16
Amazon

cloud

hadoop

programming

mapreduce

Ruby

tips

webservice

scalability
ãƒªãƒ³ã‚¯
RDBMSã®æ™‚ä»£ã®çµ‚ã‚ã‚ŠãŒè¦‹ãˆã¦ããŸ - ãã—ã ã®ã¯ã¦ãª
ã‚¯ãƒ©ã‚¦ãƒ‰ã¨ä¸€ç·’ã«ã‚„ã£ã¦ããŸã‚‚ã® æœ€è¿‘ã€ã‚¯ãƒ©ã‚¦ãƒ‰ãŒæµè¡Œã£ã¦ã¾ã™ã€‚ Googleã®MapResuceã‹ã‚‰å§‹ã¾ã£ã¦ã€Microsoftã®Azureã¾ã§ã€å¤§æ‰‹ã®ã‚¯ãƒ©ã‚¦ãƒ‰è£½å“ãŒå‡ºæƒã£ãŸæ„Ÿã˜ã€‚ ã§ã€ãã“ã§ã€ã“ã‚“ãªã‚¯ãƒ©ã‚¦ãƒ‰è£½å“ãŒå‡ºã¾ã—ãŸã¨ã„ã†ã¨ãã«ã€å¿…ãšã¨ã„ã£ã¦ã„ã„ã»ã©ãã®ã‚¯ãƒ©ã‚¦ãƒ‰ç”¨ã®ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã®èª¬æ˜ŽãŒã‚ã‚Šã¾ã™ã€‚ãã—ã¦ã€ãã‚Œã¯RDBMSã§ã¯ã‚ã‚Šã¾ã›ã‚“ã€‚ Googleã ã¨BigTableã€Microsoftã ã¨SQL Data Servicesã€ã‚ã¨ã¯Amazonã®SimpleDBã€‚ã©ã‚Œã‚‚ã€åŸºæœ¬çš„ã«ã¯ã²ã¨ã¤ã®ãƒ†ãƒ¼ãƒ–ãƒ«ã«ãƒãƒƒã‚·ãƒ¥ã‚³ãƒ¼ãƒ‰ã§ã‚¢ã‚¯ã‚»ã‚¹ã™ã‚‹ã‚ˆã†ã«ãªã£ã¦ã„ã¾ã™ã€‚ ã»ã‹ã®ã‚¯ãƒ©ã‚¦ãƒ‰è£½å“ã‚‚ã€Oracle Coherenceã ã£ãŸã‚Šã€æ¥½å¤©ã®Romaã ã£ãŸã‚Šã€éžRDBMSã®ãƒ‡ãƒ¼ã‚¿ã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸ã‚’æä¾›ã—ã¾ã™ã€‚ ã‚¯ãƒ©ã‚¦ãƒ‰ã¨ã„ã†ã‚ã‘ã§ã¯ãªã„ã‘ã©ã€mixiã®Tokyo Tyrantã‚„Apache CouchDBã‚‚ã€RDB
HeavyFeather 2008/12/18
development

programming

scalability

sql

db
ãƒªãƒ³ã‚¯
Googleã®MapReduceã‚¢ãƒ«ã‚´ãƒªã‚ºãƒ ã‚’Javaã§ç†è§£ã™ã‚‹
Googleã®MapReduceã‚¢ãƒ«ã‚´ãƒªã‚ºãƒ ã‚’Javaã§ç†è§£ã™ã‚‹ï¼šã„ã¾å†æ³¨ç›®ã®åˆ†æ•£å‡¦ç†æŠ€è¡“ï¼ˆå‰ç·¨ï¼‰ï¼ˆ1/2 ãƒšãƒ¼ã‚¸ï¼‰ æœ€è¿‘æ³¨ç›®ã‚’æµ´ã³ã¦ã„ã‚‹åˆ†æ•£å‡¦ç†æŠ€è¡“ã€ŒMapReduceã€ã®åˆ©ç‚¹ã‚’ã‚µãƒ³ãƒ—ãƒ«ã‹ã‚‰ã‚¢ãƒ«ã‚´ãƒªã‚ºãƒ ãƒ¬ãƒ™ãƒ«ã§ç†è§£ã—ã€æ˜”ã‹ã‚‰ã‚ã‚‹Javaé–¢é€£ã®åˆ†æ•£å‡¦ç†æŠ€è¡“ã‚’è¦‹ç›´ã™ç‰¹é›†ä¼ç”»ï¼ˆç·¨é›†éƒ¨ï¼‰ ã„ã¾æ³¨ç›®ã®å¤§è¦æ¨¡åˆ†æ•£å‡¦ç†ã‚¢ãƒ«ã‚´ãƒªã‚ºãƒ æœ€è¿‘ã€å¤§è¦æ¨¡åˆ†æ•£å‡¦ç†ãŒæ³¨ç›®ã‚’æµ´ã³ã¦ã„ã¾ã™ã€‚ç‰¹ã«ã€ã€ŒMapReduceã€ã¨ã„ã†ã‚¢ãƒ«ã‚´ãƒªã‚ºãƒ ã«ã¤ã„ã¦ç›®ã«ã™ã‚‹ã“ã¨ãŒå¤šããªã‚Šã¾ã—ãŸã€‚Googleã®è†¨å¤§ãªã‚µãƒ¼ãƒå‡¦ç†ã§ä½¿ã‚ã‚Œã¦ã„ã‚‹ã¨ã„ã†ã“ã¨ã§ã€ã“ã“æ•°å¹´ã®åˆ†æ•£å‡¦ç†æŠ€è¡“ã®ä¸ã§ã¯ç‰¹ã«æ³¨ç›®ã‚’æµ´ã³ã¦ã„ã‚‹ã‚ˆã†ã§ã™ï¼ˆå‚è€ƒã€Œè¦‹ãˆã‚‹ã‚°ãƒ¼ã‚°ãƒ«ã€è¦‹ãˆãªã„ã‚°ãƒ¼ã‚°ãƒ«ã€ï¼‰ã€‚MapReduceã‚¢ãƒ«ã‚´ãƒªã‚ºãƒ ã‚’ä½¿ã†åˆ©ç‚¹ã¨ã¯ã€ã„ã£ãŸã„ä½•ãªã®ã§ã—ã‚‡ã†ã‹ã€‚ãªãœã€ã„ã¾æ³¨ç›®ã‚’æµ´ã³ã¦ã„ã‚‹ã®ã§ã—ã‚‡ã†ã‹ã€‚ ãã®è©³ç´°ã¯ã€ŒMapReduce : Simplified Data Proc
HeavyFeather 2008/07/14
google

hadoop

mapreduce

java

algorithm

scalability

programming
ãƒªãƒ³ã‚¯
1