[B! google] jksyã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

jksy id:jksy

googleã«é–¢ã™ã‚‹jksyã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (5)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

Googleç¤¾ã®åŸºç›¤æŠ€è¡“ã€ŒMapReduceã€ã«ã¤ã„ã¦ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ã«èžã
Googleç¤¾ã®åŸºç›¤æŠ€è¡“ã€ŒMapReduceã€ã«ã¤ã„ã¦ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ã«èžã ç±³Google Inc. Christophe Biscigliaæ° ç±³Google Inc.ã§å¤§è¦æ¨¡ä¸¦åˆ—ãƒ—ãƒã‚°ãƒ©ãƒŸãƒ³ã‚°ã®æ•™è‚²ã‚³ãƒ¼ã‚¹ã€ŒAcademic Cluster Computing Initiativeï¼ˆACCIï¼‰ã€ã®ç«‹æ¡ˆè€…ã§ã‚ã‚‹Senior Software Engineerã®Christophe Biscigliaæ°ã«ï¼Œã‚¤ãƒ³ã‚¿ãƒ“ãƒ¥ãƒ¼ã™ã‚‹æ©Ÿä¼šã‚’å¾—ãŸã€‚Biscigliaæ°ã¯ç¾åœ¨ï¼Œä¸å›½ãƒ»ä¸Šæµ·ã§ã‚µãƒ¼ãƒ“ã‚¹ã®é–‹ç™ºã«æºã‚ã£ã¦ã„ã‚‹ã€‚ â€•â€•Googleã®ã‚µãƒ¼ãƒ“ã‚¹ã‚’æ”¯ãˆã‚‹æŠ€è¡“ã¨ã—ã¦ï¼ŒACCIã§æ•™ãˆã¦ã„ã‚‹ã®ã¯ä½•ã‹ã€‚ Christophe Biscigliaæ°ã€€ä¸¦åˆ—å‡¦ç†ã®ãƒ—ãƒã‚°ãƒ©ãƒŸãƒ³ã‚°/ãƒ¢ãƒ‡ãƒ«ã§ã‚ã‚‹ã€ŒMapReduceã€ã¨åˆ†æ•£ãƒ•ã‚¡ã‚¤ãƒ«ãƒ»ã‚·ã‚¹ãƒ†ãƒ ã§ã‚ã‚‹ã€ŒGFSï¼ˆGoogle File Systemï¼‰ã€ã ã€‚ã“ã‚Œã‚‰ã‚’å®Ÿè£…ã—ãŸã€ŒHadoop
jksy 2008/12/09
google app engine

map reduce

google
ãƒªãƒ³ã‚¯
ã€ãƒã‚¦ãƒ„ãƒ¼ã€‘ã‚‚ã†è©¦ã—ã¾ã—ãŸã‹? Googleã®è„†å¼±æ€§ç™ºè¦‹ãƒ„ãƒ¼ãƒ«ã€Œratproxyã€ (1) XSSå•é¡Œãªã©ã‚’æ¤œå‡ºå¯èƒ½ | ã‚¨ãƒ³ã‚¿ãƒ¼ãƒ—ãƒ©ã‚¤ã‚º | ãƒžã‚¤ã‚³ãƒŸã‚¸ãƒ£ãƒ¼ãƒŠãƒ«
Webã‚¢ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³é–‹ç™ºè€…ã«ã¨ã£ã¦åˆ‡ã£ã¦ã‚‚åˆ‡ã‚Œãªã„å•é¡Œâ€•â€•ãã‚ŒãŒã‚»ã‚ãƒ¥ãƒªãƒ†ã‚£å¯¾ç–ã ã€‚æ—¥å¢—ã—ã«è¤‡é›‘ã«ãªã£ã¦ã„ãè¦ä»¶ãƒ»æ©Ÿèƒ½ã«å¯¾ã™ã‚‹è„†å¼±æ€§æ¤œæŸ»ã«æ‚²é³´ã‚’ã‚ã’ã¦ã„ã‚‹ãƒ‡ãƒ™ãƒãƒƒãƒ‘/ãƒ†ã‚¹ã‚¿ãƒ¼ã‚‚å¤šã„ã“ã¨ã ã‚ã†ã€‚ãã®ã‚ˆã†ãªä¸ã€ã‚ã®GoogleãŒã€ç¤¾å†…ã§ã‚‚æ´»ç”¨ã—ã¦ã„ã‚‹è„†å¼±æ€§ç™ºè¦‹ãƒ„ãƒ¼ãƒ«ã‚’ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹åŒ–ã—ã¦å…¬é–‹ã—ãŸã€‚åŒãƒ„ãƒ¼ãƒ«ã¯è„†å¼±æ€§æ¤œæŸ»ã®æ–°ã—ã„æ±ºã‚æ‰‹ã¨ãªã‚‹ã‹ã€‚ä»¥ä¸‹ã€åŸºæœ¬çš„ãªä½¿ã„æ–¹ã‚„ä¸»è¦æ©Ÿèƒ½ã«ã¤ã„ã¦ç´¹ä»‹ã—ã¦ã„ã“ã†ã€‚ Googleç¤¾å†…ã§ç¾å½¹ã®è„†å¼±æ€§æ¤œçŸ¥ãƒ„ãƒ¼ãƒ« - ratproxy Googleã¯1æ—¥(ç±³å›½æ™‚é–“)ã€Webã‚¢ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ã®ã‚»ã‚ãƒ¥ãƒªãƒ†ã‚£ç›£æŸ»ã‚’å®Ÿæ–½ã™ã‚‹ãƒ„ãƒ¼ãƒ«ã€Œratproxyã€ã‚’ãƒªãƒªãƒ¼ã‚¹ã—ãŸã€‚ratproxyã¯ãƒ—ãƒã‚ã‚·ã‚µãƒ¼ãƒã¨ã—ã¦å‹•ä½œã™ã‚‹ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã€‚åŒã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã‚’çµŒç”±ã—ã¦Webã‚¢ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ã‚’æ“ä½œã™ã‚‹ã“ã¨ã§ã€XSS(Cross Site Scripting)å•é¡Œã‚„ä¸é©åˆ‡ãªXSRF(Cr
jksy 2008/07/18
ã™ã°ã‚‰ã—ã„

google

security
ãƒªãƒ³ã‚¯
ã‚°ãƒ¼ã‚°ãƒ« ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ã®ã¾ã˜ã‚ãªæ—¥å¸¸ â€• ï¼ IT
ã‚°ãƒ¼ã‚°ãƒ«ãŒã©ã®ã‚ˆã†ã«ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢é–‹ç™ºã‚’è¡Œã£ã¦ã„ã‚‹ã‹ã¯ã€ã“ã‚Œã¾ã§ã‚ã¾ã‚Šè©³ç´°ãŒæ˜Žã‚‰ã‹ã«ã•ã‚Œã¦ã“ãªã‹ã£ãŸã€‚ã ãŒã‚°ãƒ¼ã‚°ãƒ«ã¯6æœˆ10æ—¥ã€é–‹ç™ºè€…å‘ã‘ã‚¤ãƒ™ãƒ³ãƒˆã€ŒGoogle Developer Day 2008 Japanã€ã‚’é–‹å‚¬ã—ã€ã‚°ãƒ¼ã‚°ãƒ«ã®ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ãŒã‚°ãƒ¼ã‚°ãƒ«ã§ã®ä»•äº‹è¡“ã‚’èªžã‚‹ã€ŒGoogle ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ã®æ—¥å¸¸ã€ã¨ã„ã†è¬›æ¼”ä¼šã‚’å®Ÿæ–½ã—ãŸã€‚ã‚¹ãƒ”ãƒ¼ã‚«ãƒ¼ã¯ã€NECã§IT ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ã¨ã—ã¦å‹¤å‹™ã—ãŸçµŒé¨“ãŒã‚ã‚‹è—¤å³¶å‹‡é€ æ°ã€‚2006å¹´ã‹ã‚‰ã‚°ãƒ¼ã‚°ãƒ«ã®ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ã¨ã—ã¦åƒã„ã¦ã„ã‚‹ã€‚è—¤å³¶æ°ã¯ã€ã‚°ãƒ¼ã‚°ãƒ«ã§ã®ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢é–‹ç™ºæ–¹æ³•ã«ã¤ã„ã¦ã€ã‚°ãƒ¼ã‚°ãƒ«ã®ã‚«ãƒ«ãƒãƒ£ãƒ¼ã¨è‡ªèº«ã®è¦‹è§£ã‚’ç¹”ã‚Šäº¤ãœã¦èªžã£ãŸã€‚ ã‚°ãƒ¼ã‚°ãƒ« ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ã®1æ—¥ã®æµã‚Œ è—¤å³¶æ°ã®1æ—¥ã¯ã€æœ10æ™‚ã”ã‚å‡ºç¤¾ã—ã€ãƒ¡ãƒ¼ãƒ«ã‚’ãƒã‚§ãƒƒã‚¯ã™ã‚‹ã“ã¨ã‹ã‚‰å§‹ã¾ã‚‹ã€‚ã“ã®æ™‚é–“ã«ãƒ¡ãƒ¼ãƒ«ã‚’è¦‹ã‚‹ç†ç”±ã¯ã€ç±³å›½ã«ã„ã‚‹åŒåƒšã«é€£çµ¡ãŒä»˜ãã‚„ã™ã„æ™‚é–“å¸¯ã ã‹ã‚‰ã ã€‚ åˆå‰ä¸ã®ä¸»ãª
jksy 2008/06/12
google

ã‚ã¨ã§èªã‚€

ä»•äº‹
ãƒªãƒ³ã‚¯
MapReduce - naoyaã®ã¯ã¦ãªãƒ€ã‚¤ã‚¢ãƒªãƒ¼
"MapReduce" ã¯ Google ã®ãƒãƒƒã‚¯ã‚¨ãƒ³ãƒ‰ã§åˆ©ç”¨ã•ã‚Œã¦ã„ã‚‹ä¸¦åˆ—è¨ˆç®—ã‚·ã‚¹ãƒ†ãƒ ã§ã™ã€‚æ¤œç´¢ã‚¨ãƒ³ã‚¸ãƒ³ã®ã‚¤ãƒ³ãƒ‡ãƒƒã‚¯ã‚¹ä½œæˆã‚’ã¯ã˜ã‚ã¨ã™ã‚‹ã€å¤§è¦æ¨¡ãªå…¥åŠ›ãƒ‡ãƒ¼ã‚¿ã«å¯¾ã™ã‚‹ãƒãƒƒãƒå‡¦ç†ã‚’æƒ³å®šã—ã¦ä½œã‚‰ã‚ŒãŸã‚·ã‚¹ãƒ†ãƒ ã§ã™ã€‚ MapReduce ã®é¢ç™½ã„ã¨ã“ã‚ã¯ã€map() ã¨ reduce() ã¨ã„ã†äºŒã¤ã®é–¢æ•°ã®çµ„ã¿åˆã‚ã›ã‚’å®šç¾©ã™ã‚‹ã ã‘ã§ã€å¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿ã«å¯¾ã™ã‚‹æ§˜ã€…ãªè¨ˆç®—å•é¡Œã‚’è§£æ±ºã™ã‚‹ã“ã¨ãŒã§ãã‚‹ç‚¹ã§ã™ã€‚ MapReduce ã®è¨ˆç®—ãƒ¢ãƒ‡ãƒ« map() ã«ã¯ãã®è¨ˆç®—å•é¡Œã®ãƒ‡ãƒ¼ã‚¿ã¨ã—ã¦ã® key-value ãƒšã‚¢ãŒæ¬¡ã€…ã«æ¸¡ã£ã¦ãã¾ã™ã€‚map() ã§ã¯ key-value å€¤ã®ãƒšã‚¢ã‚’ç•°ãªã‚‹è¤‡æ•°ã® key-value ãƒšã‚¢ã«å¤‰æ›ã—ã¾ã™ã€‚reduce() ã«ã¯ã€map() ã§ä½œã£ãŸ key-value ãƒšã‚¢ã‚’åŒä¸€ã® key ã§æŸããŸã‚‚ã®ãŒé †ç•ªã«æ¸¡ã£ã¦ãã¾ã™ã€‚ãã® key-values ãƒšã‚¢ã‚’ä»»æ„ã®å½¢å¼ã«å¤‰æ›ã™ã‚‹ã“ã¨
jksy 2008/05/12
google

åˆ†æ•£

mapreduce
ãƒªãƒ³ã‚¯
ã€ŒGoogleã‚’æ”¯ãˆã‚‹æŠ€è¡“ã€ã«è¼‰ã£ã¦ã„ãªã„æ—¥æœ¬èªžæ¤œç´¢ã‚¨ãƒ³ã‚¸ãƒ³ã®æŠ€è¡“ - nokunoã®æ—¥è¨˜
Webæ¤œç´¢ã‚¨ãƒ³ã‚¸ãƒ³ã¯ã€å¤§ããåˆ†ã‘ã¦æ¬¡ã®2ã¤ã‹ã‚‰ãªã‚Šã¾ã™ã€‚åˆ©ç”¨è€…ã‹ã‚‰ã®ã‚¯ã‚¨ãƒªãƒ¼ã‚’ç›´æŽ¥å—ã‘ã‚‹æ¤œç´¢ã‚µãƒ¼ãƒæ¤œç´¢ã‚µãƒ¼ãƒã‹ã‚‰åˆ©ç”¨ã•ã‚Œã‚‹ã‚¤ãƒ³ãƒ‡ãƒƒã‚¯ã‚¹ä¸–ç•Œä¸ã®Webã‚µã‚¤ãƒˆã‚’é›†ã‚ã¦ãã¦è§£æžã—ã€ã‚¤ãƒ³ãƒ‡ãƒƒã‚¯ã‚¹ã«ç™»éŒ²ã™ã‚‹ã‚¯ãƒãƒ¼ãƒ©ã‚¤ãƒ³ãƒ‡ãƒƒã‚¯ã‚¹ã¨ã„ã†ã®ã¯ã€åˆ©ç”¨è€…ã‹ã‚‰æ¤œç´¢ã•ã‚Œã‚‹å˜èªžã‚’ã‚ã‚‰ã‹ã˜ã‚åˆ—æŒ™ã—ã¦ãŠã„ã¦ã€å˜èªžã‹ã‚‰Webã‚µã‚¤ãƒˆã®URLã‚’å¼•ãã®ã«å¿…è¦ãªãƒ‡ãƒ¼ã‚¿æ§‹é€ ã®ã“ã¨ã§ã™ã€‚æ¤œç´¢ã‚¨ãƒ³ã‚¸ãƒ³ã¯Googleã‚’æ”¯ãˆã‚‹æŠ€è¡“ã«ã‚ã‚‹ã‚ˆã†ã«ã€ã€Œä¸‹æº–å‚™ãŒã‚ã‚Œã°ã“ãã®é«˜æ€§èƒ½ã€ãªã‚ã‘ã§ã™ã€‚ ã‚¤ãƒ³ãƒ‡ãƒƒã‚¯ã‚¹ã‚’ä½œæˆã™ã‚‹ãŸã‚ã«ã¯ã€ã‚ã‚‰ã‹ã˜ã‚Webãƒšãƒ¼ã‚¸ã®å†…å®¹ã‚’å˜èªžã«åˆ†å‰²ã™ã‚‹å¿…è¦ãŒã‚ã‚Šã¾ã™ã€‚è‹±èªžã§ã¯å˜èªžã¨å˜èªžã®é–“ã‚’ã‚¹ãƒšãƒ¼ã‚¹ã§åŒºåˆ‡ã‚‹ãŸã‚ã€ã“ã®ä½œæ¥ã¯ã•ã»ã©é›£ã—ãã‚ã‚Šã¾ã›ã‚“ã€‚ã—ã‹ã—æ—¥æœ¬èªžã§ã¯ã€å˜èªžã®å¢ƒç•Œã¯ãã‚Œã»ã©è‡ªæ˜Žã§ã¯ãªã„ãŸã‚ã€æ—¥æœ¬èªžç‰¹æœ‰ã®å‡¦ç†ã‚’ã™ã‚‹å¿…è¦ãŒã‚ã‚Šã¾ã™ã€‚ æ—¥æœ¬èªžã®æ–‡ã‹ã‚‰å˜èªžã«åˆ†è§£ã™ã‚‹ã«ã¯ã€å½¢æ…‹ç´ è§£æžã‚’ä½¿ã†å ´åˆã¨ã€N-gramã‚’ä½¿ã†å ´åˆãŒã‚ã‚Šã€ã
jksy 2008/05/03
*ã‚ã¨ã§èªã‚€

google

ã‚¤ãƒ³ãƒ‡ãƒƒã‚¯ã‚¹
ãƒªãƒ³ã‚¯
1