Ameba Piggの裏側
•
17 likes•3,281 views
The document describes the architecture of AmebaPigg, a social networking application. It shows that AmebaPigg uses a hadoop cluster for file storage, MySQL for user data storage, and memcached for caching. It also uses various socket servers to handle chat, games, and other functions, with a web app server presenting the interface, all built using Flash (ActionScript 3).
![IndexPersister
NDI
byte[] : byte[]
persister
MySQL
varbinary : longblob
indexPersister persister
Application
Interface
MongoDB
persister
OK
2011 5 16](https://image.slidesharecdn.com/mixi-110515192650-phpapp02/85/Ameba-Pigg-76-320.jpg)
Ameba Piggの裏側
- 1. AmebaPigg 2011 5 16
- 2. 2011 5 16
- 3. (32) / @waysaku 2006 • SIer AmebaPigg 2011 5 16
- 4. (32) / @waysaku 2006 • SIer AmebaPigg 2011 5 16
- 5. AmebaPigg 2011 5 16
- 6. 2009 2 400 2011 5 16
- 7. 2011 5 16
- 8. 2011 5 16
- 9. 2011 5 16
- 10. 6 2011 5 16
- 11. • • 2011 5 16
- 12. 2011 5 16
- 13. 2011 5 16
- 14. 2011 5 16
- 15. 2011 5 16
- 16. (Push ) 2011 5 16
- 17. (Push ) 2011 5 16
- 18. (Push ) 2011 5 16
- 19. File Store Cluster hadoop cluster MySQL memcached memcached web-app server info-socket-server chat-socket-server game-socket-server Flash(ActionScript3) 2011 5 16
- 20. File Store Cluster hadoop cluster MySQL memcached memcached swf img web-app server info-socket-server chat-socket-server game-socket-server Flash(ActionScript3) 2011 5 16
- 21. File Store Cluster hadoop cluster MySQL memcached memcached web-app server info-socket-server chat-socket-server game-socket-server Flash(ActionScript3) 2011 5 16
- 22. File Store Cluster hadoop cluster MySQL memcached memcached web-app server info-socket-server chat-socket-server game-socket-server Flash(ActionScript3) 2011 5 16
- 23. File Store Cluster hadoop cluster MySQL memcached memcached web-app server info-socket-server chat-socket-server game-socket-server Flash(ActionScript3) 2011 5 16
- 24. File Store Cluster hadoop cluster MySQL memcached memcached web-app server info-socket-server chat-socket-server game-socket-server Flash(ActionScript3) 2011 5 16
- 25. File Store Cluster hadoop cluster MySQL memcached memcached web-app server info-socket-server chat-socket-server game-socket-server Flash(ActionScript3) 2011 5 16
- 26. File Store Cluster hadoop cluster MySQL memcached memcached web-app server info-socket-server chat-socket-server game-socket-server Flash(ActionScript3) 2011 5 16
- 27. File Store Cluster hadoop cluster MySQL memcached memcached web-app server info-socket-server chat-socket-server game-socket-server Flash(ActionScript3) 2011 5 16
- 28. File Store Cluster hadoop cluster MySQL memcached DB memcached web-app server info-socket-server chat-socket-server game-socket-server Flash(ActionScript3) 2011 5 16
- 29. File Store Cluster hadoop cluster MySQL memcached memcached web-app server info-socket-server chat-socket-server game-socket-server Flash(ActionScript3) 2011 5 16
- 30. File Store Cluster hadoop cluster MySQL memcached memcached swf web-app server info-socket-server chat-socket-server game-socket-server Flash(ActionScript3) 2011 5 16
- 31. File Store Cluster hadoop cluster MySQL memcached memcached web-app server info-socket-server chat-socket-server game-socket-server Flash(ActionScript3) 2011 5 16
- 32. File Store Cluster hadoop cluster MySQL memcached memcached web-app server info-socket-server chat-socket-server game-socket-server Flash(ActionScript3) 2011 5 16
- 33. File Store Cluster hadoop cluster MySQL memcached memcached web-app server info-socket-server chat-socket-server game-socket-server Flash(ActionScript3) 2011 5 16
- 34. File Store Cluster hadoop cluster MySQL memcached memcached web-app server info-socket-server chat-socket-server game-socket-server Flash(ActionScript3) 2011 5 16
- 35. File Store Cluster hadoop cluster MySQL memcached memcached web-app server info-socket-server chat-socket-server game-socket-server Flash(ActionScript3) 2011 5 16
- 36. File Store Cluster hadoop cluster MySQL memcached memcached web-app server info-socket-server chat-socket-server game-socket-server Flash(ActionScript3) 2011 5 16
- 37. File Store Cluster hadoop cluster MySQL memcached memcached web-app server info-socket-server chat-socket-server game-socket-server Flash(ActionScript3) 2011 5 16
- 38. File Store Cluster hadoop cluster MySQL memcached memcached web-app server info-socket-server chat-socket-server game-socket-server Flash(ActionScript3) 2011 5 16
- 39. File Store Cluster hadoop cluster MySQL memcached memcached web-app server info-socket-server chat-socket-server game-socket-server Flash(ActionScript3) 2011 5 16
- 40. File Store Cluster hadoop cluster MySQL memcached memcached web-app server info-socket-server chat-socket-server game-socket-server Flash(ActionScript3) 2011 5 16
- 41. File Store Cluster hadoop cluster MySQL memcached memcached web-app server info-socket-server chat-socket-server game-socket-server Flash(ActionScript3) 2011 5 16
- 42. File Store Cluster hadoop cluster MySQL memcached memcached web-app server info-socket-server chat-socket-server game-socket-server Flash(ActionScript3) 2011 5 16
- 43. File Store Cluster hadoop cluster MySQL memcached memcached web-app server info-socket-server chat-socket-server game-socket-server Flash(ActionScript3) 2011 5 16
- 44. File Store Cluster hadoop cluster MySQL memcached memcached web-app server info-socket-server chat-socket-server game-socket-server Flash(ActionScript3) 2011 5 16
- 45. File Store Cluster hadoop cluster MySQL memcached memcached web-app server info-socket-server chat-socket-server game-socket-server Flash(ActionScript3) 2011 5 16
- 46. File Store Cluster hadoop cluster MySQL memcached memcached web-app server info-socket-server chat-socket-server game-socket-server Flash(ActionScript3) 2011 5 16
- 47. File Store Cluster hadoop cluster MySQL memcached memcached web-app server info-socket-server chat-socket-server game-socket-server Flash(ActionScript3) 2011 5 16
- 48. File Store Cluster hadoop cluster MySQL memcached memcached web-app server info-socket-server chat-socket-server game-socket-server Flash(ActionScript3) 2011 5 16
- 49. File Store Cluster hadoop cluster MySQL memcached memcached web-app server info-socket-server chat-socket-server game-socket-server Flash(ActionScript3) 2011 5 16
- 50. 2011 5 16
- 51. 2011 5 16
- 52. ActionScript3 + 2011 5 16
- 53. ActionScript3 + Dynamic Module Loading Dependency Injection (LinkedList ) 2011 5 16
- 54. profile.swf core.swc room.swf main.swf main.swf casino.swf fishing.swf shop.swf 2011 5 16
- 55. profile.swf core.swc room.swf main.swf main.swf casino.swf fishing.swf shop.swf swf 2011 5 16
- 56. (socket) 2011 5 16
- 57. (socket) Java + 2011 5 16
- 58. (socket) Java + IO 2011 5 16
- 59. server client <interface> <interface> Command Command AS3 python 2011 5 16
- 60. 2011 5 16
- 61. IndexPersister(Java) + MySQL 2011 5 16
- 62. IndexPersister(Java) + MySQL MySQL MySQL KeyValue 2011 5 16
- 63. IndexPersister @Persistable("address") public class Address { private int userId; private String name;; private byte enable; @IndexKey @Store(index=0) public int getUserId() { return userId; } @Store(index=1) public String getName() { return name; } @Store(index=2) public byte getEnable() { return status; } 2011 5 16
- 64. IndexPersister @Persistable("address") public class Address { private int userId; private String name;; private byte enable; @IndexKey @Store(index=0) public int getUserId() { return userId; } @Store(index=1) public String getName() { return name; } @Store(index=2) public byte getEnable() { return status; } Key : Value userId : userId + name + enable 2011 5 16
- 65. IndexPersister @Persistable("address") public class Address { private int userId; private String name;; private byte enable; @IndexKey @Store(index=0) public int getUserId() { return userId; } @Store(index=1) public String getName() { return name; } @Store(index=2) public byte getEnable() { return status; } Key : Value userId : userId + name + enable 2011 5 16
- 66. IndexPersister @Persistable("address") public class Address { private int userId; private String name;; private byte enable; @IndexKey @Store(index=0) public int getUserId() { return userId; } @Store(index=1) public String getName() { return name; } @Store(index=2) public byte getEnable() { return status; } Key : Value userId : userId + name + enable 2011 5 16
- 67. IndexPersister @Persistable("address") public class Address { private int userId; private String name;; private byte enable; @IndexKey @Store(index=0) public int getUserId() { return userId; } @Store(index=1) public String getName() { return name; } @Store(index=2) public byte getEnable() { return status; } Key : Value userId : userId + name + enable 2011 5 16
- 68. IndexPersister @Persistable("address") public class Address { private int userId; private String name;; private byte enable; @IndexKey @Store(index=0) public int getUserId() { return userId; } @Store(index=1) public String getName() { return name; } @Store(index=2) public byte getEnable() { return status; } Key : Value userId : userId + name + enable 2011 5 16
- 69. IndexPersister 2011 5 16
- 70. IndexPersister 2011 5 16
- 71. IndexPersister 2011 5 16
- 72. IndexPersister 2011 5 16
- 73. IndexPersister 2011 5 16
- 74. IndexPersister 2011 5 16
- 75. IndexPersister 2011 5 16
- 76. IndexPersister NDI byte[] : byte[] persister MySQL varbinary : longblob indexPersister persister Application Interface MongoDB persister OK 2011 5 16
- 77. MySQL Key Value `key` varbinary(255) NOT NULL `value` longblob NOT NULL 2011 5 16
- 78. MySQL Key Value `key` varbinary(255) NOT NULL `value` longblob NOT NULL Ameba MySQL • MySQL I/O I/O Accerarator(FusionIO) 2011 5 16
- 79. • • • • • • 2011 5 16
- 80. Flash 2011 5 16
- 81. Flash 2011 5 16
- 82. 2011 5 16
- 83. File Store Cluster hadoop cluster MySQL memcached memcached web-app server info-socket-server chat-socket-server game-socket-server Flash(ActionScript3) 2011 5 16
- 84. File Store Cluster hadoop cluster MySQL memcached memcached web-app server info-socket-server chat-socket-server game-socket-server 10 Flash(ActionScript3) 2011 5 16
- 85. File Store Cluster hadoop cluster MySQL memcached memcached web-app server info-socket-server chat-socket-server game-socket-server 10 2.2Gbps Flash(ActionScript3) 2011 5 16
- 86. File Store Cluster hadoop cluster MySQL memcached memcached (Query Per Second) 14 QPS 30 QPS web-app server info-socket-server chat-socket-server game-socket-server 10 2.2Gbps Flash(ActionScript3) 2011 5 16
- 87. 2011 5 16
- 88. 2011 5 16
- 89. CPU 2011 5 16
- 90. CPU 2011 5 16
- 91. CPU 2011 5 16
- 92. CPU 2011 5 16
- 93. 2011 5 16
- 94. 2011 5 16
- 95. 2011 5 16
- 96. 2011 5 16
- 97. 2011 5 16
- 98. 2011 5 16
- 99. 2011 5 16
- 100. • • • • etc... 2011 5 16
- 101. • 100• 3GB/day • • etc... 2011 5 16
- 102. 2011 5 16
- 103. hadoop cluster File Store Cluster MySQL web-app server info-socket-server chat-socket-server game-socket-server Flash(ActionScript3) 2011 5 16
- 104. hadoop cluster File Store Cluster MySQL web-app server info-socket-server chat-socket-server game-socket-server Flash(ActionScript3) 2011 5 16
- 105. hadoop cluster File Store Cluster MySQL KVS web-app server info-socket-server chat-socket-server game-socket-server Flash(ActionScript3) 2011 5 16
- 106. KVS Namura Distributed Index(NDI) 2008 KVS 2011 5 16
- 107. KVS Namura Distributed Index(NDI) 2008 KVS range search by key auto sharding auto failover on memory 2011 5 16
- 108. KVS Namura Distributed Index(NDI) 2008 KVS range search by key auto sharding auto failover on memory 200 • 2011 5 16
- 109. NDI MySQL 200 MySQL × 4 2011 5 16
- 110. NDI MySQL 200 MySQL × 4 MySQL I/O 2011 5 16
- 111. FusionIO NAND SSD(I/O Accerarator) Read HD 5 Write HD 7 8 2011 5 16
- 112. Fusion-io 2011 5 16
- 113. SAS RAID5 FusionIO 2011 5 16
- 114. MySQL QPS CPU Load Average Traffic 2011 5 16
- 115. MySQL QPS CPU Load Average Traffic 2011 5 16
- 116. 2011 5 16
- 117. • • • 2011 5 16
- 118. • • • ※ 2011 5 16
- 119. AmebaPigg 2011 5 16
- 120. 2011 5 16
- 121. 2011 5 16
- 122. 2011 5 16
- 123. 2011 5 16
- 124. 2011 5 16
- 125. 2011 5 16