SILT: A Memory-Efï¬cient, High-Performance Key-Value Store [pdf]
To appear in Proceedings of the 23rd ACM Symposium on Operating Systems Principles (SOSP’11) This version is reformatted from the official version that appears in the conference proceedings. SILT: A Memory-Efficient, High-Performance Key-Value Store Hyeontaek Lim1, Bin Fan1, David G. Andersen1, Michael Kaminsky2 1Carnegie Mellon University, 2Intel Labs ABSTRACT SILT (Small Index Large Table) is a
MapReduce: Simplified Data Processing on Large Clusters
OSDI'04: Sixth Symposium on Operating System Design and Implementation, San Francisco, CA (2004), pp. 137-150 MapReduce is a programming model and an associated implementation for processing and generating large data sets. Users specify a map function that processes a key/value pair to generate a set of intermediate key/value pairs, and a reduce function that merges all intermediate values associa
The Google File System
Proceedings of the 19th ACM Symposium on Operating Systems Principles, ACM, Bolton Landing, NY (2003), pp. 20-43 We have designed and implemented the Google File System, a scalable distributed file system for large distributed data-intensive applications. It provides fault tolerance while running on inexpensive commodity hardware, and it delivers high aggregate performance to a large number of cli
Failure Trends in a Large Disk Drive Population [pdf]
Appears in the Proceedings of the 5th USENIX Conference on File and Storage Technologies (FAST’07), February 2007 Failure Trends in a Large Disk Drive Population Eduardo Pinheiro, Wolf-Dietrich Weber and Luiz Andr´e Barroso Google Inc. 1600 Amphitheatre Pkwy Mountain View, CA 94043 {edpin,wolf,luiz}@google.com Abstract It is estimated that over 90% of all new information produced in the world is
5th USENIX Conference on File and Storage Technologies - Paper
2 Methodology 2.1 What is a disk failure? While it is often assumed that disk failures follow a simple fail-stop model (where disks either work perfectly or fail absolutely and in an easily detectable manner [22,24]), disk failures are much more complex in reality. For example, disk drives can experience latent sector faults or transient performance problems. Often it is hard to correctly attribut
Informatics at Edinburgh: Informatics Theses
Informatics PhD Theses and MSc Dissertations Informatics Dissertations are made available as and when they are approved in their final form. Any relevant and published thesis can be found on the Edinburgh Research Archive. Informatics Forum, 10 Crichton Street, Edinburgh, EH8 9AB, Scotland, UK Tel: +44 131 651 5661, Fax: +44 131 651 1426, E-mail: [email protected] Please contact our webad
What are the seminal papers in distributed systems? Why?
Answer (1 of 12): Note: this is slightly biased to the problems of scalable online processing systems (mostly data storage and messaging). As such I may be leaving out papers related to other (equally important) topics such as HPC, security in distributed systems and may be leaving out important ...
Mapreduce & Hadoop Algorithms in Academic Papers (4th update – May 2011) | atbrox
Mapreduce & Hadoop Algorithms in Academic Papers (4th update – May 2011) Follow @atbrox It’s been a year since I updated the mapreduce algorithms posting last time, and it has been truly an excellent year for mapreduce and hadoop – the number of commercial vendors supporting it has multiplied, e.g. with 5 announcements at EMC World only last week (Greenplum, Mellanox, Datastax, NetApp, and Snaplog
SVMツールã¨é–¢é€£ã™ã‚‹è«–æ–‡ã¾ã¨ã‚ - EchizenBlog-Zwei
最近SVM(Support Vector Machine)周りã®å¾©ç¿’ã‚’ã—ã¦ã„ã‚‹ã®ã§æœ‰åã©ã“ã‚ã®ãƒ„ールã¨ã€ãã‚Œã«é–¢é€£ã™ã‚‹è«–文をã¾ã¨ã‚ãŸã€‚完全ã«å€‹äººç”¨ãƒ¡ãƒ¢ãªã®ã§æŠœã‘ãŒã‚ã‚‹ã‹ã‚‚。ã‚ãã¾ã§å‚考程度ã«ã€‚ ツールã¯è‰²ã€…ã‚ã‚‹ã‘ã‚Œã©ä½¿ã†ã®ãŒç›®çš„ãªã‚‰å®šç•ªã®svmlightã‚„libsvmãŒã„ã„æ°—ãŒã™ã‚‹ã€‚最近ã ã¨liblinearãŒæµè¡Œã£ã¦ã„る。SVMã¨ã„ãˆã°ã‚«ãƒ¼ãƒãƒ«é–¢æ•°ã¨ãƒžãƒ¼ã‚¸ãƒ³æœ€å¤§åŒ–ã ã‘ã‚Œã©ã€æœ€è¿‘ã§ã¯ã‚«ãƒ¼ãƒãƒ«ã¯ç·šå½¢ã§ã„ã„ã‚„ã¨ã„ã†æµã‚Œã«ãªã£ã¦ãã¦ã„る？個人的ã«ã¯pegasosãŒã‚ã‹ã‚Šæ˜“ã„線形カーãƒãƒ«ï¼‹ã‚ªãƒ³ãƒ©ã‚¤ãƒ³å¦ç¿’ã«ãªã£ã¦ã„ã¦è‡ªåˆ†ã§ä½œã£ã¦éŠã¶ã«ã¯è‰¯ã„ã¨æ€ã£ã¦ã„る。ã¾ãŸsvmsgdã¯"straightforward stochastic gradient descent"ã¨è¨€ã£ã¦ã„ã‚‹ã‚‚ã®ã®éžå¸¸ã«é«˜æ€§èƒ½ã§ã€ãれを実ç¾ã™ã‚‹ãŸã‚ã®æ§˜ã€…ãªå·¥å¤«ãŒæ–½ã•ã‚Œã¦ã„ã¦å®Ÿè£…ã‚’å¦ã¶ä¸Šã§å¤§å¤‰å‚考ã«ãªã‚‹ã€‚ã“ã“ã«ã¯æŒ™ã’ã¦ã„ãªã„ã‘ã‚Œã©ã€ç·šå½¢ã‚«
Google Megastore: The Data Engine Behind GAE – Perspectives
Disclaimer: The opinions expressed here are my own and do not necessarily represent those of current or past employers. Recent CommentsRaffaele on David Patterson Retires After 40 YearsJames Hamilton on David Patterson Retires After 40 YearsJames Hamilton on Pat SelingerMariana Carvalho on Pat SelingerRaffaele Santopaolo on David Patterson Retires After 40 YearsJames Hamilton on Seagate HAMRTom Da
リリースã€éšœå®³æƒ…å ±ãªã©ã®ã‚µãƒ¼ãƒ“スã®ãŠçŸ¥ã‚‰ã›
最新ã®äººæ°—エントリーã®é…ä¿¡
j次ã®ãƒ–ックマーク
kå‰ã®ãƒ–ックマーク
lã‚ã¨ã§èªã‚€
eコメント一覧を開ã
oページを開ã
YSmart: Yet Another SQL-to-MapReduce Translator [pdf]
https://www.cs.umbc.edu/~hillol/DDMBIB/ddmbib.pdf
Empirical Measurements of Disk Failure Rates and Error Rates - Microsoft Research
http://www.cs.ucsb.edu/~sudipto/papers/md-hbase.pdf
Toward an Understanding of the Motivation of Open Source Software Developers [pdf]
http://db.csail.mit.edu/projects/cstore/abadicidr07.pdf
https://www.comp.nus.edu.sg/~vldb2010/proceedings/files/papers/R29.pdf
https://www.sigops.org/s/conferences/sosp/2009/papers/isard-sosp09.pdf
test.dvi
Data Cube: A Relational Aggregation Operator Generalizing Group-By, Cross-Tab, and Sub-Totals - Microsoft Research
{{#tags}}- {{label}}
{{/tags}}