Sneakernet
Part of a series on |
File sharing |
---|
Sneakernet, also called sneaker net, is an informal term for the transfer of electronic information by physically moving media such as magnetic tape, floppy disks, optical discs, USB flash drives or external hard drives between computers, rather than transmitting it over a computer network. Sneakernets enable data transfer through physical means and offer a solution in the presence of network connections that lack reliability; however, a consequence of this physical transfer is high latency.[1] The term, a tongue-in-cheek play on net(work) as in Internet or Ethernet, refers to walking in sneakers as the transport mechanism.[2] Alternative terms may be floppy net, train net, or pigeon net.
Summary and background
[edit]Sneakernets are in use throughout the computer universe. A sneakernet may be used when computer networks are prohibitively expensive for the owner to maintain; in high-security environments where manual inspection (for re-classification of information) is necessary; where information needs to be shared between networks with different levels of security clearance; when data transfer is impractical due to bandwidth limitations; when a particular system is simply incompatible with the local network, unable to be connected, or when two systems are not on the same network at the same time. Because sneakernets take advantage of physical media, security measures used for the transfer of sensitive information are respectively physical.
This form of data transfer is also used for peer-to-peer (or friend-to-friend) file sharing and has grown in popularity in metropolitan areas and college communities. The ease of this system has been facilitated by the availability of USB external hard drives, USB flash drives and portable music players.[3]
The United States Postal Service offers a Media Mail service for compact discs, among other items. This provides a viable mode of transport for long distance sneakernet use. In fact, when mailing media with sufficiently high data density such as high capacity hard drives, the throughput (data transferred per unit of time) as well as the cost per unit of data transferred may compete favorably with networked methods of data transfer.[4]
A quantum version of sneakernet was proposed in a paper by Simon Devitt and collaborators in 2016.[5]
Usage examples
[edit]Afghanistan
[edit]In 2021 Taliban-governed Afghanistan, "computer kars" distribute Internet-derived content by hand: "Movies, music, mobile applications, iOS updates, and naughty videos. Also creating Apple IDs and social media accounts, and backing up and unlocking phones and recovering data." The kars collectively maintain an archive of hundreds of terabytes of data. Four terabytes of the latest Indian or American movies or Turkish TV dramas, dubbed in the Afghan national languages Dari and Pashto reportedly wholesale for about 800 afghanis, or nine US dollars, while the retail price of five gigabytes of content is 100 afghanis, or one US dollar. Kars report that their earnings have dropped 90% under Taliban rule.[6]
Australia
[edit]When Australia joined Usenet in 1983, it received articles via tapes sent from the United States to the University of Sydney, which disseminated data to dozens of other computers on the country's Unix network.[7]
Bhutan
[edit]The Rigsum Sherig Collection project[8] uses a sneakernet to distribute offline educational resources, including Kiwix and Khan Academy on a Stick,[9] to hundreds of schools and other educational institutions in the Kingdom of Bhutan. Many of the schools in Bhutan have computers or IT labs, but no Internet connection (or a very slow one).[10] The sneakernet, facilitated by teachers, distributes about 25 GB of free, open-source educational software to the schools, often using external hard disks.
Cuba
[edit]El Paquete Semanal is a roughly 1TB compilation of media, distributed weekly throughout Cuba via portable hard drives and USB memory sticks.[11]
Iran
[edit]A weekly data dump compilation collected through the satellite system Toosheh.
North Korea
[edit]North Korean dissidents have been known to smuggle flash drives filled with western movies and television shows.[12][13][14][15][16]
Pakistan
[edit]The May 2011 raid of Osama bin Laden's compound in Abbottabad, Pakistan, revealed that he used a series of USB thumb drives to store his email drafts. A courier of his would then take the saved emails to a nearby Internet cafe and send them out to the desired recipients.[17][18]
South Africa
[edit]In September 2009, Durban company Unlimited IT reportedly pitted a messenger pigeon against South African ISP Telkom to transfer 4 GB of data 60 miles (97 km) from Howick to Durban. The pigeon, carrying the data on a memory stick, arrived in one hour eight minutes, with the data taking another hour to read from the memory stick. During the same two-hour period, only about 4.2% of the data had been transferred over the ADSL link.[19] A similar experiment was conducted in England in September 2010; the "pigeonnet" also proved superior.[20][21] In November 2009 the Australian comedy/current-affairs television program Hungry Beast repeated this experiment. The experiment had the team transfer a 700 MB file via three delivery methods to determine which was the fastest; A carrier pigeon with a microSD card, a car carrying a USB Stick, or a Telstra ADSL line. The data was to be transferred a distance of 132 kilometres (82 mi) by road. The pigeon won the race with a time of approximately 1 hour 5 minutes, the car came in second at 2 hours 10 minutes, while the internet transfer did not finish, having dropped out a second time and not come back.[22]
Wizzy Digital Courier provided Internet access to schools in South Africa with poor or no network connectivity by implementing UUCP on USB memory sticks. This allowed offline cached email transport and scoops of web pages to back-fill a web cache.[23]
United States
[edit]Google has used a sneakernet to transport large datasets, including 120 TB of data from the Hubble Space Telescope.[24][25] Users of Google Cloud can import their data into Google Cloud Storage through sneakernet.[26]
Oracle similarly offers its Data Transfer Service to customers to migrate data to Oracle Cloud Infrastructure or export data from it.[27]
The SETI@home project uses a sneakernet to overcome bandwidth limitations: data recorded by the radio telescope in Arecibo, Puerto Rico was stored on magnetic tapes which were then shipped to Berkeley, California, for processing. In 2005, Jim Gray reported sending hard drives and even "metal boxes with processors" to transport large amounts of data by postal mail.[28]
Very Long Baseline Interferometry performed using the Very Long Baseline Array ships hard drives to a data reduction site in Socorro, New Mexico. They refer to their data transfer mechanism as "HDOA" (Hard Drives On Airplane).
Data analytics teams in the financial services sector often use sneakernets to transfer sensitive corporate information and information obtained from data mining, such as ledger entries, customer data and financial statistics. There are several reasons for this: firstly, sneakernets can generally provide very high security (and possibly more importantly, they are perceived to be secure) due to the impossibility of a man-in-the-middle attack or packet sniffing; secondly, the volumes of data concerned are often extremely high; and thirdly, setting up secure network links between the client business and the analytics team's facilities is often either impossible or an extremely convoluted process.
In 2015 Amazon Web Services launched AWS Snowball, a 50 lb (23 kg), 50 TB device for transporting data to the AWS cloud;[29] and in 2016 AWS Snowmobile, a truck to transport up to 100 PB of data in one load.[30] For similar reasons, there is also a Google Transfer Appliance, an IBM Cloud Mass Data Migration device,[31] and Microsoft's Azure Data Box Disk service.[32]
Observation data from the Event Horizon Telescope is collected on hard drives which are transported by commercial freight airplanes[33] from the various telescopes to the MIT Haystack Observatory and the Max Planck Institute for Radio Astronomy, where the data is analyzed.[34]
USSR
[edit]In later USSR, the operating system called DEMOS was created and adapted for many types of Soviet computers by cloning versions of UNIX that were brought into USSR on magnetic tapes bypassing the Iron Curtain. This allowed to build Relcom country-wide UUCP network to provide global Usenet access for Soviet users which led to the registration of .su ("Soviet Union") top level domain in 1990.
In media
[edit]Non-fiction
[edit]There's a lot of band-width in a station wagon.
— Fred Gruenberger, Computing: A Second Course[35]
The first USENET citation is July 16, 1985,[citation needed] and it was widely considered an old joke already.[clarification needed]
Never underestimate the bandwidth of a station wagon full of tapes hurtling down the highway.
Other alleged speakers included Tom Reidel, Warren Jackson, or Bob Sutterfield.
Although the station wagon transporting magnetic tapes is generally considered the canonical version, variants using trucks or Boeing 747s or C-5s and later storage technologies such as CD-ROMs, DVDs, Blu-rays, or SD Cards[37] have frequently appeared.
The very first problem in Andrew S. Tanenbaum's 1981 textbook Computer Networks asks the student to calculate the bandwidth of a St. Bernard carrying floppy disks.[38]
Fiction
[edit]- In Minority Report, the computer center of the "Precrime" police division operates by transferring data from one console to another using a thin, flat storage device.
- The Terry Pratchett novel Going Postal (2004) includes a contest between a horse-drawn mail coach and the "Grand Trunk Clacks" (a semaphore line) to see which is faster to transmit the contents of a book to a remote destination.
- William Gibson's novel Spook Country (2007) also features sneakernets, with iPods being the storage device used to clandestinely move information.[39]
- In Cory Doctorow's novel Little Brother, the main character uses the term sneakernet to describe how he and his friends distribute the fictitious XNet software for encrypted communications.
Similar concepts
[edit]- Delay-tolerant networks, such as the Haggle project[40] at Cambridge University.
- IP over Avian Carriers (RFC 1149), an April Fools' Day RFC describing the transmission of messages via homing pigeon.
See also
[edit]References
[edit]- ^ Jaya, Andika Candra; Safitri, Cutifa; Mandala, Rila (December 16, 2020). "Sneakernet: A Technological Overview and Improvement". 2020 IEEE International Conference on Sustainable Engineering and Creative Computing (ICSECC). IEEE. pp. 287–291. doi:10.1109/icsecc51444.2020.9557509. ISBN 978-1-7281-7588-1.
- ^ "sneakernet". Oxford Dictionary. Archived from the original on November 19, 2015. Retrieved September 9, 2016.
- ^ Boutin, Paul (August 26, 2002). "Sneakernet Redux: Walk Your Data". Wired News. Archived from the original on November 19, 2009. Retrieved June 8, 2010.
- ^ Munroe, Randall (February 8, 2013). "FedEx Bandwidth". xkcd what if?. Archived from the original on February 8, 2013. Retrieved September 18, 2019.
- ^ Devitt, Simon J.; Greentree, Andrew D.; Stephens, Ashley M.; Van Meter, Rodney (November 2, 2016). "High-speed quantum networking by ship". Scientific Reports. 6 (1): 36163. Bibcode:2016NatSR...636163D. doi:10.1038/srep36163. PMC 5090252. PMID 27805001.
- ^ Kumar, Ruchi (November 26, 2021). "Can Afghanistan's underground "sneakernet" survive the Taliban?". MIT Technology Review. Retrieved November 26, 2021.
- ^ Marquis, Bret (March 29, 1983). "Australia joins USENET". Newsgroup: net.news.newsite. [email protected]. Retrieved February 14, 2016.
- ^ "Rigsum Sherig Collection". rigsum-it.com. Retrieved August 8, 2023.
- ^ "Khan Academy on a Stick". mujica.org. Retrieved August 8, 2023.
- ^ "Only a Third of Government Schools Have Internet Access". Kuensel. April 18, 2013. Archived from the original on June 15, 2013.
- ^ Kessler, Sarah (July 7, 2015). "In Cuba, An Underground Network Armed With USB Drives Does The Work Of Google And YouTube". Fast Company. Retrieved August 8, 2023.
- ^ "Fighting The State, Without The Web: North Korea's Sneakernet Insurgency".
- ^ Greenberg, Andy (March 1, 2015). "The Plot to Free North Korea with Smuggled Episodes of 'Friends'". Wired.
- ^ "How One Man Wants to Free North Korea With USB Drives and Pirated Movies". Gizmodo. March 2, 2015.
- ^ Crocker, Lizzie (December 22, 2014). "North Korea's Secret Movie Bootleggers: How Western Films Make It Into the Hermit Kingdom". The Daily Beast.
- ^ "Balloon activist sends 'thousands of copies' of The Interview to North Korea". The Guardian. Agence France-Presse. April 8, 2015.
- ^ Apuzzo, Matt; Goldman, Adam (May 13, 2011). "How bin Laden emailed without being detected by US". The Washington Times. Associated Press. Retrieved June 29, 2012.
- ^ McCullagh, Declan (May 13, 2011). "How bin Laden evaded the NSA: Sneakernet". Privacy Inc. CNET. Retrieved May 17, 2011.
- ^ "SA Pigeon 'Faster than broadband'". BBC News. September 10, 2009.
- ^ "BT feathers ruffled over pigeon-based file transfer caper". The Register. September 17, 2010.
- ^ Pigeon flies past broadband in data speed race, BBC News Technology, September 16, 2010
- ^ "The Great Australian Internet Challenge". ABC Television/Hungry Beast. November 10, 2009.
- ^ Lindow, Megan (April 23, 2004). "Seeking Riches From the Poor". Wired.
- ^ "Google helps terabyte data swaps". BBC News. March 7, 2007. Retrieved May 23, 2010.
- ^ Farivar, Cyrus (March 20, 2007). "Google's Next-Gen of Sneakernet". Wired. Retrieved February 5, 2013.
- ^ "Offline Media Import / Export". Google Cloud. Archived from the original on July 15, 2019. Retrieved January 29, 2016.
- ^ "Overview of Data Transfer Service". Retrieved April 30, 2021.
- ^ "A Conversation with Jim Gray". ACM Queue. 1 (4). July 31, 2003. Archived from the original on December 5, 2009.
Who would ever, in this time of the greatest interconnectivity in human history, go back to shipping bytes around via snail mail as a preferred means of data transfer?
- ^ Kastrenakes, Jacob (October 7, 2015). "Amazon made a huge plastic box called Snowball so people can ship data to the cloud". The Verge. Retrieved October 8, 2015.
- ^ Dignan, Larry (November 30, 2016). "AWS' Snowmobile data transport truck highlights why cloud giant is so damn disruptive".
- ^ Sharwood, Simon (September 19, 2017). "IBM packs 120TB into a carry-on bag, for snow-balling cloud uploads". The Register. Retrieved September 19, 2017.
- ^ "What is Azure Data Box?". Microsoft Learn. July 26, 2022.
- ^ "The Hidden Shipping and Handling Behind That Black-Hole Picture". The Atlantic. April 13, 2019. Retrieved April 14, 2019.
- ^ Mearian, Lucas (August 18, 2015). "Massive telescope array aims for black hole, gets gusher of data". Computerworld. Archived from the original on June 3, 2017. Retrieved August 21, 2015.
- ^ Gruenberger, Fred (1971). Computing: A Second Course. San Francisco: Canfield Press. p. 138. ISBN 978-0063834057. Retrieved January 24, 2017.
- ^ Tanenbaum, Andrew S. (1989). Computer Networks. New Jersey: Prentice-Hall. p. 57. ISBN 0-13-166836-6.
- ^ "Fedex Bandwidths". Retrieved April 18, 2023.
- ^ "Updated Textbook Explores Theoretical Basis of Networks". InfoWorld. February 6, 1989. Retrieved April 16, 2019.
- ^ Poole, Steven (August 18, 2007). "Sign language". The Guardian. London. Retrieved September 24, 2009.
- ^ Ben Hui (March 1, 2006). "Haggle". University of Cambridge Computer Laboratory. Archived from the original on June 28, 2015.