GitHub - restic/others: Exhaustive list of backup solutions for Linux
Tags used below: authenticated: Uses cryptographic signatures or MAC tags to ensure integrity compression: Storage with compression dedup: Supports deduplication encrypted: Supports encrypting data locally (stored encrypted on the backup medium) error-correction: Supports reconstructing data in scenarios x-of-n backup media are lost filesystem: Backups are stored on a regular filesystem in plainte
GoogleãŒé–‹ç™ºã—ãŸé«˜é€Ÿãƒ•ã‚¡ã‚¤ãƒ«è»¢é€ãƒ„ール「CDC File Transferã€ãŒç„¡æ–™å…¬é–‹ä¸
GoogleãŒæä¾›ã—ã¦ã„ãŸã‚¯ãƒ©ã‚¦ãƒ‰ã‚²ãƒ¼ãƒ サービス「Stadiaã€ã¯ã€ã‚¹ãƒšãƒƒã‚¯ã®ä½Žã„PCやスマートフォンãªã©ã§ã‚‚インターãƒãƒƒãƒˆã‚’介ã—ã¦é«˜ç”»è³ªãªã‚²ãƒ¼ãƒ を楽ã—ã‚るサービスã¨ã—ã¦æ³¨ç›®ã‚’集ã‚ã¦ã„ã¾ã—ãŸãŒã€2022å¹´ã«ã‚µãƒ¼ãƒ“ス終了ãŒç™ºè¡¨ã•ã‚Œã¾ã—ãŸã€‚ãã‚“ãªStadiaã®é–‹ç™ºéŽç¨‹ã§ç”Ÿã¿å‡ºã•ã‚ŒãŸãƒ•ã‚¡ã‚¤ãƒ«è»¢é€ãƒ„ール「CDC File Transferã€ãŒã€ã‚ªãƒ¼ãƒ—ンソースã§å…¬é–‹ã•ã‚Œã¦ã„ã¾ã™ã€‚ GitHub - google/cdc-file-transfer: Tools for synching and streaming files from Windows to Linux https://github.com/google/cdc-file-transfer CDC File Transferã®é–‹ç™ºãƒãƒ¼ãƒ ã«ã‚ˆã‚‹ã¨ã€Stadiaã®é–‹ç™ºã«ã¯LinuxマシンãŒç”¨ã„られã¦ã„ãŸã¨ã®ã“ã¨ã€‚ã—ã‹ã—ã€å¸‚å ´ã«æµé€šã—ã¦ã„ã‚‹
GitHub - hjmangalam/parsyncfp: follow-on to parsync (parallel rsync) with better startup perf
NB: If you don't want to transfer at least 10s of GB across a network, this is probably not the the tool you want. Use rsync alone if a sync, 'tar and netcat' if a fresh copy, or scp if the copy needs to be encrypted. parsyncfp is the offspring of my parsync (more info here) and Ganael LaPlanche's fpart, which collects files based on size or number into chunkfiles which can be fed to rsync on a ch
rsyncを高速ã«
追記（2025.02.09）：手軽ã«é«˜é€ŸåŒ–ã—ãŸã„ãªã‚‰ã€parasyncを使ã£ã¦ã¿ã¦ãã ã•ã„。 ã¯ã˜ã‚ã«ï¼šrsyncã«é™ã‚‰ãšã€é«˜é€Ÿã«Azureã«ãƒ‡ãƒ¼ã‚¿ã‚’コピーã§ãã‚‹ä»–ã®æ‰‹æ®µã§ã‚‚良ã„ãªã‚‰ã€azcopyを使ãŠã†ã€‚ 1TBã®ãƒ‡ãƒ¼ã‚¿ã‚’rsyncã§ã‚¤ãƒ³ã‚¿ãƒ¼ãƒãƒƒãƒˆçµŒç”±ã§Azureã«åŒæœŸã—ãŸã„ã‚ã‘ã§ã™ãŒã€æ™®é€šã« $ rsync source_directory/ rsync://myrsyncserver.japaneast.cloudapp.azure.com/target_directory/ ãªã‚“ã¦ã‚„ã£ã¦ãŸã‚‰ã€è¶…絶時間ãŒã‹ã‹ã‚‹ã‚ã‘ã§ã€ä½•ã¨ã‹ã—ãŸã„。 拙宅ã§ã¯auã²ã‹ã‚Šãƒ›ãƒ¼ãƒ 10Gã‚’å°Žå…¥ã—ã¦ã„ã‚‹ã®ã§ã€Azureæ±æ—¥æœ¬ãƒªãƒ¼ã‚¸ãƒ§ãƒ³ã¾ã§ãã“ãã“ã®ã‚¹ãƒ”ードãŒå‡ºã‚‹ã¯ãšã€‚ Standard_D16s_v3ã®VMã«Ubuntu 18.04-LTSã€OS Diskã¯IOPSã‚’ã‚る程度確ä¿ã™ã‚‹ãŸã‚ã«512GBã®Prem
rsyncã®æ‚²åŠ‡ 〜本番環境を消ã—飛ã°ã™å‰ã«è¦šãˆã¦ãŠããŸã„ã“ã¨ã€œ
ã“ã®è¨˜äº‹ã¯æœ¬ç•ªç’°å¢ƒã§ã‚„らã‹ã—ã¡ã‚ƒã£ãŸäºº Advent Calendar 2019 17日目ã®è¨˜äº‹ã§ã™ã€‚ ã¯ã˜ã‚ã¾ã—ã¦ã€ãƒ€ãƒ¼ã‚·ãƒŽ(@bc_rikko)ã§ã™ã€‚ çªç„¶ã§ã™ãŒã€æ‡ºæ‚”ã—ã¾ã™ã€‚ ç§ã¯è»¢è·ã—ã¦10ヶ月ã§2回も本番環境をã¶ã£é£›ã°ã—ã¾ã—ãŸã€‚ãŠå®¢æ§˜ã‚’ã¯ã˜ã‚ã€é–¢ä¿‚å„ä½ã«ã¯å¤šå¤§ãªã‚‹ã”迷惑をãŠã‹ã‘ã—ãŸã“ã¨ã‚’ã€ã“ã“ã§ãŠè©«ã³ç”³ã—上ã’ã¾ã™ã€‚ 1回目ã¯2015å¹´11月27æ—¥ã€å…¥ç¤¾27日目ã®ã“ã¨ã€‚ gitã®è¨å®šãƒŸã‚¹ã«ã‚ˆã‚Šå£Šã‚ŒãŸãƒ–ランãƒã‚’masterã«force pushã—ã¦ã—ã¾ã„ã€CIãŒæµã‚Œã¦æœ¬ç•ªç’°å¢ƒãŒå£Šã‚ŒãŸã€‚åŽŸå› ã¯push.defaultãªã®ã ãŒã€è©³ã—ãã¯ã™ã§ã«è¨˜äº‹ã‚’書ã„ã¦ã„ã‚‹ã®ã§ãã¡ã‚‰ã‚’èªã‚“ã§ã»ã—ã„。 2回目ã¯ç¿Œå¹´9月1æ—¥ã€å…¥ç¤¾ã—ã¦ã¡ã‚‡ã†ã©10ヶ月ãŸã£ãŸæ—¥ã®ã“ã¨ã 。 ã¾ãŸã—ã¦ã‚‚本番環境をã¶ã£é£›ã°ã—ãŸã€‚ã—ã‹ã‚‚ã€å‰å›žã‚ˆã‚Šç››å¤§ã«â€¦â€¦ã€‚ タイトルã«ã‚‚ã‚るよã†ã«rsyncコマンドãŒåŽŸå› ã 。 当記事ã§ã¯ã€ã“ã®ã€Œrsy
rsyncã§åœ§ç¸®è»¢é€ã—ãŸã„ã‘ã©pigzã¿ãŸã„ã«ä¸¦åˆ—ã«ãªã‚‰ãªãã¦å›°ã‚‹ - ãªã‚“ã‹ã‹ããŸã„
ã®ã§ã€tarã¨sshをパイプã§ã¤ãªã„ã§ä¸¦åˆ—ã§åœ§ç¸®ã—ãªãŒã‚‰è»¢é€ã™ã‚‹å›ã‚’作りã¾ã—ãŸã€‚ tar ã«ã¯æŒ‡å®šã—ãŸãƒ•ã‚¡ã‚¤ãƒ«ã®ã¿ã‚’アーカイブã«å«ã‚ã‚‹ -T オプションãŒã‚ã‚‹ã®ã§ã€ rsync -nã®çµæžœã‚’リストã«ã—ã¦æ¸¡ã™ã“ã¨ã§ã€rsyncã®å¯¾è±¡ã«ãªã‚‹ãƒ•ã‚¡ã‚¤ãƒ«ã ã‘を転é€ã§ãるよã†ã«ã—ã¦ã¾ã™ã€‚ ç¾å ´ã‹ã‚‰ã¯ä»¥ä¸Šã§ã™ã€‚
Very fast MySQL slave setup with zero downtime using rsync | Electricmonk.nl weblog
Blog Sunday, November 6th, 2016 Most online tutorials for setting up a slave replication database involve dumping and loading the database on the master with mysqldump. Unfortunately, loading data with mysqldump can be very slow. My friend Cris suggest a much faster method using rsync. Benefits The benefits of this method are: Very fast setup of a slave by avoiding having to load a logical dump in
Docker for MacãŒé…ã„å•é¡Œã‚’docker-syncã§è§£æ±ºã™ã‚‹ - Clueit Developersブãƒã‚°
ã“ã‚“ã«ã¡ã¯ã€‚エンジニアã®å¿—æ‘ã§ã™ã€‚ Docker for Mac便利ã§ã™ãï¼ docs.docker.com 日本語ã§ã‚‚様々ãªè¨˜äº‹ãŒå‡ºã¦ãã¦ã„ã¾ã™ã€‚ ç§ã‚‚Vagrant + Dockerをメインã«ä½¿ç”¨ã—ã¦ãŠã‚Šã¾ã—ãŸãŒã€ã¤ã„ã«Docker for Macã«ä¹—ã‚Šæ›ãˆã¾ã—ãŸã€‚ 弊社ã§ã¯ã€dev環境をDockerã«ã—ã¦ã„ã‚‹ã®ã§ã™ãŒã€Vagrant + Dockerã®æ™‚ã¯å¿«é©ã«é–‹ç™ºãŒå‡ºæ¥ã¾ã—ãŸã€‚ ãŸã ã€VMを使ã‚ãªããªã£ãŸé€”端ã«ã‚ã¡ã‚ƒãã¡ã‚ƒå‹•ä½œãŒé‡ããªã‚Šã¾ã—ãŸã€‚ docker-compose --service-port â—â—ã¨ã„ã†æ„Ÿã˜ã§ã€rails serverã¨webpack-dev-serverã‚’ç«‹ã¡ä¸Šã’ã‚‹ã®ã§ã™ãŒã€ãƒ–ラウザã‹ã‚‰ã®èªè¾¼ãŒåŠ‡çš„ã«é…ã„…。seedデータçªã£è¾¼ã‚€ã®ã‚‚ã‚ã¡ã‚ƒãã¡ã‚ƒé…ã„… フォーラムã§ã‚‚話題ã«ãªã£ã¦ã„ã¾ã™ã。 forums.docker.com ç§ã®ç’°å¢ƒã§ã„ã†ã¨ã€Vagr
ssh 㨠rsync ã ã‘㧠Tree Deploy を実ç¾ã™ã‚‹ "grifork" を作ã£ãŸ - weblog of key_amb
ã¯ã˜ã‚ã«ã€œfireap to grifork Tree Deploy ã¨ã¯ grifork: standalone モード grifork: grifork モード 使ã„æ–¹ 動作例ã¨å®Ÿè¡Œãƒã‚° 今後ã®å±•æœ› 余談〜デプãƒã‚¤ã®æœªæ¥ã«ã¤ã„㦠ãŠã¾ã‘〜grifork ã®èªžæº ã¯ã˜ã‚ã«ã€œfireap to grifork ç´„åŠå¹´å‰ã« fireap ã¨ã„ã†ãƒ‡ãƒ—ãƒã‚¤ãƒ„ール(タスクランナー)を作りã¾ã—ãŸã€‚ オンプレミスã§ã‚‚使ãˆã¦ã€ãƒŽãƒ¼ãƒ‰æ•° N ã«å¯¾ã—㦠O(log N) ã§å‹•ä½œã™ã‚‹ã€ã¨ã„ã†ã‚‚ã®ã§ã™ã€‚ ãŒã€å‰ææ¡ä»¶ã¨ã—ã¦ã€ã‚·ã‚¹ãƒ†ãƒ 内ã®å…¨ãƒ›ã‚¹ãƒˆã« fireap をデプãƒã‚¤ã—ã€ã¾ãŸã€å…¨ãƒ›ã‚¹ãƒˆã§ Consul ã® agent ã‚’å‹•ã‹ã™å¿…è¦ãŒã‚ã‚Šã¾ã™ã€‚ ãã®è¾ºã‚ŠãŒå°Žå…¥éšœå£ã«ãªã‚‹ç’°å¢ƒã‚‚ã‚ã‚‹ã‹ã‚‚ã—ã‚Œãªã„ãªã€ã¨æ€ã„ã¾ã—ãŸã€‚ …ã§ã€å°‘ã—工夫ã™ã‚Œã°ã€ã€Œãƒ‡ãƒ—ãƒã‚¤ã‚µãƒ¼ãƒã«ã ã‘プãƒã‚°ãƒ©ãƒ ãŒã‚ã‚Œã°ãƒ„リー状ã«ãƒ‡ãƒ—ãƒã‚¤ã§ãã‚‹ã€ã‚‚ã®ã‚‚作れる
Rclone
Rclone syncs your files to cloud storage About rclone What can rclone do for you? What features does rclone have? What providers does rclone support? Download Install About rclone Rclone is a command-line program to manage files on cloud storage. It is a feature-rich alternative to cloud vendors' web storage interfaces. Over 70 cloud storage products support rclone including S3 object stores, busi
websync puts a web interface on rsync
Sander Struijk's websync looks like nice way to manage a bunch of scheduled rsync transfers. This NodeJS-backed web UI lets you set up arbitrary hosts (via SSH) and then schedule transfers between them. Here's the Tasks tab in action: Bonus: There is a docker container all ready to go so trying websync out should be pain-free! Software moves fast. We help you keep up. Our weekly newsletter is brie
Linuxã®ãƒ–ãƒãƒƒã‚¯ãƒ‡ãƒã‚¤ã‚¹ãƒ¬ãƒ™ãƒ«ã§å®Ÿç¾ã™ã‚‹rsyncより高速ãªå·®åˆ†ãƒãƒƒã‚¯ã‚¢ãƒƒãƒ—ã«ã¤ã„㦠- ゆã†ã†ãブãƒã‚°
社内ã§è«–文輪èªä¼šã¿ãŸã„ãªã“ã¨ã‚„ã£ã¦ã¦ã€ãã“ã§ç´¹ä»‹ã—ãŸè«–æ–‡ã®å†…容ã«ã¤ã„ã¦ã§ã™ã€‚ 最近ã€Graphite ã«ä¿å˜ã—ã¦ã„るデータã®ãƒãƒƒã‚¯ã‚¢ãƒƒãƒ—（データåŒæœŸï¼‰ã« rsync 使ã£ã¦ã¦ã€ã‹ãªã‚Šé…ã„ã®ã§å›°ã£ã¦ãŸã€‚ LISA ã£ã¦ã„ㆠ大è¦æ¨¡ã‚·ã‚¹ãƒ†ãƒ ã€sysadmin ç³»ã®ã‚«ãƒ³ãƒ•ã‚¡ãƒ¬ãƒ³ã‚¹ãŒã‚ã£ã¦ã€ã“ã“ã‹ã‚‰è«–文探ã—ã¦ãŸã‚‰ã€ã¡ã‚‡ã†ã©å·¨å¤§ãƒ‡ãƒ¼ã‚¿ã®é«˜é€Ÿãƒãƒƒã‚¯ã‚¢ãƒƒãƒ—ã®å®Ÿè£…ã®è©±ãŒã‚ã£ãŸã®ã§èªã‚“ã§ã¿ãŸã€‚ è«–æ–‡æ¦‚è¦ dsync: Efficient Block-wise Synchronization of Multi-Gigabyte Binary Data - https://www.usenix.org/conference/lisa13/technical-sessions/presentation/knauth - Thomas Knauth and Christof Fetzer, Technische U
rsync ã§å‰Šé™¤ã™ã‚‹ã¨é€Ÿã„ (?) 件 - ã„ã¡ã„ã®æ—¥è¨˜
https://twitter.com/matsuu/statuses/340655491917152257 http://linuxnote.net/jianingy/en/linux/a-fast-way-to-remove-huge-number-of-files.html ã¡ã‚‡ã£ã¨æ°—ã«ãªã£ãŸã®ã§è©¦ã—ãŸã‘ã©ãã‚“ãªå·®ãŒã§ãªã‹ã£ãŸã€‚ã‚‚ã†ã¡ã‚‡ã„調ã¹ãŸã„ã¨ã“ã ãŒæ™‚間切れã§é€”ä¸ã¾ã§ã®ãƒ¡ãƒ¢ã€‚ (追記: ã¤ã¥ãã‚’ http://d.hatena.ne.jp/ichii386/20130602/1370112280 ã«æ›¸ãã¾ã—ãŸã€‚) 環境 solaris11.1 zfs rm: coreutils-8.21, ãµã¤ã†ã« gcc-4.5 㧠./configure && make ã—ãŸã ã‘ rsync: rsync-3.0.9, coreutils åŒæ§˜ 空㮠zfs 㧠``mkdir aho &&
Re: rsync ã§å‰Šé™¤ã™ã‚‹ã¨é€Ÿã„ (?) 件 - ã„ã¡ã„ã®æ—¥è¨˜
ã“ã‚“ãªã®é ‘張るæ„味ã‚ã‚“ã®? ã£ã¦æ°—ã‚‚ã—ãªãã‚‚ãªã„ã‘ã©ã€å¿…è¦ãªã“ã¨ã®å°ã•ã„サンプルã«ãªã£ãŸã®ã§ã‚°ãƒ©ãƒ•ã¾ã§æ›¸ã„ã¦ã¿ãŸã€‚ rsync --delete よりも rm -rf ã®ã»ã†ãŒã€ getdents (readdir) ã®ç´¯è¨ˆæ™‚間㌠30 秒多ã„ã‹ã‚‰ real ã‚‚ 30 秒多ã„ã€ã¨ã„ã†ã®ãŒå‰æã®ã‚ˆã†ã«æ›¸ã„ã¦ã¾ã™ãŒã€å®Ÿéš›ã«æ£ã—ã„ã®ã‹ã¯æœªç¢ºèªã€‚é‡è¦ãªã®ã¯ methodology ã£ã¦ã“ã¨ã§ã€‚ 調査用 dtrace スクリプト aggregation ã® key ã« wall ã‹ã‚‰ã®çµŒéŽæ™‚刻 (秒å˜ä½) を入れるã“ã¨ã§ç§’ã”ã¨ã«å‡ºã—ãŸã€‚ quantize ã—ãŸã„ã‘ã© @ ã‚’æ•°ãˆã‚“ã®ã‚ã‚“ã©ã„ã—ã€ã‚ã‚“ã¾ã‚Š printf ã—ã¾ãる㨠drop ã•ã‚Œã¡ã‚ƒã†ã—。 avg ã„ã‚‹ã®? ã¨ã„ã†ã®ã¯ excel ã® pivot table ã®éƒ½åˆã€‚ #!/usr/sbin/dtrace -s int start_wa
1
リリースã€éšœå®³æƒ…å ±ãªã©ã®ã‚µãƒ¼ãƒ“スã®ãŠçŸ¥ã‚‰ã›
最新ã®äººæ°—エントリーã®é…ä¿¡
j次ã®ãƒ–ックマーク
kå‰ã®ãƒ–ックマーク
lã‚ã¨ã§èªã‚€
eコメント一覧を開ã
oページを開ã
GitHub - google/cdc-file-transfer: Tools for synching and streaming files from Windows to Linux
GitHub - gokrazy/rsync: rsync in Go! implements client and server, which can send or receive files (upload, download, all directions supported)
{{#tags}}- {{label}}
{{/tags}}