Anyone have suggestions for rsync (or similar) friendly file hosting?

[usernamenumber]

Question for my techie friends:

The one thing Dreamhost gives me that I do not get from a cloud provider is gobs and gobs of disk space for cheap (seriously, I currently have 2.2 TERABYTES free, and I don't think disk space used even factors into their billing). This is great because I do sometimes do projects that involve making gobs and gobs of data available to a small number of people.

Dropbox, gDrive and the like seem like obvious modern alternatives, but I need something that can be automated, anonymous (no per-user credentials, e.g. so files can be synced with a generic shell script or Ansible playbook), and with the ability to recursively download directories (though I could probably work around that if I really had to).

Anyone have suggestions?

Comments

[beowabbit]

I don’t know what your definition of “for cheap” is, and I haven’t used it in years, but there’s rsync.net.

There are also a handful of pieces of FOSS host-your-own-cloud-fileserver software. The one I’m most familiar with is ownCloud. It supports more or less Google-Drive-like functionality, and there's a plugin that lets you use arbitrary external storage (like Google Drive itself, or any random FTP server) to extend your storage space. So you could set up ownCloud for web-based access from anywhere (including optional sharing), and store your files on a hard drive (or multiple hard drives) in your house. There’s a dedicated client for Windows and Linux and I think MacOS, and a (cheap but not free or Free) Android app, but also webdav access so you can just mount your ownCloud space somewhere; that's what I do. It’s a little flaky (especially around upgrades), but I’m getting a lot out of it (although I haven't used the external-storage plugin myself).

[laurion]

I tried the external storage plugin with google drive. It's fine, but can't compare to a local btrfs RAID 10 array with a slew of medium size drives.

[laurion]

Anonymous? Tricky that one. The way I see it, there are a few cloud options if you don't want to host your own (owncloud is fantastic). Some services like AWS (Mostly downloading? Go with Amazon Glacier?) and Dreamhost themselves offer easy access to tons of storage. Other services like box.com or gdrive offer ways of mounting storage (fuse, webdav). Very few offer easy options like ftp(s), sftp, or heaven forfend, nfs or smb.