Remote storage solution ?
Remote storage solution ?
I used to rock a bare metal 1Tib HDD server for 17€/month, that I used as an NFS server for all my other servers which needed storage space.
First of all, NFS kinda sucks and I'm looking for alternative solution that I can use on OpenBSD to mount remote volumes.
Secondly, I'm planning to move this server to hetzner (my current provider), but they lack affordable storage (it's 50€/month for 1Tib). Do you know an hosting provider which would provide high volumes for not so expensive prices ?
Hetzner has their storage boxes which are very cheap, might be an option.
Alternatively use an external S3 provider like Wasabi or Backblaze.
I didn't know about their storage box. That's interesting, thanks !
I ise backblaze for backups already. But is an S3 backend any good for mounting locally and doing many read/write ? What are my options to mount it besides rclone ?
Fuse
Time4vps will get you a full vps with a 1tb disk for ~50 euro/year. (Or ~ 5€/month if billed monthly)
I’ve had a couple of those for years, they’re ok but don’t expect stellar performance from the vps itself.
That's cheap indeed. Is it possible to install a different OS than those listed on their website ?
Nope, the options I get are: AlmaLinux 8, CentOS 7, Debian 10-11, Ubuntu 14.04 - 22.04.
And here I am running NFS as the backing storage on an R720xd for 4 other M630 VM hosts.
Connected via SFP+ DAC. I get max bandwidth saturation, and ~65k IOPS!! NFS is great 😅
You could use things like AWS S3 or similar offerings from other providers like digitalocean. They have plenty of documentation that guide you through how they work.
My main issue with NFS is that it's been unreliable in my case (multiple servers connected over wireguard, over internet). Which cause locks and latency for the applications that read/write to it (Matrix server, distributed repository, …).
Of course if you can afford connecting the NFS server directly to the servers, that's perfect but I'm more on the worst case scenario ^^
Selfhosting storage is pretty good to, if you're into that.
I'd like to avoid that as I don't consider my home network reliable enough for such a critical task.
Understandable. Sadly, really reliable storage is pretty pricey.
Google and dropbox are ~10€ a month for 2 TB. Idk is that solution for you, but I would consider building NAS at home. I mean...this is selfhosted channel :)
For backup I use backblaze, but thats cheap only if you dont download a lot, also not sure can it be used for your case. Sry, not rly helpful (:
I'm never going with Google/Dropbox ^^ the goal is to be in control of my data. Backblaze could be an option, but I expect too many read/writee for it to be cheap.
I considered the NAS at home but my home net is not reliable enough.
TBH I'm still looking for a better option to share storage between servers other than NFS. There has to be something better in 2023!
NFS kinda sucks and I'm looking for alternative solution
Rsync + cron? If you just need to backup some files/directories.
Edit: ah, saw that you will read/write a lot. Do you really need to do that over the network? Why not upload a .tar, a snapshot or whatever of the changes?
If you could be a bit more specific then maybe we could give some better advice.
Use a seedbox if you're downloading stuff and dont have enough disk space.
The best example would be a running an email or chat server. The spool/media directories can go large pretty quick as users share pictures, gifs, ... So I would like to mount it from a remote location because the matrix server itself only has a 20G SSD for the whole OS. Rsync won't cut it there as I have a specific process writing to a location.
Ah, I see.
Perhaps sshfs could be an alternative. Not sure of the performance out of the box, but it is possible to tweak a bit.