Any S3 compatible server where I can define where individual bucket storage is?
from RonnyZittledong@lemmy.world to selfhosted@lemmy.world on 29 Apr 08:55
https://lemmy.world/post/28872321

I have been using MinIO for my self hosted S3 needs but I now have a need to break up my backing storage into SSD for images and other small files and HDD for videos. From what I can tell this is not possible with MinIO and I would rather not run two instances if I can help it. Are there other self hosted solutions where this is easy to do?

#selfhosted

threaded - newest

catloaf@lemm.ee on 29 Apr 09:16 next collapse

Looks like MinIO supports tiering. Does that not do what you want?

RonnyZittledong@lemmy.world on 29 Apr 09:22 collapse

Thanks, this looks like a possible solution. I will have to dive into it to see if it will work the way I need it to.

poVoq@slrpnk.net on 29 Apr 09:29 next collapse

garagehq.deuxfleurs.fr maybe?

RonnyZittledong@lemmy.world on 29 Apr 09:41 collapse

I have been looking at Garage. Not sure if you can set certain buckets to different mount points or whatever but it does seem to be easier to setup and update which would make running two instances much less painful.

6eLuD@lemmy.today on 29 Apr 11:13 next collapse

Seaweedfs?

filister@lemmy.world on 29 Apr 11:15 next collapse

Why don’t you do some bash scripting and route files to different buckets depending on their extensions or mime types? You can easily do that with rclone for example.

segmentation_fault@programming.dev on 30 Apr 00:22 collapse

Good question, but I‘m afraid we‘re looking for a solution to a problem that S3 is not trying to solve. Blob storage solves problems such as redundancy and resiliency, effectively abstracting away the underlying storage.

That said, I would recommend hosting different instances (“clusters”) of Garage S3 for that purpose. You could also use the storage type as the region name for more clarity (AFAIK a garage cluster works with a single region).

This would probably work well because Garage is so light on resources (unlike minio). I also have Garage running in a similar setup for around 2 years, with daily reads/writes… Never had an operational issue. Rock-solid stuff.