Addiction....
from ShredderFeeder@shredderfood.net to selfhosted@lemmy.world on 30 Jun 13:48
https://shredderfood.net/post/17172

I think I officially have a hoarding problem…

#selfhosted

threaded - newest

alastel@lemmy.ml on 30 Jun 14:30 next collapse

I was like “nothing wrong here” until I saw that T that my brain just refused to parse the first time.

neidu3@sh.itjust.works on 30 Jun 14:53 next collapse

If I was on my laptop and not my phone I would post a screenshot with a P just for you

nixfreak@sopuli.xyz on 30 Jun 16:13 collapse

lol , is home separate mount point?

ShredderFeeder@shredderfood.net on 30 Jun 17:55 collapse

Yeah,

So Home is a separate 1.8TB NVME drive… But under home is my home directory, and under that is a half-dozen NAS mounts, including my Plex stuff. collection of ISO images. ;-)

lemonhead2@lemmy.world on 30 Jun 20:21 collapse

omg. how many isos to get 100tb

village604@adultswim.fan on 30 Jun 20:40 collapse

If you’re doing raw bluray, not as many as you’d think.

Ghoelian@piefed.social on 30 Jun 23:11 collapse

Yeah, a single raw blu-ray can be over 100GB. I ripped my whole doctor who blu-ray collection once, it took quite a few days. And that wasn’t even 4k or HDR or anything. The first few seasons are even interlaced iirc.

ohulancutash@feddit.uk on 30 Jun 23:28 collapse

BR is 25/50G, 4K BR is 66/100G

Ghoelian@piefed.social on 01 Jul 04:47 collapse

Uncompressed raw blu-ray rips most certainly are not.

MedievalPresent@discuss.tchncs.de on 30 Jun 14:31 next collapse

Your username absolutely does not check out. Or your shredder is broken haha

ShredderFeeder@shredderfood.net on 30 Jun 16:57 next collapse

For working I’m a backup and DR guy…the name was intended to be ironic. ;-)

ShredderFeeder@shredderfood.net on 30 Jun 17:57 collapse

I shred paper. ;-) After digitizing it of course. ;-)

darth_grunkus@lemmy.world on 30 Jun 14:38 next collapse

Greetings, fellow data hoarder!

tuckerm@feddit.online on 30 Jun 14:42 next collapse

Pfft, the only “hoarding problem” is that storage is expensive these days!

ShredderFeeder@shredderfood.net on 30 Jun 18:00 collapse

I know, I just paid $500 for a 24TB SAS drive that was $250 just over a year ago.

Someonelol@lemmy.dbzer0.com on 30 Jun 22:45 collapse

That’s a good deal. Microcenter was selling a WD 20TB external HDD for $600. Didn’t end up pulling the trigger 'cause I’m going for a 2 drive Raid1 config on my janky setup and $1350 w/ taxes is way too steep.

ShredderFeeder@shredderfood.net on 01 Jul 05:12 collapse

SAS actually ends up being a little cheaper due to it not being as compatible with home systems… And it’s a refurb but I got lucky because smartctl showed it only had about 200 hrs of uptime reported.

bacon_pdp@lemmy.world on 30 Jun 15:06 next collapse

Rookie numbers.

Try that shit on datahoarders and see hoards measured in Petabytes

ShredderFeeder@shredderfood.net on 30 Jun 16:56 next collapse

Jesus…

devaly@ani.social on 30 Jun 21:20 collapse

I went there once, on Reddit, and they are indeed over PB for some years now.

I myself already have 50T and it feels like a bottomless pit

homik@slrpnk.net on 30 Jun 23:28 collapse

I’m at single digit TBs and dreading that a drive breaks and I need a new one. Not that I have a lot of free space either.

bacon_pdp@lemmy.world on 01 Jul 08:55 collapse

Well, a 256GB of storage in flash drive form can be obtained for $31 or less. So it is very possible to slowly save a copy of your data from the most important to the least. (Or to move 256GB of your least important data off at a time). The data curation community is a great resource for figuring out how to organize things to keep found things found

happy_wheels@lemmy.blahaj.zone on 30 Jun 15:11 next collapse

Pardon my stupidity BUT why include stdout to Devnull? Why not omit and simply ‘du -sh /home’

helix@feddit.org on 30 Jun 15:24 next collapse

That’s stderr, not stdout

nbailey@lemmy.ca on 30 Jun 15:24 next collapse

There’s probably a bunch of permissions errors, filesystems warnings for cross-filesystem mounts or links, etc. all going to stderr. Linux output streams are a bit odd, 1 is stdout and 2 is stderr. So the command is redirecting the “noise” to null and just printing the actual command output. That would be my assessment, but OP could probably give a more correct answer…!

Sprocketfree@sh.itjust.works on 30 Jun 17:31 next collapse

Noob, just use sudo, less chars!

ShredderFeeder@shredderfood.net on 30 Jun 17:57 collapse

Oddly enough, still generates errors. (There are stuff in user directories that are set to 600… so even root can’t browse/open.)

Sprocketfree@sh.itjust.works on 30 Jun 19:15 next collapse

Well now I have to try this. Missing that executable bit would make sense. But last time I did this on / I didn’t get errors 🤔

village604@adultswim.fan on 30 Jun 20:42 next collapse

There’s also some stuff in Proc and run that won’t let you.

technopagan@lemmy.world on 30 Jun 22:22 collapse

Are you sure? Root can see everything.

Hule@lemmy.world on 30 Jun 22:43 collapse

On a network, it can’t.

NFS mount probably.

ShredderFeeder@shredderfood.net on 30 Jun 17:56 collapse

Nope, you are exactly on.

ShredderFeeder@shredderfood.net on 30 Jun 16:55 collapse

2> means stderr… Keeps the “can’t access …” Out of the display.

massive_bereavement@fedia.io on 30 Jun 17:12 next collapse

Bruh

ShredderFeeder@shredderfood.net on 30 Jun 17:54 collapse

To be fair, all but about 2TB of that is on a NAS…but still.

Morgikan@fedia.io on 30 Jun 19:36 next collapse

Bob Saget would roll in his grave if he heard about your addiction.

swab148@lemmy.dbzer0.com on 30 Jun 23:04 collapse

“You ever suck some dick for some HDDs?”

TownhouseGloryHole@lemmy.world on 30 Jun 23:54 next collapse

Lately, I’m considering it.

Jo4ted@lemmy.zip on 01 Jul 01:47 collapse

That’s an option?

farmgineer@nord.pub on 30 Jun 19:44 next collapse

I’m reading the command to the tune of Du Hast

fogelmensch@lemmy.world on 01 Jul 00:00 collapse

Du hast mich. Du hast mich gefragt UND ICH HAB SPEICHERPLATZ

chraebsli@programming.dev on 01 Jul 00:54 collapse

Toller Musik Geschmack!

ohshit604@sh.itjust.works on 30 Jun 21:26 next collapse

Meanwhile here I am trying to upgrade my 512gb NVME drive to 2Tb while also still trying to afford car payments, rent and food. Rookie numbers on my part.

kalpol@lemmy.ca on 01 Jul 05:09 collapse

The most well-timed thing I ever did was buy 6 2tb NVMe drives in August last year

God help me if one fails

glibg10b@lemmy.zip on 01 Jul 21:42 collapse

ZFS it

kalpol@lemmy.ca on 02 Jul 09:41 collapse

That’s why there are 6. There’s a pool with a hot spare. Just don’t want to pay $350 or whatever to replace a $90 drive.

Decronym@lemmy.decronym.xyz on 30 Jun 22:50 next collapse

Acronyms, initialisms, abbreviations, contractions, and other phrases which expand to something larger, that I’ve seen in this thread:

Fewer Letters More Letters
NAS Network-Attached Storage
NFS Network File System, a Unix-based file-sharing protocol known for performance and efficiency
NVMe Non-Volatile Memory Express interface for mass storage
Plex Brand of media server package
VPN Virtual Private Network
ZFS Solaris/Linux filesystem focusing on data integrity

6 acronyms in this thread; the most compressed thread commented on today has 9 acronyms.

[Thread #35 for this comm, first seen 1st Jul 2026, 05:50] [FAQ] [Full list] [Contact] [Source code]

justme@lemmy.dbzer0.com on 01 Jul 03:08 next collapse

never saw the s argument and was curious what’s the difference to d. man pages are way ahead of me ^^

–max-depth=0 is the same as –summarize

ShredderFeeder@shredderfood.net on 01 Jul 05:14 next collapse

Now I need to try that.

ShredderFeeder@shredderfood.net on 01 Jul 05:23 collapse

So just did a couple of experiments…

sudo su -sh /home - returns permission denied errors on certain NAS subdirectories, but not a lot.

du -sh /home --summarize -returns the same errors.

du -sh --max-depth=0 - returns the same errors plus an error saying that using --max-depth=0 is the same as --summarize.

;-) for the purposes of what I was doing (creating a clip for posting) redirecting stderr to null was the best option.

But I learned a few things today, which is cool. ;-)

justme@lemmy.dbzer0.com on 01 Jul 06:08 collapse

But I learned a few things today, which is cool. ;-)

that is always the most important. thanks for sharing!

Joelk111@lemmy.world on 01 Jul 09:11 next collapse

I create videos, and back up all of my raw footage. I make weekly videos, and the size ranges from 50GB up to 500GB or more. I have 105TB available, 90TB used at the moment. I also have a fully redundant set of another 105TB. My employer has unfortunately made it very easy to justify hoarding, as they’ll sell me reputable used commercial drives for $10/TB.

The video archives are 53TB

TubeArchivist is 19TB

Legally acquired movies and TV is 10TB

Immich is 2TB

Those are the main users of data. A bunch of other folders are using anywhere from a gig to 500GB, but those are basically rounding errors.

ShredderFeeder@shredderfood.net on 01 Jul 11:23 next collapse

Ask you’re employer if they’re hiring…or…you know…adopting. ;-)

Joelk111@lemmy.world on 01 Jul 12:11 collapse

Are you living in or willing to move to Spokane, WA? I will say, I might be bias, but it is nice here.

ShredderFeeder@shredderfood.net on 01 Jul 12:24 collapse

I’m in Virginia - I love Washington state, spent some time in Issaquah a while back in the SeaTac area… But the last time we moved my wife told me in no uncertain terms “If you take another out of state job, you’re going alone.” (Too many years of travelling for work…)

But I’m an awesome remote worker. ;-)

ShredderFeeder@shredderfood.net on 01 Jul 17:42 next collapse

I have 120TB in a dell T630 at a condo i rent on the other side of the state… I replicate some Truenas volumes and proxmox backups to over VPN…an “in case the house burns down” kind of thing…

Joelk111@lemmy.world on 01 Jul 18:29 collapse

Yeah, I’ve considered doing that, but most of my media is static and doesn’t change and, with my upload speeds, would take literal days to sync. So I just have a set of HDDs that I keep across the state. I’ll loose some if everything fails, but at least I’ll have most of it.

ShredderFeeder@shredderfood.net on 01 Jul 18:58 collapse

I brought the two into the same room for the initial sync…then drove the T630 to the condo and hooked up, and it’s all incremental updates over the 1G VPN. :)

Joelk111@lemmy.world on 01 Jul 19:34 collapse

Yeah, I have 40Mbps uploads at my house, that’s the best I can get. I create anywhere from 100GB to 3TB of footage per week. On the high end, it’d take an entire week to sync, sucking up all of my upload bandwidth for that time, meaning I wouldn’t even be able to upload the videos I create to YouTube/PeerTube. When I get faster upload speeds I’ll definitely have to build a remote NAS for closer to real time backups.

ShredderFeeder@shredderfood.net on 01 Jul 20:09 collapse

OOhh ouch, that sucks ass… If I didn’t have Gigabit synchronous at the source there is no way I would even attempt replciation…I’d be carrying spare drives with me every time I go down to visit my grandson. ;-)

Joelk111@lemmy.world on 01 Jul 20:19 collapse

That’s exactly my plan haha, and yeah, it sucks. Thanks Comcast.

someonesmall@lemmy.ml on 01 Jul 22:11 collapse

How often did you need a raw video older than one year?

Joelk111@lemmy.world on 01 Jul 22:54 collapse

I don’t need a raw video older than a day after the video is finished. I also don’t need TBs of legally acquired content. I also don’t need TBs of archived YouTube videos. I don’t really need a NAS. I don’t need a phone. We don’t really need any of this tech stuff actually.

To answer your question more seriously, they’re nice to have sometimes, instead of having to re-edit finished videos to make a compilation or something. I’m also hoping that maybe I’ll see some success some day and be able to hire a more skilled editor (or even just me from the future with improved skills) to turn old media into feature-length films or just better versions of what I released. I dunno. It’s data hoarding, but when I do want it, it’s super nice to have.

I’ve also seen multiple professional creators talk about regretting not keeping the original footage from their old videos, so I’m not making that mistake. It’s just nice to have it if you ever do want it, and I have the skills to archive it myself on the cheap, as compared to paying something like BackBlaze $7/TB/mo.

Just checked and my average video this year is currently at 400GB, so that’s $4*2 for redundancy, so $8 per week aka $35/mo. If it were in BackBlaze, my subscription fee would go up by $12 per month forever, and it’d currently be at $630/mo, with zero redundancy. When I frame it like that, I’d be a fool not to do it!

billwashere@lemmy.world on 01 Jul 09:28 next collapse

One think I miss from reddit… /r/datahoarder

These were my people. I probably have 100TB but it certainly isn’t in my home directory. I’m not sure if I should be immpressed or freightened.

flameleaf@lemmy.world on 01 Jul 10:16 next collapse

There’s !datahoarder@lemmy.world, !datahoarder@lemmy.ml, and !datahoarder@selfhosted.forum…

EDIT: spelling

billwashere@lemmy.world on 01 Jul 12:36 collapse

Well TIL … I subscribed to the first two but the last one didn’t work for some reason.

Ephera@lemmy.ml on 01 Jul 14:28 collapse

Looks like a typo: !datahoarder@selfhosted.forum

billwashere@lemmy.world on 01 Jul 14:36 collapse

Yeah I totally missed that.

ShredderFeeder@shredderfood.net on 01 Jul 11:22 next collapse

Not gonna lie… I have some space…

<img alt="" src="https://shredderfood.net/pictrs/image/cb0eb9ed-400d-4ad8-acc0-8abf73d6a68d.png">

anon_8675309@lemmy.world on 01 Jul 15:19 collapse

I agree.

Jankatarch@lemmy.world on 01 Jul 13:28 next collapse

Is there any advantage of using du over df for this?

Ephera@lemmy.ml on 01 Jul 14:27 next collapse

df only shows partitions, whereas du adds up the file sizes in the directory you specify.

So, in particular, if you want to find out what’s taking up so much space, you can repeatedly run du -sh * and cd into the largest directory.

ShredderFeeder@shredderfood.net on 01 Jul 15:17 next collapse

What he said. DF won’t take into account the contents of mount points within a directory.

ShredderFeeder@shredderfood.net on 01 Jul 15:21 next collapse

What he said. DF won’t take into account the contents of mount points within a directory.

GreenKnight23@lemmy.world on 01 Jul 17:14 next collapse

What he said. DF won’t take into account the contents of mount points within a directory.

Vendetta9076@sh.itjust.works on 01 Jul 17:35 next collapse

What he said. DF won’t take into account the contents of mount points within a directory.

helix@feddit.org on 01 Jul 22:26 collapse

Or you run ncdu and save some keystrokes.

bitjunkie@lemmy.world on 01 Jul 15:02 next collapse

Someone may eventually write CLI programs called hast and mich that you can somehow usefully pipe to it

Evotech@lemmy.world on 02 Jul 01:16 collapse

Now that’s a good idea

anon_8675309@lemmy.world on 01 Jul 15:18 next collapse

Yeah it lets you have time to get some tea while it works.

mal3oon@lemmy.world on 02 Jul 10:01 collapse

I gotten used to dust instead of du because it has much nicer visual representation.

katze@lemmy.4d2.org on 01 Jul 22:47 collapse

Why do you pipe stderr of du into /dev/null?

ShredderFeeder@shredderfood.net on 02 Jul 05:15 collapse

To keep the errors out and provide just the result.