Awesome Tips Our data is GONE… Again – Petabyte Project Recovery Part 1
Configure your own workstation at
Configure your own workstation at
Check out Hetzner Cloud and use code LTT22 for $20 off at
It’s been a long time since we’ve had any serious data loss, but on this episode, we’re discussing a software misconfiguration that has resulted in us losing an unknown amount of data on our petabyte project storage clusters.
Discuss on the forum:
Check out 45Drives at the links below
Website:
YouTube:
Buy Seagate 20TB Exos Drives
On Amazon:
On Newegg:
Purchases made through some store links may provide some compensation to Linus Media Group.
► GET MERCH:
► AFFILIATES, SPONSORS & REFERRALS:
► PODCAST GEAR:
► SUPPORT US ON FLOATPLANE:
FOLLOW US ELSEWHERE
—————————————————
Twitter:
Facebook:
Instagram:
TikTok:
Twitch:
MUSIC CREDIT
—————————————————
Intro: Laszlo – Supernova
Video Link:
iTunes Download Link:
Artist Link:
Outro: Approaching Nirvana – Sugar High
Video Link:
Listen on Spotify:
Artist Link:
Intro animation by MBarek Abdelwassaa
Monitor And Keyboard by vadimmihalkevich / CC BY 4.0
Mechanical RGB Keyboard by BigBrotherECE / CC BY 4.0
Mouse Gamer free Model By Oscar Creativo / CC BY 4.0
CHAPTERS
—————————————————
0:00 Intro
Deals for Days. Big home savings are happening now.
"You should hire a person to take care of your data, especially if you measure it in anything other than tens of terabytes"
Welp, I should get someone for my 600 gigs of SSD i guess xD
One question why don’t you have an LTO tape library as well for a back up I’m not talking a small drive I’m talking one of those regular robotic type tape library systems to wear when you punch in the number the tape comes up and it inserted into the drive then you can locate the file you need take it off put it into the server do whatever you have to do. At least you have a tape back up of your footage original grade. With all the hard drive systems, you’re putting together and putting in place you’re eventually gonna have a failure somewhere at least with a tape back up system you won’t worry about losing your video footage and you can purchase a used system out there for under 10 grand if it’s an LTL five that is if it’s a higher LTL number you’re gonna be paying a lot more but at least you’ve got a good peace of mind so you don’t have to worry about losing valuable footage as you put it if I was in charge at your place for data I would definitely have one installed. That way. You can also put your data of your video footage and the tape back up systems that way in case if anything happens to your servers, you don’t lose your important video files. Forgot to mention a lot of those tape library systems have multiple LTO drives in them they can have 8 to 10 drives even more in a bigger library system so you could have multiple users using it
Of course you are losing data. Because you are using Seagate drives. Seagate drives are junk.
Every company, no matter how small, should have dedicated IT staff.
tfw I am still one of those using like 220gb on desktop and 40gb on mobile, lol
(I do have 512gb and 128gb, but I basically only have like 6 games all of which are 400mb to 4gb each such as binding of isaac with its like 550gb file size and a few programs that also are like 200mb to 1.2gb at most)
10:23 and also, use SSDs for your data when possible 😂
I think backblaze backing up your computer data (as hdd) is the best to backup your videos 😉
So use recovery media like recuva
From the thumbnail we can infer that Linus uses comcast as a provider and utilized the 10.20/16 address space for internal infrastructure
I gotta ask… Why would you need every single video you made, in full quality… Meaning 8k or 4k?! Why … well damn
Question! Would used LTO storage be a viable secondary backup solution? I'm looking at getting an LTO-5 setup for my personal data archive.
To get the Youtube videos, isnt Google takout better?
If i had a dollar for every time Linus's servers died or something went horribly wrong with them..id probably have 2 dollars
But its weird it happened twice
Anthony the best boy!
no part 2 link in description
wtf
I only backup my hardcore minecraft world.
Why you need 1.2 petabyte? Are you downloader? Ha
Imagine having these problems for 10+ years and never implementing the basic standards for operating a server
Is there REALLY no way to force ZFS to just roll with the errors, calculate a new checksum and just go with it? Seems a little overzealous. I mean yes, error detection and correction is awesome, big part of why it's used, but if it's so sticky on errors that it will throw the whole pool in the garbage even if 99.9% of it is still good because of some unfortunately placed errors then is it really protecting data? Tantamount to throwing a book in the garbage because it's missing a couple pages.
"…We never did preventative maintanance…" Aight video done wrap it up folks we are done here.
Linus talks about companies keeping data but he himself keeps data… different but same
but why do you need to keep this storage?
scrub
Y'all should start a community project where you get a bunch of volunteers and give each some of the data to hold on to. Crowdsource your offline backups.
How about deep glacier? 1PB would go for $1000/mo
Imagine how many information has been lost for history ! SHAME
well this sure don't help me with my data backup paranoid 😀
Perhaps it's time to imbedded (invent) 1000 slot x 1TB sdxc cards @ motherboard
Ya'll need Nagios in your lifes smh
And did you learn not to have massively wide vdevs? No of course not, you did it again with the new system. ZFS mirror is the way to go, even if it takes more disks. Perhaps do double copies of files as well?
It sucks but I’ve always just did raid1 with 4 mirrors , 2 of the mirrors offsite.. I’m not a IT person either I own my own company doing construction projects but I since I was younger enjoyed photography and realized how fragile data really is … especially if you want to keep it all in house and not use any cloud storage services. I sure don’t blame people who do that though the convenience of just paying for data storage is way cheaper upfront and way less thinking and work. You must once a month blow the dust out and check your fans and drive health it takes 15 min. And it’s not something that’s fun to do but… if you are keeping your life’s complete data all secure and safe it’s for sure worth the peace of mind .
What’s weird is I’m the only person I personally know who even thinks of it literally every one I know off uses usb external hardrives like savages hahaha
But then again I know a lot of people who have lost photos and videos of there kids and some things are kinda priceless to some people. Data storage is definitely not the sexiest subject but it’s definitely the most overlooked subject with the majority of people. Haha iCloud is just to tempting and having to hook your iPhone and iPad up to a computer… ewww plus if it’s a PC total pain in ass sometimes for no reason and if it’s a mac it wants you to use iTunes are it did on my Mac I had a decade ago before i learned how to build PCs and Intels devils canyon was just to tempting to turn away from haha.
Tech hardware has come so far in the last decade though it’s really amazing especially in GPUs and solid state drives … I can’t wait for the day that a 8tb ssd doesn’t cost 3x the price of Hdds it’s getting better but it still is not worth it yet if it was double the cost then for sure go ssd but when it was 6x the cost when I built my last array 2 years ago haha the Hdds are plenty good enough for storage always use SSDs though for everything your working on on your computer at this point in time a terabyte ssd if under $50… it’s amazing.
Here a Petabyte, there a Petabyteand Oops where's a Petabyte🤣Murphys law, and plausible deniability built in, and you were my tech hero. 🤣
Hisenberg 35 for me partner sefer
Lol how you figure that 2000 call of duty lol 😂
please i want to work in your company, please am begging you, hire me pleaaaaaaaaaase 🙁
Ever notice that one thing about computers? We dont know what happened but we spent 100k trying to make sure it didn’t happen yet it happened. Buy a console.
linus main backup is google server sweet
Something random: the cern collider generates 5 Petabytes of data per test…
On another note, i guess that's what differentiates an IT Youtuber like LTT versus company IT pros doing IT operations.
Maintenance & patching, are done regularly. A DR/BCP is in place in the case needed. A dedicated person is assigned to the resource. Nothing is done without proper approvals (release).
Corporate IT is all about processes and with good reason. Data loss or service interruptions costs money.
Whereas most IT Youtubes are build and forget.
1st…problem…Seagate. i've had 3 Seagate drives fail in 3 years. i still have my 8GB Western Digital from 1996. Never had a WD fail on me.
What about 1 petabyte ssd storagee😮
damn…
so this is how roblox servers are handled(expect its probaly half a gigabyte instead of a petabyte)
Would Amazon Glacier be more cost effective?
I can't wait to meet the new IT admin.
goes up every boy the day to channel
Linus keeps secretly dropping the server so he can keep making videos about it
Nearly 10 years, and you guys still haven’t started using LTO for backups. Oh well.