Skip Navigation
how do you know if a backup is dead (even if you have multiple copies)
  • Ideally you would have generated and saved a HASH before you copied your files as a control. Otherwise, it's just a probability game. If the HASH on copy 1&2 match, but doesn't match 3, then the probability is 1&2 are correct. If all three don't match, you toss a coin.

    If you're on Windows, I recommend using Teracopy for all your file copying (always copy, never move!) and set verify on, which will perform a CRC and generate a HASH which you can then save. You can also use it to Test your files after the fact and generate a HASH.

  • Best Way to Rip Rare DVDs?
  • The best possible quality to rip to either .ISO, saving the entire DVD as an image or rip and remux, placing the video into another container. Both will give you 1:1 quality of the original.

    MakeMKV can do both of these and is free.

  • WD 28TB Ultrastar DC HC680
  • They're HM-SMR (Host Managed-SMR) that requires specialized hardware and software. Which is why the article clearly states they're not for home users.

    Read this and link about why Dropbox and other cloud providers are using them and HM-SMR is the future for larger hard drives.

    https://www.reddit.com/r/DataHoarder/comments/184vwtd/complete\_list\_of\_smr\_drives\_as\_of\_112623/

  • Data Hoarder @selfhosted.forum Far_Marsupial6303 @alien.top
    BOT
    Complete list of SMR drives as of 11/26/23

    Inspired by this thread: https://www.reddit.com/r/DataHoarder/comments/184k6iu/are\_nasrated\_drives\_really\_worth\_it/, here's AFAIK, the complete list of SMR drives as of 11/26/23. Any corrections are greatly appreciated. Hopefully this thread will be made a sticky. I will be using it a reference for the numerous times this question is asked.

    Important note: There are three types of SMR drives, DM-SMR, HM-SMR and HA-SMR.

    DM-SMR (Drive Managed-SMR) is the most common and are what 99.9% of drives that home consumers will buy. All write/read activities are handled by the drives electronics.

    HM-SMR (Host Managed-SMR) write/read activities are as the name stated, handled by specialized off drive hardware and software. This what is used in the current 26TB WD Ultrastar, upcoming 28TB WD drive and likely the upcoming 30TB Seagate drive.

    HA-SMR (Host Aware-SMR) - I don't fully understand how HA-SMR drives work, but they're not as efficient at handling writes HM-SMR and are likely to be widely implemented/available.

    https://www.reddit.com/r/DataHoarder/comments/13z7w96/lets\_discuss\_dmsmr\_hmsmr\_hasmr\_and\_dropbox/

    https://www.reddit.com/r/DataHoarder/comments/146hb9k/information\_about\_cmr\_to\_smr\_manufacturer/

    https://zonedstorage.io/docs/getting-started/smr-disk

    Barring any unfounded conspiracy theory, all generally available to the public >8TB drives 3.5" drives are not DM-SMR. While technically manufacturers could submarine SMR into drives once again, that would be utterly stupid and market suicide.

    Thank you to HTWingNut for this list of current SMR drives.

    WD Blue 8TB is a CMR drive and just as good as any NAS drive. But I'd avoid any consumer grade hard drives 8TB and under:

    • Seagate Barracuda / Barracuda Compute \[My note: The 1TB Seagate Barracuda is CMR
    • WD Blue (except 8TB) \[My note: 2-4TB drives may be CMR depending on model number\]
    • WD Red (Red Plus and Red Pro are fine tho)
    • Toshiba DT02 \[My note: 4/6TB\]
    • Toshiba P300 \[My note: 4/6TB\]

    All consumer 2.5" Seagate and WD drive >500GB are SMR. The 9.5mm Toshiba L200 1TB is CMR, but the 7mm model is SMR.

    Seagate's 2.5" Exos E line are all CMR and tops out a 2.4TB (four, 600GB platters). The is/was (can't find it on Toshiba's site), a 1TB or possibly even 2TB Toshiba surveillance drive that is CMR.

    https://support-en.wd.com/app/answers/detailweb/a\_id/50697/\~/steps-to-determine-if-an-internal-drive-uses-cmr-or-smr-technology

    https://toshiba.semicon-storage.com/ap-en/company/news/news-topics/2020/04/storage-20200428-1.html

    https://www.seagate.com/products/cmr-smr-list/

    8
    Are NAS-rated drives REALLY worth it?
  • DM-SMR is Drive Managed-SMR. All the write/read activity is handled by the onboard electronics.

    HM-SMR is Host Managed-SMR. All write/read activity is handled by specialized external hardware and software. They're far from the capabilities of most home users today.

    The current 26TB WD Ultrastar and upcoming 28TB WD drives are HM-SMR. The upcoming 30TB Seagate is also HM-SMR.

    https://www.reddit.com/r/DataHoarder/comments/13z7w96/lets_discuss_dmsmr_hmsmr_hasmr_and_dropbox/

    https://www.reddit.com/r/DataHoarder/comments/146hb9k/information_about_cmr_to_smr_manufacturer/

    Your MaxDigitalData (MDD) drive is likely CMR because they're almost surely used enterprise drives. However, be careful as there was a user whose drive was HM-SMR and unusable.

    MDD is a division of GoHardDrive and IMO, are drives that GoHardDrive doesn't want to sell under their own name. Also Avolusion (externals) is a division of GoHardDrive and has been reported to contain used drives.

  • Are NAS-rated drives REALLY worth it?
  • For completeness, I'll add the only other type of generally available drive category currently available, surveillance drives, which are designed/tweaked for 24/7 writes.
    Seagate Skyhawk - All CMR
    Seagate Skyhawk AI - All CMR
    Seagate Skyhawk Lite - All SMR

    WD Purple - All CMR
    WD Purple Pro - All CMR

    Toshiba S300 - All CMR

  • Are NAS-rated drives REALLY worth it?
  • Two thumbs up to those who are posting that NAS and by inferred extension, Enterprise drives aren't necessarily any better for home use.

    However, since NAS/Enterprise labeling is now 98% marketing, there really isn't much of a decision necessary today. Other than the handful of drive lines HTWingNut posted and another handful of specialized surveillance drives, everything else is NAS or Enterprise.

  • Are NAS-rated drives REALLY worth it?
  • +1

    You've listed all the 3.5" consumer drives. Though WD Red is listed as a NAS drive.

    Barring an unfounded conspiracy, there is no >8TB DM-SMR drive drives. There are >8TB HM-SMR drives in the NAS and Enterprise lines, but they require specialized hardware and software.

    In addition for completeness, all consumer 2.5" Seagate and WD drive >500GB are SMR. The 9.5mm Toshiba L200 1TB is CMR, but the 7mm model is SMR.

  • What is your setup for data organisation and backup?
  • I'm on Windows so I use Everything as my search and VVV (Virtual Volumes View) for an offline searchable database. I also keep copies of TV show episode and apperances lists from Wikipedia.

    With my drive organization, which is a variation on animal, vegetable. mineral*, I can find anything within seconds as long as I know something about it. More below.

    *Animal, vegetable, mineral is based on the idea that everything can be primarily catagorized into one of those three catagories. So in my case, if I know a movie is by a certain director, stars a certain actress or was a certain type of show, I can go directly to that drive or folder.

    I don't use RAID because I like to keep my drives separate and just do a 1:1 swapout when one fails without any rebuild time. This does leave a lot of unused slack space and I do have to upgrade my drive size every so often, but by that time I'm ready to retire my active drives to backup anyway.

    I have two backups. An exact set of mirror drives and my second backup is spread over 3 & 4TB drives. Unfortunately I don't have anywhere to store them physically offsite and could is too expensive for my 200TB raw hoard. Everything is verified after copy and every few years, re-verify the integrity of the files with ViceVersa to ensure they're bit of for bit accurate. Unfortunately, I didn't save the HASH(es) the first go around, but am now doing it during the re-verify and initial copy.

    Note: Always copy, never move your files and always verify! Odd things can happen if you move! There are those that say, correctly that a move on the same drive just rewrites the location to the File Allocation Table, but I still never move unless the file is completely unimportant.

    For finding duplicates, Czwaka is highly recommended here for all file types. I've been using Video Duplicator for years and will continue to use it since I have the Pro version.

    My drive organization, is 20 dedicated drives ranging from 8-14TB. Each drive/set of drives is for:

    Directors - Alpha by name
    Actresses - Alpha by name
    Music - Sub categorized into groups/soloists and type of show (Reality, Variety, Special)
    Variety Shows
    Reality Shows
    Specials/Documentaries/Shorts/Collections
    Movies with sequels - Regardless of director

  • Checking file integrity after copying using Teracopy
  • In Teracopy, choose your files, Test and save a HASH. You'll need a program like MD5Checker to compare the HASH.

    I like ViceVersa for comparing drives/directories. The free version should be fine unless you have non-English file names. https://www.tgrmn.com/free/

  • Failing hard drive?? Bad/reallocated sectors. Is there any saving files at all?
  • 9. r/techsupport exists.

    r/Datahoarder is not a sub for tech support,

    r/techsupport is for posts which could have been a google search, e.g. a post with CrystalDiskInfo screenshots with the title "is my drive ok?". Literally every question about SMART status. A**udio recordings of "is this click noise normal?" More technical questions are allowed, e.g. "what is the optimal ZFS configuration of a 24 disk array" or "how else can i automate the archiving of this [thing]"

  • Data Hoarder @selfhosted.forum Far_Marsupial6303 @alien.top
    BOT
    Digital Services Act (DSA) in EU to take effect February 17, 2024 and may affect content sharing and availability

    Thank you to dobik for sharing this the news about Czech cloud provider Uloz implementing restrictions on users to only be able to access files they've uploaded. This is in anticipation of the Digital Services Act (DSA) scheduled to take effect February 17, 2024

    https://www.reddit.com/r/DataHoarder/comments/18336f0/ulo%C5%BEto/

    There's too much to personally absorb and decipher, so here's Google's search results for Digital Service Act. https://www.google.com/search?q=Digital+Services+Act+&sca\_esv=585139827&ei=NyNhZayHHu6sur8PtoiiCA&ved=0ahUKEwjs\_vWc192CAxVulu4BHTaECAEQ4dUDCBA&uact=5&oq=Digital+Services+Act+&gs\_lp=Egxnd3Mtd2l6LXNlcnAiFURpZ2l0YWwgU2VydmljZXMgQWN0IDILEAAYgAQYigUYkQIyBRAAGIAEMgUQABiABDIFEAAYgAQyBRAAGIAEMgUQABiABDIFEAAYgAQyBRAAGIAEMgUQABiABDIFEAAYgARI9A5QyghY9ApwAHgCkAEAmAGWAaABmQKqAQMwLjK4AQPIAQD4AQHCAgQQABhHwgIGEAAYFhge4gMEGAAgQYgGAZAGCA&sclient=gws-wiz-serp

    \-Cut and paste from my comment to dobik's thread-

    Thank you for sharing. Google translate does a good job of making the article readable.

    My biggest concern is that this change is because of the Digital Services Act (DSA), which was established in August 2023 and is set to be implemented on February 17, 2024 throughout the EU. Some Very Large Online Platforms (VLOPs) and Very Large Online Search Engines (VLOSEs), those with 45 million+ users in the EU have already been contacted as an informational notice of the requirements of the DSA. https://digital-strategy.ec.europa.eu/en/policies/dsa-enforcement

    Hosting companies are in the third tier of DSA pyramid, but other EU hosting companies will likely start changing their policies to ensure compliance.

    What is the DSA?

    https://commission.europa.eu/strategy-and-policy/priorities-2019-2024/europe-fit-digital-age/digital-services-act\_en#:\~:text=The%20DSA%20regulates%20online%20intermediaries,and%20the%20spread%20of%20disinformation.

    Digital Services Act (DSA) overview

    The DSA regulates online intermediaries and platforms such as marketplaces, social networks, content-sharing platforms, app stores, and online travel and accommodation platforms. Its main goal is to prevent illegal and harmful activities online and the spread of disinformation. It ensures user safety, protects fundamental rights, and creates a fair and open online platform environment.

    What are the key goals of the Digital Services Act?

    The DSA protects consumers and their fundamental rights online by setting clear and proportionate rules. It fosters innovation, growth and competitiveness, and facilitates the scaling up of smaller platforms, SMEs and start-ups. The roles of users, platforms, and public authorities are rebalanced according to European values, placing citizens at the centre.

    The act covers all sectors of internet information, sharing and hosting.

    All online intermediaries offering their services in the single market, whether they are established in the EU or outside, will have to comply with the new rules. Micro and small companies will have obligations proportionate to their ability and size while ensuring they remain accountable. In addition, even if micro and small companies grow significantly, they would benefit from a targeted exemption from a set of obligations during a transitional 12-month period.

    1
    Data Hoarder @selfhosted.forum Far_Marsupial6303 @alien.top
    BOT
    18TB Easystore for $199 back in stock at BestBuy

    I just checked two random locations and they're available for pickup. They were mostly unavailable earlier this week, so it seems they were holding back stock for day and possibly Cyber Monday.

    I personally won't buy externals anymore because of the following, but may worth it for some of you. https://www.reddit.com/r/DataHoarder/comments/146hb9k/information\_about\_cmr\_to\_smr\_manufacturer/

    12
    InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)FA
    Far_Marsupial6303 @alien.top
    BOT
    Posts 3
    Comments 76