I'm a big fan of the saying that "time you enjoy wasting is not wasted time" for that exact reason. If you want to do nothing then do nothing, that's perfectly okay!
What is sad, though, is that I feel like this is saying you get so tired and burnt out from working just to survive that even when you get time off you don't get to enjoy it or do things you want because you're just so burnt out from working.
Work until you have no more energy left to live. Wait for your day off from work to live. Don't live because you have no energy left (plus the anxiety from having to work the next day). Feel like shit because you wasted your day off.
Scroll through social media. See a meme calling you out. Grimace because you want to laugh and cry at the same time. Get angry at yourself because you keep consuming media that makes you feel even worse.
Friday: Too exhausted to do anything after work and go to bed in regular schedule
Saturday: Groceries shopping, cleaning, then too exhausted to do anything, slacking off and go to bed 3am
Sunday: Sleep till 1pm, be sad and mad about Monday coming
You need a long drawn out hobby you can go back to anytime you have no idea what to do. Painting, puzzles, coding, sewing, model planes/cars, whatever, as long as it's a project that usually takes several weeks or months.
Tbh thats part of the reason I like to take many small amounts and spread them out over the year instead of few big chunks. This probably changes once you have kids I guess.