It's not you, it's us, it's the society that's too darn demanding. You're taking a break to recharge, not waste time in a porcelain throne.
Think about it, if you're constantly on the clock, you'll burn out. Like a candle in the wind, but, like, literally.
So, take a deep breath (or two, or ten), and remember: you're not lazy, you're just on a mission to find your inner calm.