I agree with Helegad. This is actually awesome. Later TES games are caring for the player too much, and players make gameplay even more boring and non-exciting themselves.
Many players in Skyrim always run in stealth mode and instakill enemies with 15x critical sneak strike. I once did the same until I tried to give up stealth mechanics and various exploits completely and fight with a shield and a sword like a real warrior. Never returned to the old playstyle since then. I had a lot of nervous battles with high-level draugr and bandits with lots of exchanges of blows against shields, retreating tactically, using the environment to my advantage, etc etc. And Tu'um shouts really became handy and even life-savers, not just a fancy toy!
And in Daggerfall it's even much more extreme. You must seriously prepare for any trip, because you may be doomed to death even despite cheap save-load tricks which we all tend to abuse sometimes

Be thankful for that! It's a feature, not an annoying flaw. You are really risking your life and you feel that.