I believe this might be related to a rare-ish Unity engine bug where the player's character controller stops colliding with random other colliders. If you return to this same spot again in another session, it should work normally.
The problem in question should be resolved in 5.6 or greater, but I have some other problems to solve before I can move up baseline engine version. This is something I'll give more priority once main quest playthrough supported.