Thanks for the responses but just checking that stuff will sadly not solve my problem.
Just now after everything worked fine I quit the viewer, restarted and had those freezes again. Then I quit the viewer again and logged back in and everything was fine. It feels like it's completely random.