I found the issue, digging in a bit I found I was also having problems with my work VPN. I work for a digital workspace monitoring company and used some of our tools to find that I was having issues with network saturation. I called my ISP and they confirmed (after lv 1 support) that yes the signal to my modem was weaker than normal and there is probably a problem with the line.