I had a very similar issue when first setting up the Google Nest Wifi.
The issue was that I had a modem/router combo causing double NATing even
with the "Router Mode" being disabled. None of the ports on the combo
would work for more than a few hours...