Thanks for posting here in the Google Nest Community.
Good question. If the old Wi-Fi is still available there is an option under your speaker settings in the Home app to forget it. If the old network is not available anymore, you can do a full reset and set up your speaker to the new network. Check the steps below on how to forget the network.
Hope this helps.