Thanks for posting here in the Google Nest Community.
We understand your concern. We want to know a few things so we can better assist: Which Nest speaker are we working on? Are you using the same email address? If it’s a Nest speaker you can do a full reset and set it up using your new phone. Check the helpful link below on how to reset and set up Nest speakers.
Let me know how it goes.