It might not work, especially if you got a different WAN type in your vacation home than your regular home. More about supported WAN types:
I'd rather just set it up at the vacation home to avoid potential extra steps (factory reset).
If you'd like to try it anyways: Create a new Google Home home for your vacation home.
Then set up the unit as a new Nest Wifi network. Unplug your existing Nest Wifi main unit from your modem when doing it.