Thanks for reaching out. Let's check on this further.
A few questions: what's the LED light status in your Chromecast Voice Remote? Was anything spilled onto the device? Can you confirm if the metal contacts of the battery terminal look contaminated, blocked, or discolored?
Give these steps a try: