You may be able to depending on your phone. Read this for more information:
https://support.google.com/chromecast/answer/11221499
Some features (like volume control) may not be available on the Virtual Remote.
Also, you should find your remote or order a replacement. If you have to reset your Chromecast device you HAVE to have the physical remote to complete that process.
You can order one from the Google Store:
https://store.google.com/product/chromecast_google_tv_voice_remote?hl=en-US
