Unfortunately there is no setting or feature to turn that off. I’d encourage you to also send this feedback directly to Google. You will not receive a response, unless Google need more details from you, however the team are still reading the feedback.
