When I was a kid my mother’s boyfriend bragged of doing exactly this. He heard them having a conversation in another language at a gas station, approached them, and started speaking to them in German. When they were confused he allegedly said exactly the phrase. You are in America, speak English. He thought it was hysterical.

He may have been full of shit, but the fact that he felt it worth bragging about said enough about him.