Not in private conversation. It would be rude to assume when engaging in public business that people will speak your language if it is not the common language of that country. But we are not discussing that. We are discussing a mother speaking to her child in private conversation.
Perhaps I am not explaining this properly. I’ll use an example.
If you are getting a haircut in a barber shop where the barbers are all Italian, it would be inconsiderate and rude for them to speak among themselves in the your presence in a language other than English, unless they had no ability to speak or understand English.