A criminal doesn’t need to know your address. All he has to do is pick a potential neighborhood and start scrolling up and down the streets until he spots a home that looks promising.
That really is no different than driving to a nice neighborhood and looking for a potential target. Plus, the Google view is a static picture that may be years out of date; it won’t provide information like how many people live there, if the owners are typically home a lot, or if the house is vacant all day, when the owners are on vacation, etc. In other words, the criminal won’t find a target of opportunity by looking at Google street view, and Google street view will not help much with a planned burglary.