Whenever you are in city view and press the Street/Satellite toggle button the zoom/pan factors you had are reset to the full city view.
When you are exploring a city and zoom in on some streets, if you toggle to satellite view to get a feel for what the area looks like you usually don’t want to automatically zoom out to the whole city.