If you want full control over a Zoom effect, set the zooming mode to manual and pick a static target point to zoom in on.
After selecting a Zoom animation on the timeline, set the Zooming Mode to manual zoom in the properties.
Use the coordinate picker to set the focus point of the Zoom .
To see the preview update as you change the target, make sure to move the playhead to the Zoom element.