A translation or scale could be defined just for one axis, in that case the other axis is supposed to be left untouched.
This case make the plot fail, as can be reproduced from this notebook.
Fortunately, the new helper function of this PR scverse/spatialdata#314 that was developed to fix the bug with the affine transformation #103, will automatically fix also this issue.