Make change between different intrinsic calibration without losing trackpoints
It seems to be possible to switch between different intrinsic calibrations, by revert the calibration and then applying the new one.
map1, map2 = cv.initUndistortRectifyMap(
camera, distortion, np.eye(3), camera_wrong,
frame.shape[:-1][::-1], cv.CV_16SC2
)
x = map1[int(point.y)][int(point.x)]