Automated camera head calibration tools
Camera calibration tools and tactics can change depending on the needs of the application.
ifm provides python code samples to facilitate calibration using a stationary checkerboard. This process can be used to build calibration cells for end-of-line testing of AMRs/AGVs camera systems.
When developing an AMR and testing the camera system, the static calibration methodology requires repeated measurements with each repositioning of the vehicle. An alternate tool was built to address the need for field-testing of cameras. This tool is called Motion Camera Calibration (MCC).
Motion Camera Calibration
The MCC tool allows the roboticist to perform camera calibration by moving the vehicle to which the camera is attached.
The application will use the images that the camera collects while the vehicle is moving to determine the 3 rotation parameters of the camera’s extrinsic calibration.
An o3r camera system mounted on a vehicle.
A vehicle which can travel in a straight line in the negative-x direction (backward).
A computer connected to the VPU of the o3r camera system.
Measurements of the translations of the camera head (transX, transY, and transZ of the extrinsicHeadToUser properties). This can be measured manually, or derived from CAD. Note that the camera positions are relative to the center of the rear face of the camera head.
The Motion Camera Calibration software package. Currently, this is available upon request from email@example.com.
A printed calibration checkerboard (checkerboard.pdf in 0.8m x 0.6m) resting on the floor or at a height so that it is in the field of view of the camera being calibrated. Please find the checkerboard in pdf format
We recommend installing the MCC tool to a fresh Python3 venv to minimize the risk of conflicting versions of dependent Python libraries.
Create a new venv:
python3 -m venv venv
Install the requirements: The required
requirements_MCC.txtfile can be found in the GH repository under
source ./venv/bin/activate python3 -m pip -r requirements_MCC.txt
Install the MCC tool: request the download link via email from: from firstname.lastname@example.org
Start the MCC tool:
The MCC application window has 2 parts.
On the left side, you can:
The cell size of the checkerboard
The translation parameters
Start backward motion / stop backward motion
Clear and restart the calibration process
Save / load the data ﬁle
On the right side, you have two windows:
Left window: shows the live stream of the camera,
Right window: shows the last image that is used for calibration.
You can calibrate only one camera at a time; therefore select the camera port in the application window which you wish to calibrate.
Place the target horizontally (if the camera head is mounted horizontally) or vertically (if the camera is mounted vertically) such that the reference corner (bigger cell) is up.
Type in the camera translations.
Move the camera closer to the target such that the target is large in the live image: it should at least ﬁll 50% of the image.
Once the checkerboard is detected, the corners will become green indicating that you can start the backward motion.
Start backward motionand move the robot backward in a straight line.
Once you clicked the
start backward motionall other options will be greyed out except
Clear and Restart
The minimum movement range should be
50 cm(If you moved the robot less than 50 cm then the calibration will not be successful)
The calibration tool will automatically save the frames to a file in the background while you move the robot (camera).
Once the calibration tool captures the required number of frames, the
Stop backward motionbutton will be enabled again and can be clicked by the user to terminate this step.
During the procedure, if you feel you did anything wrong or didn’t move the camera in a straight line click
Clear and Restartto restart the calibration procedure.
Move the robot orthogonal to the backward motion line and close to the target (ﬁll at least 50% of the image) such that the tool detects all corners of the checkerboard target.
The orthogonal offset should be a minimum of 40 cm.
Add single image (1/2)to add this image to the calibration data file. After clicking the button once, it changes to
Add single image (2/2)which means the first offset position was successful.
Move the camera to the other side of the backward motion line and ensure all the checkerboard corners are detected.
Add single image (2/2).
Calibrateto perform calibration and output the results.
The calibration status and parameters will be displayed at the top of the application window.
Manually save the calibration parameters output (values) to a file for further reference.
Save the image data file by clicking on the
Save h5 filebutton, this is a handy file to send back to ifm development team for debugging.
The calibration might not be successful due to the following reasons:
Backward motion is not in a straight line.
If the backward motion path is too short. The minimum path length is 0.4 meters.
Due to low signal levels in the images. In this case, try calibrating using
If the target is too small in the images. Try to move closer to the checkerboard target.
If the single images are too close to each other. The offset between the positions of two single images should be at least 0.50 meters.
If the distance between a single image and the motion path is less than 0.25 meters.