American Institute of Mathematical Sciences

January  2021, 17(1): 427-445. doi: 10.3934/jimo.2019119

Calibration of a 3D laser rangefinder and a camera based on optimization solution

 a. School of Control Science and Engineering, Dalian University of Technology, Dalian 116024, China b. School of Mathematical Sciences, Dalian University of Technology, Dalian 116024, China c. Information Center, Ministry of Water Resources of China, Beijing 100032, China

* Corresponding author: Lei Wang (Email: wanglei@dlut.edu.cn)

Received  March 2019 Revised  April 2019 Published  September 2019

The calibration of a 3D laser rangefinder (LRF) and a camera is a key technique in the field of computer vision and intelligent robots. This paper proposes a new method for the calibration of a 3D LRF and a camera based on optimization solution. The calibration is achieved by freely moving a checkerboard pattern in front of the camera and the 3D LRF. The images and the 3D point clouds of the checkerboard pattern in various poses are collected by the camera and the 3D LRF respectively. By using the images, the intrinsic parameters and the poses of the checkerboard pattern are obtained. Then, two kinds of geometric constraints, line-to-plane constraints and plane-to-plane constraints, are constructed to solve the extrinsic parameters by linear optimization. Finally, the intrinsic and extrinsic parameters are further refined by global optimization, and are used to compute the geometric mapping relationship between the 3D LRF and the camera. The proposed calibration method is evaluated with both synthetic data and real data. The experimental results show that the proposed calibration method is accurate and robust to noise.

Citation: Yi An, Bo Li, Lei Wang, Chao Zhang, Xiaoli Zhou. Calibration of a 3D laser rangefinder and a camera based on optimization solution. Journal of Industrial & Management Optimization, 2021, 17 (1) : 427-445. doi: 10.3934/jimo.2019119
References:

show all references

References:
Calibration board and 3D color laser ranging system
Pinhole camera model
Point cloud of the calibration board and its line point clouds
Calibration images
Normal vector $\bar{\mathit{\boldsymbol{n}}}_{j}$ of the calibration board in $j$th pose
Line-to-plane constraint
The plane-to-plane constraint
Synthetic data generation
Calibration results with the increasing number of poses
Calibration results with the increasing noise level
Calibration results with the number of poses 30 and the noise level 10$mm$
3D color point cloud of the room
3D color point cloud of the housing estate
RMS error analysis results (unit: pixel)
 Method Minimum Average Maximum Our Method 1.3571 3.6962 7.2579 Zhang's Method 1.8495 4.7702 8.6392 Ying's Method 1.5946 3.7866 7.4648
 Method Minimum Average Maximum Our Method 1.3571 3.6962 7.2579 Zhang's Method 1.8495 4.7702 8.6392 Ying's Method 1.5946 3.7866 7.4648
 [1] Vianney Perchet. Approachability, regret and calibration: Implications and equivalences. Journal of Dynamics & Games, 2014, 1 (2) : 181-254. doi: 10.3934/jdg.2014.1.181 [2] Wenxiu Gong, Zuoliang Xu. An alternative tree method for calibration of the local volatility. Journal of Industrial & Management Optimization, 2020  doi: 10.3934/jimo.2020146 [3] Laurent Devineau, Pierre-Edouard Arrouy, Paul Bonnefoy, Alexandre Boumezoued. Fast calibration of the Libor market model with stochastic volatility and displaced diffusion. Journal of Industrial & Management Optimization, 2020, 16 (4) : 1699-1729. doi: 10.3934/jimo.2019025 [4] Xiangyu Gao, Yong Sun. A new heuristic algorithm for laser antimissile strategy optimization. Journal of Industrial & Management Optimization, 2012, 8 (2) : 457-468. doi: 10.3934/jimo.2012.8.457 [5] Dmitri E. Kvasov, Yaroslav D. Sergeyev. Univariate geometric Lipschitz global optimization algorithms. Numerical Algebra, Control & Optimization, 2012, 2 (1) : 69-90. doi: 10.3934/naco.2012.2.69 [6] Claudia Lederman, Noemi Wolanski. An optimization problem with volume constraint for an inhomogeneous operator with nonstandard growth. Discrete & Continuous Dynamical Systems, 2021, 41 (6) : 2907-2946. doi: 10.3934/dcds.2020391 [7] Marissa Condon, Alfredo Deaño, Arieh Iserles. On systems of differential equations with extrinsic oscillation. Discrete & Continuous Dynamical Systems, 2010, 28 (4) : 1345-1367. doi: 10.3934/dcds.2010.28.1345 [8] Anna Doubova, Enrique Fernández-Cara. Some geometric inverse problems for the linear wave equation. Inverse Problems & Imaging, 2015, 9 (2) : 371-393. doi: 10.3934/ipi.2015.9.371 [9] Jiang-Xia Nan, Deng-Feng Li. Linear programming technique for solving interval-valued constraint matrix games. Journal of Industrial & Management Optimization, 2014, 10 (4) : 1059-1070. doi: 10.3934/jimo.2014.10.1059 [10] Lekbir Afraites, Chorouk Masnaoui, Mourad Nachaoui. Shape optimization method for an inverse geometric source problem and stability at critical shape. Discrete & Continuous Dynamical Systems - S, 2021  doi: 10.3934/dcdss.2021006 [11] Mahdi Karimi, Seyed Jafar Sadjadi. Optimization of a Multi-Item Inventory model for deteriorating items with capacity constraint using dynamic programming. Journal of Industrial & Management Optimization, 2020  doi: 10.3934/jimo.2021013 [12] Víctor León, Bruno Scárdua. A geometric-analytic study of linear differential equations of order two. Electronic Research Archive, 2021, 29 (2) : 2101-2127. doi: 10.3934/era.2020107 [13] Behrouz Kheirfam. Multi-parametric sensitivity analysis of the constraint matrix in piecewise linear fractional programming. Journal of Industrial & Management Optimization, 2010, 6 (2) : 347-361. doi: 10.3934/jimo.2010.6.347 [14] Cornel Marius Murea, Dan Tiba. Topological optimization and minimal compliance in linear elasticity. Evolution Equations & Control Theory, 2020, 9 (4) : 1115-1131. doi: 10.3934/eect.2020043 [15] David Russell. Structural parameter optimization of linear elastic systems. Communications on Pure & Applied Analysis, 2011, 10 (5) : 1517-1536. doi: 10.3934/cpaa.2011.10.1517 [16] Yibing Lv, Zhongping Wan. Linear bilevel multiobjective optimization problem: Penalty approach. Journal of Industrial & Management Optimization, 2019, 15 (3) : 1213-1223. doi: 10.3934/jimo.2018092 [17] Adil Bagirov, Sona Taheri, Soodabeh Asadi. A difference of convex optimization algorithm for piecewise linear regression. Journal of Industrial & Management Optimization, 2019, 15 (2) : 909-932. doi: 10.3934/jimo.2018077 [18] Luke Finlay, Vladimir Gaitsgory, Ivan Lebedev. Linear programming solutions of periodic optimization problems: approximation of the optimal control. Journal of Industrial & Management Optimization, 2007, 3 (2) : 399-413. doi: 10.3934/jimo.2007.3.399 [19] Prabhu Manyem. A note on optimization modelling of piecewise linear delay costing in the airline industry. Journal of Industrial & Management Optimization, 2021, 17 (4) : 1809-1823. doi: 10.3934/jimo.2020047 [20] Alireza Ghaffari Hadigheh, Tamás Terlaky. Generalized support set invariancy sensitivity analysis in linear optimization. Journal of Industrial & Management Optimization, 2006, 2 (1) : 1-18. doi: 10.3934/jimo.2006.2.1

2019 Impact Factor: 1.366