Comprehensive Review of Camera Calibration Methods for Three-dimensional Imaging Technology

Jingge Zhang; Weijing Kong; Rui Meng; Rongguo Yin; Yuanyuan Zhang

doi:10.62051/ijmee.v2n3.08

Authors

Jingge Zhang
Weijing Kong
Rui Meng
Rongguo Yin
Yuanyuan Zhang

DOI:

https://doi.org/10.62051/ijmee.v2n3.08

Keywords:

Camera Calibration, Three-dimensional Imaging, Neural Networks

Abstract

Through a systematic review of relevant literature, this paper comprehensively elucidates the evolution of camera calibration techniques and analyzes key milestones in its development. It introduces traditional camera calibration, self-calibration, and neural network-based camera calibration methods along with their research status, summarizing the characteristics and applicable scenarios of each method in practical applications. Based on the latest research progress, it delineates the latest technologies and methods in the field of camera calibration, highlighting their respective advantages and limitations. Prospects for the future development of camera calibration techniques are provided, exploring potential breakthroughs in high-precision, high-robustness mapping models, and automatic, accurate marking of image feature points, thereby offering valuable insights for addressing complex scenarios in 3D measurement applications.

References

Abdel-Aziz Y I, Karara H M. “Direct Linear Transformation from Comparator Coordinates into Object Space Coordinates in Close-Range Photogrammetry”, Proceedings of the Symposium on Close-Range Photogrammetry, pp. 1–18. 1971.

Wu Jinming, Li Yufeng, Chen Niannian, etc. “A method for pose estimation of DLT cameras using an improved RAC model”, Journal of Southwest University of Science and Technology, Vol. 34, pp. 71–76. 2019.

Barone F ,Marrazzo M ,Oton J C. “Camera Calibration with Weighted Direct Linear Transformation and Anisotropic Uncertainties of Image Control Points”, Sensors , Vol. 20, pp. 1175. 2020.

Zhang Lei, Zhang Tianyi, Yao Xingtian, etc. “Improved target pose estimation in robot vision”, Journal of Nantong University (Natural Science Edition), Vol. 20, pp. 38-45. 2021.

Chen Yang. “Research on High-Precision Camera Calibration Technology Based on Control Fields”, Wireless Interconnection Technology, Vol. 24, pp. 116-119. 2023.

Li Qinwen, Ni Shoujun, Wang Zhiqian, et al. “Pose Calibration for Non-Common Field of View Stereo Cameras ”, Optics and Precision Engineering, Vol. 28, pp. 2737-2744. 2020.

Akinori N. “Three-dimensional videography using omnidirectional cameras: An approach inspired by the direct linear transformation method”, Journal of Biomechanics, Vol. 128, pp. 110722-110722. 2021.

Tsai R Y. “An efficient and accurate camera calibration technique for 3D machine vision”, Computer Vision and Pattern Recognition, Vol. 3, pp. 364-374. 1986.

Xu Jie. “Analysis and Improvement of Tsai's Two-Step Camera Calibration Method in Machine Vision”, Computer Engineering and Science, Vol. 32, pp. 45-48. 2010.

Mi Xue. “Su Jianmin. A Stable and Accurate Camera Calibration Method”, Computer Engineering and Applications, Vol. 48, pp. 190-193. 2012.

Yao Longxing, Han Jiangtao, Zhang Zhiyi. “An Analytical Improvement of Tsai's Planar Calibration Algorithm”, Computer Engineering and Science, Vol. 44, pp. 1976-1984. 2022.

Liu Zeqing, Xu Yong, Du Bojun, et al. “Calibration Method for High-Speed Cameras Based on Onboard Marker Targets”, Progress in Laser and Optoelectronics, Vol. 60, pp. 369-375. 2023.

Zhang Z. “A flexible new technique for camera calibration”, IEEE Transactions on pattern analysis and machine intelligence, Vol. 22, pp. 1330-1334. 2000.

Wang Linxia, Chen Guangfeng. “Camera Parameter Calibration Method Based on Chaos Particle Swarm Optimization Algorithm”, Automation and Instruments, Vol. 34, pp. 41-45. 2019.

Tian Shaobing, Fan Jiali, Wang Zheng, et al. “Monocular Camera Calibration Algorithm Based on Improved Particle Swarm Algorithm”, Ship Electronic Engineering, Vol. 41, pp. 44-47. 2021.

Xizuo D,Qicheng G,Mei Z,et al. “Chessboard Corner Detection Based on EDLines Algorithm”, Sensors, Vol. 22, pp. 3398-3398. 2022.

Qu Kai, Guo Zhongyou, Tang Yulin, et al. “Zhang's Calibration Algorithm Considering Object-Side Coordinate Errors”, Northwest Hydropower, Vol. 6, pp. 79-84. 2022.

Shang Hai, Ni Shoudong, Su Zhiyong. “Camera Calibration Optimization Method Based on Improved Sparrow Search Algorithm”, Computer Technology and Development, Vol. 33, pp. 146-151. 2023.

Faugeras O D,Luong Q T,Maybank S J. “Camera Self-Calibration: Theory and Experiments”, Conference paper, Vol. 588, pp. 321-334. 1992.

Faugeras O D, Maybank S.“Motion from point matches:multiplicity of solutions”, International Journal of Computer Vision, Vol. 4, pp. 172-193. 1990.

Merras M,Akkad E N,Saaidi A, et al. “Camera Self Calibration with Varying Parameters by an Unknown Three Dimensional Scene Using the Improved Genetic Algorithm”, 3D Research, Vol. 6, pp. 1-14. 2015.

Yang Yanan, Jia Yuan. “Camera Self-Calibration Method Based on Improved Genetic Algorithm”, Computer Measurement and Control, Vol. 28, pp. 188-191. 2020.

Wang Xin, Gao Huanyu, Zhang Mingming. “A Stepwise Self-Calibration Method Based on the Kruppa Equations”, Computer Science, Vol. 39, pp. 266-268. 2012.

Wang Junzhu, Chen Lifang, Liu Yuan. “Research on Camera Self-Calibration Method Based on Tensor Voting”, Computer Engineering and Applications, Vol. 52, pp. 190-197. 2016.

Zhang Bolin, Liu Ronghai, Zheng Xin, et al. “Self-Calibration Optimization Algorithm for 3D Reconstruction from X-Ray Images”, Computer Engineering and Science, Vol. 41, pp. 1474-1481. 2019.

Triggs B,Zisserman A,Szeliski R. “Algorithms: Theory and Practice Volume Bundle Adjustment—A Modern Synthesis”, Lecture Notes in Computer Science Vision, Vol. 1883, pp. 153-177. 2000.

Chen Jing, Yuan Baozong, Miao Zhenjiang, et al. “Global Optimization Solution for Fixed Focal Length in Multi-Viewpoints”,Acta Electronica Sinica, Vol. 40, pp. 1893-1899. 2012.

Wu Xiaojun, Fan Dongkai. “A Robust Camera Self-Calibration Method Based on Semidefinite Programming”, Acta Electronica Sinica, Vol. 42, pp. 1210-1215. 2014.

Yang Duo, Liu Feifei. “Research on 3D Reconstruction of Impeller Parts Based on Monocular Vision”, Electromechanical Engineering, Vol. 37, pp. 73-77. 2020.

Yuan Sicong, Jiang Xiangkui. “Binocular Camera Calibration Based on GA-BP Neural Network”, Journal of Xi'an University of Architecture & Technology (Natural Science Edition),Vol. 43, pp. 604-608. 2011.

Chen Wenyi, Xu Jie, Yang Hui. “Camera Calibration Method Using Dual Neural Networks”, Infrared and Laser Engineering, Vol. 50, pp. 294-302. 2021.

Hu Zhixin, Wang Tao. “Binocular Camera Calibration with BP Neural Network Optimized by Improved Genetic Algorithm”, Opto-Electronic Engineering, Vol. 29, pp. 75-79. 2022.

Yuwei C,Hui W,Han Z,et al. “Neural-Network-Based Model-Free Calibration Method for Stereo Fisheye Camera”, Frontiers in Bioengineering and Biotechnology, Vol. 10, pp. 955233-955233. 2022.

An Hailin, Liu Ji, Niu Tianli, et al. “Dual Camera Calibration Algorithm Based on Improved Genetic Simulated Annealing Neural Network”, Foreign Electronic Measurement Technology, Vol. 42, pp. 21-26. 2023.

Xiang Peng, Zhou Bin, Zhu Yangkun, et al. “Camera Calibration Based on Deep Neural Networks in Complex Environments”, Progress in Laser and Optoelectronics, Vol. 56, pp. 214-222. 2019.

Song Le, Hou Yupeng, Zhang Junpeng, et al. “Monocular Vision-Based Cuboid 3D Measurement Method Using Mask-RCNN and SFM”, Journal of Measurement Science and Instrumentation, Vol. 14, pp. 127-136. 2023.

Shen Shiyu, Li Jian, Gu Mengtao, et al. “Reconstruction of 3D Particle Spatial Distribution in Light Fields Using Convolutional Neural Network Deep Learning Models”, Acta Optica Sinica, Vol. 43, pp. 213-224. 2023.