A Machine Vision-Based Method for Pose Estimation of Pin Shafts in Oil Derrick Structures

Qitao Tu; Chong Xie

doi:10.62051/ijmee.v6n3.10

Authors

Qitao Tu
Chong Xie

DOI:

https://doi.org/10.62051/ijmee.v6n3.10

Keywords:

Derrick Pin, FPFH, Model Point Cloud, Registration

Abstract

As a core component in oil drilling operations, the derrick structure of a drilling rig traditionally relies on manual handling during assembly and disassembly, which is complex, inefficient, and poses significant safety risks. To enhance the level of automation, this paper proposes a machine vision-based method for pose recognition of pin shafts in derrick structures. A structured light camera is employed to capture on-site 3D point cloud data, which is then aligned with pre-defined workpiece templates for recognition. The registration process begins with a coarse alignment using the Sample Consensus Initial Alignment (SAC-IA) algorithm based on Fast Point Feature Histograms (FPFH), followed by fine pose estimation through the Iterative Closest Point (ICP) algorithm accelerated by a KD-tree structure. Experimental results demonstrate the effectiveness and practicality of the proposed system in identifying and locating typical components. This method offers reliable technical support for the automated assembly and disassembly of derrick structures and holds promising value for engineering applications.

References

[1] Hoque S, Arafat M Y, Xu S, et al. A Comprehensive Review on 3D Object Detection and 6D Pose Estimation with Deep Learning [J]. IEEE Access, 2021, 9: 143746-70.

[2] Arnold E, Al-jarrah O Y, Dianati M, et al. A Survey on 3D Object Detection Methods for Autonomous Driving Applications [J]. IEEE TRANSACtions on Intelligent Transportation Systems, 2019, 20(10): 3782-95.

[3] Chua C S, Jarvis R. Point signatures: A new representation for 3d object recognition[J]. International Journal of Computer Vision, 1997, 25: 63-85.

[4] Johnson A E, Hebert M. Surface matching for object recognition in complex three-dimensional scenes[J]. Image and Vision Computing, 1998, 16(9): 635-651.

[5] Johnson A E, Hebert M. Using spin images for efficient object recognition in cluttered 3D scenes[J]. IEEE Transactions on pattern analysis and machine intelligence, 1999, 21(5): 433-449.

[6] Rusu R B, Blodow N, Marton Z C, et al. Aligning point cloud views using persistent feature histograms[C]. In Proceedings of International Conference on Intelligent Robots and Systems. IEEE, 2008: 3384-3391.

[7] Rusu R B, Marton Z C, Blodow N, et al. Learning informative point classes for the acquisition of object model maps[C]. International Conference on Control. IEEE, 2008.

[8] Song S, Shi X, Ma C, et al. MF-LIO: integrating multi-feature LiDAR inertial odometry with FPFH loop closure in SLAM[J]. Measurement Science and Technology, 2024, 35(8): 086308.

[9] Besl P J, McKay N D. Method for registration of 3-D shapes[C]. Sensor fusion IV: control paradigms and data structures. Spie, 1992, 1611: 586-606.

[10] Zhang Z . Iterative point matching for registration of free-form curves and surfaces[J]. International Journal of Computer Vision, 1994, 13(2).

[11] Trucco E, Fusiello A, Roberto V. Robust motion and correspondence of noisy 3-D point sets with missing data[J]. Pattern recognition letters, 1999, 20(9): 889-898.

[12] Bae K H, Lichti D D. A method for automated registration of unorganised point clouds[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2008, 63(1): 36-54.

[13] Qi C R, Su H, Mo K, et al. Pointnet: Deep learning on point sets for 3d classification and segmentation[C]. Proceedings of the IEEE conference on computer vision and pattern recognition. 2017: 652-660.

[14] Qi C R, Yi L, Su H, et al. Pointnet++: Deep hierarchical feature learning on point sets in a metric space[J]. Advances in neural information processing systems, 2017, 30.

[15] Fischler M A, Bolles R C, Foley J D. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography[J]. Communications of the Association for Computing Machinery, 1981, 24(6): 381-395.

[16] Rusu R B, Blodow N, Beetz M. Fast point feature histograms (FPFH) for 3D registration[C]. In Proceedings of International Conference on Robotics and Automation. IEEE, 2009: 3212-3217.

[17] Zhang Z. Iterative point matching for registration of free-form curves and surfaces[J]. International Journal of Computer Vision, 1994, 13(2):119-152.