Design and Implementation of Intelligent Robot Control System Integrating Computer Vision and Mechanical Engineering


  • Guiran Liu
  • Binrong Zhu



Mechanical engineering, Computer vision, Intelligent robot control system


With the rapid development of science and technology and industry, robot technology has become a key pillar in many fields, especially in industrial manufacturing, robots have been widely used in automated operations. However, in the face of the complex and changeable demands of modern industry, simple mechanized operation can no longer be satisfied, and intelligence has become the inevitable trend of robot technology development. By combining computer vision technology, this study provides robots with powerful environmental awareness and target recognition capabilities, thus achieving higher-level autonomous operation and decision-making. Aiming at the intelligent sorting system, this research adopts XYZ mechanical arm as the execution platform, equipped with TCS34725 color sensor to identify the color of articles, and integrates Hikvision industrial camera and NVIDIA Jetson TX2 image processor to capture and process image data, so as to achieve accurate positioning of articles. In the aspect of software design, this research realizes the function of accurately sorting different color items from the conveyor belt by combining color recognition algorithm and image processing technology with mechanical engineering control. The test results of the system show that the system has high accuracy and stability in color recognition and object positioning, and the trajectory accuracy of the manipulator meets the requirements, which verifies the realization of the research goal. The intelligent robot control system designed in this paper not only improves the level of industrial automation and reduces labor costs, but also broadens the application fields of robots in complex environments.


Liang, S., Chen, C., & Zou, G. (2020). Intelligent driving system of robot based on computer vision and neural network algorithm. Journal of Intelligent and Fuzzy Systems, 38(2), 1-12.

Hsieh, Y. Z., & Lin, S. S. (2020). Robotic arm assistance system based on simple stereo matching and q-learning optimization. IEEE Sensors Journal, 20(18), 10945-10954.

Schuster, M. J., Brunner, S. G., Bussmann, K. , Stefan Büttner, & Wedler, A. (2019). Towards autonomous planetary exploration: the lightweight rover unit (lru), its success in the spacebotcamp challenge, and beyond. Journal of Intelligent & Robotic Systems, 93(3-4), 461-494.

Eldré W. Beukes, Hynes, N., Mann, D. L., Hawkes, R., Jayabalan, P., & Allen, P. M. (2022). Perceived facilitators and barriers to participation in golf for people with vision impairment. American Journal of Physical Medicine & Rehabilitation, 102(9), 829-835.

José Diogo Forte de Oliveira Luna, Carlos Alberto Tenório de Carvalho Júnior, Ciro José Egoavil Montero, Oliveira, G. B. D., & Oliveira, G. S. D. (2019). Development of robotic arm control system using computational vision. IEEE Latin America Transactions, 17(8), 1259-1267.

Bouteraa, Y., Abdallah, I. B., Ibrahim, A. , & Ahanger, T. A. (2021). Fuzzy logic-based connected robot for home rehabilitation. Journal of Intelligent and Fuzzy Systems, 40(2), 1-16.

Miao, H., Xiao, C., Wei, M., & Li, Y. (2019). Efficient measurement of key-cap flatness for computer keyboards with a multi-line structured light imaging approach. IEEE sensors journal, 19(21), 10087-10098.

Chao, Y., Chen, X., & Xiao, N. (2018). Deep learning-based grasp-detection method for a five-fingered industrial robot hand. IET Computer Vision, 13(1), 61-70.

Zhang, Y., Zhao, J., & Han, H. (2021). A 3d machine vision-enabled intelligent robot architecture. Mobile Information Systems, 2021(3), 1-11.

Song, W., Qiu, N., Shen, L., & Zhang, Y. (2018). The monocular stereo matching and grasping of robot for industrial parts. Jiqiren/Robot, 40(6), 950-957.







How to Cite

Liu, G., & Zhu, B. (2024). Design and Implementation of Intelligent Robot Control System Integrating Computer Vision and Mechanical Engineering. International Journal of Computer Science and Information Technology, 3(1), 219-226.

Similar Articles

1-10 of 96

You may also start an advanced similarity search for this article.