| 79 | 0 | 8 |
| 下载次数 | 被引频次 | 阅读次数 |
采用计算机视觉技术,利用Kinect相机设计开发面向智慧医疗的无穿戴式动作检测系统,对人体姿态、行为和动作进行准确识别,辅助医生进行临床诊断与患者恢复情况评估。系统分为前端、后端和数据传输三个模块。前端使用Qt框架构建人机交互界面采集人体关节点数据,通过数据传输模块发给后端进行人体动作的智能识别;后端利用基于特征增强的时空图卷积神经网络,对人体动作进行智能识别,并返回至前端;前端根据识别结果计算关节活动范围并进行展示。经实验测试,该检测系统动作识别准确率达到99.02%,在使用GPU加速时,完成一次动作识别和关节活动范围计算仅需500 ms,校准后人体关节活动范围测量误差在±2°以内,符合临床诊断标准要求。该系统有助于推动医疗行业向更加智能、高效、便捷的方向发展,提升医疗服务的智能化、远程化、精准化。在慢病管理、康复训练、老年人健康监护、远程医疗等领域具有较好的应用价值。
Abstract:In this paper,computer vision technology was used to design a non-wearable human action detection system for smart healthcare,which can accurately recognize human posture,behavior,and actions,and assist doctors in clinical diagnosis and evaluation of patients′ recovery. The system consists of three modules:the front end,the back end,and data transmission. The front end uses Qt framework to build a human-computer interaction interface for collecting human joint-point data,which are then transmitted to the back end through the data transmission module for intelligent human action recognition. The back end module employs a feature-enhanced spatiotemporal graph convolutional neural network to recognize human actions intelligently and return the results to the front end. Based on the recognition results,the front end calculates and displays the joint range of motion(ROM).Experimental results show that the proposed system achieves an action recognition accuracy of 99. 02%. With GPU acceleration, one action recognition and joint range of motion calculation can be completed in only 500 ms. After calibration,the measurement error of the human joint range of motion is within ± 2°,meeting the requirements of clinical diagnostic standards. The system helps promote the development of the medical industry toward greater intelligence, efficiency, and convenience, and improves the intelligence, remote accessibility,and precision of medical services. It also has good application value in chronic disease management,rehabilitation training,elderly health monitoring,and telemedicine.
[1]朱洪萱.基于脊椎康复训练的体感游戏设计研究[D].南京:南京信息工程大学,2023.
[2]李睿敏.基于视觉数据的人体动作精细分类及评估方法研究[D].西安:中国科学院大学(中国科学院西安光学精密机械研究所),2021.
[3]Jordan M I. Serial order:A parallel distributed processing approach[J]. ICS-Report 8604 Institute for Cognitive Science University of California,1986,121:64.
[4]Zhang P,Lan C,Xing J,et al. View adaptive neural networks for high performance skeleton-based human action recognition[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2019,41(8):1963-1978.
[5]Cheng,K E. Skeleton-based action recognition with shift graph convolutional network[C]∥IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR),2020:180-189.
[6]Tsubasa R N R T. The reliability and validity of joint range of motion measurement using zoom and a smartphone application[J]. Journal of physical therapy science,2023,35(7):538-541.
[7]刘燕.关节量角器示值误差测量不确定度评定[J].中国计量,2024(5):145-147.
[8]杨光耀,夏振华,肖一帆,等.基于IMU和Mahony算法的人体手臂关节角度姿态测量系统研究[J].电脑知识与技术,2023,19(5):111-114.
[9]张海瑞.基于ONNX与PyTorch框架的神经网络格式转换研究[D].西安:西安电子科技大学,2023.
[10]Yan S J,Xiong Y J,Lin D H. Spatial temporal graph convolutional networks for skeleton-based action recognition[C]∥Proceedings of the AAAI Conference on Artificial Intelligence,2018.
[11]Luo C,Yan Z,Zhu J,et al. Human skeleton action recognition based on feature-enhanced spatiotemporal graph convolutional network[C]∥Proceedings of the 2024 7th International Conference on Computer Information Science and Artificial Intelligence,2024:635-640.
[12]Luo C,Yan Z,Wu J,et al. Calibration of upper limb joint angle based on Azure Kinect depth camera[C]∥2023 6th International Conference on Data Science and Information Technology(DSIT). IEEE,2023:103-108.
基本信息:
中图分类号:R318;TP391.41;TP18
引用信息:
[1]李雅卓,范正,罗晨冉,等.面向智慧医疗的人体动作检测系统研究[J].江汉大学学报(自然科学版)().
基金信息:
湖北省汽车制动管智能产线关键技术科技创新团队项目; 江汉大学校级科研项目资助计划(2023KJZX37)
2026-04-29
2026-04-29
2026-04-29