Skeletal-based action recognition for medical condition detection using PoseConv3D
Independent Researcher, UK.
Research Article
World Journal of Biology Pharmacy and Health Sciences, 2023, 14(02), 329-342.
Article DOI: 10.30574/wjbphs.2023.14.2.0213
Publication history:
Received on 07 April 2023; revised on 20 May 2023; accepted on 24 May 2023
Abstract:
Early detection of medical conditions is important for elderly people, as early diagnosis can save them from getting late help and swift intervention. In this work, we are interested in developing PoseConv3D, a novel design to address such challenges raised in traditional GCNs with apply skeletal based action recognition. GCNs are good at analyzing human joint movements, however, they fail at processing noisy pose estimations, being unscalable in recognizing a group of activities, and integrating other data types. To overcome this limitation, PoseConv3D represents 2D skeletal data with time stacked heat maps, and analyzes them with a 3D convolutional neural network. A model targeting 12 medical conditions, including falls and posture related issues, is trained using the NTU RGB+D 120 dataset. The model was trained using Google Colab’s GPU as training and outperformed the GCN based approaches. We developed a user friendly system involving a React Native frontend that would allow users upload videos or URLs to be detected on the real time condition. Docker containerization allows for efficient deployment of the backend using Fast API and local systems, while providing a backend that also processes. The results show PoseConv3D is robust, scalable and accurate, and thus can be used as a real world medical condition detection and an elderly care tool.
Keywords:
3D Convolutional Neural Networks (3D-CNNs); Docker Containerization; Elderly Care; FastAPI; Graph Convolutional Networks (GCNs); Healthcare Technology
Full text article in PDF:
Copyright information:
Copyright © 2024 Author(s) retain the copyright of this article. This article is published under the terms of the Creative Commons Attribution Liscense 4.0