Gait Patterns as Biomarkers: A Video-Based Approach for Classifying Scoliosis

1Southern University of Science and Technology, 2The Hong Kong Polytechnic University
Code     Dataset     Arxiv    

Abstract

Scoliosis presents significant diagnostic challenges, particularly in adolescents, where early detection is crucial for effective treatment. Traditional diagnostic and follow-up methods, which rely on physical examinations and radiography, face limitations due to the need for clinical expertise and the risk of radiation exposure, thus restricting their use for widespread early screening. In response, we introduce a novel video-based, non-invasive method for scoliosis classification using gait analysis, effectively circumventing these limitations. This study presents Scoliosis1K, the first large-scale dataset specifically designed for video-based scoliosis classification, encompassing over one thousand adolescents. Leveraging this dataset, we developed ScoNet, an initial model that faced challenges in handling the complexities of real-world data. This led to the development of ScoNet-MT, an enhanced model incorporating multi-task learning, which demonstrates promising diagnostic accuracy for practical applications. Our findings demonstrate that gait can serve as a non-invasive biomarker for scoliosis, revolutionizing screening practices through deep learning and setting a precedent for non-invasive diagnostic methodologies.


The Scoliosis1K Dataset

Silhouettes from the Scoliosis1K Dataset

Interpolate start reference image.

Statistics of the Scoliosis1K Dataset

Interpolate start reference image.

Download the Scoliosis1K Dataset

Step1: Download

Download when you are applying dataset via link: (OneDrive, BaiduYun code: 54iu).

Step2: Agreement

Signing the Agreement and sending it to email (12331257@mail.sustech.edu.cn) with the subject “[Scoliosis1K Dataset Application]”. Then follow the instructions to play the dataset.


Method

Interpolate start reference image.

The participant is tracked throughout the video, excluding non-participant entities like clinicians. The participant's silhouette is then segmented, followed by scoliosis classification using ScoNet-MT based on gait analysis.


BibTeX

@InProceedings{Zhou_2024_MICCAI,
      author    = {Zhou, Zirui and Liang, Junhao and Peng, Zizhao and Fan, Chao and Fengwei, An and Yu, Shiqi},
      title     = {Gait Patterns as Biomarkers: A Video-Based Approach for Classifying Scoliosis},
      booktitle = {International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI)},
      month     = {June},
      year      = {2024},
      pages     = {0-0}
  }