- search hit 1 of 1
IMU-Based Movement Trajectory Heatmaps for Human Activity Recognition
- Recent trends in ubiquitous computing have led to a proliferation of studies that focus on human activity recognition (HAR) utilizing inertial sensor data that consist of acceleration, orientation and angular velocity. However, the performances of such approaches are limited by the amount of annotated training data, especially in fields where annotating data is highly time-consuming and requires specialized professionals, such as in healthcare. In image classification, this limitation has been mitigated by powerful oversampling techniques such as data augmentation. Using this technique, this work evaluates to what extent transforming inertial sensor data into movement trajectories and into 2D heatmap images can be advantageous for HAR when data are scarce. A convolutional long short-term memory (ConvLSTM) network that incorporates spatiotemporal correlations was used to classify the heatmap images. Evaluation was carried out on Deep Inertial Poser (DIP), a known dataset composed of inertial sensor data. The results obtained suggestRecent trends in ubiquitous computing have led to a proliferation of studies that focus on human activity recognition (HAR) utilizing inertial sensor data that consist of acceleration, orientation and angular velocity. However, the performances of such approaches are limited by the amount of annotated training data, especially in fields where annotating data is highly time-consuming and requires specialized professionals, such as in healthcare. In image classification, this limitation has been mitigated by powerful oversampling techniques such as data augmentation. Using this technique, this work evaluates to what extent transforming inertial sensor data into movement trajectories and into 2D heatmap images can be advantageous for HAR when data are scarce. A convolutional long short-term memory (ConvLSTM) network that incorporates spatiotemporal correlations was used to classify the heatmap images. Evaluation was carried out on Deep Inertial Poser (DIP), a known dataset composed of inertial sensor data. The results obtained suggest that for datasets with large numbers of subjects, using state-of-the-art methods remains the best alternative. However, a performance advantage was achieved for small datasets, which is usually the case in healthcare. Moreover, movement trajectories provide a visual representation of human activities, which can help researchers to better interpret and analyze motion patterns.…
Author details: | Orhan KonakORCiD, Pit Wegner, Bert ArnrichORCiDGND |
---|---|
URN: | urn:nbn:de:kobv:517-opus4-487799 |
DOI: | https://doi.org/10.25932/publishup-48779 |
Title of parent work (German): | Postprints der Universität Potsdam : Reihe der Digital Engineering Fakultät |
Publication series (Volume number): | Zweitveröffentlichungen der Universität Potsdam : Reihe der Digital Engineering Fakultät (4) |
Publication type: | Postprint |
Language: | English |
Date of first publication: | 2021/01/05 |
Publication year: | 2021 |
Publishing institution: | Universität Potsdam |
Release date: | 2021/01/05 |
Tag: | human activity recognition; image processing; machine learning; sensor data |
Issue: | 4 |
Number of pages: | 17 |
Source: | Sensors 20 (2020) 24 Art. 7179 DOI: 10.3390/s20247179 |
Organizational units: | Digital Engineering Fakultät / Hasso-Plattner-Institut für Digital Engineering GmbH |
DDC classification: | 6 Technik, Medizin, angewandte Wissenschaften / 62 Ingenieurwissenschaften / 620 Ingenieurwissenschaften und zugeordnete Tätigkeiten |
Peer review: | Referiert |
Publishing method: | Open Access / Green Open-Access |
License (German): | CC-BY - Namensnennung 4.0 International |
External remark: | Bibliographieeintrag der Originalveröffentlichung/Quelle |