Skip to content

Releases: EmotiBit/Biometric_Validation_Methods

sit-stand_XXX_v1.0.0

15 Apr 21:34
320c7d7

Choose a tag to compare

sit-stand-baseline_v1.0.0

First version of the sit-stand baseline test.

This test records labeled sit-to-stand and stand-to-sit transitions under ideal conditions with minimal noise and a normal transition pace (~1.5 seconds per transition). It establishes a clean baseline for evaluating sit-stand detection algorithms.

Test Changes

  • First version of the test (no changes)

Performance

Test Algorithm 1
sit-stand-baseline_v1.0.0
DELTA_Y_THRESHOLDPrecisionRecallTPFPFN
0.050.8421.0001630
0.100.8421.0001630
0.150.8421.0001630
0.200.8891.0001620
0.300.9411.0001610
0.400.9411.0001610
0.500.9411.0001610
0.600.9411.0001610
0.700.9411.0001610

The default threshold of DELTA_Y_THRESHOLD = 0.20 sits in the flat-recall region (2 files, 16 ground-truth events).

Attached Files

  • baseline_v1.0.0.csv — IMU CSV recording — result of running sit-stand-baseline_v1.0.0
  • baseline_v1.0.0.json — Annotation file (state labels) — result of running sit-stand-baseline_v1.0.0

These files were recorded with the intention of evaluating sit-stand detection. Other activities present in the files (e.g. initialization, stable sit/stand periods) are annotated and may be used to evaluate false positive rates.


sit-stand-slow_v1.0.0

First version of the sit-stand slow test.

This test records labeled sit-to-stand and stand-to-sit transitions performed deliberately slowly (~5 seconds per transition). It is designed to capture edge cases where transitions are not abrupt and the resulting gyroscope signal is weaker.

Test Changes

  • First version of the test (no changes)

Performance

Test Algorithm 1
sit-stand-slow_v1.0.0
DELTA_Y_THRESHOLDPrecisionRecallTPFPFN
0.050.8421.0001630
0.100.8421.0001630
0.150.8421.0001630
0.200.8421.0001630
0.300.8421.0001630
0.400.8891.0001620
0.500.8820.9381521
0.600.8750.8751422
0.700.8670.8121323

The default threshold of DELTA_Y_THRESHOLD = 0.20 achieves perfect recall but begins to trade off above 0.40 as slow transitions produce smaller acc_y changes (2 files, 16 ground-truth events).

Attached Files

  • slow_v1.0.0.csv — IMU CSV recording — result of running sit-stand-slow_v1.0.0
  • slow_v1.0.0.json — Annotation file (state labels) — result of running sit-stand-slow_v1.0.0

These files were recorded with the intention of evaluating sit-stand detection under slow transition conditions. Other activities present in the files (e.g. initialization, stable sit/stand periods) are annotated and may be used to evaluate false positive rates.


sit-stand-noisy_v1.0.0

First version of the sit-stand noisy test.

This test records labeled sit-to-stand and stand-to-sit transitions with intentional movement noise injected during seated and standing periods (e.g. leaning, repositioning, weight shifting, partial stand attempts). It is designed to evaluate algorithm robustness against false positives from realistic in-session movement.

Test Changes

  • First version of the test (no changes)

Performance

Test Algorithm 1
sit-stand-noisy_v1.0.0
DELTA_Y_THRESHOLDPrecisionRecallTPFPFN
0.050.4211.00016220
0.100.4571.00016190
0.150.5001.00016160
0.200.5161.00016150
0.300.5161.00016150
0.400.5711.00016120
0.500.5711.00016120
0.600.6401.0001690
0.700.6961.0001670

Recall is perfect across all tested thresholds; precision is lower than baseline due to noisy movement generating spurious gyroscope peaks that pass the classification gate (2 files, 16 ground-truth events).

Attached Files

  • noisy_v1.0.0.csv — IMU CSV recording — result of running sit-stand-noisy_v1.0.0
  • noisy_v1.0.0.json — Annotation file (state labels) — result of running sit-stand-noisy_v1.0.0

These files were recorded with the intention of evaluating sit-stand detection under noisy conditions. Noise activity occurs within labeled sit and stand intervals and is not separately annotated as distinct states.


sit-stand-walking_v1.0.0

First version of the sit-stand walking test.

This test records labeled sit-to-stand and stand-to-sit transitions interspersed with walking segments. It is designed to introduce realistic false positives from walking activity and evaluate the algorithm's ability to suppress them using walking detection.

Test Changes

  • First version of the test (no changes)

Performance

Test Algorithm 1
sit-stand-walking_v1.0.0
DELTA_Y_THRESHOLDPrecisionRecallTPFPFN
0.050.5910.9291391
0.100.6500.9291371
0.150.7220.9291351
0.200.7220.9291351
0.300.7650.9291341
0.400.8120.9291331
0.500.8120.9291331
0.600.8120.9291331
0.700.8120.9291331

One ground-truth event is consistently missed across all thresholds; the remaining false positives are transitions detected adjacent to walking segments that the soft-exclusion margin does not suppress (2 files, 14 ground-truth events).

Attached Files

  • walking_v1.0.0.csv — IMU CSV recording — result of running sit-stand-walking_v1.0.0
  • walking_v1.0.0.json — Annotation file (state labels) — result of running sit-stand-walking_v1.0.0

These files were recorded with the intention of evaluating sit-stand detection in the presence of walking. Walking segments are labeled as walk in the annotation file and can be used to assess walking suppression independently from overall detection accuracy.


Results Graphs

image

These results were ran on the sit_stand.py module in CFL_Wearable_ADRD_Biometric_Lib.

sit-stand-sit_v0.0.0

03 Apr 18:50

Choose a tag to compare

sit-stand-sit_v0.0.0

The first version of the sit-stand-sit test.

This test includes tap detection, a period of sitting, a period of standing, another period of sitting, and then tap detection.
The purpose of standing and sitting in this test is to increase the variance in the heart rate data throughout the length of the test.

Test Changes

  • First Version of the test (no changes)

Performance

Test Algorithm 1
sit-stand-sit_v0.0.0
ScorePlot
ScoresValue
r0.3225
rho0.7197
tau0.5497

Attached Files

  • cyhr8.txt - Cyton File - result of running sit-stand-sit_v0.0.0
  • ebhr8.csv - Unparsed EmotiBit file - result of running sit-stand-sit_v0.0.0

These files were recorded with the intention of investigating heart rate. As such, other biometric signals found in the files may not be existent or reliable.