jared/slr_handshapes_locations
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Initial commit: handshapes multiclass project

Browse Source 
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
This commit is contained in:
jared
2026-01-19 22:27:20 -05:00
commit 816e34cb17
22 changed files with 2820 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

24
first_attempt_landmark_hands/what_to_do.txt Normal file
View File

@@ -0,0 +1,24 @@
# 1) Create dirs
# ./make_seq_dirs.sh A B J Z
# 2) Capture clips (0.8s each by default)
python capture_sequence.py --label A --split train
python capture_sequence.py --label A --split val
python capture_sequence.py --label B --split train
python capture_sequence.py --label B --split val
python capture_sequence.py --label J --split train
python capture_sequence.py --label J --split val
python capture_sequence.py --label Z --split train
python capture_sequence.py --label Z --split val
# 3) Preprocess to 32 frames (auto-picks classes from sequences/train/*)
python prep_sequence_resampled.py --in sequences --out landmarks_seq32 --frames 32
# 4) Train GRU (multiclass on A/B/J/Z)
python train_seq.py --landmarks landmarks_seq32 --epochs 40 --batch 64 --lr 1e-3 --out asl_seq32_gru_ABJZ.pt
# 5) Live inference
python infer_seq_webcam.py --model asl_seq32_gru_ABJZ.pt --threshold 0.6 --smooth 0.2
# If you later add more letters (e.g., C, D),
# just create those folders, record clips, re-run the prep step, then train again — the pipeline will include whatever letters exist under sequences/train/.