Using hand gestures and voice commands to control a 3D data visualization

2 getToTheChopin 2 5/29/2025, 6:47:57 PM twitter.com ↗

Comments (2)

getToTheChopin · 2d ago
Created using threejs, mediapipe computer vision, web speech API, and Vasco Asturiano's 3D-force-graph library
sargstuff · 1d ago
4d sudoku!

?? side list of selectable group colors

?? verbal "set operators" (intersection, difference, union,symetric difference) based on verbally selected item tag names vs. "hand pick" color group/group items to perform set operation.

"blinking" objects/object connectors involved in set operation. Results forming new "color group" of copy of originals vs. moving originals into group per set result. ??

Associate color/group with "gravity well" spot.