-
Notifications
You must be signed in to change notification settings - Fork 15
Components
Joshua Shinavier edited this page Oct 9, 2023
·
2 revisions
Semantic Synchrony is a collection of interrelated projects in hardware and software for context-aware computing with semantics. It contains:
- Extend-o-Brain: a personal knowledge base with a wiki interface and Semantic Web interoperability. It connects to a TinkerPop-compatible graph database and includes an Emacs major mode called Brain-mode (think Org-mode with a graph of notes instead of a hierarchy). See Extend-o-Brain installation.
- Extend-o-Hand: a Bluetooth-enabled gestural data glove with programming for handshakes, hand-offs (a virtual give-take interaction), and simple gestures including waves and taps. An early version of Extend-o-Hand was used in a keyboard-less typing system.
- Monomanual Typeatron: a 3D-printed wireless chorded keyer with integrated laser pointer, 6-axis motion sensor, and haptic outputs
- Omnisensory Monitron: a stationary Arduino-based device which gathers a variety of sensor data and produces a data stream using controlled vocabularies. See Semantics and Sensors
- SmSn Server: a Gremlin script engine which connects Extend-o-Brain with its Emacs UI, the Brainstem, and any number of context-aware clients with each other through the Stream42 continuous SPARQL query engine and gestural services. More information here.
- SmSn P2P: a simple framework for service discovery and data streaming using JSON and OSC
- SmSn RDF: controlled RDF vocabularies and utilities for modeling gestures and other events
- SmSn Chrome Plugin: a bookmark tool for use with Extend-o-Brain
See also:
- SmSn Android: contains the Brainstem, which controls and receives data from the Bluetooth devices, and a port of much of the Semantic Synchrony stack to Android/Dalvik
- SmSn demos a collection of demos, utilities, and scripts for analysis
- SmSn "extras", which contain lightweight support for RFID tracking and speech recognition, among other things