Cognitive Communication Interfaces

Develop tools to adapt pretrained language models as communication aids for patients with conditions like ALS, aphasia, or dysarthria. Using eye-tracking and egocentric video, our systems infer users' intentions to support effective interaction. Central to this work is "cognitive steering" - guiding AI personas equipped with personalized context to communicate on behalf of the user. We focus on representation engineering to shape and interpret AI behaviors, aligning neural activations with human thought processes to bridge human cognition and machine intelligence.

Team: John Krakauer, Daniel McNamee, Eric Lacosse
Interested in collaborating? Get in touch.