Dream to Learn is shutting down...

We are very sorry to say that Dream to Learn will be shutting down as of December 28th, 2019. If you have content that you wish to keep, you should make a copy of it before that date.


Autism Wingman

POSTED IN: Building Bridges from R to IBM Watson

Wingman - Powered by IBM Watson

what if kids with autism had a real time, heads up display that showed them visual cues for the 'low amplitude' social signals and cues?

POC below explores this.  Uses IBM Watson Speech to Text;  and Tone Analysis service.  Plus R Studio, Python Serial scripts, Arduino and some leds

Use Cases include below - Imagine an 8 Year old wearing glasses with mics:

  1. High Amplitude Emotion (e.g. other speaker voicing anger or disgust)
  2. Rapid change of Tone (casual to formal - a change in overall tone that's atypical)
  3. Repeated Social Hints (e.g. third time in conversation that other speaker hints that it's late and should be moving along, and other 'closing' cue language)
  4. Therapy Triggers - moments of awareness or reminding - green light to remind wearer about a condition they are working on.  e.g. inappropriate topics or langauge








Interested in more content by this author?

About the Author

Ryan Anderson

Ryan Anderson

Hi! I like to play with data, analytics and hack around with robots and gadgets in my garage. Lately I've been learning about machine learning.

About this blog

This is an informal blog that explores tools, code and tricks that group members have developed to engage IBM Watson cognitive computing services - from the R Programming Language. Packages include RCURL to access Watson APIs - for services that include Natural Language Classifier and Speech to Text. THIS IS MY PERSONAL BLOG - it does not represent the views of my employer. Code is presented as 'use at your own risk' (it has lots of bugs)

Created: September 13, 2015


Up Next