R4ML

What is R4ML? R4ML is a scalable, hybrid approach to ML/Stats using R, Apache SystemML, and Apache Spark   https://github.com/SparkTC/r4ml   R4ML Key Features R4ML is a git downloadable open source R package from IBM Created on top of SparkR and Apache SystemML(so it supports features from both) Acts as a R bridge between SparkR and Apache SystemML Provides a collection of canned algorithms Provides the ability to create custom ML algorithms Provides both SparkR and Apache SystemML functionality APIs are friendlier to the R user  

by Ryan Anderson

Natural Language Understanding - Basic Hooks

Natural Language Understanding The IBM Watson Developer Cloud team is planning to sunset the AlchemyLanguage Service, and replace it with Natural Language Understanding: Natural language processing for advanced text analysis. Analyze text to extract meta-data from content such as concepts, entities, keywords, categories, sentiment, emotion, relations, semantic roles, using natural language understanding. With custom annotation models developed using Watson Knowledge Studio, identify industry/domain specific entities and relations in unstructured text. https://www.ibm...

by Ryan Anderson

9 Cognitive Patterns Delivering Shareholder Value

  Updated Version- April 2017     Sensemaking Cognitive sensemaking systems can see, hear, and begin to engage in “Sensemaking” – moving systems towards understanding.  Can augment Business Intelligence ERP, call centers, operations groups, robotics, automotive and IOT, etc.. Understand, Reason, Learn and Interact   Predictive& ML Dozens of great tools exist today to equip organizations with machine learning and predictive models. ML models help understand if data contains signal, and what data features are meaningful to outcomes. Data science has been democratized and ML can be leveraged...

by Ryan Anderson

Call Center Sensemaking Systems 2

In Pursuit of Kick Ass Customer Service Just read a terrific article from Harvard Business Review(HBR) here- on"Kick Ass Customer service"  https://hbr.org/2017/01/kick-ass-customer-service In the article's conclusion:"When we share our research with managers, they sometimes cringe at the thought of a service organization full of Controllers, let alone Controllers interacting with their most frustrated and troubled customers. Managers frequently tell us that Controllers “wouldn’t be a good cultural fit” and would lack the requisite empathy to succeed. But our interviews reveal...

by Ryan Anderson

Call Center Sensemaking Systems 1

Whiteboard Scribbles: Building Sensemaking Systems to Benefit Customers, Employees and Shareholders...   Thank you for calling! Please press#1 for English- or Press#2 if you’d prefer to stab a pencil into the back of your hand, rather than enter telephone tree hell. When humans dial a Company’s customer support numbers – they are usually hoping for one of two things: 1)   HELP ME…(do something, change something) 2)   TELL ME…(information I want or need to know- so I can get back to important stuff)   Phone calls and SMS interactions with airlines, banks, technical support, utility companies,...

by Ryan Anderson

"How can I USE IBM Watson?"

How Can I Use IBM Watson?   https://developer.ibm.com/answers/questions/326439/how-can-i-use-ibm-watson.html A developer posted this question to our DEVELOPER WORKS- which, by the way, is a great place to ask questions about Watson Developer Cloud Services. It was a bit of a tricky question- given limited knowledge of, and background on, the developer/ use case- but I took a crack here.   Perhaps useful for others, so I reposted below. Response: Greetings Bob! Well – that’s a hefty question – but I’ll take a crack at it from one perspective I work for IBM Watson – and my focus is on building...

by Ryan Anderson

Big List of IBM Watson Links

Hi!  I did a FaceBook live broadcast in November 2016, and here are some links mentioned during the chat, for folks looking to learn more and perhaps do a Watson-powered project... Bigger list is here: https://dreamtolearn.com/ryan/r_journey_to_watson/13 and choice cuts below:   WATSON DEVELOPER CLOUD(WDC) SERVICES/ APIs/ TOOLS WDC Services:                http://www.ibm.com/watson/developercloud/services-catalog.html ASKs- Application Starter Kits: https://www.ibm.com/watson/developercloud/starter-kits.html SDK’s Software Dev Kits:          https://github.com/watson-developer-cloud SDK’s...

by Ryan Anderson

Exploring CONTENT CLARIFIER from IBM AbilityLab™

Exploring CONTENT CLARIFIER for AUTISM Use Cases IBM AbilityLab™ Content Clarifier is designed to help simplify, summarize, and enhance content in order to increase comprehension for people with cognitive disabilities, the aging population, or those learning English as a second language.   I am exploring a number of IBM Watson services and IBM Technologies as components to help with Autism Use Cases/ Demo's I'm building and open sourcing.  I am exploring how this tool may be used along side Tone and Emotion services to help kids with Autism navigate the world.   DEMO PAGE: http...

by Ryan Anderson

Project Birdsong - Enriching Tweets

#Project Birdsong- Let's Enrich some Tweets with IBM Watson- Alchemy Language and Tone/ Emotion Services   CODE- https://github.com/rustyoldrake/Project_Birdsong  #ZCash was used- 200 Tweets SAmple Tweets"RT ZcashNews Zcash is todays highest performing altcoin "                                                                                                                                                                                                          "Another zcash node "...

by Ryan Anderson

Music Maker - Voice Controlled Music Machine - Part 1

Music Maker- Voice Controlled Music Machine gets interesting at 4:50 if you want to jump ahead:) UPDATE- this method looks way better than mine: http://stackoverflow.com/questions/31782580/how-can-i-play-birthday-music-using-r so will try to do a Part 2 that is tighter and more elegant.     Blog:       https://dreamtolearn.com/ryan/r_journey_to_watson/50 Code:     https://github.com/rustyoldrake/Watson_Music_Maker Youtube:  https://www.youtube.com/watch?v=QZ-qRyeTivc      

by Ryan Anderson

Build your own HARRY POTTER Sorting Hat (basic version)

Build your own#STEM Harry Potter Sorting Hat! Happy Halloween 2016!    A few folks have asked about building a Harry Potter sorting hat similar to the one we built last year-> so I created a 4-day(bite size pieces)- project to create a simpler version of the hackathon model we built.  The intent is to have something#STEM accessible- that mom or dad could do with kids.  Modular, so you can do any/all of the pieces. PROJECT STATUS: CT 2nd- Midway through Part 3/ Day 3- hope to complete full blog by Friday Oct 7th. (But Day 1 and Day 2 are ready to roll!)         Project...

by Ryan Anderson

AR Command & Control Part 2

Command& Control for VR AR- Part 2- Knowledge Graphs   GOAL: TO BEGIN TO BUILD A FOUNDATION TO LOCATE"IDEAS" on the SCREEN IN FRONT OF AR VIEWER   1501 simple Nouns Processed with Alchemy(including Keywords, KnowledgeGraph,Taxonomy)- http://www.talkenglish.com/vocabulary/top-1500-nouns.aspx   985/1501 mapped to KnowledgeGraph 774/1501 mapped to Taxonomy     Examples(Five C's) cows/business and industrial/agriculture and forestry/livestock  cows /animals/cows  crack/society/crime/property crime/piracy  crack /problems/defects/crack  craft/art and entertainment/visual art and...

by Ryan Anderson

IBM Watson Command & Control for VR AR - Part 2

IBM Watson Command& Control for VR AR- Part 2   Developing.    the Cognitive Wingman

by Ryan Anderson

IBM Watson Command & Control for VR AR - Part 1

IBM Watson Command& Control for VR AR   Check out some simple verbal command and control with R here https://www.youtube.com/watch?v=36Hhb1RdbKU&t=104s   And the big boy version here https://www.youtube.com/watch?v=C56OZyQ_oFo  

by Ryan Anderson

Trick or Treat! Thomas the Empathetic Robot

Thomas the Empathetic Robot This is Thomas! He is a prototype"Robot" I am building with my kids for Halloween Basic backbone technology is using IBM Watson speech to text(STT), emotion and tone analysis to display on a visor what the speaker's emotional message and TONE is. Later, we plan to detect more sophisticated signals with Natural Language Classifiers- and perhaps give him a'robot' voice, engage in conversations, and run the Text to Speech through some robot voice distortion circuitry. Also thinking about how to give it mobility(voice controlled locomotion) and...

by Ryan Anderson

WatsonR : IBM Watson + R Package - Part 1

WatsonR: IBM Watson+ R Package- Part 1 WatsonR is a package for R that helps Users access the power of IBM Watson Developer Cloud CAUTION: As of 9/9 THE CODE BASE IS WORKING AS SEEN IN VIDEO BELOW- VERY EARLY STAGE SOME ISSUES INSTALLING PACKAGE IN WINDOWS- SO YOU MAY NEED TO FIDDLE A BIT WITH CODE HOPE TO GET SOME TESTERS/ HELPERS TO TUNE THE INSTALL BY Q4- AND BUILD OUT VISUALS Twelve months ago I started writing code in R to connect to IBM Watson Developer Cloud(WDC) Services. https://github.com/rustyoldrake/R_Scripts_for_Watson The code is about 30 R programs and R scripts that call...

by Ryan Anderson

Your Hero Moment! - Hitting your first API with R

Introduction to “R” and APIs for Non-Developers- Hero Moments with R and IBM Watson Services: Document Purpose   Most people don't code. Most people don't know how to “hit” an API.  But as the technology evolves – having a basic understanding of APIs and microservices is quickly becoming a technology table stake – much like Microsoft Excel was in the late 1980s; and Web in mid 1990’s. The purpose of this document is: 1.    to help you execute your first bit of code and access an API to do something 2.    to demystify APIs a little 3.    to give you three small “Hero Moments”   4.    to...

by Ryan Anderson

Speech to Text - (STT) - Leaning on Python for Audio

Python as a Tool to help with Continuous Audio I've not figured out how to do audio better in R(than chunking it in samples, and WAV and then sending WAV file up)- which leads to some dead time while we wait for API to get back to us.(Single threaded) I figure it's time to develop another tool.  R can call Python from inside code- so wanted to see about Audio.  For now- the hello world moment is getting"This project consists of a python client that interacts with the IBM Watson Speech To Text service through its WebSockets interface. The client streams audio to the STT service and...

by Ryan Anderson

Cognitive Bartender

Thirsty? IBM has a pretty cool app for suggesting cocktail drinks called IBM Chef Watson TWIST- https://twist.ibmchefwatson.com/- it's pretty neat- and introduced me to the concept of having hot flavors in my cocktails.  Now, nearly every drink I order has spice in it:) It's a great app for suggesting drinks.... But what if you want IBM Watson to actually mix your drink? I was curious if I could build some downstream gear to pull the ingredients together... blend them and make a drink     Parts List: DOSING PUMPS(X5)- i used these from amazon- Sican DC 12V Dosing Food Pump Peristaltic...

by Ryan Anderson

Cognitive Robot Arm (or - the most fun you can have for $1)

Can we Take a$1 Robot Arm and make it voice controlled? At a recent fundraiser at my kids' school, there was a flea-market- old toys and books.  In the pile of plastic was a little robot arm waiving at me.   For$1 I figured I'd take a punt. Tonight, I was curious if I could get it working as'voice control' in one session. (roughly 7pm to Midnight was final tally)   Getting Started   Voltage and Motors- How we handle Polarity   Motor Direction and Basic Wiring   Relays- What they do and how to wire them   Relay Testing and Cycling through a basic Sequence     First Test with...

by Ryan Anderson

CONVERSATION Service - Let's Explore!

SEPTEMBER 2016 UPDATE:  I wrote some R Hooks to talk with Conversation service- here: https://github.com/rustyoldrake/R_Scripts_for_Watson/blob/master/Watson-CONVERSATION-Code-Backbone.R    _______________________________________     IBM Watson Launched CONVERSATION Service July 2016-- here is what I found on my 1st tour....   Step 1- Go To Bluemix  https://console.ng.bluemix.net/ and select USE SERVICES OR APIs  (signing up to free account takes 2m) here is bluemix dashboard.  click bottom right box to launch a service     Step 2- Select CONVERSATION SERVICE tile new tile!  Conversation. ...

by Ryan Anderson

Mapping Brand Drift

Brand Perception in Social Media- Mapping Archetypes- Viz Foundation thinking about what it would look like for a retail brand or luxury brand to visualize the brand over time assume access to 10k+ social media sources that are expressing views on the brands on semi-regular basis assume we're clustering these folks together to nearest neighbor-demographics/relationship with brand measuring over many weeks months or years using IBM Watson(Alchemy Language, Custom NLC trained for traits that matter)- to pop signals out of group's collective voice     Basic Viz Foundation so the graph...

by Ryan Anderson

Autism Wingman

Wingman- Powered by IBM Watson what if kids with autism had a real time, heads up display that showed them visual cues for the'low amplitude' social signals and cues? POC below explores this.  Uses IBM Watson Speech to Text;  and Tone Analysis service.  Plus R Studio, Python Serial scripts, Arduino and some leds Use Cases include below- Imagine an 8 Year old wearing glasses with mics: High Amplitude Emotion(e.g. other speaker voicing anger or disgust) Rapid change of Tone(casual to formal- a change in overall tone that's atypical) Repeated Social Hints(e.g. third time in...

by Ryan Anderson

Cognitive Toy Test

Boaty McBoatFace! Playing in the"Lab" with Cognitive Toys I've been playing with toys in my spare time- and thinking about how Cognitive Computing services might make a toy interesting for kids.  In particular, I'm looking at(1) How toys can LISTEN and engage in SENSEMAKING of what kids are saying and(2) How the toys can REACT- for example, move limbs, eyes, or say something back.   What Makes a"good" Cognitive toy? I'm not sure yet.   My daughter has a Teddy Bear.  His name is Ted.   He doesn't say much- but they are pals. I'm wondering how much the toys...

by Ryan Anderson

Ryan's Watson Links

Building With Watson Developer Cloud- Selected Blogs/ Videos:     Home Page for R Journey To Watson Blogs https://dreamtolearn.com/ryan/r_journey_to_watson R Scripts to Interface to Watson Developer Cloud Services https://github.com/rustyoldrake/R_Scripts_for_Watson MacKenzie- R-Studio Voice Interface talks to Amazon Echo https://www.youtube.com/watch?v=awsFnsIPiD4 NLC Opt Out Ground Truth for Twilio and other SMS https://dreamtolearn.com/ryan/r_journey_to_watson/29 Tone Analysis with Twilio https://dreamtolearn.com/ryan/r_journey_to_watson/31 Expressive Speech Demo https://dreamtolearn...

by Ryan Anderson

Allison Feels It! Expressive Speech

Allison is REALLY Sorry!(Apologetic, Good News and Uncertainty) Code snippet showing how IBM Watson Text to Speech(Allison, voice#2) can be more expressive in certain situations https://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/doc/text-to-speech/using.shtml#expressive<express-as type=\"Apology\"> I am so sorry! Your car computer tells me the transmission is broken.</express-as>   https://github.com/rustyoldrake/R_Scripts_for_Watson/blob/master/Watson-TEXT-TO-SPEECH-Expressive.R https://www.youtube.com/watch?v=jmIfKaQ_sGc

by Ryan Anderson

Segmentation and Self Organizing Maps - Organizing and Interpreting IBM Watson Data (Part 1)

Segmentation and Value Creation Despite the grey hairs starting to appear in my bay-area-beard, I still love to play!   Often I use IBM Watson services as my"Cognitive Lego"- because the modules help me take a sliver of an idea, expand and augment data sources, and then explore how it might be useful.   Sometimes i can do this in a couple of hours.   With the tools, and a bit of enthusiasm, I can create an"artifact"- that I can show to my colleagues and our partners- and start an interesting conversation.   Sometimes the artifacts are mere curiosities, and often they are...

by Ryan Anderson

Twilio Extensions to STEM Labs - How to SMS and MMS to your phone and interact

STEM- Add Twilio?  Kids- shall we make the phone go"ping"?   My kids LOVE the movie Inside Out.  We thought we'd have a little dad and daughters coding time- seeing if the Tone Analyzer could produce the signals big enough to signal the main emotions(who are, conveniently) the characters from inside out. Do do this we needed Installed version of R, R Studio and Packages below IBM Bluemix Account(free!) with the"Tone" service endpoint(Also free to test) R COde(below) equipped with updated credentails       IMAGES: the images below belong to Pixar Animation Studios and Walt...

by Ryan Anderson

Tone Analysis - With a bit of Color! Building a Basic STEM Lab for Kids

Spring Break- Building a STEM Lab for My Kids... I'm putting together a lab for my kids.  Was thinking about what the intersection of IBM Watson services(my day job is an IBM-er) and things my kids like and are interested in...   Inside... Inside Out We recently watched the movie"Inside Out"- a wonderfully crafted Pixar/Disney production- https://en.wikipedia.org/wiki/Inside_Out_%282015_film%29 if you've not seen it(and you really should) the synopsis is:"Riley s a happy, hockey-loving 11-year-old Midwestern girl, but her world turns upside-down when she and her parents...

by Ryan Anderson

Tone Analyzer - Part 1 - Basic Code Snippet

Tone Analyzer is in BETA- here is some rough R Code to Access API. More to come- will write some scripts to process batch jobs(e.g. 1000 CSVs or SMS's)  ######################################################### Experimental Code.  Experimental R Interface for IBM Watson Services-### Focus: IBM Watson Tone Analyzer is a service that helps people comprehend, consume, and revise the language tone of their writing for more efficient communications### https://tone-analyzer-demo.mybluemix.net/### http://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/doc/tone-analyzer/### http://www.ibm...

by Ryan Anderson

SMS Unsubscribe Use Case - Proof of Concept - NL Classifier

SMS Unsubscribe Use Case- Proof of Concept playing around with a 10k Ground Truth made available by National University of Singapore  http://wing.comp.nus.edu.sg:8080/SMSCorpus/ plus 20 synthetic home grown(see pic) https://github.com/rustyoldrake/R_Scripts_for_Watson/blob/master/Watson-NLC-SMS-Test-Condition.R and NLC https://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/doc/nl-classifier/   SMS Examples(50k+ SMS examples from National University if Singapore) http://wing.comp.nus.edu.sg:8080/SMSCorpus/history.jsp         good results for a cheap and cheerful test!

by Ryan Anderson

AlchemyAPI Language - Response Time - Crude Test to measure min/max/median response time

What is the typical response time from AlchemyAPI Language at my location?  Let's find out!######################################################### IBM Watson- Alchemy API- Calls Remaining check and latency check###################################################### library(RCurl)# install.packages("RCurl")# if the package is not already installed library(httr) library(XML) library(stringr)### Simple test- no trasaction- simply asking how m test_count<- 20# number of tests to run time<- matrix(0, ncol= 1, nrow= test_count) for(i in 1:test_count){ ptm<- proc.time()...

by Ryan Anderson

MacKenzie: An IBM Watson speech interface to R and R Studio

MacKenzie is an interface to"R" programming language and R-studio This is a VERY early prototype of MacKenzie which is a speech interface powered by three IBM Watson Services- speech to text service; natural language classifier(NLC) and text to speech  Code Here- https://github.com/rustyoldrake/R_Scripts_for_Watson/blob/master/Watson-MacKenzie-R-Studio-Interface.R   http://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/services-catalog.html Tools like this can be be used to explore IBM Watson services(or other APIs) - helping R-Studio service as a RAPID PROTOTYPING  platform...

by Ryan Anderson

Harry Potter! Building a Fully Functional Sorting hat

Harry Potter! Building a Fully Functional Sorting hat   Blog here: https://dreamtolearn.com/node/8OVIWY2C5RLZZSYD9OHCKM8AI/98

by Ryan Anderson

ICD-10 Healthcare Codes and WIld Pigs - An Experiment with IBM Watson Natural Language Classifier - Part 2

ICD-10- A few more examples(Part 2) Use Case to Assist health care providers in better assignment of ICD-10 Codes. Example:  Doctor or Nurse in ER receives patients and trying to assign the best IDC Codes for accuracy, record-keeping and insurance.  65k data points.  Problem:  Loss of fidelity given human limitations.  Benefit:  TOP-10 codes provided so medical practitioner can find"best fit"   alcohol poisoning:   F10    0.9486957042565055(good fit) Alcohol abuse, uncomplicated F1010 Alcohol abuse with intoxication, uncomplicated F10120 Alcohol abuse with intoxication delirium F10121...

by Ryan Anderson

Wine and Dine with IBM Watson

What Kind of Wine with your Dinner? This is a VERY early prototype written in the R programming language that demonstrates IBM Watson speech to text natural language class a fire and text to speech services The users prompted for what kind of meal they are about to eat and determines some choices for wine that may be of interest The current prototype has a fairly small ground truth about 200 descriptors for a dozen wine types but this ground truth could be expanded to cook provide a much more sophisticated analysis and parings of tastes smells events and food types Furthermore the system could...

by Ryan Anderson

IBM Watson - Coffee Flavor Selector Prototype. STT NLC TTS

Tell IBM Watson what you like in a Coffee- and then get a recommendation back This is a very early version of an IBM Watson natural language classifier(NLC) integrated with speech to text and text to speech. It is written in the R programming language. CAUTION: The ground truth for the natural language classifier was a small subset of original Nespresso flavors of coffee flavors.   The user is prompted to describe the coffee flavors they most desire- then the system then responds with a recommendation of the Nespresso flavor most likely to fit their desires then the system asked him if they...

by Ryan Anderson

IBM Watson - TEXT TO SPEECH - Code Snippet

IBM Watson- TEXT TO SPEECH- Code Snippet   https://github.com/rustyoldrake/R_Scripts_for_Watson/blob/master/Watson-TEXT-TO-SPEECH-Code-Snippet.R  ######################################################### IBM Watson- TEXT TO SPEECH- Code Snippet### Experimental Code. R Interface for IBM Watson Services### http://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/text-to-speech.html### Before you begin you will need(1) An IBM Bluemix demo account(2) TTS Services stood up(3) Credentials to each Service######################################################   library(RCurl)# install...

by Ryan Anderson

Sensemaking In Retail - Experimenting with IBM Watson Services - Part 1

In Focus: Retail I'm working on some ideas that combine a number of IBM Watson services- in a manner that is well suited for Retail Experimentation. Rapid Prototyping. Below, I've imagined a scenario where a customer walks up to a Robot- like this one http://www-03.ibm.com/press/us/en/pressrelease/46045.wss       Input, Process, Output Input: Speech Processing: Speech to Text;  Natural Language Classifier(three models here- clothing type, gender and color), and then Text to Speech- so robot can confirm intent before taking action to help. (e.g.'follow me') Output: Robot Speech...

by Ryan Anderson

IBM Watson - TEXT TO SPEECH - Early Experiment

http://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/text-to-speech.html  ####################################  TEXT TO SPEECH EXPERIMENT(messy, but got it working- WAV format is a bit tempermental, VLC will play- other players no- RIFF����WAVEfmt library(RCurl)# install.packages("RCurl")# if the package is not already installed library(httr) library(audio) library(seewave)# need to play wav back? library(Rtts) play(sin(1:10000/32))# test audio# http://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/text-to-speech.html# Designed for...

by Ryan Anderson

IBM Watson - SPEECH TO TEXT - Code Snippet - Revisited

######################################################### IBM Watson- SPEECH TO TEXT- Code Snippet- Revisited### Experimental Code. R Interface for IBM Watson Services### Focus: SPEECH TO TEXT- R Programming Language Interface### DOCS: https://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/doc/speech-to-text/### Before you begin you will need(1) An IBM Bluemix demo account(2) A Speech to Text App and(3) Credentials to that Service###################################################### library(RCurl)# install.packages("RCurl")# if the package is not already installed...

by Ryan Anderson

IBM Watson - Tone Analyzer - Code Snippet

######################################################### Experimental Code.  Experimental R Interface for IBM Watson Services-### Focus: IBM Watson Tone Analyzer is a service that helps people comprehend, consume, and revise the language tone of their writing for more efficient communications### https://tone-analyzer-demo.mybluemix.net/### http://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/doc/tone-analyzer/### http://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/apis/tone-analyzer-apis.html###################################################### library(RCurl)# install...

by Ryan Anderson

ICD-10 Healthcare Codes and WIld Pigs - An Experiment with IBM Watson Natural Language Classifier

OINK!   Bitten by a wild pig in the left leg! How would you classify this injury using ICD-10 codes?  Below is a proof of concept to explore using the IBM Watson NL Classifier and codes as Ground Truth- to help nurse/doctor narrow down to most likely codes.  Additionally could score on most likely to be reimbursed by insurance company....     class           confidence  1:   W55  0.33606352760420066  2:   M79  0.21942966846914216   Background   ICD-10 is the International Statistical Classification of Diseases and Related Health Problems 10th Revision.  It's a REALLY long list of codes...

by Ryan Anderson

Voice of Customer:  Analyzing Product Reviews with IBM Watson(Part 1)   BACKGROUND Late in 2015, at Datapalooza in San Francisco, I presented a short session at titled: NLP Enriched Product Reviews.   It was a two-part presentation.  The first part focused on NLP enrichment of product reviews.  The second part was a preview of some work I’ve been doing on advanced user segmentation, which relies on signals extracted from IBM Watson services. Link to deck here:  https://ibm.box.com/s/z9dg2ocg0jhg6a811llwsqcaatbfzh8a   WHY DO WE CARE? We listen to “voice of customer” and customer reviews –...

by Ryan Anderson

IBM Watson and Four New IOT Services - NLP, ML, VIdeo/Image and Text Analytics

IBM Watson and Four New IOT Services- New APis include: Natural Language Processing- Allows users to interact with systems and devices using simple human language. Machine Learning- Automates data processing by continuously learning from every interaction with data Video and Audio Analytics- Finds correlations and anomalies in unstructured data. Text Analytics - Draws insights from Twitter feeds, blogs, call center transcripts   New Watson IoT Services Accelerate Cognitive IoT IBM is bringing the power of cognitive analytics to the IoT by making four families of Watson API services available...

by Ryan Anderson

Personality Insights and Segmentation / Visualization Tools (non-R) - PART 1

Personality Insights and Segmentation/ Visualization Tools This posting is not about"R" code, but I put it in this Blog space, because all the other"PI" stuff is here Analytics Just signed up for a free account here https://watson.analytics.ibmcloud.com/  This tool is for structured data, and is a different IBM platform from the Bluemix platform INPUT> Personality Insight data OUTPUT> Visualizations that help people explore and perform"Sense-making" of the PI data It took me about 5 minutes to sign up and upload a CSV file- and 10 to play around a little WARNING-...

by Ryan Anderson

Ground Truth Analysis Tool for Retrieve and Rank

IBM Watson: Retrieve& Rank Ground Truth Analysis Tool   •RANKER: To return the most relevant documents at the top of your results, the Retrieve and Rank services uses a machine learning component called a ranker. You send queries to the trained ranker. •GROUND TRUTH- The ranker learns from examples before it can re-rank results from queries that it hasn't seen before. Collectively, the examples are referred to as"ground truth.” •Background – http://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/retrieve-rank.html – http://www.ibm...

by Ryan Anderson

Segmentation PART 1 - Reagan Classification Machine - An exploration of IBM Watson, Personality Insights, & Segmentation Methods -

Election Time is upon us!  Once again, we will be hearing many presidential candidates reference Ronald Reagan fondly.  But who would the Gipper approve of?  Who is most like Ronald Reagan?  Wouldn't it be wonderful if we could build a Reagan Classification Machine to help the candidates answer this question?   Well, we can!  ;)   Below is a summary of Part 1 of a proof of concept for an IBM Watson Powered analysis that uses Cognitive Computing& Machine Learning to explore how a quarter million words of Speech content from ~60 major leaders of the 20th century- can yield 52 very...

by Ryan Anderson

IBM Watson - RETRIEVE (but not yet RANK) - code snippet

very experimental- handle with care- posting to save other folks time with Syntax on this new service in General Availability ###################################################### ### Adapting the RETRIEVE& RANK SERVICES APIs to R- RCURL and HTTR### This service helps users find the most relevant information for their query by using a combination of search and machine learning algorithms ### to detect"signals" in the data. Built on top of Apache Solr, developers load their data into the### service, train a machine learning model based on known relevant results, ### ### http://www...

by Ryan Anderson

IBM Watson - LANGUAGE DETECTION and translation - code example

 ######################################################### Adapting the LANGUAGE TRANSLATION& IDENTIFICATION APIs to R- RCURL and HTTR### http://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/apis/#!/language-translation/listIdentifiableLanguages### https://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/doc/language-translation/### Before you begin you will need(1) An IBM Bluemix demo account(2) and Credentials to that Service and confirm you're able to CURL service with###################################################### library(RCurl) library(httr) library(XML)...

by Ryan Anderson

IBM Watson - SPEECH TO TEXT - Code Snippet

######################################################### Experimental Code. R Interface for IBM Watson Services### Focus: SPEECH TO TEXT- R Programming Language Interface### DOCS: https://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/doc/speech-to-text/### Before you begin you will need(1) An IBM Bluemix demo account(2) A dialog App and(3) Credentials to that Service and confirm you're able to CURL service with###(4) some sample WAV files or method to utter audio to watson STT service###################################################### library(RCurl)# install.packages("...

by Ryan Anderson

IBM Watson - Personality Insights Service - Automating PI Analysis of 100 Speeches

  Personality Insights"The IBM Watson Personality Insights service uses linguistic analytics to extract a spectrum of cognitive and social characteristics from the text data that a person generates through blogs, tweets, forum posts, and more."  https://watson-pi-demo.mybluemix.net/  ######################################################### Experimental Code. R Interface for IBM Watson Services### Focus: PERSONALITY INSIGHTS- USER PERSONAE SEGMENTATION- R Programming Language Interface### Adapting the PERSONALITY INSIGHTS APIs https://www.ibm...

by Ryan Anderson

IBM Watson - Personality Insights Service - Code Snippet for POST in HTTR

As noted on the site http://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/personality-insights.html"Personality Insights Enables deeper understanding of people's personality characteristics, needs, and values to help engage users on their own terms The IBM Watson Personality Insights service uses linguistic analytics to infer cognitive and social characteristics, including Big Five, Values, and Needs, from communications that the user makes available, such as email, text messages, tweets, forum posts, and more. By deriving cognitive and social preferences, the service helps...

by Ryan Anderson

IBM Watson - Dialog Service - Sample Interface Functions in R

######################################################### Experimental Code. R Interface for IBM Watson Services-### Focus: DIALOG- R Programming Language Interface### Adapting the DIALOG APIs https://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/apis/ to RCURL and HTTR### http://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/doc/dialog/######################################################    ### Before you begin you will need(1) An IBM Bluemix demo account(2) A dialog App and(3) Credentials to that Service and confirm you're able to CURL service with### DOCS: https...

by Ryan Anderson

IBM Watson - Dialog Service - Code Snippet for POST in HTTR

######################################################### Experimental Code.  Experimental R Interface for IBM Watson Services- R Programming Language### Focus: DIALOG- R Programming Language Interface### Adapting the DIALOG APIs https://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/apis/ to RCURL and HTTR### http://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/doc/dialog/######################################################  ### Before you begin you will need(1) An IBM Bluemix demo account(2) A dialog App and(3) Credentials to that Service and confirm you're able to...

by Ryan Anderson

Build your own "Sorting Hat" with a Natural Language Classifier (NLC) - First Version

The Sorting Hat Remember the chapter in Harry Potter where the Sorting Hat peeks inside the thoughts of the first year children at Hogwarts and sorts them into the four houses Gryffindor, Hufflepuff, Ravenclaw, and Slytherin? This type if use case is a perfect fit for a Natural Language Classifier- which takes language(or thoughts and ideas) and classifies them with confidence.  http://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/nl-classifier.html I worked with my kid to build a ground truth(to train the NLC) and then we coded some interfaces with R to train and test the NLC.  It...

by Ryan Anderson

Building Bridges from R to IBM Watson - Welcome!

Building Bridges from R to IBM Watson Greetings!  I've been doing some'garage hacks' with my kids using the R Programming language to explore the IBM Watson Services. http://www.ibm.com/smarterplanet/us/en/ibmwatson/what-is-watson.html     Where did this start and why am I doing this? My daughter just wrote a ground truth for a Harry Potter style' sorting hat'- and we've trained it up on the Watson Natural Language Classifier(NLC)- it works quite well!  I just started working at IBM and thought this would be a great way to get hands-on quickly with the services, and...

by Ryan Anderson