Composing Cognitive Agents - Patterns
Since I posted on Cognitive Wingman in December, I’ve been doing some thinking about how to compose effective cognitive agents, and where to start from a pattern and architecture perspective. This is for systems going beyond rifle shot use cases – and mimicking emotional intelligence.
The simple image below distills much of it down. The key ingredients necessary for it all to come together and have a useful, engaging, and believable avatar (or if you prefer, cognitive enabled agent)
- KNOWLEDGE /CORPUS (Brains) – Knowledge. This is actually the easy part. Creating a system that can tap public internet knowledge, aggregate, curate and disseminate data, information, knowledge and wisdom (DIKW). The Avatar needs to know stuff – so this knowledge needs to be available.
- VR / VISUAL / AUDIO (Eyes and Ears) – Sensory. In this case I’m assuming a headset worn to deliver AR or VR photons into eyeballs – but could be a flat screen or an immersive room. But the avatar needs to be seen and heard (and to also see and hear); A beautifully rendered AV Piece is essential, but also requires the other ingredients.
- DIALOG & CONTEXT (Story & Script) – Experience. whether it’s a 10 second interaction to discuss a shopping list, or a multi-decade relationship – there is a story arc to the relationship. Dialog. Scripts, Flow, are needed. Done well, they will produce what seems to be emotional intelligence – and moments of “Aha” (serotonin shots)
- AVATAR (Heart and Soul) – Authenticity. Relationship. Empathy. When the other ingredients are composed - this where the magic happens – when the eggs, flour and sugar become a wedding cake. It’s where the user feels there is an “other” being interacted with. An “I believe” moment sufficient to overcome periodic trespasses and errors of logic. System that can remember, hold state, know context and react with a reasonable level of emotional intelligence.
The design pattern (macro) is still developing – and will probably be part of a much more complex architecture for Embodied Cognition
About this blog
Cognitive Wingman - Never Walk Alone
Created: December 20, 2016English