Voice and Speech Emotion Recogntion

The Emotion API takes a voice, speech or conversation in an audio or video as an input, and return the confidence across a set of emotions for the audio.

The emotions are given in two ways: discrete and dimensional. The discrete emotions detected are happiness, neutral, sadness, anger, fear, disgust, contempt, and surprise. These emotions are understood to be cross-culturally. The dimensional emotion are detected by arousal and valance. This metric are widely accepted and in emotion research community.

User Scenario: Chatbot, Smart living, Robot, Advertising, Entertainment, Customer Service.

Physiological Sensing of Emotion

The physiological-based Emotion API takes physiological data as input. A number of different physiological data such as Electrocardiography (ECG), Electromyography(EMG), Electroencephalography(EEG), and Galvanic skin resistance(GSR) are supported. The dynamic results of emotion or cognitive states are predicted in time-series.

Through utilizing multiple source of EEG, ECG, GSR, or EMG, emotions such as depression, anxiety, stress, angry, etc. are detected and monitored in real-time.

The emotions are also given in two ways: discrete and dimensional. The discrete emotions are used for qualitative analysis, and the dimensional emotion are used for quantitative analysis such as emotion intensity.

User Scenario: Medical and Health, Transporation and safety, Smart wearable device, Police and law interrogation.

Face Emotion Recogntion

The Emotion API takes an image or video as an input, and return the confidence across a set of emotions corresponding to faces.

The emotions are given in two ways: discrete and dimensional. The discrete emotions detected are happiness, neutral, sadness, anger, fear, disgust, contempt, surprise and so on. Totally 22 emotions can be recognized. These emotions are understood to be cross-culturally. The dimensional emotion are detected by arousal and valance.

User Scenario: New Sales & Restaurant, Marketing & Advertisment, Medical & Health, Government public service assessment.