Work for a Member organization and need a Member Portal account? Register here with your official email address.
Creative Commons
Attribution 4.0 International
Affective Computing group, MIT Media Lab
Animations designed with the help of a pre-engineered GPT are coded further by the AI to connect with a wearable sensor. The r...
This research explores how acoustic environments can elicit awe and wonder emotions, and how such experiences can contribute to restoration...
Over 600,000 youth in the United States experience abuse or neglect each year. Youth who are deemed to be at risk of significant harm in th...
Social deduction or deception games are games in which a player or team of players actively deceives other players who are trying to discov...
See for yourself how accurately you can identify AI-generated images at the DetectFakes Experiment and if you want to learn to sp...
Different approaches and models have been used to detect driver’s stress and affective states, using physiology, facial expression, and sel...
Addressing Bias in Physician-Machine PartnershipsThis research program addresses how AI assistance can enhance physician decision-making on...
Emotional arousal influences focus, attention, and decision-making, which are critical when driving. To help promote an optimal arousal lev...
We introduce–aSpire–a clippable, mobile pneumatic-haptic device designed to help users regulate their breathing rate via subtle tactile fee...
There is a consensus that the hospital experience is stressful for children and leads to anxiety and fear. Long term effects of stres...
Before automobiles were invented and widely adopted, animals like horses were the most common mode of transportation. While this change bro...
Communication skills are critical for all. We design and develop systems to help people with communication issues, fostering more emp...
The Places dataset (website) is designed following principles of human visual cognition. Our goal is to build a core of visual kn...
A wearable olfactory display that monitors cardio-respiratory information with the aspiration to support mental wellbeing.BioEssence is a w...
The project aims to investigate the relationships between emotion, wellbeing, skin, and skincare cosmetics. In our first study, we mea...
In this project we explore how to recognize and localize affect in images.
The goal of this project is providing machines with the ability of understanding what a person is experiencing from her frame of reference,...
The relationship between breathing and self-reported stress is bidirectional. Respiration pattern is an indicator of stress, but it can als...
Conversations between two individuals—whether between doctor and patient, mental health therapist and client, or between two people romanti...
Open-Source Instructions for Building SPRING System
Acu.ation is an intervention that aims to mediate the urge to smoke by pairing a wearable device that delivers transcutaneous electric acup...
We designed an app that uses augmented reality to make public transit in Philadelphia more accessible for people with disabilities.The desi...
The Affective Computing group is collaborating with Weill Cornell Medicine to build empathetic behavior in physicians working with opioid u...
One of the principal benefits of counterfactual explanations is allowing users to explore "what-if" scenarios through what does not and can...
The goal of this project is to develop techniques to remove identifying information from wearable and phone data to protect patients’ priva...
The purpose of this study is to investigate possible neural correlates of electrodermal activity. Electrodermal activity (EDA) is a b...
Automatic emotion recognition has become a well-established machine learning task in recent years. The sensitive and subjective nature of e...
The Project on Affinities and Language (PAL) is designed to help us understand what happens in a child’s brain when they engage with their ...
Adaptive Music for Affect Improvement (AMAI) is a music generation and playback system with the goal of steering the listener toward a stat...
We introduce SkinBot: a lightweight robot that moves over the skin's surface with a two-legged suction-based locomotion mechanism and captu...
In the quest towards general artificial intelligence (AI), researchers have explored developing loss functions that act as intrinsic motiva...
Excessive stress can decrease office workers' productivity and negatively impact overall health. This project aims to predict office worker...
The view on Alzheimer’s Disease (AD) diagnosis has shifted towards a more dynamic process in which clinical and pathological markers evolv...
Can we sonfiy calming breathing and passively influence a state of calm?Deep breathing has been scientifically proven to affect the heart, ...
Cube Puzzles: A tangible platform for dynamic assessment of cognitive and psychomotor skillsCognitive and psychomotor assessments are a vi...
The delivery of mental health interventions via ubiquitous devices has shown a lot of promise. A natural conversational interface that allo...
Can we modulate the way we hear the world around us to make it more calming or to induce focus? While technology is usually associated with...
The explosion of mHealth in both abundant and resource-constrained countries is both a cause for celebration and for concern. While mH...
More information coming soon.
Many drugs, such as monoclonal antibodies, are administrated using parenteral delivery devices via subcutaneous injections. Unfortunately, ...
This project seeks to examine the effects of altered gravity on an individual’s physiology during parabolic flight. Specifically, we will c...
This project investigates a general method for improving the structure and quality of sequences generated by a recurrent neural network (RN...
Pain is a subjective experience commonly measured through patients' self reports. Unfortunately, self-report measures only work when t...
Storytelling is a fundamental way in which human beings understand the world. Imagine watching a movie telling the story of your life, how ...
In collaboration with Massachusetts General Hospital, we are conducting a clinical trial exploring objective methods for assessing depressi...
EngageME: Personalized machine learning and humanoid robots for measuring affect and engagement of children with autismEngageME is a projec...
We show that using thin slices (< 1 minute) of facial expression and body language data, we can train a deep neural network to predict w...
Animated GIFs are widely used on the Internet to express emotions, but automatic analysis of their content is largely ...
Individuals with autism are known to have difficulties connecting with other people, reciprocating social interactions, and being emotional...
SPRING is a custom-built hardware and software platform for children with neuro-differences. The system automates data acquisition, optimiz...
We are conducting EEG studies to identify the musical features and musical interaction patterns that universally impact measures of arousal...
This study aims to bring objective measurement to the multiple "pulse" and "pulse-like" measures made by practitioners of traditional Chine...
This study attempts to examine humans' affective responses to superimposed sinusoidal signals. These signals can be perceived either throug...
Electrodermal Activity (EDA) is a physiological indicator of stress and strong emotion. While an increasing number of wearable devices can ...
We have designed a novel system to promote kindness and gratitude. We leverage pervasive technologies to naturally embed gratitude inspirat...
Mental wellbeing is intimately tied to both social support and physical activity. The Challenge is a tool aimed at promoting social connect...
Electrodermal activity (EDA) recording is a powerful, widely used tool for monitoring psychological or physiological arousal. However, anal...
The goal of this project is to apply machine learning methods to model the wellbeing of MIT undergraduate students. Extensive data is obtai...
This project examines how the expression granted by new musical interfaces can be harnessed to create positive changes in health and wellbe...
We are developing statistical tools for understanding, modeling, and predicting self-harm by using advanced probabilistic graphical models ...
The proliferation of smartphones and wearable sensors is creating very large data sets that may contain useful information. However, the ma...
We explore advanced machine learning and reflective user interfaces to scale the national Crisis Text Line. We are using state-of-the-art p...
With the LEGO Group and Hasbro, we looked at the emotional experience of playing with games and LEGO bricks. We measured participants' skin...
New generative AI technologies (such as the Generative Adversarial Network, or GAN) can allow us to imagine new species. Hidden within the ...
What is ELSA?ELSA is an AI-powered chatbot that acts as an empathetic companion, encouraging users to talk about their day through a form o...
Unlike traditional randomized controlled trials that generalize relationships in large groups of people, single-case experiments seek to qu...
A common practice in Traditional Chinese Medicine (TCM) is visual examination of the patient's tongue. This study will examine ways to make...
Stories, language, and art are at the heart StoryScape. While StoryScape began as a tool to meet the challenging language learning needs of...
The wide availability of low-cost, wearable, biophysiological sensors enables us to measure how the environment and our experiences impact ...
Panoply is a crowdsourcing application for mental health and emotional wellbeing. The platform offers a novel approach to computer-based ps...
Opioid therapy is the cornerstone of management of pain in the ICU. However, opioids present numerous side effects and are highly addictive...
Occupational stress can be described as a harmful emotional and physical response that occurs when high demanding job conditions cannot be ...
Physiological arousal is an important part of occupational therapy for children with autism and ADHD, but therapists do not have a way to o...
The Hol-Deep-Sense project (funded by the EU’s Horizon 2020 Marie Skłodowska-Curie grant) aims at holistic machine perception of ...
We are developing a mobile phone-based platform to assist people with chronic diseases, panic-anxiety disorders, or addictions. Making use ...
We are performing long-term measurements of autonomic nervous system (ANS) activity on patients with epilepsy. In certain cases, autonomic ...
Teaching multiple AI agents to coordinate their behavior represents a challenging task, that can be difficult to achieve without training a...
OverviewWe have created a new customizable, multi-user research-through-play platform designed to facilitate social skill development for c...
In this project, we aim to examine the interplay between the brain and body using physiological sensors and functional magnetic resonance i...
Project OverviewDepression is one of the most prevailing health problems in the world. Many recent publications have provided statistics ab...
We are applying learnings from the SNAPSHOT study to the problem of changing behavior, exploring the design of user-centered tools which ca...
Current methods to assess depression and then ultimately select appropriate treatment have many limitations. They are usually based on havi...
Complex and expensive medical devices are mainly used in medical facilities by health professionals. IDA is an attempt to disrupt this para...
You can test whether a website is usable by making wire frames, but how do you know if that site, product, or store is emotionally engaging...
SmileTracker is a system designed to capture naturally occurring instances of positive emotion during the course of normal interaction with...
A smile is a multi-purpose expression. We smile to express rapport, polite disagreement, delight, sarcasm, and often, even frustration. Is ...
MACH, My Automated Conversation coacH, is a system for people to practice social interactions in face-to-face scenarios. MACH consists of a...
With skin conductance sensors, we map out what frustrates and excites customers as they shop�from layout to wanting to touch the product. O...
Got Sleep? is an Android application to help people to be aware of their sleep-related behavioral patterns and tips about how they should c...
Working with the New World Symphony, we measured participant skin conductance as they attended a classical concert for the first time. With...
What do customers really think about your company or brand? Using skin conductance sensors, we measure what excites and frustrates customer...
This work builds on our earlier work with FaceSense, created to help automate the understanding of facial expressions, both cognitive and a...
Can we recognize stress, mood, and health conditions from wearable sensors and mobile-phone usage data? We analyze long-term, multi-modal p...
Persons on the autism spectrum often report hypersensitivity to sound. Efforts have been made to manage this condition, but there is wide r...
We are examining autonomic sleep patterns using a wrist-worn biosensor that enables comfortable measurement of skin conductance, skin tempe...
Cardiocam is a low-cost, non-contact technology for measurement of physiological signals such as heart rate and breathing rate using a basi...
Social-emotional communication difficulties lie at the core of autism spectrum disorders, making interpersonal interactions overwhelming, f...
People express and communicate their mental states–such as emotions, thoughts, and desires–through facial expressions, vocal nuances, gestu...
This project aims to build a modular lighting system where users can customize the design and lighting patterns.
Emotions are often conveyed through gesture. Instruments that respond to gestures offer musicians new, exciting modes of musical expression...
How can we better understand people�s emotional experiences with a product or service? Traditional interview methods require people to reme...
Frame It is an interactive, blended, tangible-digital puzzle game intended as a play-centered teaching and therapeutic tool. Current work i...
Individuals diagnosed with autism spectrum disorder (ASD) often have intense, focused interests. These interests, when harnessed properly, ...
We are looking at the emotional experience created when children learn games. Why do we start games with the most boring part, reading dire...
Have you ever wondered what makes an ad memorable? We have performed a comprehensive review of literature concerning advertising, memory, a...
We propose a set of customizable, easy-to-understand, and low-cost physiological toolkits in order to enable people to visualize and utiliz...
To help people improve their reading of faces during natural conversations, we developed a video tool to evaluate this skill. We collected ...
A small number of studies support the notion of a functional relationship between movement stereotypy and arousal in individuals with ASD, ...
We are automating recognition of positive/negative experiences (valence) and affect from facial expressions. We present a toolkit, Acume, f...
We have been developing comfortable, safe, attractive physiological sensors that infants can wear around the clock to wirelessly communicat...
We are characterizing changes in autonomic nervous system (ANS) during sleep. This can potentially provide insight into circadian rhythms a...
We have developed a low-cost device that can wirelessly detect a beating heart over a short distance (1m) and does not require any sensor p...
We are developing wearable sensors that measure cardiovascular parameters such as heart rate and heart rate variability (HRV) in real time....
Companies would like more new products to be successful in the marketplace, but current evaluation methods such as focus groups do not accu...
Affect as Index is a tool that takes group physiological data as input, aggregates it across different demographic dimensions, and attaches...
Recent findings in affective neuroscience and psychology indicate that human affect and emotional experience play a significant and useful ...
People who have difficulty communicating verbally (such as many people with autism) sometimes send nonverbal messages that do not match wha...
We have developed a novel market game, Prediction Game and Experience Sharing (PreGES, pronounced PreGuess), that harnesses people's collec...
Light is an important factor in the regulation of all kinds of circadian rhythms in our body, such as heart rate, blood pressure, digestion...
In this research, a proactive emotional health system, geared toward supporting emotional self-awareness and empathy, was built as a part o...
This project develops new theory and algorithms to enable computers to make rapid and accurate inferences from multiple modes of data, such...
Humans need sleep, along with food, water, and oxygen, to survive. With about one-third of our lives spent sleeping, there has been increas...
We are exploring innovative use of cell-phone Bluetooth technologies for consumer research and customer measurement. We have developed a s...
SmileSeeker is a novel, machine-vision system that captures and provides quantified information about nonverbal communication where social ...
How can technology help us understand ourselves better? In order to measure the physiological arousal of children with sensory challenges s...
In collaboration with the Early Childhood Cognition Center at MIT BCS, we are developing sensor-enabled toys and infant affect sensors with...
A robotic computer that moves its monitor "head" and "neck," but that has no explicit face, is being designed to interact with users in a n...
Shybot is a personal mobile robot designed to both embody and elicit reflection on shyness behaviors. Shybot is being designed to detect hu...
While modern communication technologies mean that we can connect to more people, these connections lack the affective subtleties inherent i...
Sometimes learners have to focus while experiencing strong emotions (e.g., family problems).�They may also face challenges in perservering ...
The Self-Cam is a wearable camera apparatus that consists of a chest-mounted camera aimed at the wearer�s face. Self-Cam was designed to be...
The wonder that occurs while watching a good magic trick or admiring a gorgeous natural vista is a strong emotion that has not been well st...
As the population ages, acuity in one or more sensory channels often diminishes or may be totally lost. Augmenting or compensating for loss...
Given motion capture samples of Charlie Chaplin's walk, is it possible to synthesize other motions—say, ascending or descending stairs—in h...
The Emotion Bottles are tangibly enticing objects that embody three emotions: angry, happy, and sad. When a bottle is opened, a vocal outp...
The technology in this project changes facial expressions in videos without the system knowing anything in particular about the person's fa...
HandWave is a small, wireless, networked skin conductance sensor that can be worn or used in many different form factors. Skin conductance ...
Affective Remixer is a real-time music-arranging system that reacts to immediate affective cues from a listener. Data was collected on the ...
The goal of this project is to produce a guilt detector. We have created an experiment that is designed to produce feelings of guilt of var...
People naturally express frustration through the use of their motor skills. The purpose of the Affective Tangibles project is to develop ph...
The computer's emerging capacity to communicate an individual's affect raises critical ethical concerns. Additionally, designers of percept...
EmoteMail is an email client that is augmented to convey aspects of the state of the writer during the composition of email to the recipien...
The goal of this project is to develop tools to sense and adapt to a user's affective state based on his or her mouse behavior. We are deve...
This project developed efficient versions of Bayesian techniques for a variety of inference problems, including curve fitting, mixture-dens...
The purpose of the INNER-active Journal system is to provide a way for users to reconstruct their emotions around events in their lives, an...
This research aims to classify gene expression data sets into different categories, such as normal vs. cancer. The main challenge is that t...
We have created a system for data collection, annotation, and feedback that is part of a longer-term research interest to gather data to un...
"I can't do this" and "I'm not good at this" are common statements made by kids while trying to learn. Usually triggered by affective state...
Driving is an ideal test bed for detecting stress in natural situations. Four types of physiological signals (electrocardiogram, electromyo...
BioMod is an integrated interface for users of mobile and wearable devices, monitoring various physiological signals such as the electrocar...
We design and evaluate an ambient blood glucose level visualization and feedback system that uses an Ambient Orb for diabetes self-care and...
The saying, "if you can't measure it, you can't manage it" may be appropriate for stress. Many people are unaware of their stress level, an...
In this project, we propose a new Bayesian receiver for signal detection in flat-fading channels. First, the detection problem is formulate...
The Interface Tailor is an agent that attempts to adapt a system in response to affective feedback. Frustration is being used as a fitness ...
We have developed a system to recognize posture patterns and associated affective states in real time, in an unobtrusive way, from a set of...
The Affective Mirror is an attempt to build a fully automated system that intelligently responds to a person's affective state in real time...
Recognizing non-verbal cues, which constitute a large percentage of our communication, is a prime facet of building emotionally intelligent...
This research project is concerned with building computational models for the automatic recognition of affective expression in speech. We a...
Relational Agents are computational artifacts designed to build and maintain long-term, social-emotional relationships with their users. Ce...
PAF (paroxysmal atrial fibrillation) is a dangerous form of cardiac arrhythmia that poses severe health risks, sometimes leading to heart a...
While instant messaging clients are frequently and widely used for interpersonal communication, they lack the richness of face-to-face conv...
The aim of this project is to build a database of natural speech showing a range of affective variability. It is an extension of our ongoin...
The galvactivator is a glove-like wearable device that senses the wearer's skin conductivity and maps its values to a bright LED display. I...
The Touch-Phone was developed to explore the use of objects to mediate the emotional exchange in interpersonal communication. Through an ab...
ASQ investigates ways to teach social-emotion skills to children interactively with toys. One of the first goals is to help autistic child...
The "Affective Carpet" is a soft, deformable surface made of cloth and foam, which detects continuous pressure with excellent sensitivity ...
This project is aimed at building a system to recognize emotional expression given four physiological signals. Data was gathered from a gr...
Mr. Java is the Media Lab's wired coffee machine, which keeps track of usage patterns and user preferences. The focus of this project is to...
The Conductor's Jacket is a unique wearable device that measures physiological and gestural signals. Together with the Gesture Constructi...
The Affective Tigger is a plush toy designed to recognize and react to certain emotinal behaviors of its playmate. For example the toy ent...
We are building a system that can watch for certain signs of stress in drivers, specifically stress related to talking on the car phone, ...
AboutFace is a user-dependent system that is able to learn patterns and discriminate the different facial movements characterizing confusi...
AffQuake is an attempt to incorporate signals that relate to a player's affect into ID Software's Quake II in a way that alters game play. ...
AltStyle によって変換されたページ (->オリジナル) / アドレス: モード: デフォルト 音声ブラウザ ルビ付き 配色反転 文字拡大 モバイル