Research

Publications

2026

2 papers
Research figure showing a three-step sequence of a person outdoors wearing EMS electrodes on their forearm, illustrating the "recall" interaction technique for an embodied slider. Step 1: a notification alerts the user that the slider state has changed. Step 2: the user is distracted by their phone and the slider drifts. Step 3: EMS activates to physically guide the user's arm back to the previous slider position, shown with an arrow and lightning bolt icon. The label "vs. with recall" appears in the top left.

Increasing Input Accuracy of Embodied Devices via Electrical Muscle Stimulation

ACM CHI — April 13, 2026

This paper evaluates interaction techniques to increase input accuracy with embodied devices—an emergent type of interactive system where the user's…

PDF DOI Video Talk
@inproceedings{chienIncreasingInputAccuracy2026,
  title = {Increasing Input Accuracy of Embodied Devices via Electrical Muscle Stimulation},
  booktitle = {Proceedings of the 2026 {{CHI Conference}} on {{Human Factors}} in {{Computing Systems}}},
  author = {Chien, Lonnie and Tanaka, Yudai and Amin, Noor and Brooks, Jas and Lopes, Pedro},
  year = 2026,
  month = apr,
  pages = {1--10},
  publisher = {ACM},
  address = {Barcelona, Spain},
  doi = {10.1145/3772318.3791134},
  isbn = {979-8-4007-2278-3},
  langid = {english}
}
Photo of an American black bear standing in its zoo enclosure, surrounded by dozens of floating soap bubbles. The bear's tongue is visible as it engages with the bubbles, illustrating the interactive olfactory enrichment system deployed as part of the BearBubbles study.

BearBubbles: Interactive Olfactory Enrichment to Encourage Foraging in Zoo Animals

ACM CHI — April 13, 2026

Enrichment is critical for zoo animal welfare. Commonly used food-based approaches have limitations in terms of sensory diversity, agency, redundancy,…

PDF DOI
@inproceedings{aggarwalBearBubblesInteractiveOlfactory2026,
  title = {{{BearBubbles}}: Interactive Olfactory Enrichment to Encourage Foraging in Zoo Animals},
  shorttitle = {{{BearBubbles}}},
  booktitle = {Proceedings of the 2026 {{CHI Conference}} on {{Human Factors}} in {{Computing Systems}}},
  author = {Aggarwal, Arushi and Woodruff, Sarah and Brooks, Jas and Kleinberger, Rebecca},
  year = 2026,
  month = apr,
  pages = {1--18},
  publisher = {ACM},
  address = {Barcelona, Spain},
  doi = {10.1145/3772318.3790842},
  isbn = {979-8-4007-2278-3},
  langid = {english}
}

2025

3 papers
Bump chart showing how the top 10 most common scents in scratch-and-sniff books shift in rank across six age groups, from infancy (0–3) through adulthood (18+). Chocolate, mint, and strawberry dominate early childhood, while pine rises to the top rank in adulthood. Socially transgressive and complex scents such as gas, breath, grave, and foot appear only in the adolescence and adulthood categories.

How Scratch-and-Sniff Books Encode Smell Across Development

Multisensory Research — November 13, 2025

Scratch-and-sniff books combine olfactory cues with textual and visual narratives thus offering multi- sensory reading experiences. Despite their popularity since…

PDF DOI
@article{brooksHowScratchandSniffBooks2025,
  title = {How Scratch-and-Sniff Books Encode Smell Across Development},
  author = {Brooks, Jas and Kucirkova, Natalia and Spence, Charles},
  year = 2025,
  month = nov,
  journal = {Multisensory Research},
  volume = {38},
  number = {6-8},
  pages = {543--585},
  issn = {2213-4794, 2213-4808},
  doi = {10.1163/22134808-bja10176},
  copyright = {https://creativecommons.org/licenses/by/4.0/}
}
Research diagram comparing two EMS-based piano training approaches. Panel (a) shows static EMS demonstrating finger movements to the user, with an idealized learning curve over time. Panel (b) shows error-adaptive EMS that corrects wrong notes and warns of upcoming errors, achieving a steeper learning curve. Panel (c) shows a box plot with adaptive EMS resulting in significantly fewer errors than static EMS.

Adaptive Electrical Muscle Stimulation Improves Muscle Memory

ACM CHI — April 25, 2025 (* Equal contribution)

Electrical muscle stimulation (EMS) has been leveraged to assist in learning motor skills by actuating the user’s muscles. However, existing…

PDF DOI Video Talk
@inproceedings{choudharyAdaptiveElectricalMuscle2025,
  title = {Adaptive Electrical Muscle Stimulation Improves Muscle Memory},
  booktitle = {Proceedings of the 2025 {{CHI Conference}} on {{Human Factors}} in {{Computing Systems}}},
  author = {Choudhary, Siya and Nith, Romain and Ho, Yun and Brooks, Jas and Guruvugari, Mithil and Lopes, Pedro},
  year = 2025,
  month = apr,
  pages = {1--11},
  publisher = {ACM},
  address = {Yokohama, Japan},
  doi = {10.1145/3706598.3713676},
  isbn = {979-8-4007-1394-1},
  langid = {english}
}
Research figure showing a person wearing a VR headset with a wearable scent-delivery device. Three hand gesture diagrams illustrate proactive olfactory interactions: (A) swiping inward twice to trigger odor release, shown alongside a VR scene of a flowering plant emitting pink particles; (B) pointing from origin to target to move an odor, shown with a VR table scene of scent objects; and (C) circling with the index finger to obtain odor direction, shown with pink particles swirling toward a virtual object.

Mid-Air Gestures for Proactive Olfactory Interactions in Virtual Reality

ACM CHI — April 25, 2025

Olfactory experiences are increasingly in demand due to their immersive benefits. However, most interaction implementations are passive and rely on…

PDF DOI
@inproceedings{liMidAirGesturesProactive2025,
  title = {Mid-Air Gestures for Proactive Olfactory Interactions in Virtual Reality},
  booktitle = {Proceedings of the 2025 {{CHI Conference}} on {{Human Factors}} in {{Computing Systems}}},
  author = {Li, Junxian and Wang, Yanan and Cui, Zhitong and Brooks, Jas and Yan, Yifan and Lou, Zhengyu and Li, Yucheng},
  year = 2025,
  month = apr,
  pages = {1--18},
  publisher = {ACM},
  address = {Yokohama, Japan},
  doi = {10.1145/3706598.3713964},
  isbn = {979-8-4007-1394-1},
  langid = {english}
}

2024

3 papers
Research figure showing a nose-worn device that uses Peltier elements to heat or cool airflow in sync with breathing. The main image shows the device worn under the nose with a close-up inset of the Peltier component. Two side panels show the contrasting effects: cooling makes breathing feel easy (paired with a crisp mountain environment), while heating makes breathing feel labored (paired with a smoky, hazy scene).

Augmented Breathing via Thermal Feedback in the Nose

ACM UIST — October 11, 2024

We propose, engineer, and study a novel method to augment the feeling of breathing—enabling interactive applications to let users feel…

PDF DOI Video Talk
@inproceedings{brooksAugmentedBreathingThermal2024,
  title = {Augmented Breathing via Thermal Feedback in the Nose},
  booktitle = {Proceedings of the 37th {{Annual ACM Symposium}} on {{User Interface Software}} and {{Technology}}},
  author = {Brooks, Jas and Mazursky, Alex and Hixon, Janice and Lopes, Pedro},
  year = 2024,
  month = oct,
  pages = {1--11},
  publisher = {ACM},
  address = {Pittsburgh, PA, USA},
  doi = {10.1145/3654777.3676438},
  isbn = {979-8-4007-0628-8},
  langid = {english}
}
Research figure overlaying a study interface on top of illustrated children's book pages. The left side shows text reading "So he ate a treat from the apple tree" with a scratch-and-sniff apple illustration, overlaid with a bar chart showing the target readerships of scratch-and-sniff books. The right side shows a colorful illustrated scene with a butterfly and tree from the same book, with labels referencing scent-enhanced books by age group.

Narrative historical review of scratch-and-sniff books and their key storytelling features

i-Perception — June 11, 2024

This conceptual paper examines the use of odours and scents in books to enhance storytelling and engage readers. While books…

PDF DOI
@article{spenceNarrativeHistoricalReview2024,
  title = {Narrative Historical Review of Scratch-and-Sniff Books and Their Key Storytelling Features},
  author = {Spence, Charles and Kucirkova, Natalia and Campbell, Janine and Gao, Yang and Brooks, Jas},
  year = 2024,
  month = may,
  journal = {i-Perception},
  volume = {15},
  number = {3},
  pages = {20416695241257566},
  issn = {2041-6695, 2041-6695},
  doi = {10.1177/20416695241257566}
}
Research figure showing a person wearing a VR headset and backpack-mounted computing system, kneeling in a mixed VR environment spanning a desert and grassy terrain. Two insets highlight wearable thermal devices: one on the bare foot conveying the sensation of sand, and one on the outer wrist conveying heat from a virtual flame while gripping a wooden prop.

ThermalGrasp: Enabling Thermal Feedback Even While Grasping & Walking

IEEE VR — March 16, 2024

Most thermal interfaces attach Peltier elements and their required cooling systems (heatsinks and fans) directly to the palm or sole,…

PDF DOI Video Talk Code
@inproceedings{mazurskyThermalGraspEnablingThermal2024,
  title = {{{ThermalGrasp}}: Enabling Thermal Feedback Even While Grasping and Walking},
  shorttitle = {{{ThermalGrasp}}},
  booktitle = {2024 {{IEEE Conference Virtual Reality}} and {{3D User Interfaces}} ({{VR}})},
  author = {Mazursky, Alex and Brooks, Jas and Desta, Beza and Lopes, Pedro},
  year = 2024,
  month = mar,
  pages = {342--353},
  publisher = {IEEE},
  address = {Orlando, FL, USA},
  doi = {10.1109/VR58804.2024.00056},
  copyright = {https://doi.org/10.15223/policy-029},
  isbn = {979-8-3503-7402-5}
}

2023

2 papers
Research figure showing a person wearing a VR headset and holding a blackberry up to their mouth, with a small tube attached near their lips. Illustrated arrows show taste retargeting: the blackberry maps to a lemon, the lemon to a strawberry, and the strawberry to a spider, depicting how the system alters taste perception.
Jury’s Best Demo Honorable Mention

Taste Retargeting via Chemical Taste Modulators

ACM UIST — October 29, 2023

Prior research has explored modifying taste through electrical stimulation. While promising, such interfaces often only elicit taste changes while in…

PDF DOI Video Talk Code
@inproceedings{brooksTasteRetargetingChemical2023a,
  title = {Taste Retargeting via Chemical Taste Modulators},
  booktitle = {Proceedings of the 36th {{Annual ACM Symposium}} on {{User Interface Software}} and {{Technology}}},
  author = {Brooks, Jas and Amin, Noor and Lopes, Pedro},
  year = 2023,
  month = oct,
  pages = {1--15},
  publisher = {ACM},
  address = {San Francisco, CA, USA},
  doi = {10.1145/3586183.3606818},
  isbn = {979-8-4007-0132-0},
  langid = {english}
}
Photo of a laser-cut cardboard prototype device with two cylindrical scent cartridges mounted in a flat base, alongside a separate star-shaped stand. Below the device, a strip of colorful scented washi tape is shown with annotations indicating play direction (left to right) and the use of non-scented washi tape to connect segments. The paper tape includes scratch-and-sniff stickers to prototype olfactory experiences, which are scratched by velcro in the cardboard cassette.
Sadakichi Award (Art & Olfaction 2024)

Smell & Paste: Low-Fidelity Prototyping for Olfactory Experiences

ACM CHI — April 19, 2023

Low-fidelity prototyping is so foundational to Human-Computer Interaction, appearing in most early design phases. So, how do experts prototype olfactory…

PDF DOI Video Talk Code
@inproceedings{brooksSmellPasteLowFidelity2023,
  title = {Smell \& {{Paste}}: Low-Fidelity Prototyping for Olfactory Experiences},
  shorttitle = {Smell \& {{Paste}}},
  booktitle = {Proceedings of the 2023 {{CHI Conference}} on {{Human Factors}} in {{Computing Systems}}},
  author = {Brooks, Jas and Lopes, Pedro},
  year = 2023,
  month = apr,
  pages = {1--16},
  publisher = {ACM},
  address = {Hamburg, Germany},
  doi = {10.1145/3544548.3580680},
  isbn = {978-1-4503-9421-5},
  langid = {english}
}

2021

3 papers
Research figure showing a person wearing a VR headset with a wearable patch on their forearm. Four circular insets illustrate chemical haptic sensations delivered via the patch: cooling (menthol), warming (capsaicin), tingling (sanshool), stinging (cinnamaldehyde), and numbing (lidocaine), each paired with a corresponding VR scene.

Chemical Haptics: Rendering Haptic Sensations via Topical Stimulants

ACM UIST — October 12, 2021

We propose a new class of haptic devices that provide haptic sensations by delivering liquid-stimulants to the user's skin; we…

PDF DOI Video Talk Code
@inproceedings{luChemicalHapticsRendering2021,
  title = {Chemical Haptics: Rendering Haptic Sensations via Topical Stimulants},
  shorttitle = {Chemical {{Haptics}}},
  booktitle = {The 34th {{Annual ACM Symposium}} on {{User Interface Software}} and {{Technology}}},
  author = {Lu, Jasmine and Liu, Ziwei and Brooks, Jas and Lopes, Pedro},
  year = 2021,
  month = oct,
  pages = {239--257},
  publisher = {ACM},
  address = {Virtual Event},
  doi = {10.1145/3472749.3474747},
  isbn = {978-1-4503-8635-7},
  langid = {english}
}
Research figure showing a person playing an electric guitar with EMS (electrical muscle stimulation) electrodes on their fretting hand. An illustrated hand diagram on the right shows the electrode placement on the fingers and wrist, with a lightning bolt icon indicating stimulation used to guide finger movements during guitar learning.
Best Paper Award (top 1%)

Increasing Electrical Muscle Stimulation’s Dexterity by Means of Back-of-the-Hand Actuation

ACM CHI — May 7, 2021

We propose a technique that allows an unprecedented level of dexterity in electrical muscle stimulation (EMS), i.e., it allows inter-…

PDF DOI Video Talk
@inproceedings{takahashiIncreasingElectricalMuscle2021,
  title = {Increasing Electrical Muscle Stimulation's Dexterity by Means of Back of the Hand Actuation},
  booktitle = {Proceedings of the 2021 {{CHI Conference}} on {{Human Factors}} in {{Computing Systems}}},
  author = {Takahashi, Akifumi and Brooks, Jas and Kajimoto, Hiroyuki and Lopes, Pedro},
  year = 2021,
  month = may,
  pages = {1--12},
  publisher = {ACM},
  address = {Yokohama, Japan},
  doi = {10.1145/3411764.3445761},
  isbn = {978-1-4503-8096-6},
  langid = {english}
}
Research figure showing a person with eyes closed wearing a small electronic device clipped to their nostril, with a lightning bolt icon indicating electrical stimulation. An arrow points from the device toward a stove in the background, indicating the rendered stereo-smell sensation.
Innovation by Design Honorable Mention

Stereo-Smell via Electrical Trigeminal Stimulation

ACM CHI — May 7, 2021

We propose a novel type of olfactory device that creates a stereo-smell experience, i.e., directional information about the location of…

PDF DOI Video Talk Code
@inproceedings{brooksStereoSmellElectricalTrigeminal2021a,
  title = {Stereo-Smell via Electrical Trigeminal Stimulation},
  booktitle = {Proceedings of the 2021 {{CHI Conference}} on {{Human Factors}} in {{Computing Systems}}},
  author = {Brooks, Jas and Teng, Shan-Yuan and Wen, Jingxuan and Nith, Romain and Nishida, Jun and Lopes, Pedro},
  year = 2021,
  month = may,
  pages = {1--13},
  publisher = {ACM},
  address = {Yokohama, Japan},
  doi = {10.1145/3411764.3445300},
  isbn = {978-1-4503-8096-6},
  langid = {english}
}

2020

1 paper
Close-up of a person smiling while wearing an HTC Vive VR headset modified with a custom electronic device and scent-delivery mechanism mounted to the front. The background is composited with two VR environments side by side: a warm desert landscape and a snowy forest scene. The person experiences the warmth or coolness with capsaicin and menthol.
Best Paper Award (top 1%)

Trigeminal-Based Temperature Illusions

ACM CHI 2020 — April 23, 2020

We explore a temperature illusion that uses low-powered electronics and enables the miniaturization of simple warm and cool sensations. Our…

PDF DOI Video Talk Code
@inproceedings{brooksTrigeminalbasedTemperatureIllusions2020,
  title = {Trigeminal-Based Temperature Illusions},
  booktitle = {Proceedings of the 2020 {{CHI Conference}} on {{Human Factors}} in {{Computing Systems}}},
  author = {Brooks, Jas and Nagels, Steven and Lopes, Pedro},
  year = 2020,
  month = apr,
  pages = {1--12},
  publisher = {ACM},
  address = {Honolulu, HI, USA},
  doi = {10.1145/3313831.3376806},
  isbn = {978-1-4503-6708-0},
  langid = {english}
}