A Hands-on Workshop on Designing LLM-Powered Context-Aware Behavior for Companion Robots

As robots increasingly enter social and domestic environments, their ability to generate context-aware and expressive behaviors becomes essential for meaningful and believable human-robot interaction. Traditional behavior generation often relies on static rules or scripted routines, limiting adaptability and nuance. In this workshop, we present a novel system that leverages Large Language Models (LLMs) to generate dynamic, embodied responses for robots. Our system integrates a defined robot persona, an affordance profile based on physical capabilities, and a response mapping framework that converts conversational inputs into sequences of expressive movement markers. Participants will engage in a hands-on experience with this system, beginning with an introduction to behavior generation in robotics and a live demonstration. Working in small groups, they will design their own LLM prompts and response scenarios for daily life interactions, implement them using the framework, and test the results directly on a quadruped robot, Spot from Boston Dynamics. The workshop drives participants and practitioners to critically reflect on expressive AI and robot interaction design.

Authors

Institutions

Publication Details

Published
2025-10-07
DOI
https://doi.org/10.1145/3757980.3758014
Primary Topic
Social Robot Interaction and HRI
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Hands-on Workshop on Designing LLM-Powered Context-Aware Behavior for Companion Robots

Bakhtawar Khan, Oğuz Buruk, Linas Kristupas Gabrielaitis, Juho Hamari et al.
Social Robot Interaction and HRI
article

A Hands-on Workshop on Designing LLM-Powered Context-Aware Behavior for Companion Robots

Bakhtawar Khan, Oğuz Buruk, Linas Kristupas Gabrielaitis, Juho Hamari, Jiangnan Xu, Eshtiak Ahmed
article en

Abstract

As robots increasingly enter social and domestic environments, their ability to generate context-aware and expressive behaviors becomes essential for meaningful and believable human-robot interaction. Traditional behavior generation often relies on static rules or scripted routines, limiting adaptability and nuance. In this workshop, we present a novel system that leverages Large Language Models (LLMs) to generate dynamic, embodied responses for robots. Our system integrates a defined robot persona, an affordance profile based on physical capabilities, and a response mapping framework that converts conversational inputs into sequences of expressive movement markers. Participants will engage in a hands-on experience with this system, beginning with an introduction to behavior generation in robotics and a live demonstration. Working in small groups, they will design their own LLM prompts and response scenarios for daily life interactions, implement them using the framework, and test the results directly on a quadruped robot, Spot from Boston Dynamics. The workshop drives participants and practitioners to critically reflect on expressive AI and robot interaction design.

Tampere University of Applied Sciences (FI), Tampere University (FI), Tampere University (FI)
Openalex Percentile: Top 60%
Social Robot Interaction and HRI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A Hands-on Workshop on Designing LLM-Powered Context-Aware Behavior for Companion Robots — Bakhtawar Khan, Oğuz Buruk, et al. · (2025) | TGRS Research Map | TGRS