Adapting Large Language Models through fine tuning techniques for application in social human-robot interaction

The research area of LLMs, while very recent, is evolving rapidly in many different ways. In this work, we explore the application of LLMs in the context of humanoid robotics,trough Abel, a humanoid robot. I created a custom dataset of conversation. I selected LLaMA 3, a large language model developed by Meta, with 8B parameters, as the base model for fine-tuning. I adapted LLaMA 3 to understand and respond to the unique interactions expected of a humanoid robot like Abel. This involved training the model on the custom dataset and optimizing key parameters to achieve the best possible performance. By evaluating the final model against responses generated by external GPT model.

Publication Details

Journal
Electronic Theses and Dissertations Repository (University of Pisa)
Published
2024-11-21
Primary Topic
Education, Healthcare and Sociology Research
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Adapting Large Language Models through fine tuning techniques for application in social human-robot interaction

Electronic Theses and Dissertations Repository (University of Pisa)
Education, Healthcare and Sociology Research
article

Adapting Large Language Models through fine tuning techniques for application in social human-robot interaction

article en

Abstract

The research area of LLMs, while very recent, is evolving rapidly in many different ways. In this work, we explore the application of LLMs in the context of humanoid robotics,trough Abel, a humanoid robot. I created a custom dataset of conversation. I selected LLaMA 3, a large language model developed by Meta, with 8B parameters, as the base model for fine-tuning. I adapted LLaMA 3 to understand and respond to the unique interactions expected of a humanoid robot like Abel. This involved training the model on the custom dataset and optimizing key parameters to achieve the best possible performance. By evaluating the final model against responses generated by external GPT model.

Electronic Theses and Dissertations Repository (University of Pisa)
Reduced inequalities, Quality Education
Openalex Percentile: Top 40%
Education, Healthcare and Sociology Research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Adapting Large Language Models through fine tuning techniques for application in social human-robot interaction · Electronic Theses and Dissertations Repository (University of Pisa) (2024) | TGRS Research Map | TGRS