Hierarchical multi-task learning with self-supervised auxiliary task

Multi-task learning is a popular approach in machine learning that aims to learn multiple related tasks simultaneously by sharing information across them.In this paper, we consider a hierarchical structure across multiple related tasks with a hierarchy of sub-tasks under the same main task, where representations used to solve the sub-tasks share more information through task-specific layers, globally shared layers, and locally shared layers.We thus propose the hierarchical multi-task learning with self-supervised auxiliary task (HiSS), which is a novel approach for hierarchical multi-task learning that incorporates self-supervised learning as an auxiliary task.The goal of the auxiliary task is to further extract latent information from the unlabeled data by predicting a cluster label directly derived from the data.The proposed approach is tested on the Hyodoll dataset, which consists of user information and activity logs of elderly individuals collected by AI companion robots, for predicting emergency calls based on the time of day and month.Our proposed algorithm is more efficient than other wellknown machine learning algorithms as it requires only a single model regardless of the number of tasks, and demonstrates superior performance in classification tasks using various metrics.The source codes are available at:

Authors

Institutions

Publication Details

Journal
Korean Journal of Applied Statistics
Published
2024-10-28
DOI
https://doi.org/10.5351/kjas.2024.37.5.631
Primary Topic
Domain Adaptation and Few-Shot Learning
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Hierarchical multi-task learning with self-supervised auxiliary task

Taeyoung Park, Seung‐Han Lee
Korean Journal of Applied Statistics
Domain Adaptation and Few-Shot Learning
article

Hierarchical multi-task learning with self-supervised auxiliary task

Taeyoung Park, Seung‐Han Lee
article en

Abstract

Multi-task learning is a popular approach in machine learning that aims to learn multiple related tasks simultaneously by sharing information across them.In this paper, we consider a hierarchical structure across multiple related tasks with a hierarchy of sub-tasks under the same main task, where representations used to solve the sub-tasks share more information through task-specific layers, globally shared layers, and locally shared layers.We thus propose the hierarchical multi-task learning with self-supervised auxiliary task (HiSS), which is a novel approach for hierarchical multi-task learning that incorporates self-supervised learning as an auxiliary task.The goal of the auxiliary task is to further extract latent information from the unlabeled data by predicting a cluster label directly derived from the data.The proposed approach is tested on the Hyodoll dataset, which consists of user information and activity logs of elderly individuals collected by AI companion robots, for predicting emergency calls based on the time of day and month.Our proposed algorithm is more efficient than other wellknown machine learning algorithms as it requires only a single model regardless of the number of tasks, and demonstrates superior performance in classification tasks using various metrics.The source codes are available at:

Korean Journal of Applied StatisticsVol. 37(5)
Yonsei University (KR)
National Research Foundation, Yonsei University, National Research Foundation of Korea, Ministry of Science and ICT, South Korea, Institute for Information and Communications Technology Promotion
Openalex Percentile: Top 83%
Domain Adaptation and Few-Shot Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Hierarchical multi-task learning with self-supervised auxiliary task — Taeyoung Park, Seung‐Han Lee · Korean Journal of Applied Statistics (2024) | TGRS Research Map | TGRS