Multimodal Content Generation: A Project for AI Creativity

21st-century interactions involve the consumption of content, whether in the form of text, audio, images, or any other medium. This paper presents a multimodal content generation (MCG) system that seeks to ease the content production process by providing integrated solutions for video, image, audio and text content production among others. Large language models (LLMs) have shown a great promise in enhancing the creativity process in various fields such as media and education where mediums of communication interweave. The system takes into account the current data, situation, user needs, and composes an appropriate and suitable content for them. At the same time, conventional AI models, such as transformers, are combined with multimodal models enhanced with optimization strategies such as transfer learning and fine-tuning. This strategy greatly augments the content generation potential and scalability of the system and thus, is of great importance in the design of systems for the content production process. The quantum- inspired elements of the hybrid model are the ones targeted towards making changes in decision and feature selection within the creative processes. The effectiveness of MCG in this research was compared to other content creation systems, and the results of the research revealed that MCG is more creative, efficient, and satisfying for the users than the existing systems; therefore, it has a great potential for changing the practices of producing content in a multimedia environment.

Authors

Institutions

Publication Details

Published
2024-12-12
DOI
https://doi.org/10.1109/icercs63125.2024.10894945
Citations
3
Primary Topic
Semantic Web and Ontologies
Type
article
Field-Weighted Citation Impact
1.04
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multimodal Content Generation: A Project for AI Creativity

Selena Hariharan, Lavanya Sanjay, M. Geetha, T Jeevanprasanth
3 citations
Semantic Web and Ontologies
1.04
article

Multimodal Content Generation: A Project for AI Creativity

Selena Hariharan, Lavanya Sanjay, M. Geetha, T Jeevanprasanth
article en
3 citations

Abstract

21st-century interactions involve the consumption of content, whether in the form of text, audio, images, or any other medium. This paper presents a multimodal content generation (MCG) system that seeks to ease the content production process by providing integrated solutions for video, image, audio and text content production among others. Large language models (LLMs) have shown a great promise in enhancing the creativity process in various fields such as media and education where mediums of communication interweave. The system takes into account the current data, situation, user needs, and composes an appropriate and suitable content for them. At the same time, conventional AI models, such as transformers, are combined with multimodal models enhanced with optimization strategies such as transfer learning and fine-tuning. This strategy greatly augments the content generation potential and scalability of the system and thus, is of great importance in the design of systems for the content production process. The quantum- inspired elements of the hybrid model are the ones targeted towards making changes in decision and feature selection within the creative processes. The effectiveness of MCG in this research was compared to other content creation systems, and the results of the research revealed that MCG is more creative, efficient, and satisfying for the users than the existing systems; therefore, it has a great potential for changing the practices of producing content in a multimedia environment.

Sri Eshwar College of Engineering
Decent work and economic growth
Openalex Percentile: Top 18%
Semantic Web and Ontologies
1.04
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.