Tackling Big Data Challenges in Large Language Models with An Emphasis on Sharing, Security, and Scalability

This paper proposes a novel approach to huge data challenges in large language models (LLMs) that prioritises sharing, security, and scale. Our solution leverages modern encryption algorithms, distributed computing tools, and edge computing principles to secure data and speed up computers. We routinely outperform previous methods in accuracy, precision, memory, and model fitting rates. Our research found that the strategy protects private data, reduces interaction costs, and speeds up model training. Cutting-edge technology allows accurate forecasts and seamless computer operations in many contexts. Ablation studies also demonstrate how our approach's components work together to improve performance. This paper advances AI-driven LLMs by demonstrating a secure, affordable, and scalable method for today's data issues. Future research may concentrate on blockchain and shared learning's larger applications and advancements as data security and computer scale become more important. Our strategy is a huge step towards creating safe and dependable AI systems that can manage today's data-driven situations.

Authors

Institutions

Publication Details

Published
2024-12-13
DOI
https://doi.org/10.1109/ictbig64922.2024.10911841
Primary Topic
Data Quality and Management
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Tackling Big Data Challenges in Large Language Models with An Emphasis on Sharing, Security, and Scalability

B. Eswara Reddy, B Maheshwari, Vikas K. Kolekar, M Chethan et al.
Data Quality and Management
article

Tackling Big Data Challenges in Large Language Models with An Emphasis on Sharing, Security, and Scalability

B. Eswara Reddy, B Maheshwari, Vikas K. Kolekar, M Chethan, Sorabh Sharma, G. Arun Francis
article en

Abstract

This paper proposes a novel approach to huge data challenges in large language models (LLMs) that prioritises sharing, security, and scale. Our solution leverages modern encryption algorithms, distributed computing tools, and edge computing principles to secure data and speed up computers. We routinely outperform previous methods in accuracy, precision, memory, and model fitting rates. Our research found that the strategy protects private data, reduces interaction costs, and speeds up model training. Cutting-edge technology allows accurate forecasts and seamless computer operations in many contexts. Ablation studies also demonstrate how our approach's components work together to improve performance. This paper advances AI-driven LLMs by demonstrating a secure, affordable, and scalable method for today's data issues. Future research may concentrate on blockchain and shared learning's larger applications and advancements as data security and computer scale become more important. Our strategy is a huge step towards creating safe and dependable AI systems that can manage today's data-driven situations.

Jain University (IN), Shri Venkateshwara University (IN), Karpagam Academy of Higher Education (IN), Chitkara University (IN)
Openalex Percentile: Top 66%
Data Quality and Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.