Wireless MapReduce Arrays for Coded Distributed Computing

We study the wireless MapReduce distributed computing system in [5], which operates in three phases: Map, Shuffle, and Reduce. The system consists of a set of distributed nodes assigned to compute arbitrary output functions depending on a file library. The computation of the output functions is decomposed into Map and Reduce functions, and the Shuffle phase, which involves the data exchange, links the two. In our model, the Shuffle phase communication happens over a full-duplex wireless interference channel. For this setting, a coded wireless MapReduce distributed computing scheme exists in the literature, achieving optimal performance under one-shot linear schemes. However, the scheme requires the number of input files to be very large, growing exponentially with the number of nodes. We present schemes that require the number of files to be in the order of the number of nodes and achieve the same performance as the existing scheme. The schemes are obtained by designing a structure called wireless MapReduce array that succinctly represents all three phases in a single array. The wireless MapReduce arrays can also be obtained from the extended placement delivery arrays known for multi-antenna coded caching schemes.

Authors

Publication Details

Published
2024-11-24
DOI
https://doi.org/10.1109/itw61385.2024.10806973
Citations
1
Primary Topic
Cooperative Communication and Network Coding
Type
article
Field-Weighted Citation Impact
0.35
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Wireless MapReduce Arrays for Coded Distributed Computing

Elizabath Peter, B. Sundar Rajan, K. K. Krishnan Namboodiri
1 citations
Cooperative Communication and Network Coding
0.35
article

Wireless MapReduce Arrays for Coded Distributed Computing

Elizabath Peter, B. Sundar Rajan, K. K. Krishnan Namboodiri
article en
1 citations

Abstract

We study the wireless MapReduce distributed computing system in [5], which operates in three phases: Map, Shuffle, and Reduce. The system consists of a set of distributed nodes assigned to compute arbitrary output functions depending on a file library. The computation of the output functions is decomposed into Map and Reduce functions, and the Shuffle phase, which involves the data exchange, links the two. In our model, the Shuffle phase communication happens over a full-duplex wireless interference channel. For this setting, a coded wireless MapReduce distributed computing scheme exists in the literature, achieving optimal performance under one-shot linear schemes. However, the scheme requires the number of input files to be very large, growing exponentially with the number of nodes. We present schemes that require the number of files to be in the order of the number of nodes and achieve the same performance as the existing scheme. The schemes are obtained by designing a structure called wireless MapReduce array that succinctly represents all three phases in a single array. The wireless MapReduce arrays can also be obtained from the extended placement delivery arrays known for multi-antenna coded caching schemes.

Affordable and clean energy
Openalex Percentile: Top 35%
Cooperative Communication and Network Coding
0.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Wireless MapReduce Arrays for Coded Distributed Computing — Elizabath Peter, B. Sundar Rajan, et al. · (2024) | TGRS Research Map | TGRS