Signal detection of M-MIMO-orthogonal time frequency space modulation using hybrid algorithms: ZFE + MMSE and ZFE + MF

• Combines OTFS modulation with massive MIMO (M-MIMO) systems. • Target: Signal detection for M-MIMO-OTFS systems of sizes 8x8, 16x16, 64x64, and 256x256. • Uses two hybrid algorithms: ZFE+MF and ZFE+MMSE. • Enhanced spectral efficiency. • Improved resistance to fading. Orthogonal Time Frequency Space (OTFS) modulation, coupled with Massive Multiple Input Multiple Output (Massive-MIMO) technology, presents a promising avenue for enhancing the efficiency and reliability of fifth-generation (5G) and beyond fifth-generation (B5G) systems. OTFS modulation offers robust communication in high-mobility environments by converting signals into the delay-Doppler domain, ensuring better performance over fading channels. MIMO enhances wireless networks by using large antenna arrays to boost capacity, spectral efficiency, and reliability, making both technologies vital for next-generation radio systems. In this study, we explore the detection of (8 × 8, 16 × 16, 64 × 64, and 256 × 256) Massive-MIMO-OTFS signals utilizing two prominent detection algorithms: zero forcing equalization (ZFE) with matched filter (MF) known as (ZFE+MF) and Zero Forcing with minimum mean square error (MMSE) known as (ZFE+MMSE). The combination of Massive MIMO and OTFS offers improved spectral efficiency, robustness against fading, and enhanced spatial multiplexing capabilities. The parameters such as bit error rate (BER) and power spectral density (PSD) are analyzed and estimated for the proposed hybrid and conventional algorithms. The proposed algorithms obtained the SNR and PSD gain of 3.2 dB, 3.2 dB, 4.8 dB, and 6.1dB gain, respectively, for 8 × 8, 16 × 16, 64 × 54, and 256 × 256 MIMO systems. Further, the PSD gain of -390 is obtained for the 256 × 256 system, resulting in high spectral efficiency.