Constraining the environment of compact binary mergers with self-lensing signatures

Gravitational waves (GWs) from coalescing binary black holes (BBHs) can come from different environments. GWs interact gravitationally with astrophysical objects, which makes it possible to use gravitational lensing by objects in the same gravitational system (self-lensing) to learn about their environments. We quantify the probability of self-lensing through the optical depth $\ensuremath{\tau}$ for the main channels of detectable GWs at frequencies ${f}_{\mathrm{GW}}\ensuremath{\sim}(1\ensuremath{-}{10}^{3})\text{ }\text{ }\mathrm{Hz}$. We then analyze the detectability of the lensing effect (imprint). In star clusters, the probability of self-lensing by stellar-mass black holes (BHs) is low, $\ensuremath{\tau}\ensuremath{\simeq}{10}^{\ensuremath{-}7}$, even when taking into account nearby BHs in resonant interactions, $\ensuremath{\tau}\ensuremath{\simeq}{10}^{\ensuremath{-}5}$. Additionally, the lensing imprint of a stellar-mass lens (diffraction and interference) is too marginal to be detectable by the LIGO-Virgo-KAGRA detectors and most Einstein Telescope signals. For a massive BH lens in the center of a cluster, the probability can reach $\ensuremath{\tau}\ensuremath{\simeq}{10}^{\ensuremath{-}4}$ either via von Zeipel-Lidov-Kozai induced mergers of BBHs orbiting a central massive BH or BBHs formed as GW captures in single-single interactions in the Bahcall-Wolf cusp of a nuclear cluster. For self-lensing by a supermassive BH for BBHs in the migration trap of an active galactic nucleus (AGN) disk, $\ensuremath{\tau}\ensuremath{\simeq}{10}^{\ensuremath{-}2}$. The imprint of these massive lenses are multiple images that are already detectable. Moreover, self-lensed signals from AGN disks have a distinct linear polarization. The probability depends on the extent of the detectability through the threshold impact parameter ${y}_{\mathrm{max}}$, which can increase for future detectors. We conclude that constraining the environment of BBHs is possible by combining self-lensing imprints with other waveform signatures such as eccentricity and polarization.