Sensitivity to triple Higgs couplings via di-Higgs production in the RxSM at the (HL-)LHC and future e+e− colliders

A bstract The real Higgs singlet extension of the Standard Model (SM) without Z 2 symmetry, the RxSM, is the simplest extension of the SM that features a First Order Electroweak Phase Transition (FOEWPT) in the early universe. The FOEWPT is one of the requirements needed for electroweak baryogenesis to explain the baryon asymmetry of the universe (BAU). Thus, the RxSM is a perfect example to study features related to the FOEWPT at current and future collider experiments. The RxSM has two $$ \mathcal{CP} $$ <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:mi>CP</mml:mi> </mml:math> -even Higgs bosons, h and H , with masses m h &lt; m H , where we assume that h corresponds to the Higgs boson discovered at the LHC. Our analysis is based on a benchmark plane that ensures the occurence of a strong FOEWPT, where m H &gt; 2 m h is found. In a first step we analyze the di-Higgs production at the (HL-)LHC, gg → hh , with a focus on the impact of the trilinear Higgs couplings (THCs), λ hhh and λ hhH . The interferences of the resonant H -exchange diagram involving λ hhH and the non-resonant diagrams result in a characteristic peak-dip (or dip-peak) structure in the m hh distribution. We analyze how λ hhH can be accessed, taking into account the experimental smearing and binning. We also demonstrate that the approximation used by ATLAS and CMS for the resonant di-Higgs searches may fail to capture the relevant effects and lead to erroneous results. In a second step we analyze the benchmark plane at a future high-energy e + e − collider with $$ \sqrt{s} $$ <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:msqrt> <mml:mi>s</mml:mi> </mml:msqrt> </mml:math> = 1000 GeV (ILC1000). We analyze the potential sensitivity to λ hhH via an experimental determination at the ILC1000 and demonstrate that it is nearly independent of the heavy Higgs-boson mass, as long as it is kinematically accessible.