Constraining $t \to u$ flavor changing neutral Higgs coupling at the LHC

Abstract

We study the constraints on $t\to u$ flavor changing neutral Higgs (FCNH) coupling, and how it may be explored further at the Large Hadron Collider (LHC). In the general two Higgs doublet model, such transitions can be induced by a nonzero $\rho_{tu}$ Yukawa coupling. We show that such couplings can be constrained by existing searches at the LHC for $m_H$, $m_A$ and, $m_{H^+}$ in the sub-TeV range, where $H$, $A$ and $H^+$ are the exotic $CP$-even, $CP$-odd and charged scalars. We find that a dedicated $ug\to t H/tA \to t t \bar u$ search can probe the available parameter space of $\rho_{tu}$ down to a few percent level for $200\,\mbox{GeV} \lesssim m_H,\,m_A \lesssim 600$ GeV, with discovery possible at high luminosity. Effects of how other extra top Yukawa couplings, such as $\rho_{tc}$ and $\rho_{tt}$, dilute the sensitivity of the $\rho_{tu}$ probe are discussed.