Interpretation of 750 GeV diphoton excess at LHC in singlet extension of color-octet neutrino mass model

We propose that the possible 750 GeVdiphoton excess can be explained in the color-octet neutrino mass model extended with a scalar singlet Φ\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\Phi $$\end{document}. The model generally contains Ns\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$N_s$$\end{document} species of color-octet, electroweak doublet scalars S and Nf\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$N_f$$\end{document} species of color-octet, electroweak triplet χ\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\chi $$\end{document} or singlet ρ\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\rho $$\end{document} fermions. While both scalars and fermions contribute to the production of Φ\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\Phi $$\end{document} through gluon fusion, only the charged members induce the diphoton decay of Φ\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\Phi $$\end{document}. The diphoton rate can be significantly enhanced due to interference between the scalar and fermion loops. We show that the diphoton cross section can be from 3 to 10 fb for O(TeV)\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\mathcal {O}(\mathrm{TeV})$$\end{document} color-octet particles while evading all current LHC limits.


The model
Recently, both ATLAS and CMS have found an excess in the diphoton channel around 750 GeV with a width possibly 45 GeV in the LHC run-II data at √ s = 13 TeV [1,2]. The local significance of the excess is 3.6σ at 747 GeV and 2.6σ at 760 GeV, and the global significance is 2.0σ and 1.2σ for ATLAS [1] and CMS [2], respectively. While CMS previously observed a slight excess ∼ 2σ around 750 GeV at √ s = 8 TeV [3], ATLAS did not go beyond 600 GeV in the same channel [4]. If the excess persists with accumulation of more data in the near future, it will likely point to new physics beyond the standard model (SM). The excess has caused a burst of discussions on its possible origin in various phenomenological frameworks .
On the other hand, there is an established piece of evidence for new physics beyond SM, namely the neutrino mass; and a e-mail: dingran@mail.nankai.edu.cn b e-mail: hanzhilong@mail.nankai.edu.cn c e-mail: liaoy@nankai.edu.cn d e-mail: maxid@mail.nankai.edu.cn dark matter whose gravitational evidence is robust may also originate from new particles and physics that are unknown to us so far. It would be desirable if the newly found excess is related to the same physics of the neutrino mass or dark matter. In this work we try to connect the excess with physics that is responsible for neutrino mass. Since the cross section for the excess is large for such a heavy resonance, it seems natural that the resonance is produced and decays through interactions with some new particles that participate in strong and electromagnetic interactions. In this context the color-octet model of the neutrino mass [162] stands out, in which the octet particles generating radiative neutrino mass would also couple to the resonance field resulting in its strong production and electromagnetic decay.
Since the nature of the resonance, named below, such as parity and spin is completely unknown, we treat it in the simplest manner from the point of view of effective field theory. Assuming it is an electroweak singlet of spin zero, its relevant effective interaction with color-octet scalars is where the octet fields S a r have the same electroweak quantum numbers as the SM Higgs field H with a referring to color and r enumerating N s ≥ 1 such scalars. We note two points in passing. First, the interaction entering radiative neutrino mass is proportional to S a † r H S a † s H while the coupling in Eq. (1) does not contribute. Second, the interaction may originally be a combination of trilinear and quartic terms when the field develops an expectation value. We are aware that a large μ could be potentially dangerous for vacuum stability, but a simple estimation based on the boundedness from below indicates that for TeV-scale octet scalars and appropriate values of scalar couplings, there is no threat on the vacuum stability as long as μ does not far exceed TeV scale. For renormalization-group improved analyses of the issue, see Ref. [163] in the presence of color-octet scalars, Ref. [159] with color-octet scalars coupled to a singlet scalar , and Refs. [160,161] with the singlet being a scalar or pseudoscalar that couples to a vector-like fermion. The octet fermions carry no hypercharge and can be a singlet, ρ a x , or a triplet χ a x , of SU (2) L , where x enumerates N f species of fermions. The Yukawa coupling for radiative neutrino mass is proportional toF LS a r ρ a x orF L χ a xS a r , where F L is the SM left-handed lepton doublet,S = iσ 2 S * , and χ is written in a 2 × 2 matrix form. The relevant Yukawa coupling for our purpose here is simply or For simplicity we will assume a diagonal and universal Yukawa coupling in numerical analysis. The neutral singlet scalar in general mixes with the SM Higgs boson. While the mixing can be made small in a complete theory by arranging, for instance, a relatively small quartic coupling to the SM Higgs field, it must be phenomenologically small in order not to break the constraints established for the SM Higgs boson; see for instance Ref. [159]. We will therefore neglect the mixing in our work.

The diphoton excess and LHC constraints
The rich phenomenology for color-octet particles at LHC has been extensively studied in the literature [164][165][166][167][168][169]. We mention some of it relevant to our study here. The Yukawa couplings of S to quarks (q) must be small to avoid constraints from flavor physics and single production of neutral color-octet scalars at LHC [170][171][172]. Consequently, the effective qq coupling induced by the S loop can be ignored. The direct search for pair production of S in the Zgbb (with g denoting gluon) final state by CMS has excluded m S < 625 GeV at 95 % CL [173], while the CMS search for four jets [174] and ATLAS search for four tops [175] have excluded m S 830 GeV at 95 % CL. Concerning color-octet fermions, the pair production of gluinos has been searched for at LHC in the context of simplified supersymmetric models, with their masses excluded up to 1.1-1.2 TeV at 8 TeV LHC [176,177]. Very recently, the analysis of 13 TeV LHC data has significantly extended the lower mass bound up to 1.6-1.8 TeV [178,179]. Considering these direct search constraints, we will illustrate our numerical result by assuming m χ,ρ = 2 TeV and m S = 1, 1.5 TeV throughout this paper. Currently, there exist a series of observed upper limits related to various decay final states of the singlet , which must be respected in our analysis. To be specific, for m = 750 GeV, the searches for j j, V V , hh, tt, and + − channels at LHC 8 TeV have set the bounds on the cross sections: σ j j < 1.78 pb [180,181], 1 σ hh < 45 fb [182][183][184], σ W W < 60 fb [185], σ Z Z < 12 fb [186], σ Z γ < 6 fb [187], σ tt < 300 fb [188,189], and σ + − < 1.3 fb [190]. Among them, the constraints from the hh, W W , Z Z, and tt channels can be safely ignored due to negligible mixing between the SM Higgs h and . As we will see later, the bounds from the Z γ and dilepton channels can also easily be evaded.
We now consider the diphoton signature at LHC. The excess observed by ATLAS and CMS implies a theoretical diphoton rate roughly in the range σ γ γ ∼ 3-10 fb depending on the narrow or wide width assumption of that was obtained in Refs. [157,158] by taking into account efficiency and acceptance; see for instance, the footnote 1 in Ref. [158]. From the interactions shown in Eqs. (1) and (2) or (3), we obtain the decay widths of to the most relevant channels: for the case of singlet fermions ρ, and  (N f , N s ) = (2, 1), (1, 2) respectively, and the solid (dashed) curve assumes y = 0.2 (0.5) for the case of triplet fermions χ , where N c = 3 is the number of colors and α (α s ) is the QED (QCD) fine structure constant. To reduce the number of parameters we will assume in the numerical analysis that the N s (N f ) species of octet scalars (fermions) are degenerate. The loop functions A 0,1/2 of τ i = m 2 /(4m 2 i ) and of τ i and η i = m 2 Z /(4m 2 i ) are well known, and they can be found, for instance, in Ref. [191,192]. Note that the decay width for the diphoton channel distinguishes between the singlet and triplet cases since the electrically neutral singlet ρ does not enter. In the singlet case, the branching ratio for diphoton may receive considerable enhancement when there is a strong cancellation in the digluon channel between the octet fermions and scalars, which occurs for yμ < 0. In contrast, for the triplet case, the branching ratio for diphoton tends to a constant when the neutral and charged particles are almost degenerate.
In the narrow width approximation, the diphoton cross section from the resonance is estimated as where SM H →gg denotes the digluon decay width of a SM-like Higgs boson H scaled up to m H = 750 GeV, and σ SM (H ) = 735 fb is its production cross section at 13 TeV LHC with NNLO accuracy [193,194]. For SM H →gg , we employed the full one-loop result in Refs. [191,192] with a top quark mass m t = 172 GeV and neglected the bottom quark contribution. The value of σ SM (H ) at 13 TeV was obtained by rescaling its value (156.8 fb) listed in Ref. [193] for a mass of 750 GeV at 8 TeV LHC by the gg parton luminosity ratio (4.69) from 8 TeV to 13 TeV [194]. In our scenario, the constraint in the Z γ channel is trivially fulfilled since the decay width for → Z γ is always smaller than that for → γ γ in both the singlet and the triplet cases. The dilepton decays of are induced at one loop through the trilinear coupling in Eq. (1) and the Yukawa coupling y F LS ρ or y F L χS. The same Yukawa coupling appears also in the anomalous magnetic moments and electromagnetic transitions of the charged leptons, and is thus severely constrained by current experimental bounds. Without requiring a special flavor structure, these bounds impose a universal limit |y | 0.01. This implies that the dilepton decay widths of are generally much smaller than that of diphoton. We therefore only have to consider the dijet constraint from → gg. In our numerical analysis, the upper limit on σ j j at 13 TeV is obtained by rescaling the limits at 8 TeV through their gg parton luminosity ratio, which yields σ j j < 8.35 pb. We will restrict ourselves to the minimal choice that can induce two nonzero neutrino masses, namely, with the numbers of octet species being (N f , N s ) = (2, 1) or (N f , N s ) = (1, 2).
We first investigate the singlet fermion case. In Fig. 1, we plot the diphoton (σ γ γ ) and dijet (σ gg ) cross sections as a function of the trilinear coupling μ for the two minimal choices of the neutrino mass generation. The vertical bands represent the allowed region of μ by the required diphoton  (2, 1), (1, 2), respectively excess and the upper dijet limit, with the blue (pink) band corresponding to the Yukawa coupling y = 0.2 (0.5). In addition, the allowed parameter space in the y-μ plane is presented in Fig. 2. From these two figures, we learn some important features: • The diphoton cross section required by the excess can be reached for O(0.1) Yukawa coupling and O(TeV) trilinear coupling μ. • For μ positive (negative), the main constraint comes from σ gg (σ γ γ ). This arises from the interference effect in the gg channel which is constructive for μ > 0 and destructive for μ < 0 (recalling that y is always assumed to be positive), while the γ γ channel has no such interference as it is contributed only by the octet scalars. • For a smaller Yukawa coupling y = 0.2, μ is allowed to be either positive or negative. On the contrary, for a larger Yukawa coupling, only negative μ survives. This also results from the interference effect, and implies that the Yukawa coupling cannot be too large for a positive μ. • As shown in Fig. 2, the allowed regions for the diphoton excess are not so sensitive to y, because y enters in σ γ γ only indirectly through the gg channel. • The allowed values of |μ| are smaller in the case of (N f , N s ) = (1, 2) than (N f , N s ) = (2, 1), simply because more charged particles contribute to the diphoton process in the former case. • Since the loop functions are more suppressed by heavier octet particles, a larger |μ| is demanded to fulfill the observed diphoton excess.
Now we turn to the triplet fermion case. The crucial difference from the singlet case is that now the charged members of χ also contribute to the diphoton channel. From Eq. (7), one can roughly estimate that BR( → γ γ ) is a constant, since Therefore, to explain the diphoton excess with σ γ γ ∼ 3-10 fb, we just need σ gg ∼ 3-10 pb. The cross sections σ γ γ,gg versus the trilinear coupling μ are presented in Fig. 3, while Fig. 4 shows the allowed parameter space in the y-μ plane. We summarize the properties as follows: • The diphoton excess can also be explained naturally with O(0.1) Yukawa coupling and O(TeV) trilinear coupling μ in the case of triplet fermions χ . • The lower and upper bound on μ comes, respectively, from σ γ γ and σ gg , since BR( → γ γ ) is a constant in this case. This behavior is different from the singlet ρ case. • It is clear that μ < 0 must be satisfied with a bigger y = 0.75 in the case of (N f , N s ) = (2, 1). Meanwhile for the case of (N f , N s ) = (1, 2), μ > 0 is still allowed at y = 0.75. • The simple relation between χ →γ γ and χ →gg implies that the allowed bands in the y-μ plane present a linear correlation. This is clearly shown in Fig. 4. Moreover, a larger m S leads to an increase of the slope, and for the same m S the slope for the (N f , N s ) = (2, 1) scenario is steeper than that of (N f , N s ) = (1, 2).

Conclusion
We have interpreted the 750 GeV diphoton excess in the framework of color-octet neutrino mass model. In addition to a singlet scalar that plays the role of the 750 GeV  Fig. 2, but for the triplet fermion case resonance, the model introduces N s species of color-octet, electroweak doublet scalars S and N f color-octet fermions that can be an electroweak singlet ρ or triplet χ . The diphoton signal results from the production of via gluon fusion through color-octet messengers and its subsequent decay into the diphoton through interactions with charged color-octet particles. We find that for the triplet case BR( → γ γ ) is a constant of about 0.1 %, while for the singlet case BR( → γ γ ) can be varied. With the O(0.1) Yukawa coupling y and the O(TeV) trilinear coupling μ, both cases can explain the diphoton excess naturally without conflict with the current experimental limits. Meanwhile, the interference effect between the scalar and fermion octet particles plays a crucial role. The distinct features and allowed parameter space are discussed in detail for both cases, as well as for the two minimal scenarios of neutrino mass generation with (N f , N s ) = (2, 1) or (1, 2).