Skip to main content
Log in

Surprises, sentiments, and the expectations hypothesis of the term structure of interest rates

  • Original Research
  • Published:
Review of Quantitative Finance and Accounting Aims and scope Submit manuscript

Abstract

This study shows that time-varying coefficients in the term structure of interest rates equation are correlated with the time-varying term premiums (TVTP) and expectation error (EE). Consistent with Froot (J Finance 44:283–305, 1989), TVTP and EE are the main factors that cause variations in the expectations hypothesis. Once the TVTP and the EE are appropriately incorporated into the model, the GARCH-M evidence fades away. This study documents that investors’ sentiment and macroeconomic surprises are the main driving forces behind the TVTP and EE. Evidence of significant sentiment and its interacting with macroeconomic surprises shed some light on the bias due to behavioral variations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

Notes

  1. Some researchers prefer to use survey data (Froot 1989; Chiang and Chung 1993) to proxy for expectations, although it could have sample bias or forecasting bias problem.

  2. Bekaert et al. (2001) incorporate a peso problem into their model and find data consistent with the term structure of the US, the UK, and Germany. In a follow-up study of the same markets, Jardet (2008) finds a peso problem in the UK and Germany during the European exchange rate crisis in 1992. However, there is no rejection of the “no peso problem” hypothesis in the US.

  3. Some authors (Lesseig and Stock 1998; Chang, Lin and Yang 2015), however, demonstrate that that stochastic changes in interest rates will have impact on the capital structure of the firm.

  4. Other variables will be stated in due time. However, the full data explanation is given in “Appendix 1”.

  5. Wu and Zhang (1997) provide a procedure to test the unit-root of interest rate series.

  6. Empirical studies are further differentiated from each other by sample sizes/periods, frequency of observations, econometric methods, and continuous time versus discrete time setting, among others. In this study, we focus on the 6-month and 3-month interest rates (US Libor rates and US Treasury bill rates) to avoid the overlapping sample problem.

  7. For the case when the change point is known, one can form regular tests such as F, Wald, LM, or LR in a normal linear regression model. If we are interested in the case where the change point is unknown, we face the problem of testing for structural change with an unknown change point that does not fit into the standard "regular" testing framework. The sup F test statistic for this case is constructed to treat unknown change points as parameters (see Andrews 1993). Because the test statistics do not follow any regular distribution, Bai and Perron (1998) simulated a list of asymptotic critical values and reported them in their Table 1.

  8. This test assesses whether the overall minimum value of the sum of squared residuals in (l + 1) breaks is sufficiently smaller than that in l breaks to evaluate the significance of the marginal contribution by including an additional break.

  9. Engle and Ng (1993) find that adjusting the forward rate for the volatility-related forward premium can improve its performance as a predictor for the future spot rate.

  10. CME Eurodollar futures prices are determined by the market’s forecast of the 3-month USD Libor interest rate expected to prevail on the settlement date.

  11. To simplify the notations, we use \(\alpha_{t} {\text{and }}\beta_{t}\) to denote the intercept and slopes of the right-hand-side variables. In fact, in estimating Eq. (10), the transitional equation of \(\beta_{t}\) will be a vector for \(\{ \beta_{t}^{\left( 3 \right)} , \beta_{t}^{{\theta^{*} }} {\text{and}} \beta_{t}^{{\delta^{*} }} \}\).

  12. It should be noted that the purpose of using the Kalman filter procedure here (in Eqs. 1113) is to trace out the time-varying coefficients, while in Eqs. (6) and (7), or in the Eqs. (12) and (13), the Kalman filter was used to generate the time-varying term premium, \(\theta_{t}\) or \(\theta_{t}^{*}\). By comparing Eqs. (1.3) and (11), it is clear that the constant coefficient model in Eq. (1.3) appears to be a special case of the time-varying coefficient model as represented by Eq. (11), since if we impose: \(\alpha_{1} = \alpha_{2} = \cdots = \alpha_{t - 1 } = \alpha_{t} = \alpha^{\left( 0 \right)}\) and \(\beta_{1} = \beta_{2} = \cdots = \beta_{t - 1} = \beta_{t} = \beta^{\left( 0 \right)}\), Eq. (11) reduces to (1.3), where \(X_{t} = FP_{t + 1,t} \,{\text{and}}\,\theta_{t} = 0,\,{\text{or}}\, \theta_{t}^{*} = \delta_{t + 1}^{ *} = 0.\)

  13. In Figs. 1 and 2, we plot the intercept and slope of the forward premium. The coefficients of the term premium and the expectation error are depicted in Fig. 3. Definitions of the variables are given in “Appendix 1”.

  14. Rational herding occurs when market participants react to information about the behavior of other economic agents or investors rather than the behavior of the market and fundamental factors (Devenow and Welch 1996).

  15. Table 7 in “Appendix 2” provides some supportive evidence.

  16. Data and measurement of sentiment and macroeconomic surprises are described in “Appendix 1”.

  17. Appendix 2” reports the estimates of the economic determinants of time-varying term premium and expectation error. The evidence indicates that market irrationality driven by investors’ sentiment and macroeconomic surprises are important determinants.

  18. In Table 7 of “Appendix 2”, we regress \(\theta_{t}\) on sentiment, expectation error, and related macroeconomic variables, and find statistical significance.

  19. The evidence in Table 7 of “Appendix 2” indicates that \(\theta_{t}\) is significantly and positively correlated with the sentiment and expectation error; however, \(\theta_{t}^{ *}\) is not significantly correlated with these variables.

  20. If we compare the difference in slopes between model 2 and model 3 (\(\beta_{t}^{\left( 3 \right)} - \beta_{t}^{\left( 2 \right)} )\), only the macroeconomic surprises are significant, since both models include the information on the time-varying term premium, as shown in Eqs. (7) and (9), respectively.

  21. We estimated a similar equation by including both sentiment and U_PC in the equation. The estimated results (not reported) suggest that both coefficients are statistically significant. The estimated equation is available upon request.

  22. This is known as the GARCH-M model. We do not report the statistics of the variance equation to save space. However, we will supply them upon request. In general, we impose IGARCH (Franses 1995) in estimations due to the persistence variance resulting from the structural breaks reported in Table 2.

  23. We claim that the GARCH-M term may serve as a proxy for unspecified determinants, such as the term premium or the expectations error. In this sense, the model is consistent with the HJM framework, but with an additional parameter of the d second moment. As a result, the GARCH-M term may capture the term premium or the expectations error that could be one of the reasons for explaining why the GARCH-M term becomes less significant once we have incorporated the term premium or the expectation error into the model.

  24. An exception is Eq. (20)′, where an interacting term of (Sent*U_PC) is used as a regressor. The evidence shows that the GARCH-M term is statistically significant. We believe that this is due to the magnification effect during the crisis period presenting structural breaks. When we rerun the equation excluding the crisis period (drop the sample after mid-2007), the GARCH-M is insignificant.

  25. To deal with the possibility that sentiment proxies may contain rational assessments of the future interest rate, we need to extract the error beliefs in the sentiment variables. After we regress each sentiment variable on a set of rational predictors of the future interest rate, the residuals in the regression tend to be cleaner proxies for the belief errors in investor sentiment. The rational predictors of the future interest rate in the regression we use include: (1) monetary policy (i.e., measured by money growth or the M2 growth rate), (2) the growth rate of the industrial production index, (3) demand for liquidity (i.e., the difference between the 1-year USD swap interest rate and the Treasury yield), (4) term spread (i.e., the difference between the 5-year T-bond rate and the 6-month T-bill rate), and (5) the inflation rate (see Bekaert et al. 2001; Bartolini et al. 2002; Deuskar et al. 2008).

  26. Selection of these macroeconomic variables is motivated by the evidence in a number of research papers (see Bekaert et al. 2001; Bartolini et al. 2002, Benkert 2004; Deuskar et al. 2008; and Kuo and Chen 2011). These variables are measured as follows: the term spread, which is the slope of the yield curve (the difference between the 5-year T-bond rate and the 6-month T-bill rate), the credit spread (the difference between the 3-month U.S. interbank rate and the 3-month overnight indexed swap), the liquidity spread (the difference between the 3-month overnight indexed swap and the 3-month T-bill rate), volatility (the model-free implied volatility extracted from Eurodollar options markets), monetary policy (the M2 growth rate, which is the percentage change in the monthly M2), and the inflation rate (the percentage change in the CPI for each month).

  27. This surprise index, U_PC, constructed from the first principal component, explains 40 % of the total variance.

References

  • Abken PA (1995) Using Eurodollar futures options: gauging the market’s view of interest rate movements. Econ Rev Fed Reserve Bank of Atlanta 80:10–30

    Google Scholar 

  • Andrews DWK (1993) Tests for parameter instability and structural change with unknown change point. Econometrica 61:821–856

    Article  Google Scholar 

  • Backus DK, Wright JH (2007) Cracking the conundrum. Brook Pap Econ Activ 38(1):293–329

    Article  Google Scholar 

  • Bai J, Perron P (1998) Estimating and testing linear models with multiple structural changes. Econometrica 66:47–78

    Article  Google Scholar 

  • Bai J, Perron P (2003) Computation and analysis of multiple structural change models. J Appl Econom 18:1–22

    Article  Google Scholar 

  • Baker M, Wurgler J (2006) Investor sentiment and the cross-section of stock returns. J Finance 61:1645–1680

    Article  Google Scholar 

  • Bartolini L, Bertola G, Prati A (2002) Day-to-day monetary policy and the volatility of the federal funds interest rate. J Money Credit Bank 34:137–159

    Article  Google Scholar 

  • Bekaert G, Hodrick R (2001) Expectation hypothesis tests. J Finance 56:1357–1394

    Article  Google Scholar 

  • Bekaert G, Hodrick R, Marshall DA (2001) Peso problem explanations for term structure anomalies. J Monet Econ 48:241–270

    Article  Google Scholar 

  • Bekdache B (2001) Term premia and the maturity composition of the federal debt: new evidence from the term structure of interest rates. J Forecast 20:519–539

    Article  Google Scholar 

  • Benkert C (2004) Explaining credit default swap premia. J Futures Markets 24:71–92

    Article  Google Scholar 

  • Campbell JY (1995) Some lessons from the yield curve. J Econ Perspect 9(3):129–152

    Article  Google Scholar 

  • Chang CC, Lin J-B, Yang CC (2015) The effect of stochastic interest rates on a firm’s capital structure under a generalized model. Rev Quant Financ Account 45:695–719

    Article  Google Scholar 

  • Chen CYH, Kuo ID, Chiang TC (2014) What explains deviations in the unbiased expectations hypothesis? Market irrationality vs. the peso problem. J Int Financ Mark Inst Money 30:172–190

    Article  Google Scholar 

  • Chiang TC (1988) The forward rate as predictor of the future spot rate: a stochastic coefficient approach. J Money Credit Bank 20:210–232

    Article  Google Scholar 

  • Chiang TC (1997) Time series dynamics of short-term interest rates: evidence from Euro-currency markets. J Int Financ Mark Inst Money 7:201–220

    Article  Google Scholar 

  • Chiang TC, Chung RK (1993) An empirical analysis of the expert expectations hypothesis in the US Treasury bill market. Appl Financ Econ 4:329–334

    Article  Google Scholar 

  • Chiang TC, Kahl D (1991) Forecasting the Treasury bill rate: a time-varying coefficient approach. J Financ Res 14:27–336

    Article  Google Scholar 

  • Cogley T (2005) Changing beliefs and the term structure of interest rates: cross-equation restrictions with drifting parameters. Rev Econ Dynam 8:420–451

    Article  Google Scholar 

  • Curdia V, Woodford M (2011) The central bank balance sheet as an instrument of monetary policy. J Monet Econ 58:54–79

    Article  Google Scholar 

  • Deuskar P, Gupta A, Subrahmanyam MG (2008) The economic determinants of interest rate option smiles. J Bank Finance 32:714–728

    Article  Google Scholar 

  • Devenow A, Welch I (1996) Rational herding in financial economics. Euro Econ Rev 40:603–615

    Article  Google Scholar 

  • Diebold FX, Mariano RS (1995) Comparing predictive accuracy. J Bus Econ Stat 13:253–263

    Google Scholar 

  • Durbin J, Koopman SJ (1997) Monte carlo maximum likelihood estimation for non-Gaussian state space models. Biometrika 84:669–684

    Article  Google Scholar 

  • Ederington LH, Huang CH (1995) Parameter uncertainty and the rational expectations model of the term structure. J Bank Finance 19:207–223

    Article  Google Scholar 

  • Engle RF, Ng VK (1993) Time-varying volatility and the dynamic behavior of the term structure. Part I. J Money Credit Bank 25:336–349

    Article  Google Scholar 

  • Engle RF, Lilien D, Robins RP (1987) Estimating time-varying risk premia in the term structure: the ARCH-M model. Econometrica 55:391–407

    Article  Google Scholar 

  • Evans MDD, Lewis MK (1994) Do stationary risk premia explain it all? Evidence from the term structure. J Monet Econ 33:285–318

    Article  Google Scholar 

  • Fama EF (1984) The information in the term structure. J Financ Econ 13:509–528

    Article  Google Scholar 

  • Fama EF (2006) The behavior of interest rates. Rev Financ Stud 19:359–379

    Article  Google Scholar 

  • Franses PH (1995) IGARCH and variance change in the US long-run interest rate. Appl Econ Lett 2:113–114

    Article  Google Scholar 

  • Froot KA (1989) New hope for the expectation hypothesis of the term structure of interest rates. J Finance 44:283–305

    Article  Google Scholar 

  • Harris RDF (2001) The expectations hypothesis of the term structure and time-varying risk premia: a panel data approach. Oxf B Econ Stat 63:233–245

    Article  Google Scholar 

  • Ho C, Hung CH (2009) Investor sentiment as conditioning information in asset pricing. J Bank Finance 33:892–903

    Article  Google Scholar 

  • Jardet C (2008) Term structure anomalies: term premium or peso-problem? J Int Money Finance 27:592–608

    Article  Google Scholar 

  • Jongen R, Verschoor WFC, Wolff CCP (2011) Time-variation in term premia: international survey-based evidence. J Int Money Finance 30:605–622

    Article  Google Scholar 

  • Kuo ID, Chen YH (2011) Regime dependent information contents of model-free volatility: evidence from the Eurodollar options markets. Rev Fut Mark 19:347–380

    Google Scholar 

  • Lauterbach B (1989) Consumption volatility, production volatility, spot-rate volatility, and the returns on Treasury bills and bonds. J Financ Econ 24:155–179

    Article  Google Scholar 

  • Lee SS (1995) Macroeconomic sources of time-varying risk premia in the term structure of interest rates. J Money Credit Bank 27:549–569

    Article  Google Scholar 

  • Lesseig V, Stock D (1998) The effect of interest rates on the value of corporate assets and the risk premia of corporate debt. Rev Quant Financ Account 11:5–22

    Article  Google Scholar 

  • Lewis KK (1989) Changing beliefs and systematic rational forecast errors with evidence from foreign exchange. Am Econ Rev 79:621–636

    Google Scholar 

  • Lewis KK (1991) Was there a peso problem in the US interest rate term structure: 1979–1982? Int Econ Rev 32:159–173

    Article  Google Scholar 

  • Lewis KK (2008) Peso problem. In: Durlauf SN, Blume LE (eds) The New Palgrave dictionary of economics, 2nd edn. Macmillan, London

    Google Scholar 

  • Liu J, Wu S, Zidek JV (1997) On segmented multivariate regressions. Stat Sinica 7:497–525

    Google Scholar 

  • Lucas RE (1976) Econometric policy evaluation: a critique. In Brunner K, Meltzer AH (eds) The Phillips curve and labor markets. Carnegie-Rochester Conference Series on Public Policy, 1, J Mon Econ Supplementary issue 19–46

  • Mankiw NG, Miron JA (1986) The changing behavior of the term structure of interest rates. Q J Econ 101:211–228

    Article  Google Scholar 

  • Mankiw NG, Summer LH (1984) Do long-term interest rates overreact to short-term interest rates? Brook Pap Econ Activ 1: 223–242

  • Mishkin FS (1982) Monetary policy ad short-term interest rates: an efficient markets-rational expectations approach. J Finance 37:63–72

    Google Scholar 

  • Mishkin FS (1988) The information in the term structure: some further results. J Appl Econom 3:307–314

    Article  Google Scholar 

  • Shiller RJ (1990) The term structure of interest rates. In: Friedman BM, Hahn FH (eds) Handbook of monetary economics, vol 1. North-Holland, Amsterdam, pp 627–722

    Google Scholar 

  • Shiller RJ (2000) Irrational exuberance, 1st edn. Princeton University Press, Princeton

    Google Scholar 

  • Simon DP (1989) Expectations and risk in the Treasury bill market: an instrumental variables approach. J Financ Quant Anal 24:357–365

    Article  Google Scholar 

  • Sims CA (1980) Macroeconomics and reality. Econometrica 48:1–47

    Article  Google Scholar 

  • Sims CA (2003) Implications of rational inattention. J Monet Econ 50:665–690

    Article  Google Scholar 

  • Wolff CCP (1987) Forward foreign exchange rates, expected spot rates, and premia: a signal-extraction approach. J Finance 42:395–406

    Google Scholar 

  • Wu Y, Zhang H (1997) Do interest rate follow unit-root processes? Evidence from cross-maturity Treasury bill yields. Rev Quant Financ Account 8:69–81

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Cathy Yi-Hsuan Chen.

Appendices

Appendix 1: Description of the data and data measurements

1.1 Interest rate data

Quarterly and non-overlapping 3-month Libor rate data are employed in this study. Using 3-month Eurodollar futures rates as the proxy for the market’s expectations for future 3-month interest rates enables us to measure the quantitative expectation error by comparing it with the realized 3-month Libor rate. The forecasting values from Eurodollar futures markets are more appealing because of their timely availability to the public and because they more sensitively reflect investor expectations in reacting to public information. Since trading Eurodollar futures contracts in CME start from 1998, we collect the 3-month Libor rate data ranging from the third quarter of 1998 to the fourth quarter of 2010. For the same sample period, we also use the 3-month and 6-month Treasury constant maturity rates. Those data were downloaded from the FRED economic database, Federal Reserve Bank of St. Louis.

1.2 Determinants

Following Baker and Wurgler (2006) and Ho and Hung (2009), we apply the principal component analysis (PCA) and construct a composite sentiment index comprising (1) the residuals in the bullish consensus for Eurodollar futures (Eurodollar Consensus); (2) the residuals in the net position in Eurodollar futures (CFTC); (3) the residuals in the AAII bearish percentage; and (4) the residuals in the Baker sentiment index.Footnote 25 We define Sent, an investor sentiment index, as the first principal component estimated by the PCA, capturing the common component of the four proxies.

Surprise is more likely to capture information associated with the peso bias and can be chosen as the residual terms from the VAR (Sims 1980) model for macroeconomic variables such as the term spread, the credit spread, the liquidity spread, interest rate market volatility, the money growth rate, and the inflation rate.Footnote 26 All of these variables are directly linked to interest rate movements. In addition, the unobserved regime changes or policy innovations can lead to surprises in macroeconomic fundamentals, subsequently resulting in the expectation error. It’s likely that the surprises extracted from various macroeconomic variables may share some common factors, and in turn, they may correlate with each other; that is, there should be some common factors that drive or produce surprises across macroeconomic variables. Likewise, we employ the PCA method again to construct a composite surprise index comprising these surprises and call it U_PC.Footnote 27 The expectation error, at least during certain sub-periods, might not always be white noise due to the existence of sentiment as well as surprise.

Appendix 2

See Table 7 and Figs. 4, 5.

Table 7 Estimates of the economic determinants of time-varying term premiums and expectation error
Fig. 4
figure 4

The time variations of the term premium, expectation error, and sentiment. Time series plots of time-varying term premiums (\(\theta_{t} \,{\text{and}}\,\theta_{t}^{ *}\)), and expectation error (\(\delta_{t + 1}^{ *}\)), and sentiment index (Sent) are plotted against time. “Appendix 1” contains the illustration of deriving these variables. Structural breaks are in the region between the two vertical lines (2000:03-2002:09 and 2007:09–2009:06)

Fig. 5
figure 5

The time variations of t statistics of time-varying coefficients. The t-statistics of time-varying alpha and beta coefficients are depicted in the upper and lower panels, respectively. Structural breaks are shown in the region between the two vertical lines (2000:03–2002:09 and 2007:09–2009:06). Using iterated extended Kalman filtering and importance sampling method (Durbin and Koopman 1997), we derive the conditional mean and conditional variance matrices of the state vector, as well as the approximated log-likelihood based on the Gaussian approximation to the state space model. The 5 % significance level corresponding to the t-statistic value, 1.96, is used to test the null hypothesis for \(\hat{\alpha }_{t} = 0\) or \(\hat{\beta }_{t} = 1\)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chen, C.YH., Chiang, T.C. Surprises, sentiments, and the expectations hypothesis of the term structure of interest rates. Rev Quant Finan Acc 49, 1–28 (2017). https://doi.org/10.1007/s11156-016-0584-y

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11156-016-0584-y

Keywords

JEL Classification

Navigation