Skip to main content
Log in

Automation of the Individualized Investing Strategy for an Investment Advisor Established by a Semi-Markov Regime-Switching Model

  • Published:
Computational Economics Aims and scope Submit manuscript

Abstract

The purpose is to establish an automated investing strategy which can imitate an advisor’s behaviour in financial market. In view of the above needs, we review previous studies of Markov regime-switching model whose duration is geometrically distributed, propose a semi-Markov regime-switching model whose duration has a general distribution. By extending the state space of the semi-Markov chain, the model is transformed to a Markov regime-switching model. As the full information of the semi-Markov regime-switching model is available in the issue, we propose a divide-and-conquer and computationally tractable algorithm to estimate parameters. Experiments with empirical datasets show that the automated investing strategy based on estimated parameters behaves like the investment advisor. For an investment advisor, the automated investing strategy can help the advisor to avoid boring routines, and evaluate the advisor’s advice thoroughly.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  • Akaike, H. (1974). A new look at statistical-model identification. IEEE Transactions on Automatic Control, 19(6), 716–723.

    Article  Google Scholar 

  • Asmussen, S., Nerman, O., & Olsson, M. (1996). Fitting phase-type distributions via the EM algorithm. Scandinavian Journal of Statistics, 23, 419–441.

    Google Scholar 

  • Bacon, D. W., & Watts, D. G. (1971). Estimating the transition between two intersecting straight lines. Biometrika, 58(3), 525–534.

    Article  Google Scholar 

  • Billio, M., Casarin, R., & Osuntuyi, A. (2018). Markov switching GARCH models for Bayesian hedging on energy futures markets. Energy Economics, 70, 545–562.

    Article  Google Scholar 

  • Burnham, K. P., & Anderson, D. R. (2004). Understanding AIC and BIC in model selection. Sociological Methods & Research, 33(2), 261–304.

    Article  Google Scholar 

  • Chen, Z., & Duan, Q. (2011). New models of trader beliefs and their application for explaining financial bubbles. Economic Modelling, 28(5), 2215–2227.

    Article  Google Scholar 

  • Chen, Z., Hu, Q., & Lin, R. (2016). Performance ratio-based coherent risk measure and its application. Quantitative Finance, 16(5), 681–693.

    Article  Google Scholar 

  • Deutsch, M., Granger, C. W. J., & Terasvirta, T. (1994). The combination of forecasts using changing weights. International Journal of Forecasting, 10(1), 47–57.

    Article  Google Scholar 

  • Dai, M., Zhang, Q., & Zhu, Q. J. (2010). Trend following trading under a regime switching model. SIAM Journal on Financial Mathematics, 1(1), 780–810.

    Article  Google Scholar 

  • Duan, Q., Liu, J., & Zhao, D. (2017). Short term electric load forecasting using an automated system of model choice. Electrical Power and Energy Systems, 91, 92–100.

    Article  Google Scholar 

  • Duan, Q., & Liu, J. (2016). Modelling a bathtub-shaped failure rate by a coxian distribution. IEEE Transactions on Reliability, 65(2), 878–885.

    Article  Google Scholar 

  • Duan, Q., & Liu, J. (2020). Filtering and smoothing formulas of AR(p)-modulated Poisson processes. Communications in Statistics—Simulation and Computation, 49(6), 1575–1591.

    Article  Google Scholar 

  • Duan, Q., & Liu, J. (2019). A fast algorithm for short term electric load forecasting by a hidden semi-markov process. Journal of Statistical Computation and Simulation, 89, 831–843.

    Article  Google Scholar 

  • Elliott, R. J., & Bradrania, R. (2018). Estimating a regime switching pairs trading model. Quantitative Finance, 18(5), 877–883.

    Article  Google Scholar 

  • Elliott, R. J., Siu, T. K., & Lau, J. W. (2018). A hidden Markov regime-switching smooth transition model. Studies in Nonlinear Dynamics and Econometrics, 22(4), 20160061.

    Article  Google Scholar 

  • Elliott, R. J., & Siu, T. K. (2018). A note on regime-switching Kolmogorov’s forward and backward equations using stochastic flows. Journal of Mathematical Analysis and Applications, 460(2), 891–899.

    Article  Google Scholar 

  • Engle, R. F., & Ng, V. K. (1993). Measuring and testing the impact of news on volatility. Journal of Finance, 48(5), 1749–1778.

    Article  Google Scholar 

  • Granger, C. W. J., & Teräsvirta, T. (1993). Modelling non-linear economic relationships. UK: Oxford University Press.

    Google Scholar 

  • Lai, Y., Sheu, H., & Lee, H. (2017). A multivariate markov regime-switching high-frequency-based volatility model for optimal futures hedging. Journal of Futures Markets, 37(11), 1124–1140.

    Article  Google Scholar 

  • Hannan, E. J. (1980). The estimation of the order of an ARMA process. Annals of Statistics, 8(5), 1071–1081.

    Article  Google Scholar 

  • Hurvich, C. M., & Tsai, C. L. (1989). Regression and time-series model selection in small samples. Biometrika, 76(2), 297–307.

    Article  Google Scholar 

  • Li, X. Y., & Mulvey, J. M. (2021). Portfolio optimization under regime switching and transaction costs: Combining neural networks and dynamic programs. INFORMS Journal on Optimization, 3(4), 398–417.

    Article  Google Scholar 

  • Liu, J., & Chen, Z. (2018). Time consistent multi-period robust risk measures and portfolio selection models with regime-switching. European Journal of Operational Research, 268(1), 373–385.

    Article  Google Scholar 

  • Lo, A. W., & Remorov, A. (2017). Stop-loss strategies with serial correlation, regime switching, and transaction costs. Journal of Financial Markets, 34, 1–15.

    Article  Google Scholar 

  • Ma, G., Siu, C. C., Zhu, S. P., & Elliott, R. J. (2020). Optimal portfolio execution problem with stochastic price impact. Automatica, 112, 108739.

    Article  Google Scholar 

  • McShane, B. B., Jensen, S. T., Pack, A. I., & Wyner, A. J. (2013). Statistical learning with time series dependence: An application to scoring sleep in mice. Journal of the American Statistical Association, 108(504), 1147–1162.

    Article  Google Scholar 

  • Meng, X., & Rubin, D. B. (1993). Maximum-likelihood-estimation via the ECM algorithm—A general framework. Biometrika., 80(2), 267–278.

    Article  Google Scholar 

  • Omay, T., & Emirmahmutoǧlu, F. (2017). The comparison of power and optimization algorithms on unit root testing with a smooth transition. Computational Economics, 49(4), 623–651.

    Article  Google Scholar 

  • Pimenta, A., Nametala, C. A. L., Guimaraes, F. G., & Carrano, E. G. (2018). An automated investing method for stock market based on multiobjective genetic programming. Computational Economics, 52(1), 125–144.

    Article  Google Scholar 

  • Shi, Y., Feng, L., & Fu, T. (2020). Markov regime-switching in-mean model with tempered stable distribution. Computational Economics, 55(4), 1275–1299.

    Article  Google Scholar 

  • Siu, C. C., Guo, I., Zhu, S. P., & Elliott, R. J. (2019). Optimal execution with regime switching market resilience. Journal of Economic Dynamics & Control, 101, 17–40.

    Article  Google Scholar 

  • Su, E. (2017). Stock index hedging using a trend and volatility regime-switching model involving hedging cost. International Review of Economics & Finance, 47, 233–254.

    Article  Google Scholar 

  • Tong, H. (2015). Threshold models in time series analysis-some reflections. Journal of Econometrics, 189(2), 485–491.

    Article  Google Scholar 

  • Türkvatan, A., Hayfavi, A., & Omay, T. (2020). A regime-switching model for temperature modeling and applications to weather derivatives pricing. Mathematics and Financial Economics, 14(1), 1–42.

    Article  Google Scholar 

  • Wu, C. (1983). On the convergence properties of the EM algorithm. The Annals of Statistics, 11, 95–103.

    Article  Google Scholar 

  • Zhu, D. M., Xie, Y., Ching, W. K., & Siu, T. K. (2016). Optimal portfolios with maximum value-at-risk constraint under a hidden markovian regime-switching model. Automatica, 74, 194–205.

    Article  Google Scholar 

  • Zhu, D. M., Lu, J. J., Ching, W. K., & Siu, T. K. (2019). Option pricing under a stochastic interest rate and volatility model with hidden Markovian regime-switching. Computational Economics, 53(2), 555–586.

    Article  Google Scholar 

Download references

Funding

This work was supported by the National Natural Science Foundation of China (Grant No. 11991023 & 12271433), Author Liu J.R. has received the funding of teaching and researching program of Northwest University (Grant No. XM05190195), and the fund of Shaanxi province (21BZ023).

Author information

Authors and Affiliations

Authors

Contributions

All authors contributed to the study conception and design. Material preparation, data collection and analysis were performed by QD and JL. The first draft of the manuscript was written by JL and all authors commented on previous versions of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Qihong Duan.

Ethics declarations

Conflict of interest

The authors have no relevant financial or non-financial interests to disclose.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendices

Appendix A: Proof of Theorem 3.1

The proof needs the following Lemma A.1.

Lemma A.1

  1. 1)

    Assume that \(z_k\ne z_{k+1}\). For \(r= (z_{k+1},1)\), we have that \(P\left( Y_{k+1}=r|A\right) =1\). The conditional probability is 0 for any value of \(r\ne (z_{k+1},1)\).

  2. 2)

    Assume that \(m>k\), \(z_k\ne z_{k+1}\) and \(z_m\ne z_{m+1}\). We have that

    $$\begin{aligned} P\left( Y_l,Y_{l+1}|A\right) =P\left( Y_l,Y_{l+1}|Y_{k+1}=r,Z_{k+1}=z_{k+1},\ldots ,Z_{m+1}=z_{m+1},Y_{m+1}=s\right) , \end{aligned}$$

    where \(r=(z_{k+1},1)\) and \(s= (z_{m+1},1)\).

Proof

As \(z_k\ne z_{k+1}\) and \(\mathcal{G}(Y_k)=Z_k\) as well as \(\mathcal{G}(Y_{k+1})=Z_{k+1}\), it follows from the event \(\{ Z_k\ne Z_{k+1}, Z_{k+1}=z_{k+1}\}\) that \(\{\mathcal{G}(Y_k)\ne \mathcal{G}(Y_{k+1})\}\). Note that \(P_{r,s}=0\) when \(\mathcal{G}(r)\ne \mathcal{G}(s)\) and \(\mathcal{H}(s)\ne 1\). Hence if \(z_k\ne z_{k+1}\), \(P(\mathcal{H}(Y_{k+1})= 1|A)=1\). Then 1) follows from \(\mathcal{G}(Y_{k+1})=Z_{k+1}=z_{k+1}\). Now we turn to prove 2). Under the assumptions, similar to the preceding proof, we have that for an event \(B=\{Y_{k+1}=r,,Y_{m+1}=s\}\),

$$\begin{aligned} P(A)=P(A\cap B). \end{aligned}$$

And hence for any \(r',s'\in R_e\),

$$\begin{aligned} P(A\cap \{Y_l=r',Y_{l+1}=s'\}) =P( A\cap B\cap \{Y_l=r',Y_{l+1}=s'\}). \end{aligned}$$

Therefore,

$$\begin{aligned} P(Y_l=r',Y_{l+1}=s'|A) =P( Y_l=r',Y_{l+1}=s'| A\cap B). \end{aligned}$$

And the result follows from the Markovian property of \(\{Y_k,Z_k\}\). \(\square \)

Proof of Theorem 3.1

Let \(\log \mathcal{L}\) be

$$\begin{aligned}{} & {} \sum \limits _{k=1}^{N-1}\sum \limits _{r,s}\log P_{r,s} \cdot P\left( Y_k=r,Y_{k+1}=s|A\right) \\{} & {} \qquad + \sum \limits _{i\in R_g}\lambda _{i}\left( \sum \limits _{j\in R_g}P_{i,j}-1\right) +\sum \limits _{r\in R_e}\lambda _{r}\left( p_r^c+p_r^e+p_r^n-1\right) , \end{aligned}$$

where the last two terms are Lagrange multipliers.

It follows from(6) that for \(i,j \in R_g\) such that \(i\ne j\),, \(\frac{\partial P_{r,s}}{\partial q_{i,j}}=1\) when \(\mathcal{G}(r)=i, \mathcal{G}(s)=j \) and \(\mathcal{H}(s)= 1\). For other cases, we have that \(\frac{\partial P_{r,s}}{\partial q_{i,j}}=0\). Then it follows from

$$\begin{aligned} \frac{\partial \log \mathcal{L}}{\partial q_{i,j}}= \sum \limits _{r,s}\frac{\partial \log \mathcal{L}}{\partial P_{r,s}}\cdot \frac{\partial P_{r,s}}{\partial q_{i,j}}, \end{aligned}$$

(7) and 1) of Lemma A.1 that for \(i\ne j\)

$$\begin{aligned} \frac{\partial \log \mathcal{L}}{\partial q_{i,j}}= \lambda _{i}+\frac{1}{q_{i,j}}\sum \limits _{k=1}^{N-1}1_{z_k=i,z_{k+1}=j}, \end{aligned}$$

and the preceding partial derivative is zero when \(i=j\). For a given \(i\in R_g\), we can solve \(\frac{\partial \log \mathcal{L}}{\partial q_{i,j}}=0\) for all \(j\in R_g\) and obtain \(\hat{q}_{i,j}\) as given in 1).

Similarly, we can prove 2) by using 2) of Lemma A.1. \(\square \)

Appendix B: Estimator \(\hat{p}_r^c,\hat{p}_r^e,\hat{p}_r^n\)

Theorem 3.1 ensures that \(\hat{p}_r^c,\hat{p}_r^e,\hat{p}_r^n\) can be calculated group by group, where in one group, every substate \(r=(i,k)\) has the same i. In the following, we manage to establish the estimator for a group of \(r=(i,k)\), \(k=1,2,\ldots ,K\). Without any loss of generality, write the estimator as \(\hat{p}_k^c,\hat{p}_k^e,\hat{p}_k^n\) for \(r=(i,k)\). From 2) of Theorem 3.1, let \(t_l\) denote \(f_l-s_l\) for the given i and suppose that \(l=1,2,\ldots ,L\).

For the random vector \((T_1, \ldots , T_L)\) corresponding to \((t_1, \ldots , t_L)\), it follow from the Markovian property of \(\{Y_n\}\) that \(T_1, \ldots , T_L\) are independent. In fact, \(T_\cdot \) draws from a discrete coxian distribution (Duan & Liu, 2020) with parameter \(p_m^c,p_m^e,p_m^n\), \(m=1,2,\ldots ,K\). Further, we can study an extended coxian random vector (TI) determined by the sequence \(\{Y_n\}\) such that \(I=1\) when \(Y_{T}=(i,K)\) and \(I=0\) otherwise. That is, I indicates whether the the last state i of time series \(Y_n\), \(n=1,\ldots ,T\) has the substate (iK).

Then using a similar discussion of Appendix A, we can establish the following Theorem.

Theorem B.1

Suppose (SJ), (TI) and (UH) are three extended coxian random vectors. (TI) draws from the distribution with parameter \(p_m^c,p_m^e,p_m^n\), \(m=1,2,\ldots ,K\), (SJ) is with parameter \(p_m^c,p_m^e,p_m^n\), \(m=1,2,\ldots ,k-1\), and (UH) is with parameter \(p_m^c,p_m^e,p_m^n\), \(m=1,2,\ldots ,k\), respectively. And V draws from a geometric distribution with parameter \(p_k^c\). For given \(t_1, \ldots , t_L\), we have that

$$\begin{aligned} \hat{p}_k^n=\frac{p_k^c}{L}\sum \limits _{l=1}^{L}P(S+W+U=t_l,J=0|T=t_l), \end{aligned}$$

and

$$\begin{aligned} \hat{p}_k^n=L\left( \sum \limits _{l=1}^{L}\sum \limits _{j=1}^{t_l-1}\left( p_k^cW_1+p_k^eW_2\right) \right) ^{-1}, \end{aligned}$$

where \(W_1=P(S+U=j,W=t_l-j,J=0|T=t_l)\) and \(W_2=P(S=j,W=t_l-j,J=0|T=t_l).\) Moreover, \(\hat{p}_K^e=1\) and if \(k<K,\)

$$\begin{aligned} \hat{p}_k^e=\frac{p_k^e}{L}\sum \limits _{l=1}^{L}P(S+W=t_l,J=0|T=t_l), \end{aligned}$$

We refer to Appendix of Duan and Liu (2019) the formulae of the probability mass function of a discrete coxian distribution.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liu, J., Chen, Z. & Duan, Q. Automation of the Individualized Investing Strategy for an Investment Advisor Established by a Semi-Markov Regime-Switching Model. Comput Econ (2023). https://doi.org/10.1007/s10614-023-10409-z

Download citation

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10614-023-10409-z

Keywords

Navigation