Skip to main content
Log in

Maximizing the sum of a generalized Rayleigh quotient and another Rayleigh quotient on the unit sphere via semidefinite programming

  • Published:
Journal of Global Optimization Aims and scope Submit manuscript

Abstract

The problem is a type of “sum-of-ratios” fractional programming and is known to be NP-hard. Due to many local maxima, finding the global maximizer is in general difficult. The best attempt so far is a critical point approach based on a necessary optimality condition. The problem therefore has not been completely solved. Our novel idea is to replace the generalized Rayleigh quotient by a parameter \(\mu \) and generate a family of quadratic subproblems \((\hbox {P}_{\mu })'s\) subject to two quadratic constraints. Each \((\hbox {P}_{\mu })\), if the problem dimension \(n\ge 3\), can be solved in polynomial time by incorporating a version of S-lemma; a tight SDP relaxation; and a matrix rank-one decomposition procedure. Then, the difficulty of the problem is largely reduced to become a one-dimensional maximization problem over an interval of parameters \([\underline{\mu },\bar{\mu }]\). We propose a two-stage scheme incorporating the quadratic fit line search algorithm to find \(\mu ^*\) numerically. Computational experiments show that our method solves the problem correctly and efficiently.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2

Similar content being viewed by others

References

  1. Ai, W., Zhang, S.Z.: Strong duality for the CDT subproblem: a necessary and sufficient condition. SIAM J. Optim. 19(4), 1735–1756 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  2. Antoniou, A., Lu, W.S.: Practical Optimization: Algorithms and Engineering Applications. Springer, Berlin (2007)

    MATH  Google Scholar 

  3. Bazaraa, M.S., Sherali, H.D., Shetty, C.M.: Nonliear Programming: Theory and Algorithms, 3rd edn. Wiley, Hoboken (2006)

    Book  MATH  Google Scholar 

  4. Benson, H.P.: Global optimization algorithm for the nonlinear sum of ratios problem. J. Optim. Theor. Appl. 112, 1–29 (2002)

    Article  MathSciNet  MATH  Google Scholar 

  5. Benson, H.P.: Using concave envelopes to globally solve the nonlinear sum of ratios problems. J. Glob. Optim. 22, 343–364 (2002)

    Article  MathSciNet  MATH  Google Scholar 

  6. Benson, H.P.: On the global optimization of sum of linear fractional functions over a convex set. J. Optim. Theory Appl. 121, 19–39 (2004)

    Article  MathSciNet  MATH  Google Scholar 

  7. Ben-Tal, A., Nemirovski, A.: Lectures on Modern Convex Optimization. MPS-SIAM Series on Optimization (2001)

  8. Ben-Tal, A., Teboulle, M.: Hidden convexity in some nonconvex quadratically constrained quadratic programming. Math. Program. 72, 51–63 (1996)

    MathSciNet  MATH  Google Scholar 

  9. Brickman, L.: On the field of values of a matrix. Proc. Am. Math. Soc. 12, 61–66 (1961)

    Article  MathSciNet  MATH  Google Scholar 

  10. Craven, B.D.: Fractional Programming. Sigma Series in Applied Mathematics, vol. 4. Heldermann Verlag, Berlin (1988)

    Google Scholar 

  11. Dundar, M.M., Fung, G., Bi, J., Sandilya, S. Rao, B.: Sparse Fisher discriminant analysis for computer aided detection. In Proceedings of SIAM International Conference on Data Mining (2005)

  12. Eberhard, A., Hadjisavvas, N., Dinh, L.T.: Generalized Convexity, Generalized Monotonicity and Application: Proceedings of the 7th International Symposium On Generalized Convexity and Generalized Monotonicity, Nonconvex Optimization and its Applications, vol. 77. Springer (2005)

  13. Fang, S.C., Gao, D.Y., Sheu, R.L., Xing, W.: Global optimization for a class of fractional programming problems. J. Glob. Optim. 45(3), 337–353 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  14. Freund, R.W., Jarre, F.: Solving the sum-of-ratios problem by an interior-point method. J. Glob. Optim. 19, 83–102 (2001)

    Article  MathSciNet  MATH  Google Scholar 

  15. Fung, E., Ng, M.K.: On sparse Fisher discriminant method for microarray data analysis. Bioinformation 2, 230–234 (2007)

    Article  Google Scholar 

  16. Grant, M., Boyd, S.: CVX: Matlab software for disciplined convex programming, version 1. 21 Web. http://cvxr.com/cvx (2010)

  17. Hsia, Y., Lin, G.X., Sheu, R.L.: A revisit to quadratic programming with one inequality quadratic constraint via matrix pencil. Pac. J. Optim. 10, 461–481 (2014)

    MathSciNet  MATH  Google Scholar 

  18. Konno, H., Fukaishi, K.: A branch and bound algorithm for solving low rank linear multiplicative and fractional programming problems. J. Glob. Optim. 18, 283–299 (2000)

    Article  MathSciNet  MATH  Google Scholar 

  19. Kuno, T.: A branch-and-bound algorithm for maximizing the sum of several linear ratios. J. Glob. Optim. 22, 155–174 (2002)

    Article  MathSciNet  MATH  Google Scholar 

  20. Luenberger, D.G., Ye, Y.: Linear and Nonlinear Programming, 3rd edn. Springer, Berlin (2008)

    MATH  Google Scholar 

  21. Pólik, I., Terlaky, T.: A survey of S-lemma. SIAM Rev. 49(3), 371–418 (2007)

    Article  MathSciNet  MATH  Google Scholar 

  22. Primolevo, G., Simeone, O., Spagnolini, U.: Towards a joint optimization of scheduling and beamforming for MIMO downlink. In: IEEE Ninth International Symposium on Spread Spectrum Techniques and Applications, pp. 493–497 (2006)

  23. Rendl, F., Wolkowicz, H.: A semidefinite framework for trust region subproblems with applications to large scale minimization. Math. Program. 77, 273–299 (1997)

    MathSciNet  MATH  Google Scholar 

  24. Sturm, J.F., Zhang, S.: On cones of nonnegative quadratic functions. Math. Oper. Res. 28, 246–267 (2003)

    Article  MathSciNet  MATH  Google Scholar 

  25. Wolkowicz, H., Saigal, R., Vandenberghe, L. (eds.): Handbook on Semidefinite Programming: Theory, Algorithms and Applications. Kluwer Academic Publishers, Dordrecht (2000)

    MATH  Google Scholar 

  26. Wu, M.C., Zhang, L.S., Wang, Z.X., Christiani, D.C., Lin, X.H.: Sparse linear discriminant analysis for simultaneous testing for the significance of a gene set/pathway and gene selection. Bioinformatics 25, 1145–1151 (2009)

    Article  Google Scholar 

  27. Wu, W.Y., Sheu, R.L., Birbil, I.: Solving the sum-of-ratios problem by a stochastic search algorithm. J. Glob. Optim. 42(1), 91–109 (2008)

    Article  MathSciNet  MATH  Google Scholar 

  28. Ye, Y., Zhang, S.Z.: New results on quadratic minimization. SIAM J. Optim. 14(1), 245–267 (2003)

    Article  MathSciNet  MATH  Google Scholar 

  29. Zhang, L.H.: On optimizing the sum of the Rayleigh quotient and the generalized Rayleigh quotient on the unit sphere. Comput. Optim. Appl. 54, 111–139 (2013)

    Article  MathSciNet  MATH  Google Scholar 

  30. Zhang, L.H.: On a self-consistent-field-like iteration for maximizing the sum of the Rayleigh quotients. J. Comput. Appl. Math. 257, 14–28 (2014)

    Article  MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ruey-Lin Sheu.

Additional information

This research was supported by Ministry of Science and Technology of Taiwan under the Project MOST 103-2115-M-006-014-MY2; by National Natural Science Foundation of China under Grant 11471325, and by Beijing Higher Education Young Elite Teacher Project 29201442.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Nguyen, VB., Sheu, RL. & Xia, Y. Maximizing the sum of a generalized Rayleigh quotient and another Rayleigh quotient on the unit sphere via semidefinite programming. J Glob Optim 64, 399–416 (2016). https://doi.org/10.1007/s10898-015-0315-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10898-015-0315-2

Keywords

Mathematics Subject Classification

Navigation