Normal forms, invariant manifolds and Lyapunov theorems

: We present an approach to Lyapunov theorems about a center for germs of analytic vector fields based on the Poincar ´ e–Dulac and Birkho ff normal forms. Besides new proofs of three Lyapunov theorems, we prove their generalization: if the Poincar´e–Dulac normal form indicates the existence of a family of periodic solutions, then such a family really exists. We also present new proofs of Weinstein and Moser theorems about lower bounds for the number of families of periodic solutions; here, besides the normal forms, some topological tools are used, i.e., the Poincar´e–Hopf formula and the Lusternik–Schnirelmann category on weighted projective spaces.


Introduction
In his memoir [21], Lyapunov stated several theorems about analytic families of periodic solutions of some analytic autonomous vector fields near equilibrium point.Below, we distinguish three of them.
First, consider an analytic planar vector field with a singular point having a pair of pure imaginary eigenvalues.Thus, we can assume an autonomous differential system of the form ẋ = −ωy + . . ., ẏ = ωx + . . . . (1.1) with real analytic right-hand sides.
Here, one looks for a first integral in the form of a formal power series: In general, such a formal first integral does not exist; one finds Ḟ = c 2k+1 x 2 + y 2 k+1 + . . ., (1.3) where c 2k+1 0 is the so-called Poincaré-Lyapunov focus quantity and we have a weak focus of order 2k − 1 (see Section 2 below).Otherwise, we have the following result attributed to Lyapunov [21, Section 39] and Poincaré [27,Chapter 11].
Theorem 1. (Lyapunov-Poincaré) If all focus quantities vanish, then the formal integral (1.2) is, in fact, analytic, and all solutions near x = y = 0 are periodic.
In [21, Section 40] the latter situation is generalized to the following system: ẋ = Ax + . . ., (1.4) x ∈ (R n , 0) , where the matrix A has a pair λ 1,2 = ±iω of pure imaginary eigenvalues and all of its other eigenvalues lie in the half-plane {Reλ < 0} .Again, one looks for a formal first integral of the form where x 1,2 are the variables associated with λ 1,2 , and there are again obstacles to such an integral occurring.
Theorem 2. (Lyapunov) If all of these obstacles vanish, then the first integral is analytic and system (1.4) has an analytic 1-parameter family of periodic solutions.
The last situation considered in [21, Section 42] * is the case when the matrix A in system (1.4) has the pure imaginary eigenvalues ±iω 1 , . . ., ±iω m , ω j > 0, and one of the frequencies, say, ω 1 , is such that none of the other frequencies is an integer multiple of it; thus, ω j /ω 1 Z, j ≥ 1.
The latter theorem has attracted the attention of specialists in Hamiltonian dynamics.†  Recall that an autonomous analytic Hamiltonian system with m = n 2 degrees of freedom takes the form qj = ∂H ∂p j , ṗj = − ∂H ∂q j , j = 1, . . ., n; (1.7) the corresponding vector field is usually denoted as Assume that it has equilibrium point q = p = 0 with the eigenvalues ±iω 1 , . . ., ±iω m , ω j > 0. Assuming H (0) = 0, the leading part of the Taylor expansion of the Hamiltonian function is where q j , p j are suitable canonical variables, i.e., with the Poisson brackets p i , q j = δ i j , and ϵ j = ±1 are well-defined signs.‡ Schmidt [28] studied 1-parameter families of periodic solutions for such systems with two degrees of freedom in the cases of resonant frequencies ω 1 and ω 2 .His analysis was mainly focused on definite Hamiltonians, i.e., when ϵ 1 = ϵ 2 ; but, he also considered the situation near the Lagrangian libration point in the restricted three-body problem, where the Hamiltonian function is indefinite.He did not refer to the third Lyapunov theorem.Anyway, his results agree with what is presented below.
Weinstein [35] has applied the Lusternik-Schnirelmann category to prove the following.
Next, Moser tried in [23,Theorem 4] to specify Weinstein's result by assuming that H 2 is positive on a linear subspace E associated with one frequency ω, i.e., all solutions in E of the linear system have the period 2π/ω and these are the only such solutions.He claimed that there exists at least 1  2 dimE of periodic solution of the period ≈ 2π/ω of the full Hamiltonian system.But his own example [23, Example 2] contradicts his statement; see also Example 4 below.Note also that the change H −→ −H means the reversion of the time, and it does not influence the periodic property of solutions.
We have the following specification of Theorem 4. Again assume an analytic Hamiltonian system (1.6) with the eigenvalues ±iω j , ω j > 0.
Following [35, Proof of Theorem 2.1] we consider the following equivalence relation on the set {ω 1 , . . ., ω m } of frequencies ω i ∼ ω j iff ω i /ω j ∈ Q. (1.9) For each equivalence class C ν we have a linear subspace E ν that is invariant for the linear part of the system.Choose some equivalence class C 1 and let E 1 be the corresponding linear subspace.Let us order the frequencies from C 1 as follows: (1.10) > . . .> ωr := ω k 1 +...+k r−1 +1 = . . .= ω k 1 +...+k r .‡ We have ḟ = { f, H} in the case of a general Hamiltonian system with the symplectic structure defined by a Poisson bracket.In particular, for z j = q j +ip j and v j = q j −ip j , we have z j , z k = v j , v k = 0 and z j , v k = 2iδ jk .Thus żj = z j , v k ∂H/∂v k = 2i•∂H/∂v k .Also, the resonant monomials g = z k v l that form the Birkhoff theorem satisfy {g, H 2 } = 0.In the case of (1.8) the corresponding linear system is diagonalizable in the complex variables.The non-diagonalizable case is somewhat special and we consider it only in Example 7 in Section 5.
(1.8), then there exists a sequence {γ n (t)} of periodic solutions to the equation ẋ = X H (x) of non-constant periodic solutions tending to γ (t) ≡ 0 of periods tending to 2π/ ωl .
We see that the first assumption is like in the third Lyapunov theorem.But, the assumption (ii) is new; it replaces the definiteness assumption of H 2 from Theorems 4 and 5.
Finally, we recall the following non-Hamiltonian version of the third Lyapunov theorem due to Moser [23,Theorem 2].Theorem 7. (Moser) Assume that an analytic system (1.4) with only purely imaginary eigenvalues has an analytic first integral F (x) such that D 2 F (0) is positive definite.Then, this system has at least one 1-parameter family of periodic solutions.
The aim of this paper is to take a somehow different look at this center problem.Our approach is rather qualitative and less topological, like in [1] and [18].It turns out that much can be deduced from the Poincaré-Dulac normal form and its Hamiltonian version, i.e., the Birkhoff normal form (Schmidt also used the Birkhoff normal form).Important is the use of some versions of the standard Poincaré return map combined with the analyticity assumption of the vector fields.We will reprove most of above theorems and we shall prove a new result.
Assume that the matrix A in system (1.4) has pure imaginary eigenvalues: ±iω 1 , . . ., ±iω m , ω j > 0. We can reduce it, via a formal change of variables, to the Poincaré-Dulac normal form (see Theorem 9 in the next section).It may happen that the latter formal system admits a formal 1-parameter family of periodic solutions with the period ≈ 2π/ω l .
More precisely, one can consider the situation with only one equivalence class for the frequencies, i.e., ω j /ω k = p j /p k , with relatively prime positive integers p i , and that ω 1 ≥ . . .≥ ω l .Let Z j be the formal complex variables associated with the Poincaré-Dulac normal form.For the new variables R ∈ R, W j ∈ C and Θ ∈ S 1 , defined by Z l = Re iΘ and Z j = W j e ip j Θ/p l , one obtains a formal differential system: (called the return system).The analogue of the center conditions in this case means that the latter system has a formal curve Γ of non-isolated equilibrium points.All of these notions are made precise in Section 7 (Eqs.(7.1)-( 7.3), Lemma 3 and Definition 4).
The next statement can be regarded as a fourth Lyapunov theorem.
Theorem 8.In this case, there exists a continuous family of periodic solutions to system (1.4) with the period ≈ 2π/ω l .
The paper is organized as follows.In Section 2, we define the Poincaré-Dulac and Birkhoff normal forms, with their principal properties.In Section 3, we present and discuss theorems about invariant manifolds.Section 4 is devoted to various proofs of the three Lyapunov theorems; they are included in this paper (which is treated as a sort of review) because some of the Lyapunov theorems are not widely known, and because their proofs are (we hope) illuminating.In Section 5, we present some examples of Hamiltonian systems with explicit families of periodic solutions.In Section 6,we prove the existence of some additional invariant submanifolds following from the normal forms.In Section 7, we prove Theorem 8. Section 8 is devoted to the discussion of situations with a first integral; there, we give proofs of Theorems 4, 5, 7 and an introduction to the functional analytic method.In Section 9, we present our approach, based only on the Birkhoff normal form, of two examples from the celestial mechanics: geostationary orbits of satellites and libration points in the restricted four-body problem.The last section contains appendices about the topology of weighted projective spaces and the Lusternik-Schnirelmann category.

Poincaré-Dulac and Birkhoff normal forms
Consider the analytic system (1.4), but in (C n , 0) (not in (R n , 0) .Thus, we can assume that the matrix A is in the Jordan form with eigenvalues λ 1 , . . ., λ n .Definition 1.We say that the latter system of eigenvalues satisfies the resonant relation of type Theorem 9. (Poincaré-Dulac [13,27]) There exists a change x → X, defined by formal power series, which transforms system (1.4) to the following Poincaré-Dulac normal form: where the summation runs over multi-indices k such that the resonant relations of type ( j; k) hold and The proof can be found in [3,17,37].
Remark 1.In the case when there are multiple eigenvalues λ j and the corresponding Jordan cell is not diagonal,we have the resonant relations ( j; k), where k = (0, . . ., 0, 1, 0, . . .0) with 1 in the ( j + 1) th entry.They imply non-diagonal entries in A.
Remark 2. In the so-called Poincaré domain, i.e., when the convex hull of the set {λ 1 , . . ., λ n } ⊂ C is separated from 0 ∈ C, the Poincaré-Dulac normal form is polynomial and the normalizing change is analytic.We refer the reader to [30] for a short proof.
Remark 3. In the general, situation the Poincaré-Dulac normal form is divergent.Indeed, in the example due to Euler (see [37]), the Poincaré-Dulac normal form is the so-called center manifold W c , corresponding to the zero eigenvalue and formally defined by X 2 = 0, in the original system (2.3) takes the form Consider now an autonomous analytic Hamiltonian system (1.7) with m = n 2 degrees of freedom near an equilibrium point q = p = 0 with the eigenvalues ±iω 1 , . . ., ±iω m , ω j > 0. Assuming H (0) = 0, the leading part of the Taylor expansion of the Hamiltonian function is like in Eq. (1.8), i.e., H 2 = 1 2 ϵ j ω j q 2 j + p 2 j , where q j , p j are suitable canonical variables, i.e., with the Poisson brackets p i , q j = δ i j , and ϵ j = ±1 are well-defined signs.
It is natural to introduce the complex variables with the Poisson brackets z j , v k = 2iδ jk .Then, we have and żj = λ j z j + . . ., vj = −λ j v j + . . ., λ j = −iϵ j ω j . (2.6) Of course, in the real domain (where p j and q k are real), we have v j = zj .
The following result from [8] is a Hamiltonian analogue of the Poincaré-Dulac theorem.
Theorem 10. (Birkhoff) There exists a formal canonical change (z, v) −→ (Z, V) which reduces the Hamiltonian function to the following one: where summation runs over the pairs hold and |k| + |l| ≥ 3.
The principal result about invariant manifolds is the Hadamard-Perron theorem for hyperbolic singular points.These manifolds are the local stable manifold (of dimension p) and the local unstable manifold (of dimension q = n − p) where g t is the phase flow generated by the vector field (1.4); g t (x 0 ) is the solution x (t) obeying the initial condition x (0) = x 0 .In the case of a finitely smooth vector field,the proof of the Hadamard-Perron theorem is rather involved.But, in the analytic case, it is quite easy.
Theorem 11. (Holomorphic Hadamard-Perron) Assume that the vector field (1.4) is analytic.Assume also that the set {λ 1 , . . ., λ n } ⊂ C of eigenvalues of the matrix A can be separated by a straight line ℓ through λ = 0 into two groups: λ 1 , . . ., λ p on one side of ℓ and λ p+1 , . . ., λ n on the other side.Then, there exist local analytic invariant manifolds for (1.4) tangent to the corresponding linear subspaces invariant for A. It follows that, if the singular point x = 0 is hyperbolic, then the invariant manifolds W s and W u are real analytic.
Proof.We present a rather novel proof, following a method from [30].Another proof can be found in [17]; note also that, in the case n = 2 and p = 1, this result was proved by Briot and Bouquet [9] (see also [37]).
Let E s ≃ C p and E u ≃ C q be the linear subspaces associated with the division of the eigenvalues set, and let (x, y) be the coordinates associated with the splitting C n = E s ⊕ E u .We can assume that the matrix A has the form A s ⊕ A u , where A s = diag µ 1 , . . ., µ p + A s 1 and A u = diag ν 1 , . . ., ν q + A u 1 , where A s,u 1 are off-diagonal with small entries.We have We look for the manifold W s as a graph of a map F : E s −→ E u , W s = {(x, F (x))} ; the case of W u is treated analogously.The invariance condition, i.e., ẏ − DF • ẋ| y=F(x) ≡ 0, leads to the equation This equation takes the form LF = T (F) , where L and T are operators, linear and nonlinear.We treat these operators as acting on the Banach space F consisting of power series F = j,k f j,k x k e j with the norm where ρ is the 'radius of convergence' (suitably chosen).We have L = L 0 + L 1 , where and L 1 is small with respect to L 0 .Because ν j and µ i are separated by the line ℓ, the operator L is invertible.Moreover, if is Lipschitz-continuous with a small Lipschitz constant.Therefore, the fixed-point problem F = P (F) has a unique solution.□ Assume now the non-hyperbolic situation.Thus, we have the splittings , where the eigenvalues of A s (respectively, A u ) lie in the left (respectively, right) halfplane and the eigenvalues of A c lie on the imaginary axis.The next theorem is usually cited without proof (which is quite technical, see [3,17]).
Theorem 12. (Center Manifold) There exist smooth invariant manifolds W s , W u and W c tangent to the subspaces E s , E u and E c , respectively.The manifolds W s and W u are analytic; W c is only infinitely smooth in general, but its Taylor series is defined uniquely.
Remark 4. The Euler example from Remark 3 demonstrates that the center manifold can be nonanalytic.If W c = {y = F(x)}, then the analogue of Eq. (3.4) is where L = Id.Here L, although invertible, is not dominating in comparison to x 2 d dx ; we have x 2 d dx x k / x k = kρ.
In [17] and [37], one can find an explanation of the non-analyticity of W c in terms of the so-called Stokes phenomena.
Next, the center manifold can be non-unique.Indeed, the real Euler example is the so-called saddlenode singularity; on the left from the unstable manifold W u = {x = 0}, we have two hyperbolic sectors separated by the left part of W c (which is unique), but, on the right of W u , we have a parabolic sector, and any of its phase curves can serve as the right part of W c .This non-uniqueness is explained by the method of the proof of the existence of W c ; there, one extends the vector field to the whole R n and W c (which is a fixed point of some functional operator) depends on this extension.
Below, we present other examples with non-analytic invariant manifolds.
Example 1.Let z = x 1 + ix 2 , v = x 1 − ix 2 and y be coordinates in C 3 .The system is as follows: One finds that The non-analyticity of the center manifold is explained via the nonlinear Stokes phenomena as follows.In the variables u = zv and y, we have u = 2u 2 , ẏ = −y + u, i.e., a saddle-node similar to the Euler example.
In a sectorial domain around {(u, y) : Im (u) = 0, Re (u) > 0}, the phase portrait near the saddle, with a unique center manifold and unique stable manifold; but, in a sectorial domain near {(u, y) : Im (u) = 0, Re (u) < 0}, the phase portrait is like near the node with many center-ype manifolds.
The system is as follows: It has two invariant planes: (analytic) and which is non-analytic.
We finish this section with another theorem about invariant manifolds.
Definition 3. Let f be a smooth diffeomorphism of a manifold M, and let L ⊂ M be a smooth invariant submanifold for f, f (L) ⊂ L. We say that f is normally hyperbolic at N if there is a splitting of the normal bundle to L into sub-bundles E s and E u that are invariant with respect to D f and the following estimates hold: -the bundle E s is contracted more strongly than the bundle T L, i.e., sup -the bundle E u is expanded more strongly than the bundle T L, i.e., inf We refer the reader to [16] for the proof of the following statement.
Theorem 13. (Normal Hyperbolicity) If f is normally hyperbolic on L, then there exists a neighborhood U of f in the functional space of C 1 -diffeomorphisms such that any g ∈ U has a unique invariant submanifold L g close to L at which it is normally hyperbolic.The Poincaré-Dulac normal form here is as follows: It is easy to find that the first nonzero coefficient a k is related to the first nonzero Poincaré-Lyapunov quantity: Next, after passing to the polar coordinates r, θ (in the real domain), i.e., with z = re iθ and v = z = re −iθ , we get the equation where f is a convergent series in powers of r with trigonometric polynomials in θ as coefficients.We define the Poincaré return map where ϕ (θ; r 0 ) is the solution to the latter equation dr/dθ with the initial condition ϕ (0; r 0 ) = r 0 .The Poincaré map is analytic and has a Taylor expansion of the form where provided the Poincaré-Lyapunov quantity c 2k+1 0.
The assumption of Theorem 1 means formally that either (i) the Poincaré-Dulac normal form equals where M = ω + b k (ZV) k is a formal integrating factor and F = ZV is the formal first integral; or (equivalently), (ii) formally, Moreover, the assumptions of the holomorphic Hadamard-Perron theorem for system (4.1) are satisfied.Therefore, we have two holomorphic invariant lines, W + and W − , formally defined by {V = 0} and {W = 0}, respectively.
Below, we present two geometrical proofs of Theorem 1.
First proof.(Note that this proof was not found in the literature).Since the Poincaré map is analytic and formally obeys Eq. (4.7), it is the identity.Therefore, the real phase portrait is of the center type and the equilibrium point is surrounded by a family of closed phase curves.Moreover, we have a first integral G (r, θ) defined via the initial condition G (r, θ) = r 2 0 if r = ϕ (θ; r 0 ) .But, this function is not correct because its value for negative r's should be compatible with the 'square root' of the Poincaré map Q : (R, 0) −→ (R, 0) , Q(r 0 ) = −r 0 + . .., such that P = Q • Q on (R + , 0) .But, we can take a function defined initially on (R + , 0) as G (r 0 ) = 1 2 r 2 0 + Q 2 (r 0 ) .Thus, . This first integral is holomorphic near the circle {r = 0, 0 ≤ θ ≤ 2π} ⊂ C × R, where R is a ring around the circle R/2πZ ⊂ C/2πZ.
In fact, we can extend it to a holomorphic first integral in Z, V.For this, one first defines it as , where Q is the extension of the square root of the return map.Outside of the disc Σ, this function is defined by the condition of being constant on the complex phase curves (Riemann surfaces).In particular, it is single-valued (see the second proof) and equals zero on the complex separatrices of the singular point.□ Second proof (due to Moussu [24]).Using the holomorphic Hadamard-Perron theorem, we can assume that the coordinate lines are invariant, i.e., Then, the phase curves outside of W − = {z = 0} are graphs of functions, where z 0 0 is fixed.The analytic continuation of solutions φ along the circle z = e iα z 0 : 0 ≤ α ≤ 2π defines the monodromy map M : This map is holomorphic and we have The center conditions from Theorem 1 mean that M = Id.Now, we can define a first integral F (z, v) by putting on D and continuing it analytically as constant on the phase curves.Because the monodromy is trivial, the function F is single-valued outside of the line {z = 0}.It is also bounded there.Hence, it is holomorphic.
The function F has a Morsean critical point at z = v = 0.By the Morse lemma [37], there exist The vector field is parallel to the analytic Hamiltonian vector field , it equals Φ • X F , where Φ = iω + . . . is an analytic function (the orbital factor).
Finally, one can reduce Φ to an analytic function of one variable: Φ (Z, V) = iM (ZV) ; we refer the reader to [30] for the proof.□ Final remark.The integrating factor M from Eq. (4.6) is also analytic.If it is constant, then the center is isochronous and the period does not depend on the periodic solution.

Second Lyapunov theorem
Recall that the spectrum of the linear part consists of λ 1,2 = ±iω and of µ 1 , . . ., µ m (m ≥ 1) in the left half-plane.Therefore, the resonant relations from Definition 1 are as follows: In the Poincaré-Dulac normal form, we have and the corresponding equation for V.Moreover, We see that the variables Z, V are formally separated from Y j and the center condition from Theorem 2 reads as a p = 0, p = 1, 2, . . . .Moreover, we have the stable invariant manifold W s = {Z = V = 0} (which is analytic) and a formal center manifold W c = {Y = 0} , about its analytic properties we cannot judge at this moment (see Example 1 above).But, the eigenvalue λ 1 = iω is separated from the remaining eigenvalues µ 1 , . . ., µ m , λ 2 by a line in C through 0, and, analogously, λ 2 is separated from the other eigenvalues.By the analytic Hadamard-Perron theorem, we have analytic invariant hypersurfaces: W + corresponding to λ 2 , µ 1 , . . ., µ m and W − corresponding to λ 1 , µ 1 , . . ., µ m ; of course, W s = W + ∩ W − .We also have two invariant lines L + and L − corresponding to the eigenvalues λ 1 and λ 2 , respectively; W c is 'spanned' by L + and L − .
We are ready to present the following: Proof of Theorem 2. We would like to follow the second proof of Theorem 1.Thus, we can assume the following analytic system: The phase curves outside of W + are graphs of functions of z.
Let us choose a hypersurface of initial conditions with the form The solutions to the equations for dv dz and for dy dz with the initial conditions v (z 0 ) = v 0 and y (z 0 ) = y 0 are of the form We also have the monodromy map M : Σ −→ Σ: In contrast to the Poincaré-Lyapunov case, this map is far from the identity.It has the form where the spectrum of the matrix B lies in the open unit disc; B is a strong contraction.Therefore, we need an additional argument.
On the one hand, we can use the normal hyperbolicity theorem, which ensures the existence of a 2−dimensional invariant manifold V c = V c z 0 , which is the center manifold for M. For this, we treat M as a perturbation of the monodromy map M 0 associated with a polynomial truncation of the Poincaré-Dulac normal form (when V c = {y = 0} .The manifold V c is unique.
Let us construct the first integral F, beginning with its definition F 0 = F| Σ on Σ.This function should have the property then, we will use the analytic continuation.Let ∂Σ = {z 0 } × {|v| < ε} × {|y| = ε} (point×disc×sphere).We put We define the following family of maps h α : Σ −→ Σ, α ≥ 0 : Since φ e iα z 0 ; v; y ≈ e −iα , the maps h α do not change much for v. But, they are contractions when acting on y.Moreover, This defines a correct analytic function on Σ⧹V c , which is extended to an analytic function on Σ. Next, the latter function F 0 is extended to a neighborhood of the singular point, i.e., we get the first integral with the critical locus along the stable manifold W s = {z = v = 0}.This follows from the center conditions.By the parametric Morse lemma [37], there exist analytic coordinates Z = z + . . ., V = v + . . ., Y = y + . . .such that F = ZV.
From the center conditions, it also follows that (i) The corresponding family depends analytically on the parameters c, d (defined by the initial conditions).In the real domain, we have the family z (t) = re it + . . ., z (t) = re −it + . . ., y (t) = . . ., with the real parameter r; this is the convergent family from [21].□ Remark 5. We see that the existence of an analytic family of periodic solutions, under the assumptions of Theorem 2 (and also of Theorem 3), implies the uniqueness and analyticity of the center manifold where M is a real series and Ω is polynomial in Y (with series in VZ as coefficients), is analytic.Finally, note that, in Example 1, the formal center manifold does not support a family of periodic solutions; formally, it has an unstable focus.
Let us describe the Poincaré-Dulac (P-D) normal form for such systems.Assume first that the frequencies ω j are independent over Q.Then, the only resonant relations are It follows that the P-D normal form is ) If there are relations, like then the P-D normal form will contain additional monomial terms, like (and some other in the case of (4.13)).Anyway, the sublattice (in Z m ) of relations (k, ω) = 0 is finitely generated and the P-D normal form has finitely many series (formal functional moduli) depending on finitely many monomials.
Assume now that the frequency ω 1 is such that no other frequency ω j is a multiple of it: (4.14) Lemma 1.Under the which assumption, the P-D normal form is such that the equations In this case, the P-D normal form restricted to W 1 is like in Eq. (4.2) with the center conditions a k = 0, k = 1, 2, . . . .

Proof.
The obstacles to the existence of such an invariant surface are implied by the following terms: They correspond to the resonant relations By condition (4.14), there are no such relations.□ Below we give two proofs of Theorem 3. Let us being with Lyapunov's argument.For this, the following standard is needed.

Lemma 2. Consider the linear equation
where a (θ) is a periodic function with period 2π.If λ is not an integer multiple of i = √ −1, then this equation has a unique periodic solution with the period 2π defined by Proof.The solutions of the initial value problem with the initial conditions x (0) = x 0 are affine in x 0 .After the period of 2π, these solutions define the monodromy map x 0 −→ M (x 0 ), which is also affine: where Λ = e 2πλ .By the assumption, Λ 1.Hence, the map M has a unique fixed point corresponding to a unique 2π−periodic solution.
If Re (λ) < 0, then this solution is as follows: After partition of the integration domain (−∞, θ] into segments of length 2π, we get Eq.(4.15), which is valid for all λ ∈ C⧹2πZ.□ Lyapunov's proof of Theorem 3. Let z 1 = re iθ and v 1 = z1 = re −iθ , where r, θ are polar coordinates.The phase curves of our system are defined by the equations ) j = 2, 3, . . ., where z = (z 2 , . . ., z m ) , ṽ = (v 2 , . . ., v m ) and ′ = d/dθ.We can assume that f begins with quadratic terms in r, z, ṽ.For simplicity, assume that the linearization matrix of the complex system is diagonal; the triangular case requires only slight modification of the proof.Thus, also g j and h j begin with quadratic terms.We look for 2π−periodic solutions to system (4.16) as power series with periodic coefficients: We set the following initial conditions: thus, we have that r (0) = c and ϕ (1) (θ) ≡ 1 (which is 2π−periodic).Substituting the Ansatz (4.17) into system (4.18),we obtain a recurrent system of equations for ϕ (k) , ψ (k) and χ (k) .We have where the functions Φ (k) (θ) are defined inductively and should be 2π−periodic.Thus, where 2π 0 Φ (k) (α) dα should equal zero.The latter vanishing conditions are guaranteed by the assumptions of the theorem, i.e., the center conditions.
The equations for ψ (k) j take the following form: where λ j = iω j /ω 1 and Ψ (k) j (θ) are defined inductively and are 2π−periodic; analogous equations hold for χ (k)  j , but with λ j replaced with −λ j .The latter equations dψ (k) j /dθ are like the equation from Lemma 2 with λ = λ j iZ.So, they have unique 2π−periodic solutions defined in Eq. (4.15); no center conditions are needed here.
The series in Eq. (4.17) is convergent due to the analyticity of the right-hand sides of the equations of Eq. (4.16), the compactness of the domain [0, 2π] of definition of this system and the simplicity of the integral formulas (4.15) and (4.19).In [21], suitable estimates are given.□ Second proof of Theorem 3. Recall that we have the formal invariant surface W 1 , defined in Lemma 2. We will show that it is analytic.
For this, we use the Poincaré return map P defined by solutions after the period of 2π of system (4.16).We have where ρ = ρ (r, z 2 , . . ., z m ) = r + . . ., ζ j = ζ j (r, z 2 , . . ., z m ) = µ j z j + . . ., µ j = e 2πiω j /ω 1 1.The periodic orbits of the period ≈ 2π/ω 1 correspond to the fixed points of the Poincaré map.The set of fixed points of P lies in the curve where ζ j − z j = µ j z j + . . .with µ j 0. By the implicit function theorem, Eq. (4.21) defines a real analytic curve.
By the center conditions, this curve is P-invariant and defines an analytic smooth surface supporting a family of periodic solutions.□ The following example demonstrates the importance of the condition (4.14).
Example 3. The system has a general solution with the form Only the solutions with c 1 = d 1 = 0 are periodic, with a period of π (not 2π).
Remark 6.(a) We see that the existence of a 1-parameter family of periodic solutions can be deduced from the P-D normal form.We need the following: (i) formal invariant surface, and (ii) vanishing of the series of Poincaré-Lyapunov coefficients after restriction of the P-D normal form to this surface.
The following questions arise naturally in this context.1. Are there other 1-parameter families of periodic solutions?2. Are there many-parameter families of periodic solutions?Concerning the first question, there should exist other formal invariant surfaces with vanishing corresponding Poincaré-Lyapunov quantities.
The answer to the second question can be positive in some resonant cases.For example, this holds for the following system: with the integer p j and the integrating factor M = ω + . ... Here, the typical solution is periodic with the period 2π pω (1 + . ..) , where p = gcd (p 1 , . . ., p m ) .But, when where the factors M j = ω + . . .are independent, then the motions take place on the invariant 'tori' In the real domain, where v j = zj , the motion on the generic torus is quasi-periodic, or periodic with a very long period.
(b) Note that, in the case considered in this subsection, the system has two analytic invariant manifolds, W + and W − , corresponding to the partition of the eigenvalues' set into two subsets {iω 1 , . . ., iω m } and {−iω 1 , . . ., −iω m } .The system restricted to either of these submanifolds has analytic P-D normal form (the systems are in the Poincaré domain).

Hamiltonian examples
Here, we discuss Theorem 3 (as well as the Weinstein-and Moser-type theorems) in the context of Hamiltonian systems.Again, we assume the imaginary eigenvalues ±iω 1 , . . ., ±iω m , ω j > 0, where m = n 2 is the number of degrees of freedom.The Hamiltonian functions considered in this section are of the form where H 2 is like in Eq. (2.5) and the functions H j are homogeneous of degree j.Such an H 2 is obvious in the case that all frequencies ω j are pairwise different.The opposite case is discussed below.Recall that, in the third Lyapunov theorem, there are two assumptions: the existence of a formal invariant surface W 1 associated with the eigenvalues ±iω 1 , and the vanishing of the series of the Poincaré-Lyapunov focus quantities after restriction of the system to W 1 (see Remark 6 above).But, in the Hamiltonian case, the situation is simpler.Proposition 1.If there exists a formal invariant surface W 1 , then all of the focus quantities for the restriction of the system to W 1 vanish.
Proof.Indeed, H restricted to W 1 is a formal first integral for the restricted system.So, in the real domain, all phase curves of that system are closed.□ People have tried to improve the third Lyapunov theorem in the Hamiltonian case.Recall that Weinstein ( [35, Theorem 2.1] and Theorem 4 above) proved that, if H 2 is positive definite, i.e., all ϵ j = 1, then there exist at least m = n 2 families of periodic solutions.Moreover, Moser, in [23,Theorem 4], claimed that, if H 2 restricted to the maximal linear invariant subspace E supporting periodic solutions of period T = 2π/ω of the linearized system is positive definite, then 'on each energy surface H = ε 2 , the number of periodic orbits is at least 1 2 dimE'.Recall that that result is wrong, but that some version of Moser's statement is valid provided that H 2 is positive definite (Theorem 5).
Of course, the number m from the Weinstein theorem cannot be improved because the Hamiltonian system żj = iω j z j • M j z j 2 , j = 1, . . ., m, with different factors M j , has m families of periodic solutions with independently varying periods T j = T j z j 2 ≈ 2π/ω j .Compare with Remark 6 above.
Recall also Example 3 above, where we observe 1 : 2 resonance between the frequencies and only one family of periodic solutions; but, there, the system is not Hamiltonian.

Example 4. In the case of the Hamiltonian
from [23, Example 2], we deal with the k : 1 resonance, but with indefinite quadratic part.The corresponding equations for z j are Of course, the plane W 2 = {z 1 = v 1 = 0} is invariant and supports a family of periodic solutions with the period 2π/k.
But, the Lyapunov-type function which is positive in the domain {z 1 0} .It prevents the existence of other periodic solutions.
Surprisingly, this example contradicts Moser's original statement [23,Theorem 4].Indeed, we have two invariant subspaces of the linear system supporting periodic solutions: But, only periodic solutions from E 2 are 'extended' to periodic solutions of the whole system.
We complete this example by analysis of some return map associated with the polar coordinates in the z 1 −plane.Thus, we put We have We get the system which we call the return system.The twisted Poincaré map (r, w 2 ) −→ P (r, w 2 ) is defined via the evaluation of solutions at the 'time' θ = 2π with the initial value (r, w 2 ) at the 'time' θ = 0.The periodic solutions with the period ≈ 2π and outside of W 2 = {r = 0} correspond to the singular points of the latter system (5.4) with r 0. Thus, we have i.e., w 2 = Rew 2 , and r 2 + k 2 w 2 2 = 0. (5.5) The latter equation does not have nontrivial solutions.¶ In [35], we find another Hamiltonian Siegel [29]), also with only one family of periodic solutions.
The following example demonstrates that, in the case of a positively definite Hamiltonian, the situation is quite different.

Example 5. (a) Consider the positive definite Hamiltonian
) (5.7) Of course, the plane W 1 = {z 2 = 0} is invariant and has a a family of periodic solutions with the period 2π/k.(b) To look for periodic solutions with the period ≈ 2π, use the polar-type coordinates (5.8) compare with Eq. (5.3).We get the return system (5.9) Again, the closed phase curves of the period ≈ 2π outside of W 1 = {r = 0} correspond to the singular points of the vector field given by Eq. (5.9).We find that Therefore, we have three families of periodic solutions.The first family {z 1 = ce ikt , z 2 = 0} spans the invariant plane W 1 , but none of the two other families of closed phase curves z 1 = ± (r/k) e ikθ , z 2 = re itθ span a smooth surface.These real surfaces (in R 4 ) take the form and are singular; in C 4 , we get one complex singular surface The number of families of periodic solutions is greater than in the Weinstein theorem.(c) To explain the this difference we use the fact that the Hamiltonian system in the Birkhoff normal form is invariant with respect to the S 1 −action.In the present case, the action is as follows: (z 1 , z 2 ; ϕ) −→ e ikϕ z 1 , e iϕ z 2 ; (5.11) it is symplectic and generated by a corresponding Hamiltonian function (the momentum map), namely, (which is a first integral for system (5.7)).The symplectic reduction procedure (see [4]) says that, for each level surface M f = {F = f } (which is S 1 −invariant), the quotient space N f = M f /S 1 with respect to the S 1 −action acquires a symplectic structure and we get a Hamiltonian vector field Y f in this quotient space.The singular points of the latter vector field correspond to periodic solutions to system (5.7).
In this case, the hypersurface is a 3-sphere M f ≃ S 3 , f > 0, and the quotient space N f turns out to be the weighted projective space, N f ≃ P k,1 (see Section 10.1).The weighted projective space P k,1 is homeomorphic with the standard complex projective line P k,1 ≃ P 1 .The natural charts in N f are ζ = z k 2 /z 1 and η = 1/ζ = z 1 /z k 2 ; thus, z 1 = ηz k 2 and z 2 = (ζz 1 ) 1/k .In these charts, we get the systems (5.12) Note that, in the ζ−chart on N f , we have that k Note also that the equilibrium points of Y f correspond to the critical points of H as a function on N f .This amounts to critical circles of the function G = H − F = 1 2 z 1 zk 2 + z1 z k 2 , restricted to M f .With λ and the Lagrange multiplier, we get the equations (5.13) One solution is z 2 = 0, λ = 0 and k |z 1 | 2 = 2 f.For the other solutions, we have Finally, the Hamiltonian system (5.7) is completely integrable, with two independent first integrals (in involution).By the Liouville-Arnold theorem [3], the common level surfaces {F = f, G = g} , which are compact, are tori (if smooth).There are also the action-angle variables, which are our objectives.
Next, the second generating circle is parametrized by the angle α 1 .The corresponding solution to Eq. (5.15) takes the form We have the second period The second Liouville-Arnold angle equals (5.17) One can find corresponding action variables I j = I j (F, G) from the condition dI 1 ∧dϕ 1 +dI 2 ∧dϕ 2 = dp 1 ∧ dq 1 + dp 2 ∧ dq 2 .For this, one has to solve some first order PDE; we omit the details.
Consider now the situation with 1 : 1 resonance and, more generally, with 1 : 1 : Here, non-diagonal cells for the linear systems associated with homogeneous quadratic Hamiltonians H 2 are expected.Canonical forms of such Hamiltonians are given in [3,Appendix 6].
Probably, the following easy statement was a motivation of Moser's work [23].
Proof.If there existed a pair of Jordan cells, then the general solution of the corresponding linear system would be unbounded.But, this would contradict the compactness of the level hypersurfaces {H 2 = h} .□ It is natural to look for families of periodic solutions in the cases with a positive definite H 2 , i.e., with a diagonalizable linear part.How many such families should exist?
Consider first the positive definite H 2 and a homogeneous perturbation in the Birkhoff normal form.Thus, we have where z = (z 1 , . . ., z m ) ∈ C m and H 2d is a homogeneous polynomial depending only on the monomials z j zk , j, k = 1, . . ., m.Here, we have some freedom.Namely, we can apply linear changes of the variables z j which leave H 2 invariant.The corresponding group is U(m); this group preserves the Hermitian product (z, ζ) −→ z • ζ, whose real part is the scalar product and whose imaginary part defines the symplectic form.Using these changes, one can reduce the our situation to the case with m invariant complex planes.(Note that, in the case with the indefinite quadratic part, H 2 = 1 2 |x| 2 − 1 2 |y| 2 , where x = x 1 , . . ., x p ∈ C p and y = y 1 , . . ., y q ∈ C q , the corresponding group is U (p, q) and the Birkhoff resonant terms depend on x j xk , y j ȳk , x j y k and xj ȳk .Also, here, m = p + q invariant planes can be found for H 2 + H 2d .)Example 6.A general quartic Hamiltonian with the form of Eq. (5.16) for m = 2 with two invariant complex planes is of the form with real constants a, . . ., d.The corresponding system becomes We study the twisted Poincaré map using the substitutions z 1 = re iθ and z 2 = we iθ .It leads to the equations (we do not write equations for dr/dθ and dw/dθ).
The periodic solutions with period the ≈ 2π outside of r = 0 are given by Imw 2 = 0 and ẇ = 0. Thus, either (1) w = Rew, |w| 2 = w 2 ; or (2) In case (1), we get the equation and, in case (2), we get It follows that, for generic values of the parameters, besides the solutions r = 0 and w = 0 (corresponding to periodic solutions of the Hamiltonian system in the invariant complex planes), we have four additional solutions.Thus, the total number of periodic solutions in the generic case is six.
On the other hand, by analogy with the previous example, the symplectic reduction, with F = H 2 and G = H 2d , leads to Hamiltonian vector field Y f on N f ≃ P 1 with χ N f = 2.One can check that the additional two pairs of singular points of Y f have opposite indices.
The above agrees with the following result of van Straten [34].
where, on the left-hand side stands the generating function for the numbers M(m − 1, d) of periodic modes for Hamiltonian systems with a generic Hamiltonian function in the Birkhoff normal form given by Eq. (5.18).
Finally, we have the following Hamiltonian systems without periodic solutions for the expected period.
Example 7. Assume the following Poisson brackets for the complex variables z j :

The Hamiltonian function equals
Communications in Analysis and Mechanics Volume 15, Issue 2, 300-341.and generates the system Note that, for a = 0, we get a nilpotent linear system with invariant plane {z 1 = 0} that supports a family of periodic solutions; this Hamiltonian can be found also in [3,7].But, we assume that a < 0; hence, the planes {z 1 = 0} and {z 2 = 0} are not invariant.One should look for periodic solutions for the period ≈ 2π.Hence, we make the natural change (look at the previous examples): z 1 = re iθ , z 2 = we iθ with r ≥ 0. We get the equations The equations for the equilibrium points are given by Rew = 0 (i.e., w = iζ) and r 2 + 4ia |w| 2 Imw = r 2 − 4aζ 4 = 0.
We refer also to previous works [12,33] devoted to bifurcations of Hamiltonian systems in the 1:1 resonant case.
In the last example from [22, Example 9.2], the linear part is diagonal.
It generates the system which excludes the existence of nontrivial periodic solutions.

Additional properties of the P-D normal form
Again, assume an analytic system (1.4) with the eigenvalues ±iω j , ω j > 0. Recall the equivalence relation (1.9) on the set {ω 1 , . . ., ω m } of frequencies.For each equivalence class C ν , we have a linear subspace E ν that is invariant for the linear part ẋ = Ax of system (1.4).In fact, we can say more.Proposition 3.For each class C ν , system (1.4) has an invariant analytic submanifold V ν tangent to E ν at the origin.
Proof.First, it is rather obvious that there exists such an invariant manifold at the formal level.To prove its analyticity, we use the Poincaré return map (4.20), introduced in the second proof of Theorem 3.
The linear part of this map has the form (r, z 2 , . . ., z m ) −→ (r, z 2 , . . ., z k , µ k+1 z k+1 , . . ., µ m z m ) , µ j = e iΘ j 1 for j > k; in fact, µ j are is not a root of unity.Then, the equations , where {g θ ϑ } is the 2-parameter family of diffeomorphisms defined by solutions to Eq. (4.6).□ Therefore, our problem is reduced to the case when there is only one equivalence class, i.e., that all of the frequencies are rationally related.Let us order these frequencies like in Eq. (1.10), i.e., Proposition 4. In this situation, there exists a series . ., tangent at the origin to linear subspaces) associated with corresponding groups of frequencies.
Proof.It essentially repeats the previous proof.We find V r−1 ; other submanifolds are obtained inductively.
Let z 1 , z1 , . . ., z l , zl , l = k 1 +. ..+k r−1 be the eigenfunctions associated with the eigenvalues ±iω 1 , . ..± iω l and z l+1 , zl+1 , . . ., z m , zm be the remaining eigenvalues (associated with ±iω m ).We put z l = re iθ and get the equations dr dθ = . . ., dz j dθ = i ω j ω l z j + . . ., From now on, we focus our attention on the case with only one equivalence class for the frequencies.Thus, we can write ω j = p j ω 0 , p j ∈ N, gcd (p 1 , . . ., p m ) = 1.(6.1) Proposition 5.In the case of Eq. (6.1), the Poincaré-Dulac normal form is invariant with respect to the following action of the circle S 1 : ∂/∂z j is resonant in the P-D normal form if and only if the resonant relation (k 1 − l 1 ) ω 1 + . . .(k m − l m ) ω m = ω j holds.But, the result of change, given by Eq. ( 6.2), on U is as follows: Only such terms are S 1 −invariant.□

Theorem 8 and its proof
Recall that the assumptions of the three Lyapunov's theorems are two-fold.One has an assumption about the eigenvalues of the linear part; it implies the existence of a formal invariant smooth surface (it is rather irrelevant in Theorem 1).The second assumption means that the focus quantities of the system restricted to the formal invariant surface vanish; it amounts to the existence of a family of periodic solutions at a formal level.We underline that this vanishing condition admits a precise definition in terms of the P-D normal form; but, there are other approaches.
To provide a precise assumption of Theorem 8, we definitely need the P-D theorem.It roughly states that the P-D normal form predicts the existence of a 1-parameter family of periodic solutions for the period ≈ 2π/ω l at a formal level.Consider the equivalence class of frequencies which contains ω l .By Proposition 3, we can focus our attention on this class, i.e., that we have the situation of Eq. (1.10).By Proposition 4, there is an invariant submanifold associated with the frequencies ω j such that ω j ≥ ω l .Therefore, we can assume that i.e., m = l, besides property (1.10).Assume the Poincaré-Dulac normal form (with the coordinates Z j ).Following Examples 4 and 5, introduce the change Z l = Re iΘ , Z j = W j e ip j Θ/p l , ( j < l).(7.2) Lemma 3. We have the following return system for phase curves: where the right-hand sides do not depend on Θ and the dots mean nonlinear terms.
Theorem 8 states that, in this case, there exists a genuine continuous 1-parameter family of periodic solutions to system (1.4).
Proof of Theorem 8. Analogously to the change given by Eq. (7.2), introduce the change z m = re iθ , z j = w j e ip j θ/p m , ( j < m).We get a system of equations dr dθ = . . ., dw j dθ = . . .(the return system) with analytic right-hand sides.The periodic solutions of the period ≈ 2π/ω m correspond to the fixed points of the twisted Poincaré map P, which is defined via solutions to the latter system dr/dθ and dw j /dθ after the 'time' θ = 2π.
The equation P (r, w) − (r, w) = 0 has a zero locus along an analytic curve γ which is formally defined as the curve Γ from Definition 4 (after the change (R, W) −→ (r, w)).□ Remark 7. The statement of Theorem 8 can be generalized to the case when system (7.3) has a formal singular locus Γ of higher dimension, say, d.Then, the equation P − Id = 0 has an analytic zero locus γ of dimension d; it corresponds to a d−parameter family of periodic solutions for the period ≈ 2π/ω m .

Systems with a first integral
The assumptions of Theorems 1, 2, 3 and 8 involve an infinite number of conditions, related to either the vanishing of all focus quantities after restriction to a formal invariant plane or the existence of a curve of non-isolated singular points for system (7.3).These phenomena have infinite codimension.
In this section, we avoid the infinite number of conditions by imposing an additional restriction to the class of considered vector fields and the existence of an analytic first integral with a regular leading part.This restriction is also of infinite codimension, but it is natural in some applications.

Generalization of Theorem 7
Theorem 15.Assume that analytic system (1.4) has pure imaginary eigenvalues ±iω j , ω j > 0, and that it has a first integral F such that D 2 F is definite on a linear subspace E j 0 (of dimension ≥ 2) corresponding to one pair of eigenvalues ±i ωj 0 such that, for any other frequency ω j ωj 0 , one has ω j / ωj 0 Z.Then, there exists at least one 1-parameter family of periodic solutions for the period ≈ 2π/ ωj 0 .
Proof.By Proposition 4, we reduce the situation to one equivalence class of frequencies containing ω j 0 ; thus, we can assume that the class C 1 and ω j 0 = ω1 in Eq. (1.10).By Proposition 5, we can assume and there is a definite first integral F (z, z), say, with positive definite D 2 F (0, 0).
Assume first that the P-D normal form is analytic.So, let the system be in this form; denote the corresponding vector field X (with variables z j , zj ).Recall that such a system is invariant with respect to the corresponding S 1 −action ρ ϕ (Proposition 6).By averaging, we get that the first integral can be chosen also as S 1 −invariant: The level hypersurfaces M f = {F(z, z) = 0} , f > 0, are diffeomorphic with a (2m − 1) −dimensional sphere.They are invariant for the vector field X.Like in [23], we obtain vector fields Y f on the quotient varieties N f = M f /S 1 .The vector fields Y f ' are diffeomorphic with the complex projective space: By the Poincaré-Hopf theorem [14], i y j Y f = χ N f (where i y j Y f denotes the indices of Y f at the isolated singular points y j ), and the vector field Y f has at least one singular point (if its singular points are isolated).This amounts to the existence of a periodic solution of X on M f .This implies the existence of a 1−parameter family of periodic solutions like in the thesis of Theorem 15.
Let us present our approach without the assumption of analyticity of the P-D normal form.Suppose that there are no families of periodic solutions as above.We shall construct a real vector field on the projective space P m−1 , which is a P-D approximation V ap of the vector field V.
We take an S 1 −invariant approximation F ap of the first integral F; we take the average given by Eq. (8.1).
We project V ap onto the tangent spaces of the level hypersurfaces M ap f = {F ap = f } , f > 0, along the radii, such that the projection is S 1 −equivariant; we get a regular vector field V ap in the P-D normal form.
Next, we quotient M ap f and V ap by S 1 and obtain a vector field Y ap on N ap f = M ap f /S 1 ≃ P m−1 without singular points.This contradicts the Poincaré-Hopf theorem.□

The Weinstein theorem
In the proof of Theorem 15 (in the previous section), we have used, essentially, the Poincaré-Hopf formula.But, that formula does not give us much information about the singular points of the quotient vector field Y f on the quotient variety N f = M f /S 1 ; it is because there is no restriction for the values of the indices.In particular, we cannot get any bound for the number of singular points of Y f .
Probably, the only topological tool that could be used in this problem is the Lusternik-Schnirelmann category.The corresponding theorem (Theorem 17 from Section 10.2) provides the estimate from below for the number of critical points of a sufficiently smooth function on a manifold based on the category of this manifold.
Weinstein [35] used this idea in the case of germs of Hamiltonian vector fields X H generated by Hamiltonian functions H (z, z) such that D 2 H (0, 0) are definite, and in fact, positive definite.He skillfully constructed a function on the level hypersurface L h = {H (z, z) = h} , h > 0, which has a critical locus at the set of periodic phase curves of X H in L h .His construction is not direct and involves many technical details.
Below, we propose a more direct proof.
Proof of Theorem 4. Recall that we have a Hamiltonian vector field X H in R 2m , 0 with nonzero pure imaginary eigenvalues of the linear part and with a positive definite D 2 H. Thus, H = H 2 + H 3 +. . ., where with ω j > 0 (compare with Eq. (2.5)).Here, we can reduce H to the Birkhoff normal form, which is an analogue of the P-D normal form.Like in the proof of Theorem 15 (in the previous section), we can reduce the situation to one equivalence class of frequencies, i.e., we assume Eq. (7.1).Assume first that the Birkhoff normal form is analytic.So, let H be in this form.
Proposition 6.The corresponding action σ ϕ of S 1 on R 2m , 0 defines a symmetry of the vector field X H .This action is symplectic; in fact, it is Hamiltonian with as the momentum map.
Proof.We have to prove the second statement.Note that the phase flow generated by the X F is g t (z) = e iω 1 t z 1 , . . ., e iω m t z m and coincides with the action σ ϕ .□ Now, we apply the symplectic reduction.Recall that, in the case of the general (non-abelian) symmetry group, the symplectic reduction concerns only the zero level of the momentum map (see [4]).
Here, the group S 1 is abelian and the symplectic reduction works for any level of the momentum function; in fact, it is the simplest case of the symplectic reduction.
So, we take the manifolds which are diffeomorphic with S 2m−1 , and their quotients The varieties N f are equipped with a natural symplectic structure and support contains higher-order terms.
Proposition 7. The periodic orbits of the X H in M f of period ≈ 2π/ω k , for some 1 ≤ k ≤ m, correspond to the critical points of the function π * G on N f .
Proof.The periodic orbits from this proposition are somewhat distinguished.They are defined via the return vector fields U k of type (7.3), i.e., they are associated with a fixed choice of the frequency ω k ; z k = re ip k θ and z j = w j e ip j θ for j k. (We do not consider possible orbits of a very long period.)The singular points of U k correspond to such periodic orbits.
But, the singular points of U k , when considered on M f , are the equilibrium points of Y f .They are the critical points of π * F, i.e., of π * G, on N f .Here, there is some subtlety associated with the fact that N f is singular, but one can use the local charts w (k) 1 : . . .: r (k) : . . .: w (k) m in N f defined in Eq. (8.2) below.□ Since M f is a sphere, its quotient N f is the weighted projective space P p 1 ,...,p m .By the Lusternik-Schnirelmann theorem (Theorem 16 in Section 10.2), the number of critical points of the function π * G is bounded from below by the category of N f .But, P p 1 ,...,p m is homologically 'similar' to P m−1 (see Section 10.1) and catP p 1 ,...,p m ≥ m (see Theorem 17 from Section 10.2). ∥ This gives the estimate ≥ m for the number of isolated periodic orbits.Now, we present our argumentation without the assumption of the analyticity of the Birkhoff normal form.We have essentially two tools at our disposal (we have used them in the proof of Theorem 8).Again, we assume only one equivalence class of the frequencies.
The first tool is the Birkhoff normal form, which we assume only to be formal.The other is the Poincaré return map (as defined in the second proof of Theorem 3, see Eq. (4.20)), or, rather, the twisted Poincaré map (as defined in the proof of Theorem 8 and in Examples 4-6).
In fact, we will use a collection of twisted Poincaré maps P (k) , k = 1, . . ., m, via the substitutions j e ip j θ/p k ( j k) , as well as the solutions after the 'time' θ = 2π of corresponding differential systems.The variables r (k) ∈ (R, 0) and w (k) j ∈ (C, 0) parametrize corresponding twisted Poincaré sections.As before, we assume that ω j = p j ω 0 , with relatively prime positive integers such that p 1 ≥ p 2 ≥ . . .≥ p m .The twisted Poincaré map differs from the standard Poincaré map (where z j = w j ) in the coordinates w j such that ω j > ω k .In the standard case we have that z j −→ e ip j /p k z j + . . .and, in the twisted case, we have that w j −→ w j + . . . .
If the system (1.7) were in an analytic Poincaré-Dulac-Birkfoff normal form with an S 1 −invariant first integral F, then the variables r (k) and w (k)  j , when restricted to M f = {F = f }, would form a local chart w (k) 1 : . . .: r (k) : . . .: in the quotient variety N f = M f /S 1 , or an affine chart w (k) 1 /r (k) , . . ., w (k) m /r (k) , r (k) > 0. Recall that the 1-parameter families of periodic solutions of system (1.7), whose corresponding vector field we denote by X H , of period ≈ 2π/ω k , correspond to 1-dimensional curves of fixed points of the twisted Poincaré map P (k) (see the above proof of Theorem 7).They are analytic curves γ defined by the analytic equation P k − Id = 0. We assume that this equation has a zero locus of dimension 1; otherwise, we have infinitely many 1-parameter families of such periodic solutions.
From the analytic geometry, we know that (germs of) analytic sets are analytically equivalent (diffeomorphic) with algebraic sets.This holds in the case of complex analytic sets and in the case of real analytic sets.For example, a germ of an analytic curve is defined by a corresponding Puiseux series.The proof uses the Weierstrass preparation theorem (see [37]).Moreover, if such a germ is defined by a system of germs of analytic functions, then an approximation of these functions by polynomials (sufficiently long jets) define an algebraic set locally diffeomorphic with the original germ.
We apply this to the germs γ of curves defined by the equation P (k) − Id = 0.These equations admit the approximation P (k)  ε − Id = 0, where the twisted Poincaré map P (ε) k is defined via a Hamiltonian ∥ The category of quotient spaces was studied also by Weinstein in [36].
vector field X H ε generated by a polynomial approximation H ε of H in the Birkhoff normal form.Then, the curve γ will correspond to a curve γ ε ⊂ P (k) ε − Id = 0 .The number of the latter curves is estimated like above.□

The Moser-type theorem about Hamiltonian systems
Recall also that, in the original version of the work [23,Theorem 4], Moser assumed only that H 2 | E⧹0 > 0, where E is the linear subspace associated with one frequency for the linear system, but his example from [23, Example 2] (or our Example 4 above) provides a contradiction to this restricted version.
It seems that the crucial point in Moser's approach is his lemma (Lemma 1) from [23].There, he somehow associates with any small vector ξ ∈ E⧹0 a solution to the Hamiltonian system and claims that some of them are periodic; probably, therein lies the flaw of his argument.Finally, he uses the Lusternik-Schnirelmann category for a suitable function on P r−1 .
Our approach is more direct.In part, it repeats the above proof of the Weinstein theorem.
Proof of Theorem 5. Much of his proof repeats the corresponding part of the proof of Theorem 4 in the previous section.In particular, we can assume that the Hamiltonian function is in an analytic Birkhoff normal form.Recall that we assume only one equivalence class among the frequencies.
Thus, we have the additional first integral F = H 2 , which defines the momentum map for the action of the group S 1 .
Recall that, by Proposition 5, we have the filtration , 0 of submanifolds that are invariant for the vector field X H such that V j ⧹V j−1 is associated with one frequency.This filtration induces corresponding filtrations in M f = {F = f } and in N f = M f /S 1 : where P ( j) denotes weighted projective spaces with complex dimensions dimV j − 1.
We have to show that G = H − F, as a function on N f , has at least 1 2 dimV j = 1 2 (k 1 + . . .k j ) critical points in P ( j) .But, this follows from Theorems 16 and 17 in Section 10.2.□

Nonlinear functional analysis approach
Topological theorems of nonlinear functional analysis are well suited to deal with nonlinear PDEs.But, some specialists began to use them to prove (or reprove) some qualitative results in the theory of ODEs; see [22] for an example.
In particular, Szulkin [32] developed a functional analytic approach to the question of the accumulation of small-amplitude periodic solutions to Hamiltonian systems.His method was followed in papers by Rybicki with various collaborators [10,15,25,26,31].
The first trick in the analysis of periodic solutions for the period T = 2π/ω, which usually varies with variation of the solution, is to normalize this period to 2π.This is done by replacing the Hamiltonian system ẋ = X H (x) with the following family of Hamiltonian systems: where λ > 0 is a parameter chosen (for a given periodic solution x = φ (t)) such that the corresponding solution y = φ (λt) to Eq. ( 8.3) has the period 2π.One says that a family y = ψ λ (t) of 2π−periodic solutions to Eq. ( 8.3) emanates from (λ, y) = (λ 0 , 0), λ 0 = 1/ω j , when x = ψ λ (t/λ), with λ close to λ 0 , denotes solutions to ẋ = X H with the period ≈ 2π/ω j .Next, it is not difficult to show that the 2π−periodic solutions to system (8.3),where y = (q, p) , correspond to the stationary paths of the following functional (see also [23]): This functional is defined on the 2π−periodic path γ : S 1 −→ R 2m , γ (t) = (q(t), p(t)) .The author considers Φ as a functional on the Sobolev space H = H 1/2 S 1 , R 2m ; using complex vector-variables z = q + ip and z = q − ip, we have that z = γ (t) The first part of the functional (8.4) takes the form With the splitting H = H − ⊕ H 0 ⊕ H + = {(γ − , γ 0 , γ + )} of the above Hilbert space into subspaces generated by negative, zero and positive modes, we have that ⟨Lγ, γ⟩ = ∥γ + ∥ 2 − ∥γ − ∥ 2 .In particular, the subspace H 0,± is invariant for L.
Consider the operator L + λB and its restrictions T (k) = (L + λB) | H (k) to the subspace H (k) = span e ikt , e −ikt ≃ R 2m , k > 0, which are as follows: We see that the operator T (k) = T (k) (λA) is non-invertible if and only if λ = k/ω j for some j; this is the case when the linear system ẋ = X H 2 (x) has a family of periodic solutions for the period 2π/ω j .
Consider the splitting H = F ⊕ F , where F = H − and F = H 0 ⊕ H + .The subspace F is invariant for L and L| F < 0 has a quadratic form.The operator B is a bounded self-adjoint operator in H. Let E n = span e ikt : k = 1, . . ., n ⊕ F be subspaces of H (invariant for L) and P n : H −→ E n be corresponding orthogonal projections.We have the Morse indices M − (L + λP n B) | E n , i.e., the numbers of negative eigenvalues.One defines another index (It has a cohomological interpretation; some cohomology groups H q F (W, W − ), which we do not define, vanish for q M − (λB) and are equal to R otherwise; see [32,Proposition 2.3].) An abstract statement, i.e., [32,Theorem 2.3], says the following: Proposition 8.If (i) L + λB is invertible for λ ∈ I⧹λ 0 , where I is a neighborhood of λ 0 , and (ii) the function λ −→ M − (λB) has a jump at λ 0 , then either (a) the path γ (t) ≡ 0 is a non-isolated critical path of Φ λ 0 , or, (b) for all λ's in I⧹λ 0 from one side of λ 0 , the functional Φ λ has a critical path γ λ (t) 0 near γ (t) ≡ 0.
Next, M − T (1) (λA) jumps at λ = 1/ ωl if and only if where E l is the invariant subspace for A corresponding to the eigenvalues ±i ωl (see [ We see that the first assumption of Theorem 6, i.e., ωj / ωl N, is like in the third Lyapunov theorem.But, the assumption, i.e., inequality (8.5), is new; it replaces the definiteness assumption of H 2 from Theorems 4 and 5.Note also that, in this topological approach, one does not assume the analyticity of the Hamiltonian function.But, when one additionally assumes the analyticity of the Hamiltonian function, then the statement of Theorem 6 can be strenghtened: there exists at least one continuous family of periodic solutions.
At this moment , the method to reprove this result using the proposed approach is unknown by the author.But, in all examples considered by the author, my tools seem to be more effective.In fact, examples of where only the Szulkin theorem works are not known by the author.

Quasi-periodic movement near geostationary orbit
Geostationary orbits of celestial objects, like GPS satellites, are determined by the property by which they are fixed with respect to an Earth's observer.The following definitions were taken from Strzelecki's thesis [31].

Restricted four-body problem
In the restricted four-body problem, we deal with three heavy bodies, S (from the sun), J (from Jupiter) and P (from a planet), and one light body A (an asteroid).The heavy bodies lie in the vertices of an equilateral triangle which rotates with constant angular velocity (equal ν = −1) about their center of mass and in a fixed plane.The asteroid moves in the gravity field generated by the principal bodies and does not influence their movement.† † As in the previous section, one passes to the coordinate-momentum frame wherein the heavy bodies rest.Thus, we have the Hamiltonian function like in Eq. (9.1), but with ν = 1 and here, q = 0 is the center of mass of the system.We assume two degrees of freedom (the case with three degrees of freedom is only slightly more complex; see [15]), i.e., that A lies in the plane S JP; so, q = (x, y) and p = p x , p y .
Using only the above information about the eigenvalues λ j , we can state the following.
(1) In cases (i) and (ii), there are no families of periodic solutions.
Analogues of these statements can be found in [15,Theorem 3.1].But, in the same theorem, we find the following statement: If in case (v), additionally, the index i (xj,yj) ∇W (the authors call it the Brouwer index) is nonzero, then there exists a branch of closed orbits.
We shall justify this using a refined version of the Birkhoff normal form in the 0 : 1 resonant case: where Ω = ω + . . .and Φ = a k Y k + . . ., a k 0. In the case of one degree of freedom, this result is due to Baider and Sanders [5] (some coefficients in the series Φ (Y) vanish); the above case is a generalization of [7,Eq. (3.4)].The corresponding differential system becomes As usual, when looking for periodic phase curves, we make the substitution Z = re iθ .We get the system dr/dθ = 0, dX/dθ = cY k−1 (1 + . ..) + r 2 Ξ Y, r 2 , dY/dθ = X/ (ω + . ..) , c = ka k /ω 0, with equilibrium points defined by X = 0 and cY k−1 (1 + . ..) + r 2 Ξ Y, r 2 = 0.The sufficient condition for the existence of a nontrivial solution to the this system is that the exponent k − 1 is odd.But, this amounts to the property that the index of X H at this singular point is nonzero; equivalently, the index of ∇W at x j , y j is nonzero.
In the case of the potential given by Eq. (9.4) for the planar restricted four-body problem, the authors of [15] referred to works of other authors when looking for libration points (see [2,6,19] for example).One assumes m S + m J + m P = 3 Moreover, in the case of equal masses, there are 10 critical points of W, all nondegenerate: the minimum x = y = 0 and three saddle points in T , one local maximum in each O ## and one saddle in each D # (see [15,Lemma 4.2]).In the case of non-equal masses, one calculates the indices of ∇W along the boundaries of the above domains (called the Brouwer degree) and finds that, in each of the above seven domains, there exists a libration point with a nonzero index of ∇W.
By the above analysis of the eigenvalues λ j = ± √ µ l , using the relations of Eq. (9.5) between µ k and the eigenvalues β m of D 2 W, one concludes the existence of a 1-parameter family of periodic solutions for each of the seven above libration points.
It would be interesting to study periodic solutions in the 1 : 1 resonance case, i.e., when a 2 > 0 and ∆ = 0 (µ 1 = µ 2 < 0).Finally, we note that the restricted four-body problem was studied from the points of view of the Lyapunov stability of the libration points, i.e., for case (iv); the existence of a family of periodic solutions does not imply it.Here, one uses the KAM theorem and fourth-order Birkhoff normal form.In [20], the generic Lyapunov stability for case (iv) was established for the following situations: when m S and m J dominate over m P and the libration points lie near P; when m S = m J and the libration points lie in a symmetry line of T ; when m S dominates over m J and m P and the libration points lie near the circle with its center at S and radius |S J| .From the algebraic geometry point of view (see [11]), it is the projective spectrum ProjS(P) , P = (p 1 , . . ., p m ) , of the graded polynomial algebra S(P) = C [T 1 , . . ., T m ] such that degT j = p j .These spaces are important from the complex geometry point of view.In particular, the morphism z j −→ T j = z where the action of the circle S 1 = e iϕ is like in Eq. (6.2), i.e., σ ϕ • z = e ip 1 ϕ z 1 , . . ., e ip m ϕ z m .
The 'cell' of maximal dimension σ 2m−2 is defined by {z m 0} in S 2m−1 .We rotate the variable z m to get argz m = 0, i.e., z m = r m > 0. We have the following description of this 'cell': where D 2m−2 = r m = 1 − |z 1 | 2 − . . .− |z m−1 | 2 and ∆ ⊂ S 1 is the stabilizer of the set argz m = 0 .The above upper semi-sphere is diffeomorphic with the standard (2m − 2) −dimensional unit ball, and its quotient is singular but with the singular locus of (real) codimension ≥ 4 (complex codimension is ≥ 2).This cell defines the fundamental cycle of P p 1 ,...,p m .
In this way, we successively construct the lower-dimensional cells, as well as cells in the singular locus of the action of the group ∆ on D 2m−2 .By the dimensional argument, the boundaries of these 'cells' are zero in the homological sense; so, the only nonzero homology groups have even dimensions.We distinguish the (2m − 4) −dimensional cycles σ 2m−4 1 , . . ., σ 2m−4 m corresponding to the hyperplane sections {z 1 = 0} , . . ., {z m = 0} respectively.The intersection of any collection of m − 1 of the above cycles is nonempty and ,hence, catP p 1 ,...,p m ≥ m (see Theorem 17 below).
Recall [14] that the homological length of a manifold M is the maximal number k such that there exist homology classes ρ 1 , . . ., ρ k ∈ H * (M, Z) , dimρ j < dimM, such that their intersection is a nonzero cycle.‡ ‡ Finally, we note that, in our analysis, we can replace the standard sphere with any manifold of the form for positive constants c j .‡ ‡ In fact, in [14], one finds the definition of the cohomological length (or the cup length) as the maximal number k such that there exist cohomology classes a 1 , . . ., a k , dima j > 0, such that a 1 ∪ . . .∪ a k 0. These cohomology classes are Poincaré-dual to the cycles ρ 1 , . . ., ρ k .But, in the proof of Theorem 17 below given in [14], only intersections of the cycles are used.

we find that |z 2 |
is separated from zero and the first term on the right-hand side of the equation for ζ is dominating.It follows that the latter system(s) (5.12) has three singular points: ζ = 0 (with index 0) and η = ±1/k |z 2 | k−1 (both with index 1).As the Euler characteristic χ P 1 = 2, this agrees with the Poincaré-Hopf formula.

√ 3 (
normalization); then, the sides of the equilateral triangle T equal √ 3.One draws three circles of radius√3 with centers at S , J and P and three straight lines which extend the sides of T .Then, one obtains 16 bounded regions, but only seven of them contain libration points (critical points of W).These (open) domains are as follows: the triangle T ; three circular sectors D S , D J and D P with vertices at S , J and P, respectively; three circular triangles O S J , O JP and O PS opposite to the corresponding sides of T (see[15, Theorem 4.1(i)]).

c 1 |z 1 | 2 +
. . .+ c m |z m | 2 = 1 |k|=d f j;k x k e j are the subspaces of homogeneous maps of degree d ≥ 2, thenL −1 | F d < C 1 /d for some constant C 1 .On the other hand, the operators T| F d : F d −→ F >d have the Lipschitz constants bounded by C 2 dρ, where the factor d arises from DF and C 2 is some constant.It follows that the operator