Stability for a class of homogeneous hybrid systems by annular ...

Report 3 Downloads 74 Views
Stability for a class of homogeneous hybrid systems by annular Lyapunov analysis Fulvio Forni, Andrew R. Teel Abstract— For a class of homogeneous hybrid systems we present a set of annular Lyapunov-like conditions for inferring global pre-asymptotic stability of systems. Then, we prove that such conditions are mild, namely, that each globally pre-asymptotically stable system must satisfy them. Based on these results, we design a sum of squares algorithm that constructs a suitable Lyapunov-like function to automatically fulfill such annular conditions. Finally, based on recent results on homogeneous approximations of hybrid systems, we point out that such conditions can also be used to deduce local preasymptotic stability of a wider class of hybrid systems.

I. I NTRODUCTION Hybrid systems characterize a suitable mathematical framework to model the interaction of continuous-time processes, namely processes whose dynamics depends on differential equations, with discrete-time processes, namely processes whose behavior depends on a specific transition relation. Computing devices that control mobile robots, electrical circuits that combine analog and digital components, mechanical systems with impacts, are all examples of systems that combine continuous and discrete processes and that can be conveniently characterized within the hybrid systems framework. Several models of hybrid systems can be found in the literature, [6], [8], [13], [18]. Here we consider the framework outlined in [9] for which several structural results has been developed [11], [25], [26] and partially summarized in [10]. Although several new phenomena arise from the interaction of continuous and discrete dynamics, important results on stability theory like Lyapunov-like tools, invariance principles and converse theorems, have been generalized to the hybrid systems framework, [3], [4], [5], [7], [11], [25]. Here we propose a local Lyapunov-like approach to the study of stability properties of a particular class of homogeneous hybrid systems [30]. For instance, we define a set of Lyapunov-like conditions whose satisfaction, in a suitable subset of the state space (an annulus), guarantees global pre-asymptotic stability of the point xe = 0. We show also that such conditions are mild, that is, they are verified by any given hybrid system within the class considered, whose point xe = 0 is pre-asymptotically stable. Based on these Research supported in part by ENEA-Euratom and MIUR. [email protected]. Research supported in part by NSF grants CNS-0720842 and ECCS0925637 and AFOSR grant FA9550-09-1-0203. [email protected]. F. Forni is with the Dipartimento di Informatica, Sistemi e Produzione, University of Rome Tor Vergata, 00133, Italy, [email protected], A.R. Teel is with the Department of Electrical and Computer Engineering, University of California Santa Barbara, CA 93106-9560, USA, [email protected].

results, we define a sum of squares algorithm [21], that constructs a suitable function to automatically fulfill such conditions. The use of sum of squares algorithms in control and, in particular, the use of sum of squares algorithms to construct Lyapunov functions, is well developed. See for example [19], [23], [28], [29]. Sum of squares formulations have been used in [1], [14], [20], [22] on arbitrary switching systems, on switched systems and on hybrid automata. In such works, the system dynamics is usually defined by polynomial functions x˙ = fi (x), or by affine functions x˙ = Ai x + ai , for i ∈ {1, . . . , N }, each of which enabled either in a subset of the state-space [14], [20], [22] or by a particular updating rule based on the state [1]. The stability analysis in [1], [14], [22] is developed by considering a part of the state that never jumps. Systems in [20] allow for the reset of the state, provided that no solutions are Zeno (namely solutions with infinitely many jumps in a bounded interval of time) or discrete (namely solutions that only jump). Then, continuous and piecewise continuous Lyapunov functions are proposed to infer stability. The functions constructed by our algorithm satisfy usual Lyapunov conditions for pre-asymptotic stability [10] but only in an annulus. Then, for the class of systems considered, it is possible to generalize such local Lyapunov functions to the whole space, guaranteeing global pre-asymptotic stability. Our approach can be used on systems with Zeno and purely discrete solutions and produces smooth functions that may exhibit non-convex level sets in the subset of the state space in which they resembles classical Lyapunov functions. It follows that our method can be applied on global pre-asymptotically stable systems for which a convex Lyapunov function does not exists, see [2]. Finally, based on recent results on homogeneous approximation of hybrid systems [12], our method can be used on a properly defined linearization of general hybrid systems to infer local preasymptotic stability of the point xe = 0. The work is organized as follows: in Section II, the hybrid systems framework is briefly introduced and the class of hybrid systems considered is defined. Stability concepts, main theoretical results, the sum of squares algorithm and an example are presented in Section III. Further analysis on sum of squares implementation is developed in Section IV. The conclusion follows. Proofs are in appendices. Notation: The Euclidean norm of a vector and is denoted by | · |. A continuous function α(·) : [0, a) → [0, +∞) is said to belong to class K if it is strictly increasing and α(0) = 0; it is said to belong to class K∞ if a = +∞ and limr→+∞ α(r) = +∞. For any given

set X ⊂ Rn , coX denotes the closed convex hull of points of X.

II. H YBRID

SYSTEM MODEL

We consider a model of hybrid systems given by the tuple (C, F, D, G), where C ⊆ Rn and D ⊆ Rn are, respectively, the flow set and the jump set, while F : C ⇉ Rn and G : D ⇉ Rn are set-valued mappings, respectively, the flow map and the jump map. F and G characterize the continuous and the discrete evolution of the system, that is, the motion of the state, while C and D characterize subsets of Rn where such evolution may occur. A hybrid system H can be conveniently represented as follows  x˙ ∈ F (x) x∈C H= (1) x+∈ G(x) x ∈ D. Intuitively, the evolution of the state either continuously flows through C, by following the dynamic given by F , or it jumps from D, according to G. Such alternation of jumps and flow intervals can be conveniently characterized by using a generalized notion of time, called hybrid time. In what follows, we recall the notions of hybrid time and of solution to a hybrid system. For details, see [9], [10], [11]. Definition 1: A set E ⊆ R≥0 × N is a hybrid time domain if it is the union of infinitely many intervals of the form [tj , tj+1 ] × {j} where 0 = t0 ≤ t1 ≤ t2 ≤, . . . , or of finitely many such intervals, with the last one possibly of the form [tj , tj+1 ] × {j}, [tj , tj+1 ) × {j}, or [tj , ∞) × {j}. Definition 2: A hybrid arc x is a map x : dom x → Rn such that (i) dom x is a hybrid time domain, and (ii) for each j, the function t 7→ x(t, j) is a locally absolutely continuous function on the interval Ij = {t : (t, j) ∈ dom x}. A hybrid arc x : dom x → Rn is a solution to the hybrid system H if x(0, 0) ∈ C ∪ D and (i) for each j ∈ N such that Ij has a nonempty interior, x(t, ˙ j) ∈ F (x(t, j)) x(t, j) ∈ C

for almost all t ∈ Ij for all t ∈ [min Ij , sup Ij );

(2)

(ii) for each (t, j) ∈ dom x such that (t, j + 1) ∈ dom x, x(t, j + 1) ∈ G(x(t, j)) (3) x(t, j) ∈ D. In what follows we consider a particular class of hybrid systems in which flow set and jump set are defined as the union of closed polyhedral cones, and flow map and jump map are defined, respectively, as the convex hull and the union of several linear vector fields. Indeed, let i be an index number in N, and let R(i) be a closed set defined as follows     (i)   m1     (i) . . . (4) R = x| x ≥ 0   (i)   mr(i) (i)

where r(i) belongs to N and mj ∈ R1×n is a row vector, for each j = 1, . . . , r(i) . Then, C and D can be defined as [ [ C= R(i) D= R(i) (5) i∈IC

i∈ID

where IC , ID are disjoint and finite index sets. Note that C and D can overlap. Note also that it is possible to have C ∪ D 6= Rn . In a similar way, consider set-valued mappings Fi : Rn ⇉ n R , for i ∈ IC , and Gi : Rn ⇉ Rn , for i ∈ ID , defined as as follows. For each i ∈ IC , Fi (x) is a convex and closed set defined by  co{f | f = Fik x for k = 1 . . . rF } if x ∈ R(i) Fi (x) = ∅ otherwise (6) where Fik ∈ Rn×n and rF ∈ N. For each i ∈ ID , Gi (x) is a set defined by  {g | g = Gik x for k = 1 . . . rG } if x ∈ R(i) Gi (x) = ∅ otherwise (7) where Gik ∈ Rn×n and rG ∈ N. Then, flow and jump mappings, F : Rn ⇉ Rn and G : Rn ⇉ Rn , can be defined as [ [ F (x) = co Fi (x) G(x) = Gi (x) (8) i∈IC

i∈ID

Note that F (x) reduces to Fi (x) when x belongs only to one cone R(i) , for some i ∈ IC . The same holds for G(x). Hybrid systems of the form (1),(4)-(8) satisfy the following basic conditions. Such conditions coincide with the basic assumptions of [10] and with the fundamental conditions of [11] Claim 1 (Basic Conditions): A hybrid system H of Equations (1),(4)-(8) satisfies the following properties: 1) C ⊆ Rn and D ⊆ Rn are closed sets in Rn . 2) F : Rn ⇉ Rn is an outer semicontinuous set-valued mapping, locally bounded on C and, for each x ∈ C, F (x) is nonempty and convex. 3) G : Rn ⇉ Rn is an outer semicontinuous set-valued mapping, locally bounded on D and, for each x ∈ D, G(x) is nonempty. Proof: C and D are finite union of closed sets. Boundedness of F and G follows from the fact that they are constructed from linear vector fields. Convexity of F (x), for each x ∈ C, follows from the use of the convex-hull operator. Finally, outer semicontinuity of F follows from the fact that its graph is closed. Thus, by [24, Theorem 5.7] F is outer semicontinuous. Analogously for G. Remark 1: Hybrid systems that satisfy the conditions in Claim 1 exhibit a sort of regularity of solutions that leads to several important results. For example, for such systems, sequential compactness of the space of solutions holds, [11, Theorem 4.4 and Lemma 4.3], there is outer semicontinuous dependence of solutions on initial conditions, [10, Theorem 5] and [11, Corollary 4.8], and it is possible to relate solutions to a hybrid system H, with solutions to stateperturbed hybrid systems Hδ , constructed from H by a suitable state-perturbation of magnitude δ, [10, Theorem 8] and [11, Theorem 5.1]. Regularity of solutions has effects also on stability theory. See [11], [25] y

Remark 2: Switched linear systems with state dependent switching policies, [15, Sections 3.3 and 3.4], can be characterized within the family of hybrid systems considered above. For example, consider the system x˙ = Ai x if x ∈ Ci ,

i = 1, . . . , N.

where N ∈ N and, for each i = 1, . . . , N , Ai ∈ Rn×n and Ci is a conic subset of Rn . Such systems can be easily defined within the class of hybrid systems considered above, by defining Fi (x) = Ai x if x ∈ Ci and Fi (x) = ∅ otherwise, for each i = 1, . . . , N . In such case, D = ∅. Moreover, switched linear systems under arbitrary switching policies, [15, Section 2.1.4], can be written as hybrid systems (1),(4)(8), based on a single differential inclusion of the form (6), defined by the convex hull of the linear vector fields of the switched linear system, and C = Rn . y III. S TABILITY A. Preliminaries By following [10], for a hybrid system H, the point xe = 0 is (i) stable if for each ǫ > 0 there exists δ > 0 such that any solution x to H with |x(0, 0)| ≤ δ satisfies |x(t, j)| ≤ ǫ for all (t, j) ∈ dom x; (ii) pre-attractive if there exists δ > 0 such that any solution x to H with |x(0, 0)| ≤ δ is bounded and x(t, j) → 0 as t + j → 0 whenever x is complete; (iii) pre-asymptotically stable if it is both pre-stable and pre-attractive. The basin of pre-attraction Bxe is the set of points in Rn from which each solution is bounded and the complete solutions converge to A. Finally, if the basin of preattraction Bxe = Rn then xe is globally pre-asymptotically stable. In such case we say that the system is globally preasymptotically stable. Stability properties of a hybrid system H can be studied with Lyapunov-like tools. By following [10], a function V : dom V → R is a Lyapunov-function candidate for (H, xe ) if (i) V is continuous and nonnegative in (C ∪ D) \ {xe } ⊆ dom V and (ii) V is continuously differentiable on an open set O satisfying C \ {xe } ⊆ O ⊆ dom V , and (iii) limx→xe ,x∈dom V ∩(C∪D) V (x) = 0. Theorem 1 ([10, Theorem 20]): Consider the hybrid system H = (C, F, D, G) satisfying Claim 1 and an equilibrium point xe . If there exists a Lyapunov-function candidate V for (H, xe ) such that h∇V (x), f i < 0 V (g) − V (x) < 0

for all x ∈ C \ {xe }, f ∈ F (x), for all x ∈ D \ {xe }, g ∈ G(x) \ {xe },

then xe is pre-asymptotically stable and the basin of preattraction contains every forward invariant compact set. Moreover, suppose that either C ∪ D is a compact set, or the sublevel sets of V |C∪D , defined by {x ∈ C ∪ D | V (x) ≤ c} with c ∈ R≥0 , are compact. Then, xe is globally preasymptotically stable In what follows we show some results on stability of equilibrium point xe of hybrid systems (1),(4)-(8) by following a Lyapunov-like approach, namely, by using a suitable selected function V that satisfies a given set of conditions. Then, we

present a sum of squares algorithm to effectively construct such function V . B. Main results Global pre-asymptotic stability of a hybrid system (1),(4)(8) can be inferred from a local analysis of the system by finding a function V : Rn → R that respects some specific conditions on the annulus {x | c ≤ |x| ≤ ρc}, where c ∈ R≥0 and ρ ∈ R>1 . The local satisfaction of such conditions will guarantee global pre-asymptotic stability of the system, as stated in the following theorem. Definition 3: A function ϑ : Rn → R is said to be homogeneous of degree k ∈ N if for all x ∈ Rn and all λ ∈ R≥0 , ϑ(λx) = λk ϑ(x), Theorem 2: For a hybrid system H (1),(4)-(8), suppose that there exist a function V : Rn → R and constants c ∈ R>0 and ρ ∈ R>1 such that, • for each x in {x | c ≤ |x| ≤ ρc}, (1) h∇V (x), f i < 0 x ∈ C, ∀f ∈ F (x); (2) V (g) − V (x) < 0 x ∈ D, ∀g ∈ G(x); • there exists ℓ1 , ℓ2 ∈ R>0 , ℓ1 < ℓ2 , (3) max|x|=c V (x) ≤ ℓ1 and min|x|=ρc V (x) ≥ ℓ2 ; (4) if x ∈ D ∩ {x | c ≤ |x| ≤ ρc} ∩ {x | V (x) ≤ ℓ2 } and g ∈ G(x) then |g| ≤ ρc; • V is a continuous function in C ∪ D, and it is continuously differentiable in an open set that contains C. Then, for any given constant k ∈ R>0 , there exists a function V : Rn → R≥0 and some constants a2 ≥ a1 > 0, µ > 0, 0 < ν < 1 in R such that V is a homogeneous function of degree K, continuous in Rn , smooth in Rn \ {0}, and a 1 |x|k ≤ V (x) ≤ a2 |x|k ∀x ∈ C ∪ D ∀x ∈ C, ∀f ∈ F (x) (9) ∇V (x), f ≤ −µV (x) V (g) ≤ νV (x) ∀x ∈ D, ∀g ∈ G(x) Proof: See Appendix A. The meaning of Conditions (1)-(4) of the theorem can be explained by considering Figure 1, in which we summarized the case of a planar hybrid system for which conditions (1)-(4) are satisfied. In general, Conditions (1)-(2) can be interpreted as usual Lyapunov conditions for pre-asymptotic stability but, in Theorem 2, each inequality must be satisfied only for c ≤ |x| ≤ ρc. For guaranteeing a global result from such annular Lyapunov-like conditions (1)-(2), we need some extra-conditions on the function V (x) and on the dynamics of the system. With this aim, ℓ1 < ℓ2 and Condition (3) force V (x) to be lower at |x| = c than at |x| = ρc, guaranteeing the existence of two level sets of V (x) that surround the origin. This is represented in Figure 1 by closed curves with labels ℓ1 and ℓ2 . By looking at the figure, Condition (4) ensures that no jumps from a state within the set enclosed by ℓ2 can bring the state out of ρc. Conditions in Theorem 2 are quite mild, as stated in the following theorem, whose proof is in Appendix B. Theorem 3: For a a hybrid system H (1),(4)-(8), the equilibrium xe = 0 is globally pre-asymptotically stable if and only if there exists a smooth function V : Rn → R that

x2

solver runs over such problem and, if it finds a solution, the set of inequalities is feasible and the algorithm ends positively, as stated in OUTPUT. The following quantities are used in the algorithm. Definition 4: For any given i ∈ IC ∪ ID , the function (i) ∆2 (x) : Rn → R is defined as follows

D

C

(i)

(i)

c

ρc

x1

(i) ∆2 (x)

=

r X

+

r (i) X

(i) pj (x) mj x

+

ℓ1

(i)

(i)

pjk (x) mj x mk x

j=1 k=j+1

j=1

C

(i)

r r X X

r (i) X

r (i) X

(i)

(i)

(i)

pjkh (x) mj x mk x mh x

j=1 k=j+1 h=k+1

ℓ2

+ . . . + p1,2,...,r (x)m1 x m2 x · . . . · mr(i) x D

Fig. 1. A function V that satisfies Theorem 2 for a planar hybrid system.

satisfies Conditions (1)-(4) of Theorem 2, for some c ∈ R>0 and ρ ∈ R>1 . Remark 3: Following [12], for general a hybrid system H, (1), that satisfies the basic conditions, local pre-asymptotic stability of the point xe = 0 can be deduced from the preasymptotic stability of xe = 0 of a suitable approximation HL of H. Therefore, Theorem 2 can be used to infer local pre-asymptotic stability of xe = 0 of a general hybrid system H whose approximation HL is definable within the class of hybrid systems of equations (1),(4)-(8) and satisfies the conditions of Theorem 2. Indeed, following [12, Theorem 3.16], Theorem 2 can be applied to homogeneous approximations HL of hybrid systems H based on a dilation M (λ) = λI ([12, Definition 3.7]), such that (i) tangent cones TC (xe ) and TD (xe ) are polyhedral cones ([12, Definition 3.9]) and (ii) set-valued mappings coF M,0 and GM,0 are definable as combinations of a finite number of linear vectors field ([12, Definition 3.13]). y

where, for any given combination of indices j,k,. . . , pj , pjk , . . . denote functions in Rn → R≥0 , defined by nonnegative polynomials of a given degree. We refer to the whole set of polynomials pj , pjk , . . . by using the name slack polynomials. Definition 5: Let ε1 , ε2 ∈ R≥0 be two constants and let ∆1 (ε1 , ε2 , ·) : Rn → R be a map defined with respect to ε1 and on ε2 as ∆1 (ε1 , ε2 , x) = −(|x|2 − ε21 )(|x|2 − ε22 ). (i) It follows from (4) that, for each i ∈ IC ∪ ID , ∆2 (x) (i) is positive for each x in R while it is possibly negative for x ∈ / R(i) , based on the particular configuration of slack polynomial. ∆1 (ε1 , ε2 , x) is positive for ε1 ≤ |x| ≤ ε2 , and is strictly negative otherwise. A planar example of a subset of Rn with positive ∆1 and ∆2 is in Figure 2. ∆1 and ∆2 are used in Algorithm 1 for relaxing the conditions on V to hold only in a subset of Rn . x2 ∆1 (ε1 , ε2 , x) < 0 (i)

∆2 (x) < 0 possibly

∆1 (ε1 , ε2 , x) ≥ 0

C. Sum of squares algorithm In this section we present an algorithm for finding a function V that satisfies the conditions of Theorem 2. The general idea is to construct a set of polynomial inequalities that imply the conditions of the theorem. Then, a solution to such set of inequalities is computed by (i) relaxing each inequality to a sum of squares decomposition, and by (ii) using a semidefinite program solver for seeking a solution to the whole sum of squares decomposition problem. Of course, conservativeness is introduced [21], [23]. Algorithm 1 works as follows. The input of the algorithm is filled by the data of the hybrid system H and by parameters ε, c, ρ, d1 and d2 , as stated in INPUT. A set of inequalities is then constructed, parameterized on H and on ε, c, ρ, d1 and d2 , as stated in CONSTRAINTS. Each inequality uses variables defined in VARIABLES. Then, a solution is computed by relaxing the satisfiability problem of the whole set of inequalities to a sum of squares decomposition problem. A semidefinite program

ε1 ∆1 (ε1 , ε2 , x) < 0

ε2

x1

∆1 (ε1 , ε2 , x) ≥ 0

R(i)

(i)

∆2 (x) ≥ 0

(i)

∆2 (x) < 0 possibly

(i)

∆2 (x) ≥ 0

Fig. 2.

Subsets of the state-space related to the sign of ∆1 and ∆2 .

Algorithm 1: INPUT: data hF, G, C, Di of the hybrid system H; constants ε, c, ρ ∈ R>0 , satisfying ε ≪ c and ρ > 1;

constants d1 , d2 ∈ N, satisfying d1 ≥ d2 . OUTPUT: feasibility of the sum of squares problem. VARIABLES: scalar variables ǫ, ℓ1 , ℓ2 ; (ik) polynomials V (x), s3 (x), s4 (x), s1 (x), for each i ∈ IC (ik) (ik) (ik) and each k = 1, . . . , rF , s2 (x), s5 (x), s6 (x), for each i in ID and each k = 1, . . . , rG , and all the slack polynomials. CONSTRAINTS: V (x) is a polynomial of degree d2 . (ik) • ∀i ∈ IC , ∀k ∈ {1 . . . , rF }, s1 (x) is a polynomial of degree d1 and (i)

(ik)

−∇V (x)T Fik x − ∆2 (x) − s1 (x)∆1(c, ρc, x) > 0 (ik)

s1 (x) ≥ 0

(10)

(ik)

• ∀i ∈ ID , ∀k ∈ {1 . . . , rG }, s2 (x) is a polynomial of degree d1 and (i)

(ik)

V (x) −V (Gik x)− ∆2 (x) − s2 (x)∆1(c, ρc, x) > 0 (ik)

s2

(x) ≥ 0

(11)

• s3 (x) and s4 (x) are polynomials of degree d1 , ℓ1 and ℓ2 are scalar variables and ℓ1 − V (x) − s3 (x)∆1 (c, c + ε, x) ≥ 0 V (x) − ℓ2 − s4 (x)∆1 (ρc − ε, ρc, x) ≥ 0 ℓ2 − ℓ1 > 0 s3 (x), s4 (x), ℓ1 , ℓ2 ≥ 0 (ik)

(12)

(ik)

• ∀i ∈ ID , ∀k ∈ {1 . . . , rG }, s5 (x) and s6 (x), are polynomials of degree d1 , ℓ1 , ℓ2 are scalar variables and (ik)

V (x) − ℓ2 − s5 (x)(x′ GTik Gik x − ρ2 c2 )+ (i)

(ik)

−∆2 (x) − s6 (x)∆1 (c, ρc, x) ≥ 0 (ik)

(ik)

s5 (x), s6

(x) ≥ 0 (13)

(i)

• For each use of ∆2 (x) in (10), (11) and (13) a new fresh set of slack polynomials must be used. Moreover for each slack polynomial, say p(x), a new inequality p(x) ≥ 0 is added. Remark 4: The last bullet of Algorithm 1 requires a (i) new set of slack polynomials for each use of ∆2 (x). For (i) example, slack polynomials of ∆2 (x) used in an inequality that involves Gik1 in (11) must not be confused with slack (i) polynomials of ∆2 (x) used in an inequality that involves y Gik2 in (11), with k1 6= k2 . The left-hand side of each inequality of Algorithm 1 is constructed following two goals: the first part is used to enforce some constraint on V so that V fulfils the conditions (i) of Theorem 2, while the second part uses ∆1 and ∆2 , for i ∈ IC ∪ ID , to guarantee that V satisfies some constraints only in a subset of Rn , leaving V practically unconstrained in the rest of the space. Consider now to run Algorithm 1 for some given hybrid system H and to find a feasible solution. Inequalities

(10) and (11) guarantee that (i) the directional derivative of V (x), h∇V (x), f i, is negative for each x in the set C ∩ {x | c ≤ |x| ≤ ρc} and each f ∈ F (x), and (ii) the increment of V (x), V (g) − V (x), is negative for each x in the set D ∩ {x | c ≤ |x| ≤ ρc} and each g ∈ G(x). Therefore, (10) and (11) are related to Conditions (1) and (2) of Theorem 2. The first inequality of (12) implies maxc≤|x|≤c+ε V (x) ≤ ℓ1 . The second inequality of (12) implies minρc−ε≤|x|≤ρc V (x) ≥ ℓ2 . Note that ℓ1 < ℓ2 by third inequality. Thus, (12) is related to Condition (3) of Theorem 2. Inequality (13) guarantees that a hybrid arc of H cannot escape the set {x | |x| ≤ ρc} by a jump from D ∩ {x | c ≤ |x| ≤ ρc} ∩ {x | V (x) ≤ ℓ2 }. Therefore, (13) is related to Conditions (4) of Theorem 2. It follows that a feasible solution to the set of constraints produces a function V that satisfies the conditions of Theorem 2, as stated in the following proposition, whose proof is in Appendix C. Proposition 1: For any given hybrid system H (1),(4)-(8), if the set of inequalities of Algorithm 1 has a feasible solution for some parameters c ∈ R>0 and ρ ∈ R>1 , then the function V constructed by Algorithm 1 satisfies each condition of Theorem 2 with the same c and ρ. Remark 5: Despite the number of index i, j, k used during the description of Algorithm 1, in practical cases such algorithm is much more simple. For example, switched systems in [15, Sections 3.3 and 3.4] require a single matrix Fi for each cone R(i) . Therefore k = 1 in (10). y Remark 6: Note that V (x) is practically unconstrained when ∆1 (x) and ∆2 (x) are negative. Thus, the solver has some extra-degree of freedom during the construction of V (x). Indeed, V (x) that can be non-positive near the origin and non-positive far from the origin, i.e. with low order terms and high order terms not necessarily positive, that allows for the construction of functions V (x) with complex and not necessarily convex level sets. In fact, it could be the case that the hybrid system (1),(4)-(8) does not have a convex Lyapunov functions, as shown in [2]. y D. Example We use Algorithm 1 to study the stability of a hybrid system H (1),(4)-(8) defined by the following quantities: C = C1 ∪ C2 where C1 = {x | M1 x ≥ 0}, C2 = {x | M2 x ≥ 0}, and D = {x | M3 x ≥ 0}.  F1 x if x ∈ C1 \ C2    co{F1 x, F2 x} if x ∈ C1 ∩ C2 F (x) = F x if x ∈ C2 \ C1  2   (14) ∅ otherwise  Gx if x ∈ D. G(x) = ∅ otherwise where   1   1 1 0 −1 − 2 −1 e 10 F1 = 2 , F = , G = 1 2 1 1 − 10 1 1 − 0 e 2  2   1 1   −1 − 200 1 200 , M2 = −1 − 2 , M3 = M1 = 1 2 1 2 Some level set of the function V (x) constructed Algorithm 1, for c = 0.5, ρ = 4.4, ε = 0.001, d1 =



,



.

by 10

and d2 = 10, are summarized in Figure 3.

D C1

C2

Fig. 3. Some level sets of the function V (x) constructed by Algorithm 1.

The system used in this example is an adaptation to the hybrid system framework of the switching system in [2, Section 3], for which a convex Lyapunov function does not exist. In that case, by using d2 = 2, the algorithm would not have enough degrees of freedom on V to satisfy the set of constraints, and we need d2 = 10 to construct a suitable function V with non-convex level sets. Moreover, if we take c too small, numerical problems occur during the construction of V . IV. N OTES

ON SUM OF SQUARES IMPLEMENTATION

The problem of finding a solution to the set of inequalities of each algorithm is addressed by replacing each inequality with a sum-of-squares decomposition. In fact, the left-hand side of each inequality involving polynomials is a polynomial, say p(x). It follows that inequalities p(x) ≥ 0 can be replaced by p(x) is a sum-of-squares and each strict inequality p(x) > 0 can be considered as a non-strict inequality of the form p(x) − ǫxT x ≥ 0, with ǫ > 0 variable of the problem, then replaced by p(x) − ǫxT x is a sum-ofsquares. From a computational point of view, finding a sum-ofsquares decomposition is much easier than using a general algorithm for finding a solution to the inequality constraints. At the same time, it could be the case that a solution to the inequality constraints exists while the sum of squares decomposition fails to exist. Moreover, even though (i) polynomial inequalities constructed by each algorithm are linear with respect to the set of variables and (ii) a sum of squares decomposition problem can be solved in polynomial time, the computational complexity of finding a solution to the set of inequalities grows rapidly with the dimension of the state-space of H, with the degree of free polynomials used in the set of inequalities, with the number of disjoint cones of C ∪ D, and with the number of matrices Fik , Gik . It is worth mentioning that a sum-of-squares decomposition is satisfied within the limits of numerical computation;

therefore it cannot be exact. Fortunately, we are not interested in an exact decomposition. What we really need is that, despite the numerical approximation errors, the polynomials constructed by the sum of squares decomposition are still a feasible solution to the set of inequalities. By following [17], such goal can be achieved by considering a perturbed polynomial with a perturbation magnitude that depends on the numerical approximations errors of the decomposition (residuals). Then, we can use [17, Theorem 4] to guarantee that the approximate solution to the sum of squares decomposition problem is a feasible solution for the set of inequalities. For instance, consider the case of a polynomial p(x) such that p(x) ≥ 0: (i) we relax the problem to find p(x) such that p(x) is a sum-of-square; (ii) the data of the SDP formulation are matrices A and b; (iii) the solution is P ∈ RM×M , for some M ∈ N; (iv) p(x) can be written as v(x)′ P v(x), where v(x) is a base of monomials. Then, by [17, Theorem 4], if the test λmin (P ) ≥ M k A(P ) − b k∞ is verified, we have that v(x)′ P v(x) is non-negative, that is, each inequality is certified. Finally, Algorithm 1 and the test above can be implemented and solved by using packages like YALMIP, [16], and SeDuMi, [27]. V. C ONCLUSIONS We have shown a set of local conditions for studying the stability of a class of hybrid systems. Based on such conditions we proposed a sum of squares algorithm for characterizing the stability of such class hybrid systems. It could be of interest, as a future work, to consider an approach with piecewise functions, where several low-order polynomials are combined, instead of an approach based on a single high degree polynomial. A PPENDIX A. Proof of Theorem 2. We claim that, under Conditions (1)-(4) of Theorem 2, there exists a ν ∈ R>0 and a T ∈ R>0 such that, for each solution x to H with |x(0, 0)| = (1 + ν)c, • either dom x is compact and ∀(t, j) ∈ dom x, t+j ≤ T , • or ∃(t, j) ∈ dom x such that t+j ≤ T and |x(t, j)| ≤ c, and, in both cases, ∀(s, i) ∈ dom x such that s + i ≤ t + j, |x(s, i)| ≤ ρc. Then, from [12, Proposition 4.3] H is globally pre-asymptotically stable1 . Finally, from [5, Theorem 7.9] and [30, Theorem 2], (9) follows. The proof of the claim can be developed as follows. For a sufficiently small ν ∈ R>0 we have that max

|x|=(1+ν)c

V (x) = ℓ3 < ℓ2 .

(15)

The existence of such ν is guaranteed by ℓ1 < ℓ2 , by Condition (3), and by continuity of V . 1 [12, Proposition 4.3] requires |x(t, j)| ≤ 1 (1 + ν)c instead of 2 |x(t, j)| ≤ c in the or case. But the proof technique used in [12, Proposition 4.3] still works if we replace 21 with any constant strictly smaller than 1. Thus, the conclusion of [12, Proposition 4.3] is achieved also by using |x(t, j)| ≤ c.

From Conditions (1) and (2) and the fact that the set S = {x | c ≤ |x| ≤ ρc} is a compact set, there exist σ1 , σ2 ∈ R>0 such that (i) h∇V (x), f i ≤ −σ1 for all x ∈ C and each f ∈ F (x), and (ii) V (g) − V (x) ≤ −σ2 for each x ∈ D and each g ∈ G(x). Then, for each solution x to H with c ≤ |x(0, 0)| ≤ ρc, V (x(t, j)) ≤ V (x(0, 0)) − σ(t + j)

(16)

for all (t, j) ∈ dom x, provided that t+j ≤ inf{s+i| (s, i) ∈ dom x and x(s, i) ∈ / S} if x leaves S, and σ = min{σ1 , σ2 }. Moreover, consider T ∈ R>0 such that   1 max V (x) − min V (x) . (17) T > x∈S σ |x|=(1+ν)c Suppose now that the claim fails, that is, there exist a solution x to H with |x(0, 0)| = (1 + ν)c and a time (t, j) ∈ dom x such that t + j ≥ T and |x(s, i)| > c for all s + i ≤ t + j, or for some (s, i) ∈ dom x, |x(s, i)| > ρc. Then, by condition (4) and ℓ3 < ℓ2 , for each (s, i) ∈ dom x, x(s, i) cannot jump to a point g ∈ G(x(s, i)) for which |g| > ρc. Thus, (1), (2) apply and, with (3) and (4), they guarantee that the solution x cannot escape S by reaching a point whose norm is greater than ρc. Moreover, V decreases along the solution x, bounded by (16). Consider now (16). We have V (x(s, i)) ≤ ℓ3 − σ(s + i) and suppose that for each (s+ i) ≤ t+ j, |x(s, i)| > c. Then, for s + i = T , V (x(s, i)) ≤ ℓ3 − σT < min V (x). x∈S

(18)

Indeed, max|x|=(1+ν)c V (x) − min|x|≤c V (x) = ℓ3 − min|x|≤c V (x). Thus, T is greater than 1 σ (ℓ3 − minx∈S V (x)), from which ℓ3 −σT < minx∈S V (x). Thus, x(s, i) ∈ / S, therefore |x(s, i)| < c, which contradicts the hypothesis.  B. Proof of Theorem 3. The if direction is a consequence of Theorem 2. The only if part can be proved as follows. By the converse result in [5, Theorem 3.14], for a a hybrid system H of Equations (1),(4)(8), if the equilibrium xe = 0 is globally pre-asymptotically stable, then there exists a smooth function V : Rn → R and α1 , α2 ∈ K∞ such that ∀x ∈ Rn ∀x ∈ C, ∀f ∈ F (x) ∀x ∈ D, ∀g ∈ G(x). (19) Conditions (1), (2) of Theorem 2 are immediate. (3) Choose a constant ℓ1 > 0 and define c = α2−1 (ℓ1 ). Choose a constant ℓ2 > ℓ1 so that ρ = α−1 1 (ℓ2 )/c is strictly greater then 1. It follows that max|x|=c V (x) ≤ α2 (c) = ℓ1 and min|x|=ρc V (x) ≥ α1 (ρc) = ℓ2 . Condition (3) of Theorem 2 holds. (4) Suppose now that there exists a x ∈ D ∩ {x | c ≤ |x| ≤ ρc} ∩ {x | V (x) ≤ ℓ2 } and a g ∈ G(x) such that |g| > ρc. Then, ℓ2 = α1 (ρc) < α1 (|g|) ≤ V (g). Therefore V (g) > V (x), which contradicts (19). It follows that Condition (4) of Theorem 2 holds.  α1 (|x|) ≤ V (x) ≤ α2 (|x|) h∇V (x), f i ≤ −V (x) V (g) ≤ e−1 V (x)

C. Proof of Proposition 1. V (x) is a polynomial function, so it is smooth. (1) For each i ∈ IC and each k = 1, . . . , rF , (10) can be (i) (ik) written as ∇V (x)Fik x < −∆2 (x) − s1 (x)∆1(c, ρc, x). Therefore ∇V (x)Fik x < 0 in {x | c ≤ |x| ≤ ρc, x ∈ R(i) }, for each i ∈ IC and k = 1, . . . , rF . Suppose now that x belongs to the intersection of some sets R(i) , for i ∈ I ⊆ IC . Then, for each f ∈ F (x) we can write h∇V (x), f i as X X λik h∇V (x), Fik xi λik Fik xi = h∇V (x), i∈I,k=1,...,rF

i∈I,k=1,...,rF

P

for some i∈I,k=1,...,rF λik = 1, and λik ≥ 0 for each i ∈ I and k = 1, . . . , rF . It follows that h∇V (x), f i < 0 in {x | c ≤ |x| ≤ ρc} ∩ C, i.e. Condition (1) of Theorem 2 holds. (2) (11) implies Condition (2). To see this, an argument similar to the one above on (10) can be used. No convex combination of vectors Gik x is needed in this case, in fact g ∈ G(x) if and only if g ∈ Gik x for some i ∈ I ⊆ ID and k = 1, . . . , rG . (3) The first inequality in (12) can be written as V (x) ≤ ℓ1 − s3 (x)∆1 (c, c + ε, x), which implies V (x) ≤ ℓ1 for |x| ∈ [c, c+ε]. It follows that max|x|=c V (x) ≤ ℓ1 . A similar argument can be used to show that the second inequality in (12) guarantees min|x|=ρc V (x) ≥ ℓ2 . Therefore, Condition (3) of Theorem 2 is satisfied. (4) For each i ∈ ID and each k = 1, . . . , rG , Inequality (ik) (13) implies V (x) − ℓ2 − s5 (x)(x′ GTik Gik x − ρ2 c2 ) ≥ 0 (i) for x in {x | x ∈ R , c ≤ |x| ≤ ρc}. We can write such (ik) inequality as s5 (x)(ρ2 c2 − x′ GTik Gik x) ≥ ℓ2 − V (x), and (ik) from s5 (x) ≥ 0, it follows that ρ2 c2 − x′ GTik Gik x ≥ 0 for x in {x | x ∈ R(i) , c ≤ |x| ≤ ρc, V (x) ≤ ℓ2 }. Note that ρ2 c2 − x′ GTik Gik x ≥ 0 is equivalent to |Gik x| ≤ ρc, and such relation hold for each i ∈ ID and each k = 1, . . . , rG , whenever x belongs to {x | x ∈ R(i) , c ≤ |x| ≤ ρc, V (x) ≤ ℓ2 }. It follows that |g| ≤ ρc for each x in {x | x ∈ D, c ≤ |x| ≤ ρc, V (x) ≤ ℓ2 } and each g ∈ G(x), i.e. Condition (4) of Theorem 2 is satisfied.  R EFERENCES [1] M. Badamchizadeh, S. Khanmohammadi, G. Alizadeh, A. Aghagolzadeh, and G. Karimian. Using sum of squares decomposition for stability of hybrid systems. IEICE Transactions, 90-A(11):2478–2487, 2007. [2] F. Blanchini and C. Savorgnan. Stabilizability of switched linear systems does not imply the existence of convex Lyapunov functions. Automatica, 44(4):1166 – 1170, 2008. [3] M. Branicky. Multiple Lyapunov functions and other analysis tools for switched and hybrid systems. IEEE Trans. Aut. Cont., 43(4):475–482, April 1998. [4] C. Cai, A.R. Teel, and R. Goebel. Smooth Lyapunov functions for hybrid systems-Part I: Existence is equivalent to robustness. IEEE Transactions on Automatic Control, 52(7):1264–1277, 2007. [5] C. Cai, A.R. Teel, and R. Goebel. Smooth Lyapunov functions for hybrid systems part II:(pre) asymptotically stable compact sets. IEEE Transactions on Automatic Control, 53(3):734–748, 2008. [6] P. Collins. A trajectory-space approach to hybrid systems. In International Symposium on the Mathematical Theory of Networks and Systems, Leuven, Belgium, July 2004. [7] R.A. Decarlo, M.S. Branicky, S. Pettersson, and B. Lennartson. Perspectives and results on the stability and stabilizability of hybrid systems. Proceedings of the IEEE, 88(7):1069 –1082, jul 2000.

[8] Schaft A. J. van der and J. M. Schumacher. Introduction to Hybrid Dynamical Systems. Springer-Verlag, London, UK, 1999. [9] R. Goebel, J. P. Hespanha, A. R. Teel, C. Cai, and R. Sanfelice. Hybrid systems: Generalized solutions and robust stability. In Proc. of the 6th IFAC Symp. on Nonlinear Contr. Systems, Sep. 2004. [10] R. Goebel, R. Sanfelice, and A. Teel. Hybrid dynamical systems. Control Systems Magazine, IEEE, 29(2):28–93, April 2009. [11] R. Goebel and A.R. Teel. Solutions to hybrid inclusions via set and graphical convergence with stability theory applications. Automatica, 42(4):573 – 587, 2006. [12] R. Goebel and A.R. Teel. Preasymptotic stability and homogeneous approximations of hybrid dynamical systems. SIAM Review, 52(1):87– 109, 2010. [13] T.A. Henzinger. The theory of hybrid automata. Logic in Computer Science, Symposium on, 0:278, 1996. [14] M. Johansson and A. Rantzer. Computation of piecewise quadratic Lyapunov functions for hybrid systems. IEEE Transactions on Automatic Control, 43(4):555–559, Apr 1998. [15] D. Liberzon. Switching in Systems and Control. Birkh¨auser, 2003. [16] J. Lofberg. YALMIP : A toolbox for modeling and optimization in MATLAB. In Proceedings of the International Symposium on Computer Aided Control System Design, Taipei, Taiwan, 2004. [17] J. Lofberg. Pre- and post-processing sum-of-squares programs in practice. IEEE Transactions on Automatic Control, 54(5):1007–1011, May 2009. [18] J. Lygeros, K. H. Johansson, S. N. Simic, J. Zhang, and S. Sastry. Dynamical properties of hybrid automata. IEEE Transactions on Automatic Control, 48:2–17, 2003. [19] A. Papachristodoulou and S. Prajna. On the construction of Lyapunov functions using the sum of squares decomposition. In Proceedings of the 41st IEEE Conference on Decision and Control, 2002, volume 3, pages 3482–3487 vol.3, Dec. 2002. [20] A. Papachristodoulou and S. Prajna. Robust stability analysis of nonlinear hybrid systems. IEEE Transactions on Automatic Control, 54(5):1035–1041, May 2009. [21] P.A. Parrilo. Structured Semidefinite Programs and Semialgebraic Geometry Methods in Robustness and Optimization. PhD thesis, California Institute of Technology, 2000. [22] S. Prajna and A. Papachristodoulou. Analysis of switched and hybrid systems - beyond piecewise quadratic methods. In Proceedings of the 2003 American Control Conference, volume 4, pages 2779–2784 vol.4, June 2003. [23] S. Prajna, A. Papachristodoulou, P. Seiler, and P.A Parrilo. SOSTOOLS and its control applications. In D. Henrion and A. Garulli, editors, Positive Polynomials in Control, volume 312, pages 273–292. Springer Verlag, 2005. [24] R.J.-B. Wets. M. Rockafellar, R.T. Wets. Variational Analysis. Springer, 2004. [25] R.G. Sanfelice, R. Goebel, and A.R. Teel. Invariance principles for hybrid systems with connections to detectability and asymptotic stability. IEEE Transactions on Automatic Control, 52(12):2282–2297, 2007. [26] R.G. Sanfelice, R. Goebel, and A.R. Teel. Generalized solutions to hybrid dynamical systems. ESAIM: COCV, 14(4):699–724, Oct 2008. [27] J. F. Sturm. Using SeDuMi 1.02, a MATLAB toolbox for optimization over symmetric cones. Optimization Methods and Software, 11– 12:625–653, 1999. [28] Z. Lin T. Hu, L. Ma. Stabilization of switched systems via composite quadratic functions. IEEE Trans. Aut. Cont., 53(11):2571–2585, December 2008. [29] W. Tan. Nonlinear Control Analysis and Synthesis using Sum-ofSquares Programming. PhD thesis, University of California, Berkeley, 2006. [30] S.E. Tuna and A.R. Teel. Homogeneous hybrid systems and a converse Lyapunov theorem. In 45th IEEE Conference on Decision and Control, 2006, pages 6235–6240, Dec. 2006.