Discrete-Time Mean-Field Stochastic H_2/H_∞ Control

The finite horizon H_2/H_∞ control problem of mean-field type for discrete-time systems is considered in this paper. Firstly, the authors derive a mean-field stochastic bounded real lemma(SBRL). Secondly, a sufficient condition for the solvability of discrete-time mean-field stochastic linearquadratic(LQ) optimal control is presented. Thirdly, based on SBRL and LQ results, this paper establishes a sufficient condition for the existence of discrete-time stochastic H_2/H_∞ control of meanfield type via the solvability of coupled matrix-valued equations.     

Stackelberg Game Approach to Mixed H_2/H_∞ Problem for Continuous-Time System

This paper studies the mixed H_2/H_∞ control for continuous-time linear dynamic systems.By applying Stackelberg game approach, the control input is treated as the leader and the disturbance is treated as the follower, respectively. Under standard assumptions and maximum principle, a necessary and sufficient existence condition which is based on three decoupled Riccati equations is obtained.Explicit expression of controllers and solutions to forward backward differential equations(FBDES)are obtained by homogeneous analysis of variables. A numerical example is finally given to verify the efficiency of the proposed approach.     

H 2/H ∞ control problems of backward stochastic systems

This paper is concerned with the mixed H2/H∞ control problem for a new class of stochastic systems with exogenous disturbance signal.The most distinguishing feature,compared with the existing literatures,is that the systems are described by linear backward stochastic differential equations（BSDEs）.The solution to this problem is obtained completely and explicitly by using an approach which is based primarily on the completion-of-squares technique.Two equivalent expressions for the H2/H∞ control are presented.Contrary to forward deterministic and stochastic cases,the solution to the backward stochastic H2/H∞ control is no longer feedback of the current state;rather,it is feedback of the entire history of the state.     

H_∞ Control for Nonlinear Stochastic Markov Systems with Time-Delay and Multiplicative Noise

This paper is concerned with the H_∞ control problem for a class of nonlinear stochastic Markov jump systems with time-delay and system state-, control input-and external disturbancedependent noise. Firstly, by solving a set of Hamilton-Jacobi inequalities(HJIs), the exponential mean square H_∞ controller design of delayed nonlinear stochastic Markov systems is presented. Secondly,by using fuzzy T-S model approach, the H_∞ controller can be designed via solving a set of linear matrix inequalities(LMIs) instead of HJIs. Finally, two numerical examples are provided to show the effectiveness of the proposed design methods.     

Receding horizon H∞ control for discrete-time Markovian jump linear systems

Receding horizon H∞ control scheme which can deal with both the H∞ disturbance attenuation and mean square stability is proposed for a class of discrete-time Markovian jump linear systems when minimizing a given quadratic performance criteria. First, a control law is established for jump systems based on pontryagin’s minimum principle and it can be constructed through numerical solution of iterative equations. The aim of this control strategy is to obtain an optimal control which can minimize the cost function under the worst disturbance at every sampling time. Due to the difficulty of the assurance of stability, then the above mentioned approach is improved by determining terminal weighting matrix which satisfies cost monotonicity condition. The control move which is calculated by using this type of terminal weighting matrix as boundary condition naturally guarantees the mean square stability of the closed-loop system. A sufficient condition for the existence of the terminal weighting matrix is presented in linear matrix inequality (LMI) form which can be solved efficiently by available software toolbox. Finally, a numerical example is given to illustrate the feasibility and effectiveness of the proposed method.     

H ∞ filtering for continuous-time systems with pointwise time-varying delay

The problem of H_∞filtering for continuous-time systems with pointwise time-varying delay is investigated in this paper.By applying an innovation analysis in Krein space,a necessary and sufficient condition for the existence of an H_∞filter is derived in two methods:One is the partial differential equation approach,the other is the reorganized innovation analysis approach.The former gives a solution to the proposed H_∞filtering problem in terms of the solution of a partial differential equation with boundary conditions.The later gives an analytical solution to the proposed H_∞filtering problem in terms of the solutions of Riccati and matrix differential equations.     

Robust H∞ control for networked control systems

The robust H∞ control for networked control systems with both stochastic network-induced delay and data packet dropout is studied. When data are transmitted over network, the stochastic data packet dropout process can be described by a two-state Markov chain. The networked control systems with stochastic network-induced delay and data packet dropout are modeled as a discrete time Markov jump linear system with two operation modes. The sufficient condition of robust H∞ control for networked control systems stabilized by state feedback controller is presented in terms of linear matrix inequality. The state feedback controller can be constructed via the solution of a set of linear matrix inequalities. An example is given to verify the effectiveness of the method proposed.     

The Optimal Control of Fully-Coupled Forward-Backward Doubly Stochastic Systems Driven by It?-Lévy Processes

This paper studies the optimal control of a fully-coupled forward-backward doubly stochastic system driven by It?-Lévy processes under partial information. The existence and uniqueness of the solution are obtained for a type of fully-coupled forward-backward doubly stochastic differential equations(FBDSDEs in short). As a necessary condition of the optimal control, the authors get the stochastic maximum principle with the control domain being convex and the control variable being contained in all coefficients. The proposed results are applied to solve the forward-backward doubly stochastic linear quadratic optimal control problem.     

A GMRP Approach for Reliability Analysis of Repairable Systems

We propose here a mathematical approach for the study of repairable systems with arbitrary distributions. The idea is to define a new type of stochastic process, called a generalized Markov renewal process (GMRP). which may describe the transition behavior of the stochastic process at non-regenerative points. In the paper an analytical method for the GMRP is put forward and the formulas are then presented for reliability analysis of repairable systems which can be described by a GMRP with finite states. A signal flow graph technique for system modeling is also summarized here. Finally- an analytical model to evaluate the reliability of a m-out-of- n.G system with general repair-time distribution is developed by means of the GMRP approach.     

Fault detection filter design for linear discrete time-varying systems with multiplicative noise

The problem of fault detection for linear discrete timevarying systems with multiplicative noise is dealt with.By using an observer-based robust fault detection filter(FDF) as a residual generator,the design of the FDF is formulated in the framework of H ∞ filtering for a class of stochastic time-varying systems.A sufficient condition for the existence of the FDF is derived in terms of a Riccati equation.The determination of the parameter matrices of the filter is converted into a quadratic optimization problem,and an analytical solution of the parameter matrices is obtained by solving the Riccati equation.Numerical examples are given to illustrate the effectiveness of the proposed method.     

New Results on H∞ Control for Nonlinear Conformable Fractional Order Systems

This paper deals with H_∞ control problem for nonlinear conformable fractional order systems. The authors first derive new sufficient condition for exponential stability of nonlinear conformable fractional order systems based on Lyapunov-like function method for conformable fractional order systems and linear matrix inequalities(LMIs) approach. Then, by introducing a new concepts of H_∞ control problem for nonlinear conformable fractional order systems, the authors study H_∞ performance analysis and H_∞ state feedback controller design problems for the considered systems. In terms of LMIs, a sufficient condition is proposed to ensure the nonlinear conformable fractional order systems are not only exponentially stable, but also satisfy H_∞ performance γ. An explicit expression for state feedback controllers is also designed to make the closed-loop system is exponentially stable with H_∞performance γ. Finally, numerical examples are given to illustrate the validity and effectiveness of the proposed results.     

On the observability and detectability of linear stochastic systems with Markov jumps and multiplicative noise

<正> This paper presents the notions of exact observability and exact detectability for Markovjump linear stochastic systems of Ito type with multiplicative noise (for short,MJLSS).StochasticPopov-Belevith-Hautus (PBH) Criterions for exact observability and exact detectability are respectivelyobtained.As an application,stochastic H_2/H_∞ control for such MJLSS is discussed under exactdetectability.     

Solution of the HJI equations for nonlinear H∞ control design by state-dependent Riccati equations approach

The relationship between the technique by statedependent Riccati equations (SDRE) and Hamilton-Jacobi-Isaacs (HJI) equations for nonlinear H ∞ control design is investigated.By establishing the Lyapunov matrix equations for partial derivates of the solution of the SDREs and introducing symmetry measure for some related matrices,a method is proposed for examining whether the SDRE method admits a global optimal control equivalent to that solved by the HJI equation method.Two examples with simulation are given to illustrate the method is effective.     

ROBUST STOCHASTIC ADAPTIVE CONTROL FOR NON-MINIMUM PHASE SYSTEMS

The adaptive control problem for stochastic systems with unmodelled dynamics isconsidered.The modelled part of the system is described by an ARMAX model which may notbe of minimum phase,while the unmodelled part is dominated by a time-varying quantitydepending upon the systen past input,output and driven noise.The adaptive control law isdesigned based on a pseudo-linear regression algorithm and a pole-assignment method.Robust-ness results with regard to stability,performance and convergence are established.     

H_∞-based fault detection for nonlinear networked systems with random packet dropout and probabilistic interval delay

The fault detection problem for the nonlinear networked control system(NCS) with packet dropout and delay is investigated.A nonlinear stochastic system model is proposed to account for the NCS with random packet dropout and networkinduced non-uniformly distributed time-varying delay in both from sensor to controller(S/C) and from controller to actuator(C/A).Based on the obtained NCS model,employing an observer-based fault detection filter as the residual generator,the addressed fault detection problem is converted into an auxiliary nonlinear H∞ control problem.Then,with the help of Lyapunov functional approach,a sufficient condition for the desired fault detection filter is constructed in terms of certain linear matrix inequalities,which depend on not only the delay interval but also the delay interval occurrence rate and successful packet communication rate.Especially,a trade-off phenomenon between the maximum allowable delay bound and successful data packet transmission rate is found,which is typically resulted from the limited bandwidth of communication networks.The effectiveness of the proposed method is demonstrated by a simulation example.     

Observer-based H∞ control over packet dropping networks

A new controller design problem of networked control systems with packet dropping is proposed. Depending on the place that the observer is put in the system, the network control systems with packet dropping are modeled as stochastic systems with the random variables satisfying the Bernoulli random binary distribution. The observer-based controller is designed to stabilize the networked system in the sense of mean square, and the prescribed H∞ disturbance attenuation level is achieved. The controller design problem is formulated as the feasibility of the convex optimization problem, which can be solved by a linear matrix inequality （LMI） approach. Numerical examples illustrate the effectiveness of the proposed methods.     

Disturbance Attenuation State-Feedback Control for Uncertain Interconnected Systems

This paper studies the problem of robust H∞ control design for a class of uncertain interconnected systems via state feedback. This class of systems are described by a state space model, which contains unknown nonlinear interaction and time-varying norm-bounded parametric uncertainties in state equation. Using the Riccati-equation-based approach we design state feedback control laws, which guarantee the decentralized stability with disturbance attenuation for the interconnected uncertain systems. A simple example of an interconnected uncertain linear system is presented to illustrate the results.     

New delay-dependent stability criteria and robust control of nonlinear time-delay systems

This paper investigates the stability analysis and H_∞ control for a class of nonlinear timedelay systems,and proposes a number of new results.Firstly,an equivalent form is given for this class of systems by means of coordinate transformation and orthogonal decomposition of vector fields.Then,based on the equivalent form,some delay-dependent results are derived for the stability analysis of the systems by constructing a novel Lyapunov functional.Thirdly,the authors use the equivalent form and the obtained stability results to investigate the H_∞ control problem for a class of nonhnear time-delay control systems,and present a control design procedure.Finally,an illustrative example is given to show the effectiveness of the results obtained in this paper.It is shown that the main results of this paper are easier to check than some existing ones,and have less conservatism.     

Robust H∞ output feedback controller design for uncertain discrete-time switched systems via switched Lyapunov functions

The H∞ output feedback control problem for uncertain discrete-time switched systems is reasearched. A new characterization of stability and H∞ performance for the switched system under arbitrary switching is obtained by using switched Lyapunov function.Then,based on the characterization,a linear matrix inequality (LMI)approach is developed to design a switched output feedback controller which guarantees the stability and H∞ performance of the closed-loop system.A numerical example is presented to demonstrate the application of the proposed method.     

The Stochastic Maximum Principle for a Jump-Diffusion Mean-Field Model Involving Impulse Controls and Applications in Finance

This paper establishes a stochastic maximum principle for a stochastic control of mean-field model which is governed by a Lévy process involving continuous and impulse control. The authors also show the existence and uniqueness of the solution to a jump-diffusion mean-field stochastic differential equation involving impulse control. As for its application, a mean-variance portfolio selection problem has been solved.