國立虎尾科技大學 |

Relative Optimization of Continuous-Time and Continuous-State Stochastic Systems

紀錄類型:	書目-語言資料,印刷品 : Monograph/item
正題名/作者:	Relative Optimization of Continuous-Time and Continuous-State Stochastic Systems/ by Xi-Ren Cao.
作者:	Cao, Xi-Ren.
面頁冊數:	XIX, 365 p. 21 illus., 12 illus. in color.online resource. :
Contained By:	Springer Nature eBook
標題:	Markov model. -
電子資源:	https://doi.org/10.1007/978-3-030-41846-5
ISBN:	9783030418465

Relative Optimization of Continuous-Time and Continuous-State Stochastic Systems
Cao, Xi-Ren.

Relative Optimization of Continuous-Time and Continuous-State Stochastic Systems[electronic resource] /by Xi-Ren Cao. - 1st ed. 2020. - XIX, 365 p. 21 illus., 12 illus. in color.online resource. - Communications and Control Engineering,0178-5354. - Communications and Control Engineering,.

Chapter 1. Introduction -- Chapter 2. Optimal Control of Markov Processes: Inﬁnite Horizon -- Chapter 3. Optimal Control of Diffusion Processes -- Chapter 4. Degenerate Diffusion Processes -- Chapter 5. Multi-Dimensional Diffusion Processes -- Chapter 6. Performance-Derivative-Based Optimization -- Appendices -- Index.

This monograph applies the relative optimization approach to time nonhomogeneous continuous-time and continuous-state dynamic systems. The approach is intuitively clear and does not require deep knowledge of the mathematics of partial differential equations. The topics covered have the following distinguishing features: long-run average with no under-selectivity, non-smooth value functions with no viscosity solutions, diffusion processes with degenerate points, multi-class optimization with state classification, and optimization with no dynamic programming. The book begins with an introduction to relative optimization, including a comparison with the traditional approach of dynamic programming. The text then studies the Markov process, focusing on infinite-horizon optimization problems, and moves on to discuss optimal control of diffusion processes with semi-smooth value functions and degenerate points, and optimization of multi-dimensional diffusion processes. The book concludes with a brief overview of performance derivative-based optimization. Among the more important novel considerations presented are: the extension of the Hamilton–Jacobi–Bellman optimality condition from smooth to semi-smooth value functions by derivation of explicit optimality conditions at semi-smooth points and application of this result to degenerate and reflected processes; proof of semi-smoothness of the value function at degenerate points; attention to the under-selectivity issue for the long-run average and bias optimality; discussion of state classification for time nonhomogeneous continuous processes and multi-class optimization; and development of the multi-dimensional Tanaka formula for semi-smooth functions and application of this formula to stochastic control of multi-dimensional systems with degenerate points. The book will be of interest to researchers and students in the field of stochastic control and performance optimization alike.

ISBN: 9783030418465

Standard No.: 10.1007/978-3-030-41846-5doiSubjects--Topical Terms:

1227422
Markov model.

LC Class. No.: TJ212-225

Dewey Class. No.: 629.8

Relative Optimization of Continuous-Time and Continuous-State Stochastic Systems
LDR:03756nam a22004095i 4500 001 1026414
003 DE-He213
005 20200706120443.0
007 cr nn 008mamaa
008 210318s2020 gw | s |||| 0|eng d
020 $a 9783030418465 $9 978-3-030-41846-5
024 7 $a 10.1007/978-3-030-41846-5 $2 doi
035 $a 978-3-030-41846-5
050 4 $a TJ212-225
072 7 $a TJFM $2 bicssc
072 7 $a TEC004000 $2 bisacsh
072 7 $a TJFM $2 thema
082 0 4 $a 629.8 $2 23
100 1 $a Cao, Xi-Ren. $e author. $0 (orcid)0000-0001-5165-8804 $1 https://orcid.org/0000-0001-5165-8804 $4 aut $4 http://id.loc.gov/vocabulary/relators/aut $3 1322715
245 1 0 $a Relative Optimization of Continuous-Time and Continuous-State Stochastic Systems $h [electronic resource] / $c by Xi-Ren Cao.
250 $a 1st ed. 2020.
264 1 $a Cham : $b Springer International Publishing : $b Imprint: Springer, $c 2020.
300 $a XIX, 365 p. 21 illus., 12 illus. in color. $b online resource.
336 $a text $b txt $2 rdacontent
337 $a computer $b c $2 rdamedia
338 $a online resource $b cr $2 rdacarrier
347 $a text file $b PDF $2 rda
490 1 $a Communications and Control Engineering, $x 0178-5354
505 0 $a Chapter 1. Introduction -- Chapter 2. Optimal Control of Markov Processes: Inﬁnite Horizon -- Chapter 3. Optimal Control of Diffusion Processes -- Chapter 4. Degenerate Diffusion Processes -- Chapter 5. Multi-Dimensional Diffusion Processes -- Chapter 6. Performance-Derivative-Based Optimization -- Appendices -- Index.
520 $a This monograph applies the relative optimization approach to time nonhomogeneous continuous-time and continuous-state dynamic systems. The approach is intuitively clear and does not require deep knowledge of the mathematics of partial differential equations. The topics covered have the following distinguishing features: long-run average with no under-selectivity, non-smooth value functions with no viscosity solutions, diffusion processes with degenerate points, multi-class optimization with state classification, and optimization with no dynamic programming. The book begins with an introduction to relative optimization, including a comparison with the traditional approach of dynamic programming. The text then studies the Markov process, focusing on infinite-horizon optimization problems, and moves on to discuss optimal control of diffusion processes with semi-smooth value functions and degenerate points, and optimization of multi-dimensional diffusion processes. The book concludes with a brief overview of performance derivative-based optimization. Among the more important novel considerations presented are: the extension of the Hamilton–Jacobi–Bellman optimality condition from smooth to semi-smooth value functions by derivation of explicit optimality conditions at semi-smooth points and application of this result to degenerate and reflected processes; proof of semi-smoothness of the value function at degenerate points; attention to the under-selectivity issue for the long-run average and bias optimality; discussion of state classification for time nonhomogeneous continuous processes and multi-class optimization; and development of the multi-dimensional Tanaka formula for semi-smooth functions and application of this formula to stochastic control of multi-dimensional systems with degenerate points. The book will be of interest to researchers and students in the field of stochastic control and performance optimization alike.
650 2 4 $a Markov model. $3 1227422
650 2 4 $a Calculus of Variations and Optimal Control; Optimization. $3 593942
650 1 4 $a Control and Systems Theory. $3 1211358
650 0 $a Markov processes. $3 527825
650 0 $a Calculus of variations. $3 527927
650 0 $a Control engineering. $3 1249728
710 2 $a SpringerLink (Online service) $3 593884
773 0 $t Springer Nature eBook
776 0 8 $i Printed edition: $z 9783030418458
776 0 8 $i Printed edition: $z 9783030418472
776 0 8 $i Printed edition: $z 9783030418489
830 0 $a Communications and Control Engineering, $x 0178-5354 $3 1254247
856 4 0 $u https://doi.org/10.1007/978-3-030-41846-5
912 $a ZDB-2-INR
912 $a ZDB-2-SXIT
950 $a Intelligent Technologies and Robotics (SpringerNature-42732)
950 $a Intelligent Technologies and Robotics (R0) (SpringerNature-43728)