Error title
Some error text about your books and stuff.
Close

Adaptive Markov Control Processes

by Hernandez-Lerma, O. A

Adaptive Markov Control Processes cover
  • ISBN: 9780387969664
  • ISBN10: 0387969667

Adaptive Markov Control Processes

by Hernandez-Lerma, O. A

  • Binding: Hardcover
  • Publisher: Springer-Verlag
  • Publish date: 05/01/1989
  • ISBN: 9780387969664
  • ISBN10: 0387969667
used Add to Cart $16.87
You save: 81%
Marketplace Item
new Add to Cart $106.25
FREE economy shipping!
Description: 1 Controlled Markov Processes.- 1.1 Introduction.- 1.2 Stochastic Control Problems.- Control Models.- Policies.- Performance Criteria.- Control Problems.- 1.3 Examples.- An Inventory/Production System.- Control of Water Reservoirs.- Fisheries Management.- Nonstationary MCM's.- Semi-Markov Control Models.- 1.4 Further Comments.- 2 Discounted Reward Criterion.- 2.1 Introduction.- Summary.- 2.2 Optimality Conditions.- Continuity of ?*.- 2.3 Asymptotic Discount Optimality.- 2.4 Approximation of MCM's.- Nonstationary Value-Iteration.- Finite-State Approximations.- 2.5 Adaptive Control Models.- Preliminaries.- Nonstationary Value-Iteration.- The Principle of Estimation and Control.- Adaptive Policies.- 2.6 Nonparametric Adaptive Control.- The Parametric Approach.- New Setting.- The Empirical Distribution Process.- Nonparametric Adaptive Policies.- 2.7 Comments and References.- 3 Average Reward Criterion.- 3.1 Introduction.- Summary.- 3.2 The Optimality Equation.- 3.3 Ergodicity Conditions.- 3.4 Value Iteration.- Uniform Approximations.- Successive Averagings.- 3.5 Approximating Models.- 3.6 Nonstationary Value Iteration.- Nonstationary Successive Averagings.- Discounted-Like NVI.- 3.7 Adaptive Control Models.- Preliminaries.- The Principle of Estimation and Control (PEC).- Nonstationary Value Iteration (NVI).- 3.8 Comments and References.- 4 Partially Observable Control Models.- 4.1 Introduction.- Summary.- 4.2 PO-CM: Case of Known Parameters.- The PO Control Problem.- 4.3 Transformation into a CO Control Problem.- I-Policies.- The New Control Model.- 4.4 Optimal I-Policies.- 4.5 PO-CM's with Unknown Parameters.- PEC and NVI I-Policies.- 4.6 Comments and References.- 5 Parameter Estimation in MCM's.- 5.1 Introduction.- Summary.- 5.2 Contrast Functions.- 5.3 Minimum Contrast Estimators.- 5.4 Comments and References.- 6 Discretization Procedures.- 6.1 Introduction.- Summary.- 6.2 Preliminaries.- 6.3 The Non-Adaptive Case.- A Non-Recursive Procedure.- A Recursive Procedure.- 6.4 Adaptive Control Problems.- Preliminaries.- Discretization of the PEC Adaptive Policy.- Discretization of the NVI Adaptive Policy.- 6.5 Proofs.- The Non-Adaptive Case.- The Adaptive Case.- 6.6 Comments and References.- Appendix A. Contraction Operators.- Appendix B. Probability Measures.- Total Variation Norm.- Weak Convergence.- Appendix C. Stochastic Kernels.- Appendix D. Multifunctions and Measurable Selectors.- The Hausdorff Metric.- Multifunctions.- References.- Author Index.
Expand description
Seller Condition Comments Price  
Seller: Row by Row Bookshop
Location: Sugar Grove, NC
Condition: Good
An ex-library copy in original yellow hard covers lettered in black. The
[...]
Price:
$16.87
Comments:
An ex-library copy in original yellow hard covers lettered in black. The
[...]
Seller: Munster & Company
Location: Corvallis, OR
Condition: Good
Shipping Icon
Springer Verlag, 1989. First printing with full number line; cover very
[...]
Price:
$18.00
Comments:
Springer Verlag, 1989. First printing with full number line; cover very
[...]
Seller: BingoBooks2
Location: Vancouver, WA
Condition: Very Good
Shipping Icon
Hardback book in near fine condition.
Price:
$37.68
Comments:
Hardback book in near fine condition.
Seller: Ergodebooks
Location: Richmond, TX Ask seller a question
Condition: New
Buy with confidence. Excellent Customer Service & Return policy.Ships Fast. 24*7 Customer Service.
Price:
$101.45
Comments:
Buy with confidence. Excellent Customer Service & Return policy.Ships Fast. 24*7 Customer Service.
please wait
Please Wait

Notify Me When Available

Enter your email address below,
and we'll contact you when your school adds course materials for
.
Enter your email address below, and we'll contact you when is back in stock (ISBN: ).