Simulation-Based Algorithms for Markov Decision Processes

Markov decision process (MDP) models are widely used for modeling sequential decision-making problems that arise in engineering, economics, computer science, and the social sciences.  Many real-world problems modeled by MDPs have huge state and/or action spaces, giving an opening to the curse of dim...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Chang, Hyeong Soo, Hu, Jiaqiao (VerfasserIn), Fu, Michael C., 19..- (VerfasserIn), Marcus, Steven I. (VerfasserIn)
Format: Livre numérique
Sprache:Anglais
Veröffentlicht: London : Springer London 2013.
Cham : Springer Nature
Schriftenreihe:Communications and Control Engineering
Online Zugang:Accès sur la plateforme de l'éditeur
Accès sur la plateforme Istex
Accès Université d'Orléans
Accès INSA CVL
Anmerkung: Archives Springer e-books (Licence nationale)
Archives Springer e-books (Licence nationale)
Autres localisations: Voir dans le Sudoc
Edition sous un autre format:• Simulation-Based Algorithms for Markov Decision Processes, Texte imprimé, 9781447150213
• Simulation-Based Algorithms for Markov Decision Processes, Texte imprimé, 9781447150237
• Simulation-Based Algorithms for Markov Decision Processes, Texte imprimé, 9781447159902
LEADER 04465nam a22003857a 4500
001 949561
008 130325s2013 xx ||| |||| 00| 0 eng d
009 PPN168294613
020 |a 9781447150220 
020 |a 9781447150220 
041 0 |a eng 
082 |a 629.8 
100 1 |a Chang, Hyeong Soo. 
245 1 0 |a Simulation-Based Algorithms for Markov Decision Processes   |c by Hyeong Soo Chang, Jiaqiao Hu, Michael C. Fu, Steven I. Marcus. 
260 |a London :  |b Springer London. 
260 |a Cham :  |b Springer Nature,  |c 2013. 
490 0 |a Communications and Control Engineering  |x 2197-7119 
500 |a Archives Springer e-books (Licence nationale) 
500 |a Archives Springer e-books (Licence nationale) 
505 0 |a Markov Decision Processes -- Multi-stage Adaptive Sampling Algorithms -- Population-based Evolutionary Approaches -- Model Reference Adaptive Search -- On-line Control Methods via Simulation -- Game-theoretic Methods via Simulation. 
506 |a Accès en ligne pour les établissements français bénéficiaires des licences nationales 
506 |a Accès soumis à abonnement pour tout autre établissement 
506 |a Conditions particulières de réutilisation pour les bénéficiaires des licences nationales. chttps://www.licencesnationales.fr/springer-nature-ebooks-contrat-licence-ln-2017 
520 |a Markov decision process (MDP) models are widely used for modeling sequential decision-making problems that arise in engineering, economics, computer science, and the social sciences.  Many real-world problems modeled by MDPs have huge state and/or action spaces, giving an opening to the curse of dimensionality and so making practical solution of the resulting models intractable.  In other cases, the system of interest is too complex to allow explicit specification of some of the MDP model parameters, but simulation samples are readily available (e.g., for random transitions and costs). For these settings, various sampling and population-based algorithms have been developed to overcome the difficulties of computing an optimal solution in terms of a policy and/or value function.  Specific approaches include adaptive sampling, evolutionary policy iteration, evolutionary random policy search, and model reference adaptive search. This substantially enlarged new edition reflects the latest developments in novel algorithms and their underpinning theories, and presents an updated account of the topics that have emerged since the publication of the first edition. Includes: . innovative material on MDPs, both in constrained settings and with uncertain transition properties; . game-theoretic method for solving MDPs; . theories for developing roll-out based algorithms; and . details of approximation stochastic annealing, a population-based on-line simulation-based algorithm. The self-contained approach of this book will appeal not only to researchers in MDPs, stochastic modeling, and control, and simulation but will be a valuable source of tuition and reference for students of control and operations research. The Communications and Control Engineering series reports major technological advances which have potential for great impact in the fields ofcommunication and control. It reflects research in industrial and academic institutions around the world so that the readership can exploit new possibilities as they become available. 
700 1 |a Hu, Jiaqiao.  |4 aut 
700 1 |a Fu, Michael C.,  |d 19..-  |4 aut 
700 1 |a Marcus, Steven I.  |4 aut 
776 0 |t Simulation-Based Algorithms for Markov Decision Processes  |b Texte imprimé  |z 9781447150213 
776 0 |t Simulation-Based Algorithms for Markov Decision Processes  |b Texte imprimé  |z 9781447150237 
776 0 |t Simulation-Based Algorithms for Markov Decision Processes  |b Texte imprimé  |z 9781447159902 
856 4 |q PDF  |u https://doi.org/10.1007/978-1-4471-5022-0  |z Accès sur la plateforme de l'éditeur 
856 4 |u https://revue-sommaire.istex.fr/ark:/67375/8Q1-F4XDVPNX-1  |z Accès sur la plateforme Istex 
856 4 |5 452349901:748123555  |u https://ezproxy.univ-orleans.fr/login?url=https://doi.org/10.1007/978-1-4471-5022-0  |z Accès Université d'Orléans 
856 4 |5 180339901:751578177  |u https://ezproxy.insa-cvl.fr/login?qurl=https://doi.org/10.1007/978-1-4471-5022-0  |z Accès INSA CVL 
997 |0 949561  |1 Livre numérique  |a Ressource numérique  |b INSA  |b ENSA  |c 0/Bibliothèque numérique/  |c 1/Bibliothèque numérique/Autre ressource numérique/