We see that javascript is disabled or not supported by your browser - javascript is needed for important actions on the site. Read more

What's New - Home - Login

Member $avings: $81,594,201.87 | Books Available: 791,363 | Members Online: 292

Swap Used Books - Buy New Books at Great Prices!

How To Swap Books Sign Up Search submenu

PBS Market (New Books)

Gift Buying Guide

Book Browser Advanced Search Books Posted Today Member Book Reviews Award Winning Books NYT Best Sellers Amazon Best Sellers Most Traveled Copies Club Wish List

Discussion Forums Book Lists

Club Lists My Book Lists My Watched Lists Create a List

Blog Donations

School Donation Program In Memory of... Military Donation Program Friends of PBS

Box-O-Books Maps The Eclectic Pen Fun Stuff

20 Questions Sudoku Bookmark Creator

Top 100

Requests Posts Swappers Referrers Reviewers

Pulse of PBS Spread The Word

Invite Friends Bookmarks Facebook Page Facebook App More Ways...

Photo Gallery Recipes Club Tag Cloud Member Testimonials

Help Center submenu

How To Swap Books Browse Help Docs Ask the Librarian PBS Member Icons Live Help

Kiosk

PBS Market (New Books) Go Shopping Buy Credits Buy PBS Money Upgrade Membership Gift Certificates Transfer Credits

Need Help?

Search - Dynamic Programming and Optimal Control, Vol. II, 4th Edition: Approximate Dynamic Programming

Dynamic Programming and Optimal Control Vol II 4th Edition Approximate Dynamic Programming
Author: Dimitri P. Bertsekas

This 4th edition is a major revision of Vol. II of the leading two-volume dynamic programming textbook by Bertsekas, and contains a substantial amount of new material, as well as — a reorganization of old material. The length has increased by more than 60% from the third edition, and — most of the old material has been restructured and/or revised.... more » Volume II now numbers more than 700 pages and is larger in size than Vol. I. It can arguably be viewed as a new book!

Approximate DP has become the central focal point of Vol. II, and occupies more than half of the book (the last two chapters, and large parts of Chapters 1-3). Thus one may also view Vol. II as a followup of the author's 1996 book ``Neuro-Dynamic Programming" (coauthored with John Tsitsiklis). The present book focuses to a great extent

on new research that became available after 1996. On the other hand, the textbook style of the book has been preserved, and some material has been explained at an intuitive or informal level, while referring to the journal literature or the Neuro-Dynamic Programming book for a more mathematical treatment.

As the book's focus shifted, increased emphasis was placed on new or recent research in approximate DP and simulation-based methods, as well as on asynchronous iterative methods, in view of the central role of simulation, which is by nature asynchronous. A lot of this material is an outgrowth of research conducted in the six years since the previous edition. Some of the highlights, in the order appearing in the book, are:

(a) A broad spectrum of simulation-based, approximate value iteration, policy iteration, and Q-learning methods based on projected equations and aggregation.

(b) New policy iteration and Q-learning algorithms for stochastic shortest path problems with improper policies.

(c) Reliable Q-learning algorithms for optimistic policy iteration.

(d) New simulation techniques for multistep methods, such as geometric and free-form sampling, based on generalized weighted Bellman equations.

(e) Computational methods for generalized/abstract discounted DP, including convergence analysis and error bounds for approximations.

(f) Monte Carlo linear algebra methods, which extend the approximate DP methodology to broadly applicable problems involving large-scale regression and systems of linear equations.

The book was developed through teaching graduate courses at M.I.T.

Contents: 1. Discounted Problems - Theory. 2. Discounted Problems - Computational Methods. 3.

Stochastic Shortest Path Problems. 4. Undiscounted Problems. 5. Average Cost per Stage Problems. 6. Approximate Dynamic Programming - Discounted Models. 7. Approximate Dynamic Programming - Nondiscounted Models and Generalizations.

ISBN-13: 9781886529441
ISBN-10: 1886529442
Publication Date: 6/18/2012
Pages: 712
Edition: 4th
Rating:

0 stars, based on 0 rating

Publisher: Athena Scientific
Book Type: Hardcover
Members Wishing: 0
Reviews: Amazon | Write a Review

Genres:

Computers & Technology >> Computer Science

Back to the Top ↑

Search - Dynamic Programming and Optimal Control, Vol. II, 4th Edition: Approximate Dynamic Programming

Loading...