
Building Dialogue POMDPs from Expert Dialogues
Description
Alles über E-Books | Antworten auf Fragen rund um E-Books, Kopierschutz und Dateiformate finden Sie in unserem Info- & Hilfebereich.
This book discusses the Partially Observable Markov Decision Process (POMDP) framework applied in dialogue systems. It presents POMDP as a formal framework to represent uncertainty explicitly while supporting automated policy solving. The authors propose and implement an end-to-end learning approach for dialogue POMDP model components. Starting from scratch, they present the state, the transition model, the observation model and then finally the reward model from unannotated and noisy dialogues. These altogether form a significant set of contributions that can potentially inspire substantial further work. This concise manuscript is written in a simple language, full of illustrative examples, figures, and tables.
More details
Other editions
Additional editions

Persons
Hamidreza Chinaei is a postdoctoral fellow at the Computer Science Department in University of Toronto under the supervision of Dr. Frank Rudzicz through an NSERC Engage Fund with IBM Canada. Dr. Chinaei has received his PhD in 2013 in Computer Science from Laval University on the application of machine learning for speech and natural language processing tasks, and MMath in Computer Science from the University of Waterloo on semantic query optimization. He has received the Industrial Track Student Scholarship and Award from the 2012 Canadian AI Conference and the Best Student Paper Award from the International Conference on Agents and Artificial Intelligence in 2009.
Brahim Chaib-draa received a Diploma in Computer Engineering from the École Supérieure d'Électricité (SUPELEC) de Paris, Paris, France, in 1978 and a Ph.D. degree in Computer Science from the Université du Hainaut-Cambrésis, Valenciennes, France, in 1990. In 1990, he joined the Department of Computer Science and Software Engineering at Laval University, Quebec, QC, Canada, where he is a Professor and Group Leader of the Decision for Agents and Multi-Agent Systems (DAMAS) Group. His research interests include agent and multiagent computing, machine learning and complex decision making. He is the author of several technical publications. Dr. Chaib-draa is a member of ACM and AAAI and senior member of the IEEE Computer Society.
Content
1 Introduction.- 2 A few words on topic modeling.- 3 Sequential decision making in spoken dialog management.- 4 Learning the dialog POMDP model components.- 5 Learning the reward function.- 6 Application on healthcare dialog management.- 7 Conclusions and future work.
System requirements
File format: PDF
Copy protection: Watermark-DRM (Digital Rights Management)
System requirements:
- Computer (Windows; MacOS X; Linux): Use the free software Adobe Reader, Adobe Digital Editions, or any other PDF viewer of your choice (see eBook Help).
- Tablet/Smartphone (Android; iOS): Install the free app Adobe Digital Editions or another reading app for eBooks, e.g., PocketBook (see eBook Help).
- E-reader: Bookeen, Kobo, Pocketbook, Sony, Tolino and many more (only limited: Kindle).
The file format PDF always displays a book page identically on any hardware. This makes PDF suitable for complex layouts such as those used in textbooks and reference books (images, tables, columns, footnotes). Unfortunately, on the small screens of e-readers or smartphones, PDFs are rather annoying, requiring too much scrolling.
This eBook uses Watermark-DRM, a „soft” copy protection. This means that there are no technical restrictions to prevent illegal distribution. However, there is a personalised watermark embedded in the eBook that can be used to identify the purchaser of the eBook in the event of misuse and to provide evidence for legal purposes.
For more information, see our eBook Help page.