首页 | 本学科首页   官方微博 | 高级检索  
     

有限规划水平部分可观Markov自适应决策过程的参数决策
引用本文:李江红,韩正之. 有限规划水平部分可观Markov自适应决策过程的参数决策[J]. 上海交通大学学报, 2000, 34(12): 1653-1657
作者姓名:李江红  韩正之
作者单位:上海交通大学智能工程研究所,上海200030
基金项目:国家自然科学基金资助项目(69874025)
摘    要:提出了一种有限规划水平部分可观、不确定Markov决策过程自适应决策算法.算法的基本思想是运用Bayes理论对未知系统进行"学习”,通过最小决策失误概率的参数决策实现参数估计,在参数估计的基础上进行控制决策从而以最大概率实现最优决策.文中证明了决策算法的收敛性.仿真结果表明了决策算法的有效性.

关 键 词:部分可观Markov决策过程  自适应控制  贝叶斯原理
文章编号:1006-2467(2000)12-1653-05
修稿时间:2000-01-19

Parameter Decision in Adaptive Partially Observable Markov Decision Process with Finite Planning Horizon
LI Jiang hong,HAN Zheng zhi. Parameter Decision in Adaptive Partially Observable Markov Decision Process with Finite Planning Horizon[J]. Journal of Shanghai Jiaotong University, 2000, 34(12): 1653-1657
Authors:LI Jiang hong  HAN Zheng zhi
Abstract:An algorithm was proposed for adaptive POMDP with finite planning horizon. In the algorithm, Bayes method is used to learn the unknown system, and the principle of minimum decision error probability is applied for parameter estimation. The control is obtained based on estimated parameter so that the probability that every decision being optimal is maximized. The convergence of the algorithm was proved and the effectiveness of the algorithm was demonstrated by the simulation.
Keywords:partially observable Markov decision process(POMDP)  adaptive control  Bayes principle
本文献已被 CNKI 万方数据 等数据库收录!
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号