报告题目:Continuous-time q-learning for Markov regime-switching system under Tsallis entropy
报告时间:2026年11月23日 19:00-20:00
报告地点:腾讯会议828-369-907
报告摘要:This paper studies continuous-time q-learning (the continuous-time counterpart of Q-learning) for a Markov regime-switching system under Tsallis entropy regularization. The Tsallis entropy regularization yields an optimal policy distribution that may not necessarily be a Gibbs measure, thereby complicating algorithm design. Furthermore, to address the limited universality of current continuous-time regime-switching reinforcement learning algorithms (often restricted to the exploratory mean-variance framework), this study focuses on continuous-time q-learning for Markov regime-switching systems based on Tsallis entropy, aiming for a more universally applicable continuous-time reinforcement learning method. We establish the martingale characterization of the q-function under Tsallis entropy for continuous-time Markov regime-switching systems. We further design two q-learning algorithms that differ based on whether the Lagrange multiplier can be explicitly derived. We apply these algorithms to the continuous-time exploratory mean-variance portfolio optimization problem in a regime-switching market.
报告人简介:张鑫,东南大学数学学院教授、博士生导师。主要从事随机控制及其在金融保险中的应用方面的研究,共主持国家自然科学基金6项, 教育部博士点专项基金1 项。在SIAM Journal on Control and Optimization、Automatica、Applied Mathematics and Optimization、Insurance Mathematics and Economics、Quantitative Finance、Scandinavian Actuarial Journal等国内外期刊上发表论文四十余篇。曾获山东省自然科学二等奖(参与),江苏省“333高层次人才”。