政大機構典藏-National Chengchi University Institutional Repository(NCCUR):Item 140.119/136360

政大機構典藏-National Chengchi University Institutional Repository(NCCUR):Item 140.119/136360

English | 正體中文 | 简体中文 | Post-Print筆數 : 27 | Items with full text/Total items : 113822/144841 (79%)
Visitors : 51776063 Online Users : 322

RC Version 6.0 © Powered By DSPACE, MIT. Enhanced by NTU Library IR team.

Scope

please add "double quotation mark" for query phrases to get precise results

please goto advance search for comprehansive author search

Adv. Search

Home ‧ Login ‧ Upload ‧ Help ‧ About ‧ Administer

Goto mobile version

政大典藏 > College of Commerce > Department of Money and Banking > Theses > Item 140.119/136360

Please use this identifier to cite or link to this item: https://nccur.lib.nccu.edu.tw/handle/140.119/136360

Title:	強化學習下動態調整風險偏好之投資組合配置:以台灣50指數為例 Portfolio Allocation with Dynamic Risk Aversion via Reinforcement Learning: Evidence from Taiwan 50 Index
Authors:	陳昱成 Chen, Yu-Cheng
Contributors:	林士貴陳昱成 Chen, Yu-Cheng
Keywords:	均數-變異數模型風險趨避強化學習近端策略優化 Mean-Variance model Risk Aversion Reinforcement Learning Proximal Policy Optimization
Date:	2021
Issue Date:	2021-08-04 14:51:05 (UTC+8)
Abstract:	Markowitz(1952)提出現代投資組合理論，透過均數-變異數模型(Mean-Variance Model) 為投資人進行資產配置，並設風險趨避參數調整報酬率和風險之間的比例，但在實務中，此風險趨避參數難以動態調整。本研究使用強化學習(Reinforcement Learning) 中的近端策略優化(Proximal Policy Optimization,PPO)，依據不同市場變化，動態調整每一天風險趨避參數，當市場情況好時，投資人偏好承擔較高風險，獲得更高報酬，當市場情況壞時，投資人風險偏好趨於保守。本研究以台灣 50 指數當作整體市場走勢，比較強化學習輸入過去不同時間週期資訊之結果，研究結果顯示，不論輸入時間週期長短，強化學習績效皆能贏過固定風險趨避參數下均數-變異數模型，說明利用強化學習，能解決實務上風險趨避參數難以動態調整之問題。 Markowitz (1952) proposed Modern Portfolio Theory, which used the Mean-Variance Model to allocate assets for investors, and set the risk aversion parameter to adjust the ratio between return and the risk. But in practice, this risk aversion parameter is difficult to adjust dynamically. In our paper, we use Proximal Policy Optimization in reinforcement learning to dynamically adjust daily risk aversion parameters according to different market changes. In a bull market, investors prefer to take higher risks and get higher returns. On the other hand, in a bear market, investors` risk appetite tends to be conservative. This study uses the Taiwan 50 Index as the overall market trend, and compares the results of inputting different time periods of information into the model. The results show that regardless of the length of the input time period, the performance of the model can outperform the mean-variance model under fixed risk aversion parameters. Explain that the use of reinforcement learning can solve the problem of difficulty in dynamic adjustment of risk aversion parameters in practice.
Reference:	劉上瑋 (2017)。深度增強學習在動態資產配置上之應用 : 以美國 ETF 為例。國立政治大學金融研究所碩士論文。 Basak, S., & Chabakauri, G. (2010). Dynamic mean-variance asset allocation. The Review of Financial Studies, 23(8), 2970-3016. Björk, T., Murgoci, A., & Zhou, X. Y. (2014). Mean–variance portfolio optimization with state‐dependent risk aversion. Mathematical Finance: An International Journal of Mathematics, Statistics and Financial Economics, 24(1), 1-24. Díaz, A., & Esparcia, C. (2019). Assessing risk aversion from the investor’s point of view. Frontiers in psychology, 10, 1490. Gold, C. (2003, March). FX trading via recurrent reinforcement learning. In 2003 IEEE International Conference on Computational Intelligence for Financial Engineering, 2003. Proceedings. (pp. 363-370). IEEE. Jiang, Z., & Liang, J. (2017, September). Cryptocurrency portfolio management with deep reinforcement learning. In 2017 Intelligent Systems Conference (IntelliSys) (pp. 905-913). IEEE. Li, Y., & Li, Z. (2013). Optimal time-consistent investment and reinsurance strategies for mean–variance insurers with state dependent risk aversion. Insurance: Mathematics and Economics, 53(1), 86-97. Markowitz, H. (1959). Portfolio selection. Journal of Finance, 7, 77–98. Moody, J., & Saffell, M. (2001). Learning to trade via direct reinforcement. IEEE Transactions on Neural Networks, 12(4), 875-889. Neuneier, R. (1998). Enhancing Q-learning for optimal asset allocation. Advances in neural information processing systems (pp. 936-942). Rosenberg, J. V., & Engle, R. F. (2002). Empirical pricing kernels. Journal of Financial Economics, 64(3), 341-372. Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017). Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347. Zhang, Y., Wu, Y., Li, S., & Wiwatanapataphee, B. (2017). Mean-variance asset liability management with state-dependent risk aversion. North American Actuarial Journal, 21(1), 87-106. Zhang, Y., Zhao, P., Li, B., Wu, Q., Huang, J., & Tan, M. (2020). Cost-sensitive portfolio selection via deep reinforcement learning. IEEE Transactions on Knowledge and Data Engineering.
Description:	碩士國立政治大學金融學系 108352019
Source URI:	http://thesis.lib.nccu.edu.tw/record/#G0108352019
Data Type:	thesis
DOI:	10.6814/NCCU202100814
Appears in Collections:	[Department of Money and Banking] Theses

Files in This Item:

File	Description	Size	Format
201901.pdf		2171Kb	Adobe PDF2	0	View/Open

All items in 政大典藏 are protected by copyright, with all rights reserved.

社群 sharing

著作權政策宣告 Copyright Announcement

1.本網站之數位內容為國立政治大學所收錄之機構典藏，無償提供學術研究與公眾教育等公益性使用，惟仍請適度，合理使用本網站之內容，以尊重著作權人之權益。商業上之利用，則請先取得著作權人之授權。
The digital content of this website is part of National Chengchi University Institutional Repository. It provides free access to academic research and public education for non-commercial use. Please utilize it in a proper and reasonable manner and respect the rights of copyright owners. For commercial use, please obtain authorization from the copyright owner in advance.

2.本網站之製作，已盡力防止侵害著作權人之權益，如仍發現本網站之數位內容有侵害著作權人權益情事者，請權利人通知本網站維護人員(nccur@nccu.edu.tw)，維護人員將立即採取移除該數位著作等補救措施。
NCCU Institutional Repository is made to protect the interests of copyright owners. If you believe that any material on the website infringes copyright, please contact our staff(nccur@nccu.edu.tw). We will remove the work from the repository and investigate your claim.

DSpace Software Copyright © 2002-2004 MIT & Hewlett-Packard / Enhanced by NTU Library IR team Copyright © - Feedback