政大機構典藏-National Chengchi University Institutional Repository(NCCUR):Item 140.119/142101

政大典藏 > College of Informatics > Executive Master Program of Computer Science of NCCU > Theses > Item 140.119/142101

Please use this identifier to cite or link to this item: https://nccur.lib.nccu.edu.tw/handle/140.119/142101

Title:	電力監控資料傳輸之一致性與可靠性問題研究—以A公司電力調度平台架構為例 Consistency and Availability Problems of Electricity Monitoring Data Transmission – A Case Study of an Electricity Dispatch Platform of A Company
Authors:	黃俊鈞 Huang, Chun-Chun
Contributors:	陳恭廖峻鋒 Chen, Kung Liao, Chun-Feng 黃俊鈞 Huang, Chun-Chun
Keywords:	電力監控分散式系統一致性可靠性 Electricity monitoring Distributed systems Consistency Availability
Date:	2022
Issue Date:	2022-10-05 09:09:19 (UTC+8)
Abstract:	在電力交易市場裡，台電公司會使用各個交易群組回傳之電表監控資料作為即時調度、月度結算的依據。但電表的監控資料卻有著幾個根本的問題。首先，傳輸距離長，但Edge端的網路可靠性不足，造成了明顯的單一脆弱點問題；第二，資料本身缺少完整性、不可否認性的驗證措施，然而這是智慧電表普遍的情形，目前已有研究進行改善；第三，資料模型缺乏一致性的保證，這使得不同端點間對資料筆數及時序關聯認定會有出入。因此本研究便希望探究並解決這幾個問題，並藉由這個研究過程，來深入了解資料一致性的本質，以及如何設計跨地域性的資料傳輸架構。對此，本研究提出三個機制來解決第一項與第三項問題：第一是藉由建立高可用的Edge端網路以增加傳輸路線，減少Edge端斷線的機率；第二是藉由建立資料間鏈結式關聯，如：時序間的因果關聯，使得Cloud端得以掌握與Edge端資料的數量與次序差異，確保一致性；第三是使用Piggyback的機制進行補值，以利當缺值發生時，可透過自動補值的方式將Cloud端資料補足。最後透過兩項網路面的實驗情境，驗證在這三項機制相互配合下，資料能自動地補足，以達成最終一致性的目標，並使得傳輸中的Edge端DataSender服務失效時，備援的另一組服務就能在短時間內接手並開始回傳資料，以達成高可用性的目標。 Taiwan Power Company (TPC) uses the Electricity Monitoring Data for dispatching ancillary services and the calculating fee of Transaction Groups monthly. However, these data read from AMI on the Edge side have several critical issues. First, the network of the Edge side is not reliable for long-range transmission, because there is a single point of failure problem. Second, the data don’t have self-verification and non-deniable mechanisms for ensuring integrity. Third, there is no guarantee of consistency of the data model, it makes data content and counts will be different between Cloud and Edge sides. This research aims to understand the essentials of consistency and know how to design a good cross-region data transmission architecture by solving these problems. This thesis proposes three methods to deal with these problems: High-Available Network of Edge, Chained Data Relationship, and Piggyback Fixing. Lastly, the author verifies these suggestions by two Network failure experiments to show how data are automatically fixed and how the standing by DataSender will take control and send to Cloud when another is failed. And how the data in Cloud will become consistent eventually.
Reference:	ArentzMarcel. (2021年11月23日). The piggyback mechanism. 擷取自 checkmk documentation: https://docs.checkmk.com/latest/en/piggyback.html Brewer, E. A. (2000). Towards Robust Distributed Systems. Proceedings of the Nineteenth Annual ACM Symposium on Principles of Distributed Computing (p. 7). Portland, Oregon, USA: Association for Computing Machinery. doi:10.1145/343477.343502 Cambridge Dictionary: piggyback. (無日期). 擷取自 Cambridge Dictionary: https://dictionary.cambridge.org/us/dictionary/english/piggyback Herlihy, M. P. (1990). Linearizability: A Correctness Condition for Concurrent Objects. New York, NY, USA: Association for Computing Machinery. doi:10.1145/78969.78972 KleppmannMartin. (2015年5月11日). Please stop calling databases CP or AP. 擷取自 Martin Kleppmann: https://martin.kleppmann.com/2015/05/11/please-stop-calling-databases-cp-or-ap.html KleppmannMartin. (2021). 一致性與共識. 於 KleppmannMartin, 資料密集型應用系統設計 (李健榮, 譯者). 台北市: 碁峰/O`REILLY. liuyongfei. (2020年7月20日). 阿里canal是怎么通过zookeeper实现HA机制的？. 擷取自 segmentfault: 阿里canal是怎么通过zookeeper实现HA机制的？ Ongaroand Ousterhout, JohnDiego. (2014). In Search of an Understandable Consensus Algorithm. Proceedings of the 2014 USENIX Conference on USENIX Annual Technical Conference (頁 305–320). Philadelphia, PA: USENIX Association. doi:10.5555/2643634.2643666 Terry, D. (2011). Replicated Data Consistency Explained Through Baseball. Microsoft. V. Deshpande, L. G. (2020). Blockchain Based Decentralized Framework for Energy Demand Response Marketplace. NOMS 2020 - 2020 IEEE/IFIP Network Operations and Management Symposium, (pp. 1-9). doi:10.1109/NOMS47738.2020.9110378 ZooKeeper. (2022, 6 5). ZooKeeper: Because Coordinating Distributed Systems is a Zoo. Retrieved from Zookeeper: https://zookeeper.apache.org/doc/r3.8.0/index.html ZooKeeper Programmer`s Guide. (2022年6月5日). 擷取自 Apache Zookeeper: https://zookeeper.apache.org/doc/r3.3.3/zookeeperProgrammers.html 台灣電力公司. (2022年8月9日). 輔助服務IEC 61850 及 DNP 3.0 傳輸格式說明. 擷取自電力交易平台: https://etp.taipower.com.tw/web/download/3-1%EF%BC%9A%E9%99%84%E4%BB%B6%E4%BA%8C%20%E8%BC%94%E5%8A%A9%E6%9C%8D%E5%8B%99IEC%2061850%20%E5%8F%8A%20DNP%203.0%20%E5%82%B3%E8%BC%B8%E6%A0%BC%E5%BC%8F%E8%AA%AA%E6%98%8E%20TPC-MT-C0301-v02-9.2.pdf 台灣電力公司. (2022年5月6日). 電力交易平台參考資料電力系統運轉與調度. 擷取自電力交易平台: https://etp.taipower.com.tw/web/download/2.電力系統運轉與調度.pdf 梁敏雄. (2021年2月23日). 臺灣電力市場-電力輔助服務市場初步介紹. 擷取自 FIND: https://www.find.org.tw/index/knowledge/browse/26c27cabcebae579b988cb356ab7a023/
Description:	碩士國立政治大學資訊科學系碩士在職專班 108971005
Source URI:	http://thesis.lib.nccu.edu.tw/record/#G0108971005
Data Type:	thesis
DOI:	10.6814/NCCU202201555
Appears in Collections:	[Executive Master Program of Computer Science of NCCU] Theses

Files in This Item:

File	Size	Format
index.html	0Kb	HTML2	1	View/Open

社群 sharing

Loading...