政大機構典藏-National Chengchi University Institutional Repository(NCCUR):Item 140.119/36378
English  |  正體中文  |  简体中文  |  Post-Print筆數 : 27 |  全文筆數/總筆數 : 113451/144438 (79%)
造訪人次 : 51244298      線上人數 : 940
RC Version 6.0 © Powered By DSPACE, MIT. Enhanced by NTU Library IR team.
搜尋範圍 查詢小技巧:
  • 您可在西文檢索詞彙前後加上"雙引號",以獲取較精準的檢索結果
  • 若欲以作者姓名搜尋,建議至進階搜尋限定作者欄位,可獲得較完整資料
  • 進階搜尋
    政大機構典藏 > 資訊學院 > 資訊科學系 > 學位論文 >  Item 140.119/36378
    請使用永久網址來引用或連結此文件: https://nccur.lib.nccu.edu.tw/handle/140.119/36378


    題名: 自動摘要方法之研究與探討
    作者: 吳家威
    Wu, Chia-wei
    貢獻者: 劉昭麟
    吳家威
    Wu, Chia-wei
    關鍵詞: summarization
    ontology
    日期: 2002
    上傳時間: 2009-09-18 18:26:21 (UTC+8)
    摘要: 隨著網際網路的發展,人類能夠獲取的資訊也隨之增加。因此,如何增加獲取資訊的效率便成為重要的研究之一。自動摘要系統的目的即在於協助使用者有效率的閱讀。其根本的問題為:如何從文章中找出重要的資訊並呈現給使用者。本文採用三種方法進行摘要,應用於英文的新聞文件:第一種為利用ontology建立一領域的文章可能的主題資訊,並利用該資訊選出重要的段落作為摘要。第二種方法為建立一領域的ontology後,利用ontology所定義的標籤建構摘要的樣板,再利用該樣版搜尋所需的資訊,並將摘要輸出。第三種方法為利用各種不同的特徵找出文章中較重要的段落。另外,我們也將文章依其主題予以分類,利用不同主題的文章呈現的特徵表現不同,改良原本的特徵選取摘要的方法。本文呈現三種以不同方式獲取文章的主題資訊的方法,並利用該資訊呈現文章中較重要的訊息,經過實驗的評估皆獲得一定的成果。
    In the past decade, the explosively growing number of online articles has made efficient information gathering a challenging necessity. We need ways to absorb the information contained in the news articles effectively. Automatically providing summaries of articles is one way to save people time. The essential problems of automatic summarization are: how to identify the useful information and how to present the results to readers. I compare and analyze three kinds of summarization methods. The first method constructs a domain-depend knowledge based on the ontology approach, then use the ontology for gathering the main topics, and chooses the desired proportion of paragraphs as the summary by gathered topical information. The second method is similar to that taken by information-extraction systems. I organize semantic tags into an ontological structure, and the summarization system learns tags patterns for creating summaries from tagged data. The summarization system creates summaries by extracting useful information from a news article, and replaces the semantic tags with extracts in selected tag patterns. The third method analyzes the effects of several previously proposed features for summarization under different situations. The most important observation is that the effectiveness if these features depends on the topics of the news articles Hence, I collect statistical information about the features for different possible new topics, and apply such conditional probabilistic information for extracting summaries. Effectiveness of these proposed methods vary from case to case, but is believed to be satisfactory based on the experimental results.
    目錄
    第一章 緒論 1
    1.1 研究動機 2
    1.2 問題描述 3
    1.3 研究目的 4
    1.4 論文貢獻 5
    1.5 論文的章節架構 6
    第二章 相關研究 7
    2.1 自動摘要系統研究簡介 7
    2.2 文獻探討 9
    2.3 自動摘要系統的評估 13
    2.4 討論 15
    第三章 應用本體論設計與建置摘要系統 17
    3.1 系統架構 17
    3.2 本體論簡介 18
    3.3 以Term-frequency為主要特徵的摘要方法 21
    3.4 Ontology-based的摘要方法 22
    3.5 資料來源 29
    3.6 實驗步驟與結果分析 30
    第四章 體育新聞摘要擷取 35
    4.1背景簡述 35
    4.2系統架構 36
    4.3 摘要產生方法 37
    4.3.1 標籤標記(tagging) 38
    4.3.2 句型學習 40
    4.3.3 句型篩選 42
    4.3.4 選取摘要 43
    4.3.5 摘要句型學習演算法 43
    4.4 成果展示 45
    4.5 分析與討論 47
    第五章 比較與分析特徵摘要方法 49
    5.1 系統架構 49
    5.2文件分類 51
    5.3 特徵 59
    5.3.1常用特徵 59
    5.3.2 Clustering Words 61
    5.4 特徵值分析 64
    5.4.1 資料來源 64
    5.4.2 使用個別特徵挑選摘要的實驗方法與結果 64
    5.4.3 特徵值於摘要段落與非摘要段落的差異 67
    5.4.4 依文章主題分類後的特徵值 69
    5.4.5 利用Information Gain分析特徵的摘要選取能力 72
    5.4.6 利用段落特徵值的排序分析 74
    5.5 實驗 76
    5.5.1 統計方法 76
    5.5.2 決策樹 82
    5.5.3討論 85
    5.6 結論 85
    第六章 總結 87
    參考文獻 89
    附錄 一: Ontology 圖 95
    附錄二 範例文章 99
    附錄三 標籤內容 100
    參考文獻: 參考文獻
    [1] C. Aone, M. E. Okurowski, and J. Gorlinsky, and B. Larsen. “A Scalable Summarization System Using Robust NLP,” Proceedings of the Association for Computational Linguistics Work shop on Intelligent Scalable Text Summarization, pp.66-73, 1997.
    [2] J. Allan, R. Gupta, and V. Khandelwal, “Temporal summaries of News Topics,” Proceedings of the 24th annual international ACM SIGIR Conference on Research and Development in Information Retrieval, pp.10-18, 2001.
    [3] J. Aseltine, “WAVE: An Incremental Algorithm for Information Extraction,” In Proceedings of the AAAI Workshop on Machine Learning for Information Extraction.1999.
    [4] R. Barzilay, N. Elhadad, and K. R. McKeown, “Inferring Strategies for Sentence Ordering in Multidocument News Summarization,”Journal of Artificial Intelligence Research, (17), pp.33-55, 2002.
    [5] L. D. Baker and A. K. McCallum, “Distributional Clustering of Words for Text Classification,” Proceedings of the 21th annual international ACM SIGIR Conference on Research and Development in Information Retrieval, pp.96-103, 1998.
    [6] S. Chan, T. Lai, W. Gao, B. T’sou, “Mining discourse markers for chinese textual summarization,” Proceedings, Conference of the North American Chapter of the Association for Computational Linguistics and Conference on Applied Natural Language Processing Workshop on Automatic Summarization, 2000.
    [7] B. Chandrasekaran, J. R. Josephson, and V. R. Benjamins, “What Are Ontologies, and Why Do We Need Them?,” IEEE Intelligent Systems, 14(1):pp.20-26, 1999.
    [8] R. O. Duda, P. E. Hart, D. G. Stork “Pattern Classification and Scene Analysis: Pattern Classification,” Brooks/Cole Wiley, John & Sons, Incorporated Pub Co, 2000.
    [9] S. Deerwester, S. Dumais, G.Furnas, T. Landauer, and R.Harshman, “Indexing by Latent Semantic Analysis,” Journal of the American Society for Information Science, (41), pp.391-407, 1990.
    [10] H. Edmundson. “New Methods in Automatic Abstracting,” Journal of ACM, 16(2), pp.264-285, 1969.
    [11] Tom Gruber, Ontology Definition, http://www-ksl.Stanford.edu/kst/what-is-an-ontology.html
    [12] H. H. Good, “Greenhouse of Science for Management,” Management Science, pp. 3,1958.
    [13] J. Goldstein, M. Kantrowitz, V. O. Mittal, and J. Carbonell, Summarizing “Text Documents: Sentence Selection and Evaluation Metrics, ” Proceedings of the 22th annual international ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 121-128, 1999.
    [14] C. W. Holsapple, and K. D. Joshi, “A Collaborative Approach to Ontology Design,” Communications of the ACM, 45, pp. 42~47, 2002.
    [15] V. Hatzivassiloglou, J. L. Klavans, M. L. Holcombe,R. Barzilay, M.-Y. Kan, and K. R. McKeown. “Simfinder: A Flexible Clustering Tool for Summarization,” Proceedings of the North American Chapter of the Association for Computational Linguistics 2001 Workshop on Automatic Summarization, pp.41-49, 2001.
    [16] U. Hahn, I. Mani, “The Challenges of Automatic Summarization,” IEEE Computer Society, (11), pp.29-36, 2002.
    [17] E. Hovy, and C. Y. Lin, “Automated Text Summarization in SUMMARIST, ” Advances in Automatic Text Summarization, MIT Press, pp.81-94, 1999.
    [18] K. S. Jones and J. Galliers, “Evaluating Natural Language Processing Systems: An Analysis and Review, ” Springer-Verlag, 1996.
    [19] H. Jing, R. Barzilay, K. McKeown, and M. Elhadad, “Summarization Evaluation Methods: Experiments and Analysis,” In Working Notes of the AAAI-98 Spring Symposium on Intelligent Text Summarization, pp.60-68, 1998
    [20] J. Kupiec, J. Pedersen, F. Chen, “A Trainable Document Summarizer,” Proceedings of the 18th annual international ACM SIGIR Conference on Research and Development in Information Retrieval, pp.68-73, 1995.
    [21] M. Kobayashi and K. Takeda, “Information retrieval on the web,” ACM Computing Surveys, (32), pp.144-173, 2000.
    [22] C. Y Lin, “Training a Selection Function for Extraction,” Proceedings of the eighth international conference on Information and knowledge management, pp.55-62, 1999.
    [23] H. P. Luhn., “The automatic creation of literature abstracts,” IBM Journal of Research and Development, 2(2), pp.159-165, 1958.
    [24] I. Mani, D. House, G. Klein, L. Hirschman, L. Obrst, T. Firmin, M. Chrzanowski, and B. Sundheim,” The tipster summac text summarization evaluation: Final report. Technical report, DARPA, 1998.
    [25] K. McKeown,“D.R.Radev, “Generating Summaries of Multiple News Articles,” Proceedings of the 18th annual international ACM SIGIR Conference on Research and Development in Information Retrieval, pp.74-82, 1995.
    [26] D. D. McDonald, “The View from the Trenches: Issues in the Ontology of Restricted Domains, ” Proceedings of the international Conference on Formal Ontology in Information Systems 2001, pp.22-33, 2001.
    [27] D. L. McGuinness, http://www.ontology.org/main/papers/iccs-dlm.html
    [28] T. M. Mitchell, “Machine Learning, ” The McGraw-Hill Companies, 1997.
    [29] M. Mitra, A. Singhal, and C. Buckley. “Automatic text summarization by paragraph extraction, ” In Applied Natural Language Processing / European Chapter of the Association for Computational Linguistics 97 Workshop on Intelligent Scalable Text Summarization, pp.31-36, 1997.
    [30] D. Marcu. “From discourse structures to text summaries,” In Applied Natural Language Processing / European Chapter of the Association for Computational Linguistics 97 Workshop on Intelligent Scalable Text Summarization, pp.82-88, 1997.
    [31] I. Mani, D. House, G. Klein, L. Hirschman, L. Obrst, T. Firmin, M. Chrzanowski, and B. Sundheim. “Advances in Automatic Text Summarization Evaluation: Final report. Technical report,” DARPA, 1998.
    [32] S. Miike, E. Itoh, K. Ono, and K. Sumita. “A FullText Retrieval System with Dynamic Abstract Generation Function,” Proceedings of the 17th annual international ACM SIGIR Conference on Research and Development in Information Retrieval, pp.152-161.1994.
    [33] A. Maedche, B. Motik, L. Stojanovic, R. Studer, and R. Volz, “Ontologies for Enterprise Knowledge Management,” IEEE Intelligent Systems, 18(2), pp.26-33, 2003.
    [34] S. H. Manning, “Foundations of Statistical Natural Language Processing”, MIT Press, 1999.
    [35] R. Navigli, P. Velardi, and A. Gangemi, “Ontology Learning and Its Application to Automated Terminology Translation,” IEEE Intelligent Systems, 18(1), pp.22-31, 2003.
    [36] M. F. Porter, “An Algorithm for Suffix Stripping,” Program, 14(3), pp.30-137, 1980.
    [37] J. R. Quinlan. , “C4.5: Programs for Machine Learning, ” 1993.
    [38] D. R. Radev, H. Jing, and M. Budzikowska, “Centro-based summarization of multiple documents: sentence extraction, utility-based evaluation and user studies,” In Applied Natural Language Processing / North American Chapter of the Association for Computational Linguistics 2000 Workshop, pp.21-29, 2000
    [39] G. Salton, M. J. McGill, “Introduction to modern information retrieval,” NY: McGraw-Hill, 1983
    [40] J. F. Sowa, “Knowledge Representation: Logical, Philosophical, and Computational Foundations, ” Brooks/Cole Pub Co, 1999.
    [41] D. Yarowsky, “Word-Sense Disambiguation Using Statistical Models of Roget`s Categories Trained on Large Corpora,” Proceedings of the 14th International Conference on Computational Linguistics, pp.454--460, 1992.
    [42] R. Yangarber, “Scenario Customization for Information Extraction,” Ph.D. thesis, New York University, 2000.
    [43] G. Yihong and X. Lin, “Generic Text Summarization Using Relevance Measure and Latent Semantic Analysis,” Proceedings of the 24th annual international ACM SIGIR Conference on Research and Development in Information Retrieval, pp.19-25, 2001.
    [44] http://www.cs.waikato.ac.nz/ml/weka/
    [45] www.mitre.org/resources/centers/it/maybury/summarization.html
    [46] ProQuest: www.proquest.com
    [47] Stop words: http://libraries.mit.edu/tutorials/general/stopwords.html
    [48] ESPN www.espn.com
    [49] 沈健誠,張俊盛, “多篇文件摘要系統,” 中華民國90年第十四屆計算機語言學會研討會論文集, pp.65-88. 2001
    [50] 李祥賓,柯淑津, “新聞文件摘要之研究,” 中華民國90年第十四屆計算機語言學會研討會論文集, pp.23-42. 2001
    [51] 吳宗璠,謝清佳, “資訊管理-理論與實務”, 智勝, 2000.
    [52] 新力索尼股份有限公司全球資訊網: www.sony.com.
    描述: 碩士
    國立政治大學
    資訊科學學系
    90753010
    91
    資料來源: http://thesis.lib.nccu.edu.tw/record/#G0090753010
    資料類型: thesis
    顯示於類別:[資訊科學系] 學位論文

    文件中的檔案:

    檔案 大小格式瀏覽次數
    index.html0KbHTML2316檢視/開啟


    在政大典藏中所有的資料項目都受到原著作權保護.


    社群 sharing

    著作權政策宣告 Copyright Announcement
    1.本網站之數位內容為國立政治大學所收錄之機構典藏,無償提供學術研究與公眾教育等公益性使用,惟仍請適度,合理使用本網站之內容,以尊重著作權人之權益。商業上之利用,則請先取得著作權人之授權。
    The digital content of this website is part of National Chengchi University Institutional Repository. It provides free access to academic research and public education for non-commercial use. Please utilize it in a proper and reasonable manner and respect the rights of copyright owners. For commercial use, please obtain authorization from the copyright owner in advance.

    2.本網站之製作,已盡力防止侵害著作權人之權益,如仍發現本網站之數位內容有侵害著作權人權益情事者,請權利人通知本網站維護人員(nccur@nccu.edu.tw),維護人員將立即採取移除該數位著作等補救措施。
    NCCU Institutional Repository is made to protect the interests of copyright owners. If you believe that any material on the website infringes copyright, please contact our staff(nccur@nccu.edu.tw). We will remove the work from the repository and investigate your claim.
    DSpace Software Copyright © 2002-2004  MIT &  Hewlett-Packard  /   Enhanced by   NTU Library IR team Copyright ©   - 回饋