Loading...
|
Please use this identifier to cite or link to this item:
https://nccur.lib.nccu.edu.tw/handle/140.119/129119
|
| Title: | Learning English–Chinese bilingual word representations from sentence-aligned parallel corpus |
| Authors: | 黃瀚萱*
Chen, Hsin-Hsi
Yen, An-Zi
Chen, Hsin-Hsi |
| Contributors: | 資科系 |
| Keywords: | Cross-lingual applications;Distributed word representation;Word alignment |
| Date: | 2019-07 |
| Issue Date: | 2020-03-05 14:40:57 (UTC+8) |
| Abstract: | Representation of words in different languages is fundamental for various cross-lingual applications. In the past researches, there was an argument in using or not using word alignment in learning bilingual word representations. This paper presents a comprehensive empirical study on the uses of parallel corpus to learn the word representations in the embedding space. Various nonalignment and alignment approaches are explored to formulate the contexts for Skip-gram modeling. In the approaches without word alignment, concatenating A and B, concatenating B and A, interleaving A with B, shuffling A and B, and using A and B separately are considered, where A and B denote parallel sentences in two languages. In the approaches with word alignment, three word alignment tools, including GIZA++, TsinghuaAligner, and fast_align, are employed to align words in sentences A and B. The effects of alignment direction from A to B or from B to A are also discussed. To deal with the unaligned words in the word alignment approach, two alternatives, using the words aligned with their immediate neighbors and using the words in the interleaving approach, are explored. We evaluate the performance of the adopted approaches in four tasks, including bilingual dictionary induction, cross-lingual information retrieval, cross-lingual analogy reasoning, and cross-lingual word semantic relatedness. These tasks cover the issues of translation, reasoning, and information access. Experimental results show the word alignment approach with conditional interleaving achieves the best performance in most of the tasks. 2019 Elsevier Ltd. All rights reserved. |
| Relation: | Computer Speech & Language, Vol.56, pp.52-72 |
| Data Type: | article |
| DOI 連結: | https://doi.org/10.1016/j.csl.2019.01.002 |
| DOI: | 10.1016/j.csl.2019.01.002 |
| Appears in Collections: | [資訊科學系] 期刊論文
|
Files in This Item:
| File |
Description |
Size | Format | |
|---|
| 182.pdf | | 2840Kb | Adobe PDF2 | 318 | View/Open |
|
All items in 政大典藏 are protected by copyright, with all rights reserved.
|
