Title
Bridging linguistic typology and multilingual machine translation with multi-view language representations
Date Issued
01 January 2020
Access level
metadata only access
Resource Type
conference paper
Author(s)
University of Edinburgh
Publisher(s)
Association for Computational Linguistics (ACL)
Abstract
Sparse language vectors from linguistic typology databases and learned embeddings from tasks like multilingual machine translation have been investigated in isolation, without analysing how they could benefit from each other's language characterisation. We propose to fuse both views using singular vector canonical correlation analysis and study what kind of information is induced from each source. By inferring typological features and language phylogenies, we observe that our representations embed typology and strengthen correlations with language relationships. We then take advantage of our multi-view language vector space for multilingual machine translation, where we achieve competitive overall translation accuracy in tasks that require information about language similarities, such as language clustering and ranking candidates for multilingual transfer. With our method, which is also released as a tool, we can easily project and assess new languages without expensive retraining of massive multilingual or ranking models, which are major disadvantages of related approaches.
Start page
2391
End page
2406
Language
English
OCDE Knowledge area
Lenguas, Literatura
Scopus EID
2-s2.0-85117753773
ISBN
9781952148606
Resource of which it is part
ference
ISBN of the container
978-195214860-6
Conference
EMNLP 2020 - 2020 Conference on Empirical Methods in Natural Language Processing, Proceedings of the Conference
Source funding
Engineering and Physical Sciences Research Council
EP-SRC
Horizon 2020
Sponsor(s)
This work was supported by funding from the European Union's Horizon 2020 research and innovation programme under grant agreements No 825299 (GoURMET) and the EP-SRC fellowship grant EP/S001271/1 (MTStretch). Also, it was performed using resources provided by the Cambridge Service for Data Driven Discovery (CSD3) operated by the University of Cambridge Research Computing Service (http://www. csd3.cam.ac.uk/), provided by Dell EMC and In-tel using Tier-2 funding from the Engineering and Physical Sciences Research Council (capital grant EP/P020259/1), and DiRAC funding from the Science and Technology Facilities Council (www.dirac.ac.uk). We express our thanks to Kenneth Heafield and Rico Sennrich, who provided us with access to the computing resources. Last but not least, we thank the organisers and participants of the First Workshop of Typology for Polyglot NLP, and the members of the Statistical Machine Translation group at the University of Edinburgh, whose provided relevant feedback in an early stage of the study. This work was supported by funding from the European Union’s Horizon 2020 re search and innovation programme under grant agreements No 825299 (GoURMET) and the EP-SRC fellowship grant EP/S001271/1 (MTStretch). Also, it was performed using resources provided by the Cambridge Service for Data Driven Discovery (CSD3) operated by the University of Cambridge Research Computing Service (http://www. csd3.cam.ac.uk/), provided by Dell EMC and Intel using Tier-2 funding from the Engineering and Physical Sciences Research Council (capital grant EP/P020259/1), and DiRAC funding from the Science and Technology Facilities Council (www.dirac.ac.uk). We express our thanks to Kenneth Heafield and Rico Sennrich, who provided us with access to the computing resources.
Sources of information: Directorio de Producción Científica Scopus