Cross-Lingual Word Embeddings

Preface.- Introduction.- Monolingual Word Embedding Models.- Cross-Lingual Word Embedding Models: Typology.- A Brief History of Cross-Lingual Word Representations.- Word-Level Alignment Models.- Sentence-Level Alignment Methods.- Document-Level Alignment Models.- From Bilingual to Multilingual Training.- Unsupervised Learning of Cross-Lingual Word Embeddings.- Applications and Evaluation.- Useful Data and Software.- General Challenges and Future Directions.- Bibliography.- Authors' Biographies.

Anders Søgaard is a father of three and a published poet, as well as a Full Professor in Computer Science the University of Copenhagen. He is currently funded by the Novo Nordisk Foundation, the Lundbeck Foundation, and the Innovation Fund Denmark; before that, he held an ERC Starting Grant and a Google Focused Research Award. He has won best paper awards at NAACL, EACL, CoNLL, etc. He previously wrote Semi-Supervised Learning and Domain Adaptation in NLP (Morgan & Claypool, 2013) and Cross-Lingual Word Embeddings (Morgan & Claypool, 2019), the latter with co-authors Ivan Vulic, Sebastian Ruder, and Manaal Faruqui.Ivan Vulic is a Senior Research Associate in the Language Technology Lab at the University of Cambridge since 2015. Ivan holds a Ph.D. in Computer Science from KU Leuven, having achieved summa cum laude in 2014 on ""Unsupervised Algorithms for Cross-lingual Text Analysis, Translation Mining, and Information Retrieval."" He is interested in representation learning, humanlanguage understanding, distributional, lexical, and multi-modal semantics inmonolingual and multilingual contexts, and transfer learning for enabling cross-lingual NLP applications. He has co-authored more than 60 peer-reviewed research papers published in top-tier journals and conference proceedings in NLP and IR. He co-lectured a tutorial on monolingual and multilingual topic models and applications at ECIR 2013 and WSDM 2014, a tutorial onword vector space specialisation at EACL 2017 and ESSLLI 2018, a tutorial on cross-lingual word representations at EMNLP 2017, and a tutorial on deep learning for conversational AI at NAACL 2018.Sebastian Ruder is a Research Scientist at DeepMind. He obtained his Ph.D. in Natural Lan-guage Processing at the National University of Ireland, Galway in 2019. He is interested intransfer learning and cross-lingual learning and has published widely read reviews as well asmore than ten peer-reviewed research papers in top-tier conference proceedings in