Publications

I also have a Google Scholar page. You can get all bibtex entries here.

2019

Biao Zhang; Rico Sennrich (2019). Root Mean Square Layer Normalization. In Advances in Neural Information Processing Systems 32. Vancouver, Canada. [bib]

Elena Voita; Rico Sennrich; Ivan Titov (2019). Context-Aware Monolingual Repair for Neural Machine Translation. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and 9th International Joint Conference on Natural Language Processing. Hong Kong, China. [bib]

Elena Voita; Rico Sennrich; Ivan Titov (2019). The Bottom-up Evolution of Representations in the Transformer: A Study with Machine Translation and Language Modeling Objectives. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and 9th International Joint Conference on Natural Language Processing. Hong Kong, China. [bib]

Biao Zhang; Ivan Titov; Rico Sennrich (2019). Improving Deep Transformer with Depth-Scaled Initialization and Merged Attention. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and 9th International Joint Conference on Natural Language Processing. Hong Kong, China. [bib]

Gongbo Tang; Rico Sennrich; Joakim Nivre (2019). Encoders Help You Disambiguate Word Senses in Neural Machine Translation. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and 9th International Joint Conference on Natural Language Processing. Hong Kong, China. [bib]

Gongbo Tang; Rico Sennrich; Joakim Nivre (2019). Understanding Neural Machine Translation by Simplification: The Case of Encoder-free Models. In Proceedings of Recent Advances in Natural Language Processing. Varna, Bulgaria, pp. 1186-1193. [bib]

Denis Emelin; Ivan Titov; Rico Sennrich (2019). Widening the Representation Bottleneck in Neural Machine Translation with Lexical Shortcuts. In Proceedings of the Fourth Conference on Machine Translation. Florence, Italy, pp. 102-115. [bib] [code]

Rico Sennrich; Biao Zhang (2019). Revisiting Low-Resource Neural Machine Translation: A Case Study. In Proceedings of the 57th Conference of the Association for Computational Linguistics. Florence, Italy, pp. 211-221. [bib]

Biao Zhang; Rico Sennrich (2019). A Lightweight Recurrent Network for Sequence Modeling. In Proceedings of the 57th Conference of the Association for Computational Linguistics. Florence, Italy, pp. 1538-1548. [bib]

Elena Voita; Rico Sennrich; Ivan Titov (2019). When a Good Translation is Wrong in Context: Context-Aware Machine Translation Improves on Deixis, Ellipsis, and Lexical Cohesion. In Proceedings of the 57th Conference of the Association for Computational Linguistics. Florence, Italy, pp. 1198-1212. [bib]

Elena Voita; David Talbot; Fedor Moiseev; Rico Sennrich; Ivan Titov (2019). Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned. In Proceedings of the 57th Conference of the Association for Computational Linguistics. Florence, Italy, pp. 5797-5808. [bib]

2018

Mathias Müller; Annette Rios; Elena Voita; Rico Sennrich (2018). A Large-Scale Test Set for the Evaluation of Context-Aware Pronoun Translation in Neural Machine Translation. In Proceedings of the Third Conference on Machine Translation. Brussels, Belgium, pp. 61-72. [bib] [dataset]

Annette Rios; Mathias Müller; Rico Sennrich (2018). The Word Sense Disambiguation Test Suite at WMT18. In Proceedings of the Third Conference on Machine Translation. Brussels, Belgium, pp. 594-602. [bib] [dataset]

Gongbo Tang; Rico Sennrich; Joakim Nivre (2018). An Analysis of Attention Mechanisms: The Case of Word Sense Disambiguation in Neural Machine Translation. In Proceedings of the Third Conference on Machine Translation. Brussels, Belgium, pp. 26-35. [bib]

Barry Haddow; Nikolay Bogoychev; Denis Emelin; Ulrich Germann; Roman Grundkiewicz; Kenneth Heafield; Antonio Valerio Miceli Barone; Rico Sennrich (2018). The University of Edinburghs Submissions to the WMT18 News Translation Task. In Proceedings of the Third Conference on Machine Translation. Brussels, Belgium, pp. 403-413. [bib]

Jonathan Mallinson; Rico Sennrich; Mirella Lapata (2018). Sentence Compression for Arbitrary Languages via Multilingual Pivoting. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. pp. 2453-2464. [bib]

Gongbo Tang; Mathias Müller; Annette Rios; Rico Sennrich (2018). Why Self-Attention? A Targeted Evaluation of Neural Machine Translation Architectures. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. pp. 4263-4272. [bib]

Samuel Läubli; Rico Sennrich; Martin Volk (2018). Has Machine Translation Achieved Human Parity? A Case for Document-level Evaluation. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. pp. 4791-4796. [bib] [dataset]

Philip Williams; Marcin Chochowski; Pawel Przybysz; Rico Sennrich; Barry Haddow; Alexandra Birch (2018). Samsung and University of Edinburgh's System for the IWSLT 2018 Low Resource MT Task. In Proceedings of the 15th International Workshop on Spoken Language Translation. Bruges, Belgium, pp. 118-123. [bib]

Sheila Castilho; Joss Moorkens; Federico Gaspari; Rico Sennrich; Andy Way; Panayota Georgakopoulou (2018). Evaluating MT for massive open online courses. Machine Translation, 32(3):255-278. [bib]

Elena Voita; Pavel Serdyukov; Rico Sennrich; Ivan Titov (2018). Context-Aware Neural Machine Translation Learns Anaphora Resolution. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Melbourne, Australia, pp. 1264-1274. [bib]

Rachel Bawden; Rico Sennrich; Alexandra Birch; Barry Haddow (2018). Evaluating Discourse Phenomena in Neural Machine Translation. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers). New Orleans, Louisiana, pp. 1304-1313. [bib] [code and dataset]

Maximiliana Behnke; Antonio Valerio Miceli Barone; Rico Sennrich; Vilelmini Sosoni; Thanasis Naskos; Eirini Takoulidou; Maria Stasimioti; Menno Van Zaanen; Sheila Castilho; Federico Gaspari; Panayota Georgakopoulou; Valia Kordoni; Markus Egg; Katia Lida Kermanidis (2018). Improving Machine Translation of Educational Content via Crowdsourcing. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018). Miyazaki, Japan. [bib]

Yutong Shao; Rico Sennrich; Bonnie Webber; Federico Fancellu (2018). Evaluating Machine Translation Performance on Chinese Idioms with a Blacklist Method. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018). Miyazaki, Japan. [bib]

2017

Pawel Przybysz; Marcin Chochowski; Rico Sennrich; Barry Haddow; Alexandra Birch (2017). The Samsung and University of Edinburgh's submission to IWSLT17. In Proceedings of the 14th International Workshop on Spoken Language Translation. Tokyo, Japan, pp. 23-28. [bib]

Antonio Valerio Miceli Barone; Rico Sennrich (2017). A Parallel Corpus of Python Functions and Documentation Strings for Automated Code Documentation and Code Generation. In Proceedings of the Eighth International Joint Conference on Natural Language Processing (Volume 2: Short Papers). Taipei, Taiwan, pp. 314-319. [bib] [dataset]

Sheila Castilho; Joss Moorkens; Federico Gaspari; Rico Sennrich; Vilelmini Sosoni; Yota Georgakopoulou; Pintu Lohar; Andy Way; Antonio Valerio Miceli Barone; Maria Gialama (2017). A Comparative Quality Evaluation of PBSMT and NMT using Professional Translators. In Proceedings of Machine Translation Summit XVI. Nagoya, Japan. [bib]

Antonio Valerio Miceli Barone; Barry Haddow; Ulrich Germann; Rico Sennrich (2017). Regularization techniques for fine-tuning in neural machine translation. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing. Copenhagen, Denmark, pp. 1489-1494. [bib]

Spandana Gella; Rico Sennrich; Frank Keller; Mirella Lapata (2017). Image Pivoting for Learning Multilingual Multimodal Representations. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing. Copenhagen, Denmark, pp. 2839-2845. [bib]

Antonio Valerio Miceli Barone; Jindřich Helcl; Rico Sennrich; Barry Haddow; Alexandra Birch (2017). Deep architectures for Neural Machine Translation. In Proceedings of the Second Conference on Machine Translation. Copenhagen, Denmark, pp. 99-107. [bib]

Rico Sennrich; Alexandra Birch; Anna Currey; Ulrich Germann; Barry Haddow; Kenneth Heafield; Antonio Valerio Miceli Barone; Philip Williams (2017). The University of Edinburgh's Neural MT Systems for WMT17. In Proceedings of the Second Conference on Machine Translation, Volume 2: Shared Task Papers. Copenhagen, Denmark, pp. 389-399. [bib] [models] [code]
★ (tied) best constrained system for 11 out of 12 translation directions in which we participated.

Maria Nadejde; Siva Reddy; Rico Sennrich; Tomasz Dwojak; Marcin Junczys-Dowmunt; Philipp Koehn; Alexandra Birch (2017). Predicting Target Language CCG Supertags Improves Neural Machine Translation. In Proceedings of the Second Conference on Machine Translation. Copenhagen, Denmark, pp. 68-79. [bib]

Annette Rios; Laura Mascarell; Rico Sennrich (2017). Improving Word Sense Disambiguation in Neural Machine Translation with Sense Embeddings. In Proceedings of the Second Conference on Machine Translation. Copenhagen, Denmark, pp. 11-19. [bib] [dataset]

Rico Sennrich (2017). How Grammatical is Character-level Neural Machine Translation? Assessing MT Quality with Contrastive Translation Pairs. In Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers. Valencia, Spain, pp. 376-382. [bib] [dataset]

Jonathan Mallinson; Rico Sennrich; Mirella Lapata (2017). Paraphrasing Revisited with Neural Machine Translation. In Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers. Valencia, Spain, pp. 881-893. [bib]

Rico Sennrich; Orhan Firat; Kyunghyun Cho; Alexandra Birch; Barry Haddow; Julian Hitschler; Marcin Junczys-Dowmunt; Samuel Läubli; Antonio Valerio Miceli Barone; Jozef Mokry; Maria Nadejde (2017). Nematus: a Toolkit for Neural Machine Translation. In Proceedings of the Software Demonstrations of the 15th Conference of the European Chapter of the Association for Computational Linguistics. Valencia, Spain, pp. 65-68. [bib] [code]

Renars Liepins; Ulrich Germann; Guntis Barzdins; Alexandra Birch; Steve Renals; Susanne Weber; Peggy van der Kreeft; Herve Bourlard; João Prieto; Ondrej Klejch; Peter Bell; Alexandros Lazaridis; Alfonso Mendes; Sebastian Riedel; Mariana S. C. Almeida; Pedro Balage; Shay B. Cohen; Tomasz Dwojak; Philip N. Garner; Andreas Giefer; Marcin Junczys-Dowmunt; Hina Imran; David Nogueira; Ahmed Ali; Sebastião Miranda; Andrei Popescu-Belis; Lesly Miculicich Werlen; Nikos Papasarantopoulos; Abiola Obamuyide; Clive Jones; Fahim Dalvi; Andreas Vlachos; Yang Wang; Sibo Tong; Rico Sennrich; Nikolaos Pappas; Shashi Narayan; Marco Damonte; Nadir Durrani; Sameer Khurana; Ahmed Abdelali; Hassan Sajjad; Stephan Vogel; David Sheppey; Chris Hernon; Jeff Mitchell (2017). The SUMMA Platform Prototype. In Proceedings of the Software Demonstrations of the 15th Conference of the European Chapter of the Association for Computational Linguistics. Valencia, Spain, pp. 116-119. [bib]

2016

Philip Williams; Rico Sennrich; Matt Post; Philipp Koehn (2016). Syntax-based Statistical Machine Translation. [bib]

Rico Sennrich; Barry Haddow; Alexandra Birch (2016). Improving Neural Machine Translation Models with Monolingual Data. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Berlin, Germany, pp. 86-96. [bib] [data]

Rico Sennrich; Barry Haddow; Alexandra Birch (2016). Neural Machine Translation of Rare Words with Subword Units. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Berlin, Germany, pp. 1715-1725. [bib] [code]

Rico Sennrich; Barry Haddow (2016). Linguistic Input Features Improve Neural Machine Translation. In Proceedings of the First Conference on Machine Translation. Berlin, Germany, pp. 83-91. [bib]

Rico Sennrich; Barry Haddow; Alexandra Birch (2016). Edinburgh Neural Machine Translation Systems for WMT 16. In Proceedings of the First Conference on Machine Translation. Berlin, Germany, pp. 371-376. [bib] [code] [models]
★ (tied) best constrained system for 7 out of 8 translation directions in which we participated.

Marcin Junczys-Dowmunt; Tomasz Dwojak; Rico Sennrich (2016). The AMU-UEDIN Submission to the WMT16 News Translation Task: Attention-based NMT Models as Feature Functions in Phrase-based SMT. In Proceedings of the First Conference on Machine Translation. Berlin, Germany, pp. 319-325. [bib]
★ ranked 1-2 (out of 10) for Russian English, and 2-4 (out of 12) for English-Russian.

Philip Williams; Rico Sennrich; Maria Nadejde; Matthias Huck; Barry Haddow; Ondřej Bojar (2016). Edinburgh's Statistical Machine Translation Systems for WMT16. In Proceedings of the First Conference on Machine Translation. Berlin, Germany, pp. 399-410. [bib]

Jan-Thorsten Peter; Tamer Alkhouli; Hermann Ney; Matthias Huck; Fabienne Braune; Alexander Fraser; Aleš Tamchyna; Ondřej Bojar; Barry Haddow; Rico Sennrich; Frédéric Blain; Lucia Specia; Jan Niehues; Alex Waibel; Alexandre Allauzen; Lauriane Aufrant; Franck Burlot; Elena Knyazeva; Thomas Lavergne; François Yvon; Marcis Pinnis; Stella Frank (2016). The QT21/HimL Combined Machine Translation System. In Proceedings of the First Conference on Machine Translation. Berlin, Germany, pp. 344-355. [bib]

Rico Sennrich; Barry Haddow; Alexandra Birch (2016). Controlling Politeness in Neural Machine Translation via Side Constraints. In Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. San Diego, California, pp. 35-40. [bib]

2015

Rico Sennrich; Barry Haddow (2015). A Joint Dependency Model of Morphological and Syntactic Structure for Statistical Machine Translation. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing. Lisbon, Portugal, pp. 2081-2087. [bib]

Philip Williams; Rico Sennrich; Maria Nadejde; Matthias Huck; Philipp Koehn (2015). Edinburgh's Syntax-Based Systems at WMT 2015. In Proceedings of the Tenth Workshop on Statistical Machine Translation. Lisbon, Portugal, pp. 199-209. [bib]
★ ranked 1-2 (out of 16) in shared translation task English-German. [code]

Rico Sennrich (2015). Modelling and Optimizing on Syntactic N-Grams for Statistical Machine Translation. Transactions of the Association for Computational Linguistics, 3. [bib] [slides]

Rico Sennrich; Philip Williams; Matthias Huck (2015). A tree does not make a well-formed sentence: Improving syntactic string-to-tree statistical machine translation with more linguistic knowledge. Computer Speech & Language, 32(1):27-45. [bib]

2014

Rico Sennrich (2014). A CYK+ Variant for SCFG Decoding Without a Dot Chart. In Proceedings of SSST-8, Eighth Workshop on Syntax, Semantics and Structure in Statistical Translation. Doha, Qatar, pp. 94-102. [bib]

Philip Williams; Rico Sennrich; Maria Nadejde; Matthias Huck; Eva Hasler; Philipp Koehn (2014). Edinburgh's Syntax-Based Systems at WMT 2014. In Proceedings of the Ninth Workshop on Statistical Machine Translation. Baltimore, Maryland, USA, pp. 207-214. [bib]
★ ranked 1-2 (out of 18) in shared translation task English-German. [code]

Markus Freitag; Stephan Peitz; Joern Wuebker; Hermann Ney; Matthias Huck; Rico Sennrich; Nadir Durrani; Maria Nadejde; Philip Williams; Philipp Koehn; Teresa Herrmann; Eunah Cho; Alex Waibel (2014). EU-BRIDGE MT: Combined Machine Translation. In Proceedings of the Ninth Workshop on Statistical Machine Translation. Baltimore, Maryland, USA, pp. 105-113. [bib]

Sarah Ebling; Rico Sennrich; David Klaper (2014). Digging for Names in the Mountains: Combined Person Name Recognition and Reference Resolution for German Alpine Texts. In Human Language Technology Challenges for Computer Science and Linguistics: 5th Language and Technology Conference, LTC 2011, Poznań, Poland, November 25–27, 2011, Revised Selected Papers. Cham, pp. 189-200. [bib]

Mark Fishel; Rico Sennrich (2014). Handling Technical OOVs in SMT. In The Seventeenth Annual Conference of the European Association for Machine Translation (EAMT). Dubrovnik, Croatia, pp. 159-162. [bib]

Rico Sennrich; Beat Kunz (2014). Zmorge: A German Morphological Lexicon Extracted from Wiktionary. In Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14). Reykjavik, Iceland. [bib]

2013

Rico Sennrich; Martin Volk; Gerold Schneider (2013). Exploiting Synergies Between Open Resources for German Dependency Parsing, POS-tagging, and Morphological Analysis. In Proceedings of the International Conference Recent Advances in Natural Language Processing RANLP 2013. Hissar, Bulgaria, pp. 601-609. [bib]

Rico Sennrich (2013). Promoting Flexible Translations in Statistical Machine Translation. In Proceedings of Machine Translation Summit XIV. Nice, France. [bib]

Rico Sennrich; Holger Schwenk; Walid Aransa (2013). A Multi-Domain Translation Model Framework for Statistical Machine Translation. In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Sofia, Bulgaria, pp. 832-840. [bib]

2012

Mark Fishel; Rico Sennrich; Maja Popović; Ondřej Bojar (2012). TerrorCat: a Translation Error Categorization-based MT Quality Metric. In Proceedings of the Seventh Workshop on Statistical Machine Translation. Montréal, Canada, pp. 64-70. [bib]

Rico Sennrich (2012). Mixture-Modeling with Unsupervised Clusters for Domain Adaptation in Statistical Machine Translation. In 16th Annual Conference of the European Association for Machine Translation (EAMT 2012). Trento, Italy, pp. 185-192. [bib]

Sadaf Abdul-Rauf; Mark Fishel; Patrik Lambert; Sandra Noubours; Rico Sennrich (2012). Extrinsic evaluation of sentence alignment systems. In Workshop on Creating Cross-language Resources for Disconnected Languages and Styles. Istanbul, pp. 6-10. [bib]

Rico Sennrich (2012). Perplexity Minimization for Translation Model Domain Adaptation in Statistical Machine Translation. In Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics. Avignon, France, pp. 539-549. [bib]

2011

Sarah Ebling; Rico Sennrich; David Klaper; Martin Volk (2011). Digging for names in the mountains: Combined person name recognition and reference resolution for German alpine texts. In 5th Language & Technology Conference. Poznan, Poland. [bib]

Martin Volk; Anne Göhring; Stéphanie Lehner; Annette Rios; Rico Sennrich; Heli Uibo (2011). Word-aligned parallel text : a new resource for contrastive language studies. In Supporting Digital Humanities, Conference 2011. Copenhagen, Denmark. [bib]

Magdalena Jitca; Rico Sennrich; Martin Volk (2011). From historic books to annotated XML: Building a large multilingual diachronic corpus . In Conference of the German Society for Computational Linguistics and Language Technology (GSCL) 2011. Hamburg, Germany, pp. 75-80. [bib]

Markus Killer; Rico Sennrich; Martin Volk (2011). From multilingual web-archives to parallel treebanks in five minutes. In Conference of the German Society for Computational Linguistics and Language Technology (GSCL) 2011. Hamburg, Germany, pp. 57-62. [bib]

Rico Sennrich (2011). The UZH System Combination System for WMT 2011. In Proceedings of the Sixth Workshop on Statistical Machine Translation. Edinburgh, Scotland, pp. 166-170. [bib]

Rico Sennrich (2011). Combining Multi-Engine Machine Translation and Online Learning through Dynamic Phrase Tables. In 15th Annual Conference of the European Association for Machine Translation (EAMT 2011). Leuven, Belgium, pp. 89-96. [bib]

Martin Volk; Rico Sennrich (2011). Disambiguation of English Contractions for Machine Translation of TV Subtitles. In Proceedings of the 18th Nordic Conference of Computational Linguistics (NODALIDA 2011). Riga, Latvia, pp. 238-245. [bib]

Rico Sennrich; Martin Volk (2011). Iterative, MT-based Sentence Alignment of Parallel Texts. In Proceedings of the 18th Nordic Conference of Computational Linguistics (NODALIDA 2011). Riga, Latvia, pp. 175-182. [bib]

Martin Volk; Lenz Furrer; Rico Sennrich (2011). Strategies for reducing and correcting OCR error. In Language Technology for Cultural Heritage. Berlin, pp. 3-22. [bib]

2010

Rico Sennrich; Martin Volk (2010). MT-based Sentence Alignment for OCR-generated Parallel Texts. In The Ninth Conference of the Association for Machine Translation in the Americas (AMTA 2010). Denver, Colorado, USA. [bib]

Martin Volk; Rico Sennrich; Christian Hardmeier; Frida Tidström (2010). Machine translation of TV subtitles for large scale production. In Second Joint EM+/CNGL Workshop. pp. 53-62. [bib]

Manfred Klenner; Don Tuggener; Angela Fahrni; Rico Sennrich (2010). Anaphora Resolution with Real Preprocessing. Lecture Notes in Computer Science, 6233.In ICETAL 2010, 7th International Conference on Natural Language Processing, Reykjavik, Iceland. pp. 215-225. [bib]

Manfred Klenner; Angela Fahrni; Rico Sennrich (2010). Real Anaphora Resolution is Hard. Lecture Notes in Computer Science, 6231.In TSD 2010, 13th International Conference on Text, Speech and Dialogue, Brno, Czech Republic. pp. 109-116. [bib]

Martin Volk; Torsten Marek; Rico Sennrich (2010). Reducing OCR errors by combining two OCR systems. In ECAI 2010 Workshop on Language Technology for Cultural Heritage, Social Sciences, and Humanities (LaTeCH 2010). Lisbon, Portugal, pp. 61-65. [bib]

2009

Rico Sennrich; Gerold Schneider; Martin Volk; Martin Warin (2009). A New Hybrid Dependency Parser for German. In Proceedings of the German Society for Computational Linguistics and Language Technology 2009. Potsdam, Germany, pp. 115-124. [bib]

Phd Thesis

Rico Sennrich (2013). Domain Adaptation for Translation Models in Statistical Machine Translation. University of Zurich, [bib]