1

We opt for a data-driven approach by developing a new corpus with fine-grained entity annotation, covering three centuries of literature corresponding to the early modern period, We then fine-tune existing state-of-the-art architectures obtaining results that are on par with those of the current state-of-the-art NER systems for Contemporary English.

We present annotated corpora and NLP models for some downstream tasks in Early Modern French.

We consider several neural language models, some of which trained or fine-tuned on a new corpus of raw Old and Middle French texts, and use their internal representations of words as inputs to train taggers and parsers on the SRCMF treebank.

We present the $\text{FreEM}_{\text{max}}$ corpus of Early Modern French and D’AlemBERT, a RoBERTa-based language model trained on $\text{FreEM}_{\text{max}}$.

we take the existing multilingual web corpus OSCAR and its pipeline Ungoliant that extracts and classifies data from Common Crawl at the line level, and propose a set of improvements and automatic annotations in order to produce a new document-oriented version of OSCAR.

We propose a new pipeline that is faster, modular, parameterizable, and well documented. We use it to create a corpus similar to OSCAR but larger and based on recent data.

In this article we present the approaches developed by the Sorbonne-INRIA for NER (SinNer) team for the CLEF-HIPE 2020 challenge on Named Entity Processing on old newspapers.

We explore the impact of the training corpus on contextualized word embeddings in five mid-resource languages.

We explore the impact of the training data size on a French version of RoBERTa. (Equal contribution by the first three authors).

We introduce the first treebank for a romanized user-generated content variety of Algerian, a North-African Arabic dialect.