Retrieval Augmented Generation for Historical Newspapers - Université de Tours
Communication Dans Un Congrès Année : 2024

Retrieval Augmented Generation for Historical Newspapers

Résumé

Nowadays, the accessibility and long-term preservation of historical records are significantly impacted by the sharp increase in the digitization of these archives. This shift creates new opportunities for researchers and students in multiple disciplines to broaden their knowledge or conduct multidisciplinary research. However, given the vast amount of data that needs to be analyzed, using this knowledge is not easy. Different natural language processing tasks such as named entity recognition, entity linking, and article separation have been developed to make this accessibility easier for the public by extracting information and structuring data. However, historical newspaper article aggregation is still unexplored. In this work, we demonstrate the potential of the retrieval-augmented generation framework that integrates large language models (LLMs), a semantic retrieval module, and knowledge bases to create a system capable of aggregating historical newspaper articles. In addition, we propose a set of metrics that permit evaluating these generative systems without requiring any ground truth. The results of our proposed RAG pipeline are promising at this early stage of the system. They show that semantic retrieval with the help of reranking and additional information (NER) reduces the impact of OCR errors and query misspellings.
Fichier principal
Vignette du fichier
JCDL2024_12October_4pages_ref_RAG4historicalnewspapers.pdf (865.43 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence

Dates et versions

hal-04796088 , version 1 (21-11-2024)

Licence

Identifiants

  • HAL Id : hal-04796088 , version 1

Citer

The Trung Tran, Carlos-Emiliano González-Gallardo, Antoine Doucet. Retrieval Augmented Generation for Historical Newspapers. ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL), Dec 2024, Hong Kong, China. ⟨hal-04796088⟩
0 Consultations
0 Téléchargements

Partager

More