OCR Error Post-Correction with LLMs in Historical Documents: No Free Lunches
Kanerva, Jenna; Ledins, Cassadra; Käpyaho, Siiri; Ginter, Filip
OCR Error Post-Correction with LLMs in Historical Documents: No Free Lunches
Kanerva, Jenna
Ledins, Cassadra
Käpyaho, Siiri
Ginter, Filip
Julkaisun pysyvä osoite on:
https://urn.fi/URN:NBN:fi-fe202601216003
https://urn.fi/URN:NBN:fi-fe202601216003
Tiivistelmä
Optical Character Recognition (OCR) systems often introduce errors when transcribing historical documents, leaving room for post-correction to improve text quality. This study evaluates the use of open-weight LLMs for OCR error correction in historical English and Finnish datasets. We explore various strategies, including parameter optimization, quantization, segment length effects, and text continuation methods. Our results demonstrate that while modern LLMs show promise in reducing character error rates (CER) in English, a practically useful performance for Finnish was not reached. Our findings highlight the potential and limitations of LLMs in scaling OCR post-correction for large historical corpora.
Kokoelmat
- Rinnakkaistallenteet [29337]
