ParaCrawl estonian-english Corpus

Description

Estonian-English parallel from release 6 of the ParaCrawl project, specifically "Broader Web-Scale Provision of Parallel Corpora for European Languages". This version is filtered with BiCleaner with a threshold of 0.7 and introduces near-duplicate removal as well. Data was crawled from the web following robots.txt, as is standard practice. The crawl is not targeted to a particular domain, intending to provide broad coverage.

Resources

Name Format Description Link
0 https://s3.amazonaws.com/web-language-models/paracrawl/release6/en-et.tmx.gz

Tags

Topics

  • REGI
  • TECH

Categories