Data pipeline Validation And Load Testing using Multiple CSV Files

Description

The datasets were used to validate and test the data pipeline deployment following the RADON approach. The dataset has a CSV file that contains around 32000 Twitter tweets. 100 CSV files have been created from the single CSV file and each CSV file containing 320 tweets. Those 100 CSV files are used to validate and test (performance/load testing) the data pipeline components.     

Resources

Name Format Description Link
0 http://data.europa.eu/88u/dataset/oai-zenodo-org-4636817
0 http://data.europa.eu/88u/dataset/oai-zenodo-org-4636817

Tags

  • data-pipeline
  • performance-testing

Topics

Categories