File size and number of files¶
When uploading data to the BSC Dataverse, please be aware of the following restrictions:
- Maximum file size: 2.5 GB per file.
- Maximum number of files per upload: 1000 files.
If your dataset exceeds these limits, we recommend splitting large files into smaller, more manageable parts, compressing multiple files into a single archive (e.g., .zip, .tar.gz), or contacting the BSC Data Management team for further assistance.
For larger files, we recommend splitting and compressing them before uploading.
Mac/Linux: Split and archive a large file
To compress and split a file into 2GB parts, use the following command:
tar -czf - largefile | split -b 2000M - largefile_part_