File size and number of files¶
When uploading data to the BSC Dataverse, please be aware of the following restrictions:
- Maximum file size: 2.5 GB per file.
- Maximum number of files per upload: 1000 files.
If your dataset exceeds these limits, we recommend splitting large files into smaller, more manageable parts, compressing multiple files into a single archive (e.g., .zip, .tar.gz), or contacting the BSC Data Management team for further assistance.
💡 When you upload a
.zip
file, it will be automatically extracted. This means:
- All individual files within the
.zip
will be visible in Dataverse. - The original folder structure will be preserved.
- You only need to upload a single file—no manual extraction required.
For larger files, we recommend splitting and compressing them before uploading.
Mac/Linux: Split and archive a large file
To compress and split a file into 2GB parts, use the following command:
tar -czf - largefile | split -b 2000M - largefile_part_
⚠️ Once the files are uploaded, it takes a while (10s - 40s) for Dataverse to show the new files.