<p>Needed to concatenate several CSV files in S3. Downloading them would be costly (both on time and money cost). There are scripts that do it without downloading, by using “multi-part upload“ from S3 to S3. See: #s3fs.core.S3FileSystem.merge and </p>
By clicking “Accept all”, you agree to the storing of cookies on your device to enhance site navigation, analyze site usage and assist in our marketing efforts. Check our privacy policies.