<p>Needed to concatenate several CSV files in S3. Downloading them would be costly (both on time and money cost). There are scripts that do it without downloading, by using “multi-part upload“ from S3 to S3. See: #s3fs.core.S3FileSystem.merge and </p>
By clicking “Accept cookies”, you agree to the storing of cookies on your device to enhance site navigation, analyze site usage and assist in our marketing efforts. Check our privacy policies.
By clicking “Accept all”, you agree to the storing of cookies on your device to enhance site navigation, analyze site usage and assist in our marketing efforts. Check our privacy policies.