Adam Jensen 6662f43d01 s3Store: Concurrently write upload parts to S3 while reading from client (#402) ... * Allow empty metadata values * Make tests less fragile by allowing loose call ordering * Add s3ChunkProducer * Integrate s3ChunkProducer to support chunk buffering * Remove completed chunk files inline to reduce disk space usage * Add tests for chunk producer * docs: Use value from Host header to forward to tusd * Use int64 for MaxBufferedParts field * Default to 20 buffered parts * Rename s3ChunkProducer -> s3PartProducer * Document s3PartProducer struct * Clarify misleading comment * Revert "Remove completed chunk files inline to reduce disk space usage" This reverts commit b72a4d43d6. * Remove redundant seek This is already being done in s3PartProducer. * Clean up any remaining files in the channel when we return * Make putPart* functions responsible for cleaning up temp files * handler: Add tests for empty metadata pairs * Factor out cleanUpTempFile func * Add test to ensure that temporary files get cleaned up Co-authored-by: Jens Steinhauser <jens.steinhauser@gmail.com> Co-authored-by: Marius <marius@transloadit.com>		2020-07-29 15:24:46 +02:00
..
calcpartsize_test.go	core: Move packages into pkg/ and internal/ folders	2019-06-11 18:23:20 +02:00
multi_error.go	core: Move packages into pkg/ and internal/ folders	2019-06-11 18:23:20 +02:00
s3store.go	s3Store: Concurrently write upload parts to S3 while reading from client (#402)	2020-07-29 15:24:46 +02:00
s3store_mock_test.go	s3store: Pass context to AWS SDK	2019-09-15 14:33:02 +02:00
s3store_part_producer_test.go	s3Store: Concurrently write upload parts to S3 while reading from client (#402)	2020-07-29 15:24:46 +02:00
s3store_test.go	s3Store: Concurrently write upload parts to S3 while reading from client (#402)	2020-07-29 15:24:46 +02:00
s3store_util_test.go	core: Move packages into pkg/ and internal/ folders	2019-06-11 18:23:20 +02:00