Adam Jensen 6662f43d01 s3Store: Concurrently write upload parts to S3 while reading from client (#402) ... * Allow empty metadata values * Make tests less fragile by allowing loose call ordering * Add s3ChunkProducer * Integrate s3ChunkProducer to support chunk buffering * Remove completed chunk files inline to reduce disk space usage * Add tests for chunk producer * docs: Use value from Host header to forward to tusd * Use int64 for MaxBufferedParts field * Default to 20 buffered parts * Rename s3ChunkProducer -> s3PartProducer * Document s3PartProducer struct * Clarify misleading comment * Revert "Remove completed chunk files inline to reduce disk space usage" This reverts commit b72a4d43d6. * Remove redundant seek This is already being done in s3PartProducer. * Clean up any remaining files in the channel when we return * Make putPart* functions responsible for cleaning up temp files * handler: Add tests for empty metadata pairs * Factor out cleanUpTempFile func * Add test to ensure that temporary files get cleaned up Co-authored-by: Jens Steinhauser <jens.steinhauser@gmail.com> Co-authored-by: Marius <marius@transloadit.com>		2020-07-29 15:24:46 +02:00
..
filelocker	core: Replace old LockerDataStore with new Locker	2019-09-12 12:37:43 +02:00
filestore	filestore: Remove useless defer (#318)	2019-10-23 18:51:36 +02:00
gcsstore	gcsstore: Remove unnecessary typecasts and unused mocks (#313)	2019-10-09 14:44:13 +02:00
handler	handler: Add tests for empty metadata pairs	2020-07-15 17:30:17 +02:00
memorylocker	core: Replace old LockerDataStore with new Locker	2019-09-12 12:37:43 +02:00
prometheuscollector	core: Move packages into pkg/ and internal/ folders	2019-06-11 18:23:20 +02:00
proto/v1	cli: Fix build time error of gRPC hooks	2020-04-06 13:46:58 +02:00
s3store	s3Store: Concurrently write upload parts to S3 while reading from client (#402)	2020-07-29 15:24:46 +02:00