5 Commits

Author	SHA1	Message	Date
Marius Kleidl	7b9030c33a	chore: Address misc linting warnings	2023-06-09 11:07:05 +02:00
Marius	c0f2026e96	s3store: Implement temporary support for buffering in memory	2022-04-10 21:13:07 +02:00
Marius	946539c3b9	cli: Add option to expose Go's pprof	2021-05-28 13:26:13 +02:00
Marius	8fd18364e7	s3store: Parallelize part uploads and information retrieval (#478) ... * Add first draft of parallel upload queue * s3store: Use queue for parallel uploads * Revert "Add first draft of parallel upload queue" This reverts commit 86a329cef2. * Revert "s3store: Use queue for parallel uploads" This reverts commit 29b59a2c90. * s3store: Cache results from listing parts and checking incomplete object * s3store: Remove debugging output` * s3store: Make requests for fetching info concurrently * s3store: Make parallel uploads work and tests pass * s3store: Add semaphore package * s3store: Add comments to semaphore package * s3store: Encapsulate more logic into s3PartProducer * s3store: Refactor WriteChunk * s3store: Remove TODO * s3store: Acquire lock before uploading * cli: Add flag for setting concurrency limit * s3store: One more comment	2021-05-18 10:29:18 +02:00
Marius	8c5192c254	s3store: Move parts producer into own file	2021-04-26 12:18:09 +02:00