Squashed commit of the following:
commit e8b5b3751a86d86cae10e0bcf89caa481e5c3de6
Author: Marius <marius@transloadit.com>
Date: Sun Jun 19 12:15:22 2022 +0200
Fix generated mocks
commit 736e2e7bb6
Merge: 9d7096f1e69d9b
Author: Stefan Scheidewig <stefan.scheidewig@staffbase.com>
Date: Sat Jun 18 07:53:29 2022 +0200
Merge branch 'v2' into readcloser_in_getreader
commit 9d7096fcb3
Author: Stefan Scheidewig <stefan.scheidewig@staffbase.com>
Date: Tue May 24 14:16:01 2022 +0200
Return ReadCloser in getReader
* Add a flag to disable downloads of uploaded files
* Add a flag to disable deletion of uploaded files
* Fix spelling error
* Rename `DisableDelete` to `DisableTermination`
* Also rename CLI flag
* Conditionally build the `Access-Control-Allow-Methods` headers
* Update tests with new order of allowed methods header
* Add test for checking conditional `Access-Control-Allow-Methods` header
* handler: Implement prototype of new locking back-end
* memorylocker2: Switch to channel for release notification
* handler: Update locker interface
* handler: Add method to close body with error
* memorylocker: Replace with new implementation
* filelocker: Adjust methods to match interface
* handler: Introduce new httpContext
* handler: Implement upload interruption
* handler: Adjust tests to new inferfaces
* handler, memorylocker: Cancel context to avoid leaks
* Create `isAzureError` function
* Throw 404 is info file is not found
* Use `isAzureError` in GetOffset function
* Make `GetUpload` match others without named returns
* Follow code style for `isAzureError` not returning but setting `err` to value
* Return not found when the blob is not found
This will also be triggered when the blob is being uploaded but not yet committed
* Return not found if blob is not found when getting offset
* Don't return error in GetUpload if GetOffset returns `handler.ErrNotFound`
* ci: Remove plugin hook handler
* Rework error type from interface to struct
* Avoid writing to http.ResponseWriter directly
* Allow hooks to modify response
* Add example for HTTP hooks using Python
* Implement new plugin system using Hashicorp/go-plugin
* Enable returning partial HTTPResponses
* Remove some (unnecessary) error handling
* Forward stdout and stderr from plugin to tusd
* docs: Update examples
* cli: Update filehooks to new system
* cli: Renovate gRPC hooks
* docs: Correct casing of gRPC
* misc: Documentation, better examples, and code structure
* fix: if a race condition occur, we check for it in the test
* fix: windows sometimes only has 1 file
* Trigger test runs
* Trigger test runs
* Trigger test runs
* Trigger test runs
* Trigger test runs
See https://github.com/tus/tusd/pull/480
Squashed commit of the following:
commit 7439fd84a6103afdedaf94701a65ce4376789380
Author: Marius <marius@transloadit.com>
Date: Mon Oct 18 00:27:12 2021 +0200
Docs and test
commit 16d9dc67e8c8eefc328b1ce12d7e7ca01a49f9f6
Merge: bae0ffbbea5183
Author: Marius <marius@transloadit.com>
Date: Mon Oct 18 00:23:13 2021 +0200
Merge branch 'head_header_check' of https://github.com/s3rius/tusd into s3rius-head_header_check
commit bea5183ec3
Author: Pavel Kirilin <win10@list.ru>
Date: Thu May 20 19:53:36 2021 +0400
Fixed "Tus-Resumable" header check for HEAD request.
Signed-off-by: Pavel Kirilin <win10@list.ru>
* Only determine object type based on name after last separator
* modify test to keep in mind directory prefixes with underscores in them
* update documentation to reflect support of underscores in gcs object prefix
* Add azure-storage-blob-go dependency
* Implement Azure BlobStorage store
* Add AzureStore Mock test
* Refactor Blob interfaces to use uppercase fields
* Refactor and remove the Create function
When getting the offset, and we get the status code BlobNotFound, we can say the offset is 0, and start from the beginning
* Update the mock
* Refactor error checking of GetOffset to actually check the service code
* Begin testing azurestore
* Write more tests
* New feature allows to set access type on new containers and blob access tier
* Write more docs
* Upgrade azure-storage-blob-go to v0.13.0
* Remove AzError, not needed
* Update link to container access type information
* Remove ?toc from link in comments
* Remove trailing spaces from workflow
* Run tests with go1.15 and 1.16
* Don't fail fast
This lets all other tests complete, and makes it easier to see if it's just a one-off fail, or on different OSes and versions
* Remove darwin 386 from `build_all.sh` script
Removed in go1.15 https://github.com/golang/go/issues/37610
* Update go version in `Dockerfile`
* Compile for Apple Silicone (darwin arm64)
Only go1.16 supports it
* Add first draft of parallel upload queue
* s3store: Use queue for parallel uploads
* Revert "Add first draft of parallel upload queue"
This reverts commit 86a329cef2.
* Revert "s3store: Use queue for parallel uploads"
This reverts commit 29b59a2c90.
* s3store: Cache results from listing parts and checking incomplete object
* s3store: Remove debugging output`
* s3store: Make requests for fetching info concurrently
* s3store: Make parallel uploads work and tests pass
* s3store: Add semaphore package
* s3store: Add comments to semaphore package
* s3store: Encapsulate more logic into s3PartProducer
* s3store: Refactor WriteChunk
* s3store: Remove TODO
* s3store: Acquire lock before uploading
* cli: Add flag for setting concurrency limit
* s3store: One more comment
* Allow empty metadata values
* Make tests less fragile by allowing loose call ordering
* Add s3ChunkProducer
* Integrate s3ChunkProducer to support chunk buffering
* Remove completed chunk files inline to reduce disk space usage
* Add tests for chunk producer
* docs: Use value from Host header to forward to tusd
* Use int64 for MaxBufferedParts field
* Default to 20 buffered parts
* Rename s3ChunkProducer -> s3PartProducer
* Document s3PartProducer struct
* Clarify misleading comment
* Revert "Remove completed chunk files inline to reduce disk space usage"
This reverts commit b72a4d43d6.
* Remove redundant seek
This is already being done in s3PartProducer.
* Clean up any remaining files in the channel when we return
* Make putPart* functions responsible for cleaning up temp files
* handler: Add tests for empty metadata pairs
* Factor out cleanUpTempFile func
* Add test to ensure that temporary files get cleaned up
Co-authored-by: Jens Steinhauser <jens.steinhauser@gmail.com>
Co-authored-by: Marius <marius@transloadit.com>
Marius
Tom Berger
Ole-Martin Bratteng
Anatoly
Tinco Andringa
benito
Adam Jensen
Ahmed J
Márk Sági-Kazár