Commit Graph

72 Commits

Author SHA1 Message Date
Derrick Hammer b82353cfa9
fix: fix need to add a root path on filename 2024-02-02 16:45:50 -05:00
Derrick Hammer 446e81ca19
fix: renter needs to be set on storage 2024-02-01 18:12:09 -05:00
Derrick Hammer 15b527933f
feat: implement initial version of multipart uploads 2024-02-01 02:03:04 -05:00
Derrick Hammer 9a87004f31
fix: need to add lifecycle hook to start tusWorker 2024-01-31 21:28:31 -05:00
Derrick Hammer d88638dfc3
fix: need to invoke storage init to setup tus 2024-01-31 21:28:02 -05:00
Derrick Hammer aff6e8106c
refactor: split renter methods to a dedicated renter service 2024-01-31 21:27:38 -05:00
Derrick Hammer 6d34f5b683
refactor: change struct naming convention from "impl" to "default" 2024-01-31 20:29:27 -05:00
Derrick Hammer 2a067102da
refactor: use new RetryableTask abstraction and move task function as a private method 2024-01-28 16:26:15 -05:00
Derrick Hammer 2dc8fc56f5
refactor: epic refactor to use uber fx microframework/DI framework to manage dependency graph, remove the portal object, and remove the interfaces package 2024-01-28 02:20:59 -05:00
Derrick Hammer f3be950ba7
feat: detect and add mime type to upload so we don't need to make extra requests on runtime 2024-01-25 19:05:52 -05:00
Derrick Hammer e00922f49d
feat: add NewFile helper in storage 2024-01-25 16:31:05 -05:00
Derrick Hammer a90344daf0
refactor: use errors.Is 2024-01-25 10:39:45 -05:00
Derrick Hammer e1556f2f68
feat: add support for ranges in tus s3 store 2024-01-25 09:50:17 -05:00
Derrick Hammer fce08283a2
fix: both clients need specific api paths 2024-01-25 09:02:49 -05:00
Derrick Hammer 6d8beb0331
fix: need to set api path 2024-01-25 08:55:59 -05:00
Derrick Hammer 8f138a5df7
fix: wrong config keys 2024-01-25 08:48:05 -05:00
Derrick Hammer 263f34b89f
Revert "fix: need to pass protocol scheme"
This reverts commit 8528df5d96.
2024-01-25 08:47:38 -05:00
Derrick Hammer 8528df5d96
fix: need to pass protocol scheme 2024-01-25 08:44:54 -05:00
Derrick Hammer f544c30430
refactor: move to using renterd's bus and worker http clients 2024-01-25 08:37:15 -05:00
Derrick Hammer dcf05974e2
feat: add support for a range offset in GetFile 2024-01-24 19:05:54 -05:00
Derrick Hammer f51c06bc24
fix: enable RespectForwardedHeaders 2024-01-24 14:46:46 -05:00
Derrick Hammer 87fb81bf97
fix: wrong endpoint 2024-01-24 02:03:14 -05:00
Derrick Hammer 27cbe2d886
fix: wrong hash encoding 2024-01-24 02:00:53 -05:00
Derrick Hammer 5d715fcac4
fix: wrong endpoint 2024-01-24 01:59:09 -05:00
Derrick Hammer efcd5b0b8a
fix: set bucket to protocol name 2024-01-24 01:57:09 -05:00
Derrick Hammer 12093637ed
feat: add initial version of GetFile 2024-01-24 01:26:40 -05:00
Derrick Hammer fb1112f3a2
fix: we need to pin the file after creating the upload 2024-01-22 19:08:56 -05:00
Derrick Hammer 8df2ee9ee8
fix: we need to manually delete both the uploaded buffer file and the metafile 2024-01-22 19:06:28 -05:00
Derrick Hammer 7b96682ce0
feat: compute metadata file id and delete it 2024-01-22 18:54:19 -05:00
Derrick Hammer 1643dacdd4
refactor: store s3 client 2024-01-22 18:53:31 -05:00
Derrick Hammer 11e533577b
refactor: return bytes count from hashing to use for upload record 2024-01-22 18:52:37 -05:00
Derrick Hammer da298cc56f
refactor: return s3 client instance with BuildUploadBufferTus 2024-01-22 18:51:09 -05:00
Derrick Hammer bf36562fca
feat: create upload record after sending to renterd 2024-01-22 18:25:11 -05:00
Derrick Hammer 3fcb897e7a
fix: need to borrow the check from finishUploadIfComplete and invert it 2024-01-22 18:02:15 -05:00
Derrick Hammer 941ce27293
fix: only process completed upload if its final 2024-01-22 17:49:42 -05:00
Derrick Hammer e0c6c88e75
feat: add TusUploadCompleted method 2024-01-22 17:49:03 -05:00
Derrick Hammer d86e0e0105
fix: need to use where 2024-01-21 01:06:14 -05:00
Derrick Hammer e0de290cff
fix: pass model protocol property 2024-01-21 00:48:50 -05:00
Derrick Hammer 3e0246df28
fix: set client timeout to a high number for now 2024-01-21 00:19:04 -05:00
Derrick Hammer ae4901757b
fix: log PutFile error 2024-01-21 00:08:49 -05:00
Derrick Hammer e73fa0a103
refactor: switch to github.com/imroc/req as go-resty can't handle streaming uploads 2024-01-20 23:36:55 -05:00
Derrick Hammer c2cccc4b84
fix: pass bucket as query arg, not as form data 2024-01-20 22:51:00 -05:00
Derrick Hammer 6bee380e75
fix: retain only the 1st 32 bytes 2024-01-20 12:30:18 -05:00
Derrick Hammer bcf2998faa
fix: need to get a new reader to stream the file 2024-01-20 12:26:31 -05:00
Derrick Hammer 8c86ecc5b7
fix: TusUploadExists needs to operate on TusUpload not Upload 2024-01-20 07:05:27 -05:00
Derrick Hammer e8fbe46dfc
fix: uploaderID is uint64 2024-01-20 06:57:57 -05:00
Derrick Hammer 0ab70dcaa5
fix: if we have errors at the CreatedUploads hook, cancel the upload 2024-01-20 06:41:51 -05:00
Derrick Hammer af5b6241bf
fix: NotifyCreatedUploads needs to be enabled 2024-01-20 06:27:11 -05:00
Derrick Hammer 48e3c690ce
feat: register storage service with cron 2024-01-19 17:47:14 -05:00
Derrick Hammer 4c92750dd0
feat: add tus getter 2024-01-19 16:51:41 -05:00