Commit Graph

74 Commits

Author SHA1 Message Date
Derrick Hammer a90344daf0
refactor: use errors.Is 2024-01-25 10:39:45 -05:00
Derrick Hammer e1556f2f68
feat: add support for ranges in tus s3 store 2024-01-25 09:50:17 -05:00
Derrick Hammer fce08283a2
fix: both clients need specific api paths 2024-01-25 09:02:49 -05:00
Derrick Hammer 6d8beb0331
fix: need to set api path 2024-01-25 08:55:59 -05:00
Derrick Hammer 8f138a5df7
fix: wrong config keys 2024-01-25 08:48:05 -05:00
Derrick Hammer 263f34b89f
Revert "fix: need to pass protocol scheme"
This reverts commit 8528df5d96.
2024-01-25 08:47:38 -05:00
Derrick Hammer 8528df5d96
fix: need to pass protocol scheme 2024-01-25 08:44:54 -05:00
Derrick Hammer f544c30430
refactor: move to using renterd's bus and worker http clients 2024-01-25 08:37:15 -05:00
Derrick Hammer ce95437191
fix: reset read to false on init 2024-01-24 19:58:10 -05:00
Derrick Hammer 84bb08144b
fix: add a read state so we can noop a seek when we have not done anything yet 2024-01-24 19:47:25 -05:00
Derrick Hammer c3646fa4d4
refactor: have name return base58 cid 2024-01-24 19:23:17 -05:00
Derrick Hammer 7b7c705c0d
feat: add CID method 2024-01-24 19:22:31 -05:00
Derrick Hammer 6cac5c6a28
fix: actually implement Name 2024-01-24 19:16:50 -05:00
Derrick Hammer 6d998eeff4
fix: we need SeekEnd to spoof and just return the length of the file for http.ServeContent 2024-01-24 19:14:06 -05:00
Derrick Hammer 2f9b684953
feat: add new File abstraction primarily to handle partial content/range requests 2024-01-24 19:07:35 -05:00
Derrick Hammer dcf05974e2
feat: add support for a range offset in GetFile 2024-01-24 19:05:54 -05:00
Derrick Hammer f51c06bc24
fix: enable RespectForwardedHeaders 2024-01-24 14:46:46 -05:00
Derrick Hammer 87fb81bf97
fix: wrong endpoint 2024-01-24 02:03:14 -05:00
Derrick Hammer 27cbe2d886
fix: wrong hash encoding 2024-01-24 02:00:53 -05:00
Derrick Hammer 5d715fcac4
fix: wrong endpoint 2024-01-24 01:59:09 -05:00
Derrick Hammer efcd5b0b8a
fix: set bucket to protocol name 2024-01-24 01:57:09 -05:00
Derrick Hammer 12093637ed
feat: add initial version of GetFile 2024-01-24 01:26:40 -05:00
Derrick Hammer fb1112f3a2
fix: we need to pin the file after creating the upload 2024-01-22 19:08:56 -05:00
Derrick Hammer 8df2ee9ee8
fix: we need to manually delete both the uploaded buffer file and the metafile 2024-01-22 19:06:28 -05:00
Derrick Hammer 7b96682ce0
feat: compute metadata file id and delete it 2024-01-22 18:54:19 -05:00
Derrick Hammer 1643dacdd4
refactor: store s3 client 2024-01-22 18:53:31 -05:00
Derrick Hammer 11e533577b
refactor: return bytes count from hashing to use for upload record 2024-01-22 18:52:37 -05:00
Derrick Hammer da298cc56f
refactor: return s3 client instance with BuildUploadBufferTus 2024-01-22 18:51:09 -05:00
Derrick Hammer bf36562fca
feat: create upload record after sending to renterd 2024-01-22 18:25:11 -05:00
Derrick Hammer 3fcb897e7a
fix: need to borrow the check from finishUploadIfComplete and invert it 2024-01-22 18:02:15 -05:00
Derrick Hammer 941ce27293
fix: only process completed upload if its final 2024-01-22 17:49:42 -05:00
Derrick Hammer e0c6c88e75
feat: add TusUploadCompleted method 2024-01-22 17:49:03 -05:00
Derrick Hammer d86e0e0105
fix: need to use where 2024-01-21 01:06:14 -05:00
Derrick Hammer e0de290cff
fix: pass model protocol property 2024-01-21 00:48:50 -05:00
Derrick Hammer 3e0246df28
fix: set client timeout to a high number for now 2024-01-21 00:19:04 -05:00
Derrick Hammer ae4901757b
fix: log PutFile error 2024-01-21 00:08:49 -05:00
Derrick Hammer e73fa0a103
refactor: switch to github.com/imroc/req as go-resty can't handle streaming uploads 2024-01-20 23:36:55 -05:00
Derrick Hammer c2cccc4b84
fix: pass bucket as query arg, not as form data 2024-01-20 22:51:00 -05:00
Derrick Hammer 6bee380e75
fix: retain only the 1st 32 bytes 2024-01-20 12:30:18 -05:00
Derrick Hammer bcf2998faa
fix: need to get a new reader to stream the file 2024-01-20 12:26:31 -05:00
Derrick Hammer 43c4590439
refactor: use time.Ticker 2024-01-20 11:16:54 -05:00
Derrick Hammer ea4a22c52d
fix: remove duplicate chan close 2024-01-20 11:07:06 -05:00
Derrick Hammer 6bbfac661a
fix: call released on ctx done 2024-01-20 11:06:50 -05:00
Derrick Hammer 112fbb4c51
refactor: moved anon func to private released method 2024-01-20 11:04:43 -05:00
Derrick Hammer 5465cf7a63
fix: RequestRelease needs to be inside for, but after we check for a non-busy error 2024-01-20 10:48:42 -05:00
Derrick Hammer 8c86ecc5b7
fix: TusUploadExists needs to operate on TusUpload not Upload 2024-01-20 07:05:27 -05:00
Derrick Hammer e8fbe46dfc
fix: uploaderID is uint64 2024-01-20 06:57:57 -05:00
Derrick Hammer 0ab70dcaa5
fix: if we have errors at the CreatedUploads hook, cancel the upload 2024-01-20 06:41:51 -05:00
Derrick Hammer af5b6241bf
fix: NotifyCreatedUploads needs to be enabled 2024-01-20 06:27:11 -05:00
Derrick Hammer 48e3c690ce
feat: register storage service with cron 2024-01-19 17:47:14 -05:00