Commit Graph

117 Commits

Author SHA1 Message Date
Derrick Hammer 8d98f131d5
refactor: implement native bao support 2024-03-30 13:59:53 -04:00
Derrick Hammer 8e9d2d0398
refactor: switch to github.com/gabriel-vasile/mimetype 2024-03-29 11:51:58 -04:00
Derrick Hammer a9c2ecade0
fix: if we get an ErrUnexpectedEOF due to being less than512 bytes, read it all instead 2024-03-02 04:45:09 -05:00
Derrick Hammer b46e12b972
fix: if for some edge case reason an upload id no longer exists, start over, but use db Save so we can update the record if we have an ID 2024-03-01 05:09:57 -05:00
Derrick Hammer 0d0ec43125
refactor: add eta to logging 2024-02-28 12:20:16 -05:00
Derrick Hammer a49da3fdfe
fix: partStartTime needs to include reading 2024-02-28 12:16:47 -05:00
Derrick Hammer 5f0e2d2e15
refactor: add performance tracking and logging 2024-02-28 12:13:26 -05:00
Derrick Hammer b030de9714
feat: add generic s3 upload tracking 2024-02-28 11:36:53 -05:00
Derrick Hammer 55203fa466
refactor: add more debug info 2024-02-28 11:08:05 -05:00
Derrick Hammer 844d3a0a5f
refactor: add debug log line 2024-02-28 10:59:44 -05:00
Derrick Hammer 7411228106
feat: add S3MultipartUpload api 2024-02-27 06:12:41 -05:00
Derrick Hammer f47552bf60
refactor: move s3 client creation to a factory method on storage for re-usability 2024-02-24 10:34:49 -05:00
Derrick Hammer bbfea6fc9e
fix: need to update config management in storage pkg 2024-02-22 03:27:48 -05:00
Derrick Hammer ae7d048e6c
fix: don't create subpath, as we use buckets 2024-02-18 03:07:14 -05:00
Derrick Hammer b4f8a1979b
fix: PROOF_EXTENSION already has file dot 2024-02-18 02:57:10 -05:00
Derrick Hammer 418cdf7836
fix: need to use a reader for mime detection 2024-02-18 02:44:57 -05:00
Derrick Hammer e435e6ded5
fix: need to return muReader early 2024-02-18 02:38:17 -05:00
Derrick Hammer a20b79ff90
fix: forgot to return UploadMetadata 2024-02-17 22:59:34 -05:00
Derrick Hammer cfb0abf81a
fix: try to fetch the upload by hash, and if no error, return the upload meta 2024-02-17 22:54:44 -05:00
Derrick Hammer 407114f527
fix: missing components in construction 2024-02-17 03:36:18 -05:00
Derrick Hammer 64492713f7
fix: Metadata needs to be exported 2024-02-17 03:35:51 -05:00
Derrick Hammer 76025f0a8a
fix: StorageServiceParams missing fx.In 2024-02-17 03:33:44 -05:00
Derrick Hammer 12a5f3f631
fix: missing fx.Annotate 2024-02-17 03:21:27 -05:00
Derrick Hammer 93e727ab3b
refactor: epic protocol and storage design refactor 2024-02-16 22:00:53 -05:00
Derrick Hammer ffbb7e371a
fix: pointer not needed as FileExists is by ref now 2024-02-16 08:53:53 -05:00
Derrick Hammer fc53bd3083
refactor: make PutFileSmall handle all tasks 2024-02-15 20:55:21 -05:00
Derrick Hammer 850b575e1c
feat: add Proof method to fetch bao file 2024-02-09 15:43:38 -05:00
Derrick Hammer 28d966cbe2
refactor: switch to using a Params struct and store Renter 2024-02-09 15:42:53 -05:00
Derrick Hammer fc9724df2c
refactor: change PutFileSmall return value 2024-02-09 15:28:28 -05:00
Derrick Hammer c790c525ae
feat: implement adding bao hashing and uploading proofs 2024-02-09 15:23:33 -05:00
Derrick Hammer b82353cfa9
fix: fix need to add a root path on filename 2024-02-02 16:45:50 -05:00
Derrick Hammer 446e81ca19
fix: renter needs to be set on storage 2024-02-01 18:12:09 -05:00
Derrick Hammer 15b527933f
feat: implement initial version of multipart uploads 2024-02-01 02:03:04 -05:00
Derrick Hammer 9a87004f31
fix: need to add lifecycle hook to start tusWorker 2024-01-31 21:28:31 -05:00
Derrick Hammer d88638dfc3
fix: need to invoke storage init to setup tus 2024-01-31 21:28:02 -05:00
Derrick Hammer aff6e8106c
refactor: split renter methods to a dedicated renter service 2024-01-31 21:27:38 -05:00
Derrick Hammer 6d34f5b683
refactor: change struct naming convention from "impl" to "default" 2024-01-31 20:29:27 -05:00
Derrick Hammer 2a067102da
refactor: use new RetryableTask abstraction and move task function as a private method 2024-01-28 16:26:15 -05:00
Derrick Hammer 2dc8fc56f5
refactor: epic refactor to use uber fx microframework/DI framework to manage dependency graph, remove the portal object, and remove the interfaces package 2024-01-28 02:20:59 -05:00
Derrick Hammer c051ef8e44
feat: add Mime to File 2024-01-25 19:17:48 -05:00
Derrick Hammer f3be950ba7
feat: detect and add mime type to upload so we don't need to make extra requests on runtime 2024-01-25 19:05:52 -05:00
Derrick Hammer e00922f49d
feat: add NewFile helper in storage 2024-01-25 16:31:05 -05:00
Derrick Hammer 15ba6e9695
feat: create interface for File 2024-01-25 16:30:45 -05:00
Derrick Hammer a90344daf0
refactor: use errors.Is 2024-01-25 10:39:45 -05:00
Derrick Hammer e1556f2f68
feat: add support for ranges in tus s3 store 2024-01-25 09:50:17 -05:00
Derrick Hammer fce08283a2
fix: both clients need specific api paths 2024-01-25 09:02:49 -05:00
Derrick Hammer 6d8beb0331
fix: need to set api path 2024-01-25 08:55:59 -05:00
Derrick Hammer 8f138a5df7
fix: wrong config keys 2024-01-25 08:48:05 -05:00
Derrick Hammer 263f34b89f
Revert "fix: need to pass protocol scheme"
This reverts commit 8528df5d96.
2024-01-25 08:47:38 -05:00
Derrick Hammer 8528df5d96
fix: need to pass protocol scheme 2024-01-25 08:44:54 -05:00