Commit Graph

265 Commits

Author SHA1 Message Date
Derrick Hammer 6fb77d102a
refactor: add logic to find any unpinned files of a child manifest if the root is pinned but the children aren't 2024-03-05 16:27:29 -05:00
Derrick Hammer caac09cc6f
feat: add CtxAborted and use in account pin 2024-03-05 13:41:47 -05:00
Derrick Hammer fdfffb897c
fix: if not a manifest, call pinEntity directly 2024-03-05 12:41:28 -05:00
Derrick Hammer a5c1356847
fix: don't rely on content length, but do a basic heuristic by reading 1 byte past the max upload, if if we haven't hit the limit and the sizes don't match, then error, but otherwise take an optimistic stance 2024-03-05 12:38:41 -05:00
Derrick Hammer c6feee1351
fix: check if entry returns nil 2024-03-03 11:29:37 -05:00
Derrick Hammer 73623b8c36
fix: add CIDTypeDirectory to isCidManifest 2024-03-03 10:43:01 -05:00
Derrick Hammer f20b4ee916
fix: update usage of GetCachedStorageLocations 2024-03-03 09:33:21 -05:00
Derrick Hammer 080fcbd559
fix: add special case to check for an index.html, and pass root and root type 2024-03-03 08:29:07 -05:00
Derrick Hammer bd5544198e
refactor: optionally track a "root" cid which will be used for webapp manifests to start. Have IsDir run heuristics to verify if it is a dir by checking the manifest tryfiles 2024-03-03 08:28:39 -05:00
Derrick Hammer 756a01d52f
fix: if the filename is a . treat as a special case for a dir 2024-03-03 07:39:18 -05:00
Derrick Hammer bd29ab4612
fix: if we are being requested the root while is a dot, create a file based on the root cid with the . name 2024-03-03 07:38:34 -05:00
Derrick Hammer 9d378f4197
fix: ignore / and . not existing 2024-03-03 07:18:03 -05:00
Derrick Hammer 201c9b992f
fix: need to deref r to replace it 2024-03-03 07:17:46 -05:00
Derrick Hammer 9d25784a6e
fix: we need to pin the files after upload 2024-03-03 06:50:24 -05:00
Derrick Hammer d2c9f8e38a
fix: strip out any port 2024-03-03 06:40:50 -05:00
Derrick Hammer b03af65418
fix: need to manually cast errorPages to webappErrorPages 2024-03-03 05:24:03 -05:00
Derrick Hammer 3d55254916
fix: update use of webApp.Paths 2024-03-03 03:41:30 -05:00
Derrick Hammer 37514a742f
fix: errorFiles is really errorPages 2024-03-03 03:03:15 -05:00
Derrick Hammer 4db07d5170
fix: need to pass tus 2024-03-02 06:24:12 -05:00
Derrick Hammer f98b0f48bd
fix: use hash provided by constructor 2024-03-02 06:12:29 -05:00
Derrick Hammer dde5d255a6
fix: debug api needs cors support 2024-03-02 06:08:23 -05:00
Derrick Hammer 3654607f3f
refactor: replace debug apu auth middlewares with proxy middlewares 2024-03-02 05:01:21 -05:00
Derrick Hammer a96fc8682f
fix: return error not S5Error 2024-03-02 04:55:04 -05:00
Derrick Hammer 7315f8e694
fix: need to manually extract the multipart filename because goes internals strips file paths 2024-03-02 04:54:29 -05:00
Derrick Hammer 0c0cdfd2b1
fix: fix parsing of app upload settings, as they are json, and errorPages needs to be errorFiles 2024-03-02 04:51:28 -05:00
Derrick Hammer 8a112a8c12
refactor: make S5File implement fs.ReadDirFile and fs.DirEntry 2024-03-01 23:30:06 -05:00
Derrick Hammer 1dff84accf
refactor: make resolveDirCid a utility function 2024-03-01 23:28:05 -05:00
Derrick Hammer b87ba1e6bf
feat: add support for webapp and dir cid's in dnslink 2024-03-01 22:50:22 -05:00
Derrick Hammer 8e2adba1eb
feat: add initial fs interfaces for webapp and dir 2024-03-01 22:49:47 -05:00
Derrick Hammer 3dbd791314
feat: add S5FileInfo struct and refactorings needed to be used as a fs.File and in a fs.Fs 2024-03-01 22:49:17 -05:00
Derrick Hammer f79a0dd448
fix: need to use hashBytes and an optional type 2024-03-01 22:46:42 -05:00
Derrick Hammer a1f36df8b9
refactor: change newFile to take the params struct directly and fill in the blanks 2024-03-01 21:59:49 -05:00
Derrick Hammer 65548e8ec7
refactor: pass cidType to new S5File 2024-03-01 21:44:02 -05:00
Derrick Hammer f63d567b53
refactor: add support for using a passed cid type 2024-03-01 21:32:06 -05:00
Derrick Hammer 217bb78b3b
fix: ExistingUploadID no longer needed 2024-03-01 20:56:22 -05:00
Derrick Hammer aefe9efaaa
fix: export struct and add json tags 2024-03-01 10:30:08 -05:00
Derrick Hammer aacdd48428
fix: we need to track when the queue is finished ourselves 2024-03-01 10:11:03 -05:00
Derrick Hammer d5e2770135
refactor: don't use a buffered chan 2024-03-01 05:14:47 -05:00
Derrick Hammer 56100e5d50
fix: shadow cid 2024-03-01 04:55:46 -05:00
Derrick Hammer 866739007c
refactor: use golang-queue to parallel process pinning checks 2024-03-01 04:27:24 -05:00
Derrick Hammer 8f6e7d1acc
fix: dont add nil cids 2024-03-01 04:14:11 -05:00
Derrick Hammer 7ec4f26142
fix: only try to fetch proof file if we are over the post limit 2024-03-01 04:01:22 -05:00
Derrick Hammer a1572b256b
fix: init results 2024-03-01 04:00:39 -05:00
Derrick Hammer 3f2757fb18
feat: add support for resolving a registry entry when pinning 2024-02-29 12:08:04 -05:00
Derrick Hammer b3df326980
feat: add support for recursively pinning a manifest and all its children 2024-02-29 12:02:49 -05:00
Derrick Hammer c984d72cfd
refactor: add performance logging for bao 2024-02-28 12:33:13 -05:00
Derrick Hammer d9d85f2804
fix: casing 2024-02-27 11:14:38 -05:00
Derrick Hammer 097e29aa94
refactor: switch to using All api then filter to find valid locations 2024-02-27 10:58:15 -05:00
Derrick Hammer 944c5f01b9
refactor: add support for ExcludeNodes via excludeSelf in newStorageLocationProvider 2024-02-27 07:31:59 -05:00
Derrick Hammer 9f5b676f47
refactor: use S3MultipartUpload if greater than S3_MULTIPART_MIN_PART_SIZE 2024-02-27 06:14:27 -05:00