Commit Graph

417 Commits

Author SHA1 Message Date
Karol Wypchlo e0520de05e
introduce hard upload limits 2021-11-11 16:59:51 +01:00
Ivaylo Novakov b34d213274
Update docker/malware-scanner/Dockerfile
Co-authored-by: Karol Wypchło <kwypchlo@gmail.com>
2021-11-11 13:33:52 +01:00
Ivaylo Novakov f92ff89d71
Use the `malware-scanner` data dir. 2021-11-11 10:34:50 +01:00
Ivaylo Novakov 50b2c8f85c
Add ClamAV config and continue the setup. 2021-11-10 21:09:16 +01:00
Matthew Sevey 2f0f7d64e0
Update handshake to use v3.0.1 2021-11-09 18:19:49 -05:00
Ivaylo Novakov f0a4dc5f8f
Add a malware-scanner service. 2021-11-09 18:04:05 +01:00
Karol Wypchło 81acfe1e48
Update Dockerfile 2021-11-09 12:45:11 +01:00
dependabot[bot] c25618cd76
Bump caddy from 2.4.5-builder to 2.4.6-builder in /docker/caddy
Bumps caddy from 2.4.5-builder to 2.4.6-builder.

---
updated-dependencies:
- dependency-name: caddy
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-11-09 11:37:06 +00:00
Matthew Sevey 6a3edd6848
Drop unused requested skylink header 2021-11-08 13:13:44 -05:00
Karol Wypchło d4eb04f702
Merge pull request #1346 from SkynetLabs/ivo/inc_body_restore
Increase the request body size of the /skynet/restore endpoint to 5MB.
2021-11-08 16:31:40 +01:00
dependabot[bot] 162a9fa200
Bump node from 16.12.0-alpine to 16.13.0-alpine in /docker/handshake
Bumps node from 16.12.0-alpine to 16.13.0-alpine.

---
updated-dependencies:
- dependency-name: node
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-11-08 12:10:15 +00:00
Karol Wypchlo c4e771759b
unit tests 2021-11-05 17:12:01 +01:00
Karol Wypchlo a4ce3c935d
implement base32 decoder 2021-11-05 13:29:33 +01:00
Karol Wypchlo 878660c52a
remove siapath 2021-11-03 17:16:28 +01:00
Karol Wypchlo d4b9146ecf
add siapath 2021-11-03 15:06:09 +01:00
Karol Wypchlo eec5150264
fix /restore endpoint 2021-11-03 14:51:10 +01:00
Karol Wypchlo 040ea5b581
fix /restore endpoint 2021-11-03 14:50:20 +01:00
Ivaylo Novakov 7787903c06
Proxy-pass /skynet/restore to skyd. 2021-11-03 14:22:05 +01:00
Ivaylo Novakov c34a32a3fd
Require auth. 2021-11-03 12:51:29 +01:00
Ivaylo Novakov adff743fde
Add CORS. 2021-11-03 10:17:44 +01:00
Ivaylo Novakov 45688eeab1
Increase the request body size of the /skynet/restore endpoint to 5MB. 2021-11-03 09:57:55 +01:00
Karol Wypchlo 40d0bb0e4d
fix caching 2021-10-26 16:47:06 +02:00
Karol Wypchlo d13a68d825
fix caching 2021-10-26 16:44:06 +02:00
Karol Wypchlo 81a1338f00
move cache to lua to minimise number of requests 2021-10-26 13:01:15 +02:00
Karol Wypchlo d4bc9df1ce
Merge remote-tracking branch 'origin/master' into wildcard-api 2021-10-26 12:48:00 +02:00
dependabot[bot] 9f1050fbb8
Bump node from 16.11.1-alpine to 16.12.0-alpine in /docker/handshake
Bumps node from 16.11.1-alpine to 16.12.0-alpine.

---
updated-dependencies:
- dependency-name: node
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-10-26 08:42:34 +00:00
Karol Wypchło 97b1920409
fix registry tracking method (#1299) 2021-10-19 16:59:23 +02:00
Karol Wypchlo ffb1e499b9
use skynet to load our homepage 2021-10-18 16:24:23 +01:00
dependabot[bot] adc971f0b8
Bump node from 16.10.0-alpine to 16.11.1-alpine in /docker/handshake
Bumps node from 16.10.0-alpine to 16.11.1-alpine.

---
updated-dependencies:
- dependency-name: node
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-10-18 12:09:48 +00:00
Karol Wypchlo aa99006822
Merge remote-tracking branch 'origin/master' into wildcard-api 2021-10-15 15:04:06 +02:00
Karol Wypchlo 26a3e6a81d
expose upload-concat header for tus 2021-10-05 21:08:53 +02:00
Karol Wypchlo add8b7d9e5
Merge remote-tracking branch 'origin/master' into unpin-from-dashboard 2021-09-29 12:22:50 +02:00
dependabot[bot] 7e2cb78893
Bump node from 16.9.1-alpine to 16.10.0-alpine in /docker/handshake
Bumps node from 16.9.1-alpine to 16.10.0-alpine.

---
updated-dependencies:
- dependency-name: node
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-09-27 12:09:40 +00:00
Karol Wypchlo 70f5e4128d
Merge remote-tracking branch 'origin/master' into unpin-from-dashboard 2021-09-25 19:20:03 +02:00
Karol Wypchlo f1240c7c60
drop max_retries and add email to caddy dns challenge 2021-09-24 01:40:21 +02:00
Karol Wypchlo 3a41bc9ae7
change caddy running container from builder to alpine 2021-09-24 01:26:39 +02:00
Karol Wypchlo 62c7f3cece
Merge remote-tracking branch 'origin/master' into unpin-from-dashboard 2021-09-23 23:55:54 +02:00
Karol Wypchlo 42f16ced25
drop ttl until the bug is fixed 2021-09-23 23:54:03 +02:00
Karol Wypchło 8dbff497d4
fix invalid json in config file (#1224) 2021-09-22 11:44:42 +02:00
Karol Wypchlo 91dbd990e4
Merge remote-tracking branch 'origin/master' into unpin-from-dashboard 2021-09-21 13:52:41 +02:00
Karol Wypchlo a96158d5a4
add / 2021-09-20 22:28:38 +02:00
Karol Wypchlo f1346f23ad
expose skylink endpoint over external domains 2021-09-20 22:21:45 +02:00
dependabot[bot] cdd06394d9
Bump node from 16.9.0-alpine to 16.9.1-alpine in /docker/handshake
Bumps node from 16.9.0-alpine to 16.9.1-alpine.

---
updated-dependencies:
- dependency-name: node
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-09-20 12:08:37 +00:00
Ivaylo Novakov 49774d2f04
Bump the go version used by accounts's container to 1.16.7 2021-09-13 09:33:22 +02:00
Matthew Sevey cd4d1d5565
Merge pull request #1181 from SkynetLabs/caddy-dns-entry-ttl
make caddy dns entries ttl 15 minutes
2021-09-10 14:26:03 -04:00
Karol Wypchło 50ec789e95
Update caddy.json.template 2021-09-10 19:11:19 +02:00
Karol Wypchlo fba0fd64f7
make caddy dns entries ttl 10 minutes 2021-09-10 17:21:39 +02:00
Karol Wypchlo a888aae6ca
cherry pick to a different pr 2021-09-10 17:21:05 +02:00
Karol Wypchlo d52f9bd698
add ttl for caddy dns entry 2021-09-10 17:20:44 +02:00
Karol Wypchlo f802165509
/skynet/tus should handle options response 2021-09-10 17:13:06 +02:00
Karol Wypchlo c8822168bf
unpin skylink action 2021-09-10 12:22:36 +02:00
Karol Wypchło 059f553745
Merge pull request #1163 from SkynetLabs/dependabot/docker/docker/caddy/caddy-2.4.5-builder
Bump caddy from 2.4.3-builder to 2.4.5-builder in /docker/caddy
2021-09-10 11:34:54 +02:00
dependabot[bot] 016e0c7ab7
Bump node from 16.8.0-alpine to 16.9.0-alpine in /docker/handshake
Bumps node from 16.8.0-alpine to 16.9.0-alpine.

---
updated-dependencies:
- dependency-name: node
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-09-10 09:26:37 +00:00
dependabot[bot] e42dfacfdb
Bump caddy from 2.4.3-builder to 2.4.5-builder in /docker/caddy
Bumps caddy from 2.4.3-builder to 2.4.5-builder.

---
updated-dependencies:
- dependency-name: caddy
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-09-10 09:26:35 +00:00
Matthew Sevey 0f60a395b3
Remove outdated NebulousLabs references 2021-09-08 15:04:02 -04:00
Karol Wypchlo 3946ad4a77
use 308 as new skyd redirect code 2021-09-07 12:56:25 +02:00
Karol Wypchło f8de4438cd
Merge pull request #1147 from SkynetLabs/dependabot/docker/docker/nginx/openresty/openresty-1.19.9.1-bionic
Bump openresty/openresty from 1.19.3.2-3-bionic to 1.19.9.1-bionic in /docker/nginx
2021-09-06 13:10:59 +02:00
dependabot[bot] bf1dcc92d0
Bump node from 16.5.0-alpine to 16.8.0-alpine in /docker/handshake
Bumps node from 16.5.0-alpine to 16.8.0-alpine.

---
updated-dependencies:
- dependency-name: node
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-09-06 11:05:22 +00:00
dependabot[bot] 0304298437
Bump openresty/openresty in /docker/nginx
Bumps openresty/openresty from 1.19.3.2-3-bionic to 1.19.9.1-bionic.

---
updated-dependencies:
- dependency-name: openresty/openresty
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-09-06 11:05:20 +00:00
Karol Wypchło 2fc575df8f
Merge pull request #1062 from SkynetLabs/sevey/handshake
Update handshake chain migration in docker compose
2021-09-03 16:55:17 +02:00
Matthew Sevey a7bb3743a3
Update comments 2021-09-03 10:52:54 -04:00
Matthew Sevey 343fc6286f
Update hsd docker file to point to new commit 2021-09-03 10:37:40 -04:00
Karol Wypchlo f6f3863736
fix tus upload limits not set 2021-09-02 10:16:41 +02:00
Karol Wypchlo 2cb0707fa5
allow If-None-Match 2021-08-31 16:55:18 +02:00
Karol Wypchlo c5afe554b5
do not expose Skynet-Requested-Skylink 2021-08-31 16:39:42 +02:00
Karol Wypchlo f01bc7ff7a
expose ETag 2021-08-31 16:01:55 +02:00
Karol Wypchlo 9ff776fdea
fix account endpoint nginx subrequests 2021-08-27 18:33:27 +02:00
Karol Wypchlo ecb73e7498
drop caddy as proxy 2021-08-27 14:15:22 +02:00
Matthew Sevey 907925e115
Merge pull request #1105 from SkynetLabs/expose-skynet-health-endpoint
expose /skynet/health endpoints
2021-08-24 13:31:38 -04:00
Karol Wypchlo 3b4a6bbd58
extend timeout on health endpoint and cache result for 1 minute 2021-08-24 19:02:11 +02:00
Karol Wypchlo 999a0d85aa
expose /skynet/health endpoint 2021-08-24 16:42:33 +02:00
Karol Wypchlo 3fa01b4357
pin golang to 1.16.7 2021-08-24 15:52:49 +02:00
Karol Wypchlo 2798254988 add missing skylink headers 2021-08-16 21:17:11 +02:00
Karol Wypchło b00d93cfa6
increase min uses and cache size (#1060)
* increase min uses and cache size

* lower the time from 14 days to 2 days
2021-08-11 11:48:15 +02:00
Karol Wypchło a7db096fe9
expose Skynet-Proof header (#1059) 2021-08-10 12:12:33 +02:00
Karol Wypchlo c59991c2e0 bump worker_connections number and auto detect worker_processes number 2021-08-09 12:14:12 +02:00
Karol Wypchlo 776be50de9 fix broken skylink v2 redirects 2021-08-06 16:52:18 +02:00
Karol Wypchlo 7304a0fc5d increase size of the buffer to fit jwt in cache key 2021-08-05 14:51:19 +02:00
Karol Wypchło 4a9828d6fb
newline 2021-08-05 14:46:04 +02:00
Karol Wypchlo f1bf2d75c2 use include file to skip unnecessary proxy 2021-08-05 14:34:00 +02:00
Karol Wypchło ec60e00bf4
fix for TUS uploads timing out (#1052)
* increase timeouts

* align

* remove client_header_timeout

* temporarily increase limit

* disable proxy buffering off

* formatting

* disable proxy request bufferring

* do not use upgrade

* 6 parallel connections

* test

* test

* test

* test

* test

* test

* test

* test

* test

* make sure it all works

* make sure it all works

* limit back to 1
2021-08-05 13:44:31 +02:00
Ivaylo Novakov bbfae662a2
Add a migration command for HSD and fix it to a given commit. 2021-08-05 13:55:57 +03:00
Karol Wypchło 30da6c4699
Proof not showing up (#1028)
* fix proof header

* fix set directive

* var mismatch

* var mismatch

* add comments
2021-08-02 16:48:04 +02:00
Karol Wypchło c78d47209c
disable slice module (#1025) 2021-07-30 09:23:04 +02:00
Ivaylo Novakov 3bf35d9d22
Merge pull request #1005 from SkynetLabs/fix-os-getenv
os.getenv doesn't take default value in lua
2021-07-26 19:57:07 +02:00
Karol Wypchlo a3e12327c0 update node and main branch 2021-07-26 13:46:02 +02:00
Karol Wypchlo 0278d4740d use true instead of 1 2021-07-26 12:31:12 +02:00
Karol Wypchlo 278482ab72 os.getenv doesn't take default value in lua 2021-07-26 01:54:03 +02:00
Karol Wypchło b31d3bf680
request skylink v2 instead of v1 (#990)
* request skylink v2 instead of v1

* skylink_v2 => skylink
2021-07-23 16:57:20 +02:00
Karol Wypchlo 7abeffe6f6 hotfix http redirect 2021-07-16 17:03:10 +02:00
Karol Wypchło 3b026b4c59
add missing new line 2021-07-09 14:45:46 +02:00
Karol Wypchlo 191d97b2c2 already contains leading slash 2021-07-09 13:59:31 +02:00
Karol Wypchlo 84d31fed00 increase timeouts on nginx locations that proxy pass internally 2021-07-09 13:58:55 +02:00
Karol Wypchło 6ae40bb6bd
Merge pull request #942 from SkynetLabs/dnslink
dnslink beta support
2021-07-08 17:51:23 +02:00
Karol Wypchło 6b5e09620d
Fix skylink v2 redirect (#946)
* replace skylink in location header

* missing ;

* add comments for skylink v2 resolver
2021-07-08 14:44:13 +02:00
Karol Wypchlo c9a13cab8e do not disable :443 2021-07-07 23:31:14 +02:00
Karol Wypchlo ee475de13b disable :443 2021-07-07 23:29:10 +02:00
Karol Wypchlo e86abc3438 serve dnslink over http 2021-07-07 16:02:58 +02:00
Karol Wypchlo 1385354074 dnslink beta support 2021-07-07 15:49:45 +02:00
Karol Wypchlo e79eaafd72 update node and rebuild website 2021-07-06 12:26:27 +02:00
Karol Wypchlo cf64fd2107 missed return 2021-06-18 17:00:53 +02:00
Karol Wypchlo 800fc543f7 support dynamic max upload size on tus endpoint 2021-06-18 14:03:38 +02:00
Karol Wypchło 9729bf7cff proxy_redirect typo 2021-06-16 16:50:05 +02:00
Karol Wypchlo fc2a3b4290 expose Skynet-Server-Api header 2021-06-16 16:50:05 +02:00
Karol Wypchlo 5214d2d298 use host overwrite instead of proxy_redirect 2021-06-16 16:50:05 +02:00
Karol Wypchlo 308e37f63f clean up failing part 2021-06-16 16:50:05 +02:00
Karol Wypchlo 4c3aa72424 use in context of location 2021-06-16 16:50:05 +02:00
Karol Wypchlo db1a50a999 use set_by_lua instead 2021-06-16 16:50:05 +02:00
Karol Wypchlo e463199022 use perl_set to expose env variables 2021-06-16 16:50:05 +02:00
Karol Wypchlo cb85ed355a use skynet server api env variable to rewrite proxy response on /tus endpoint 2021-06-16 16:50:05 +02:00
Karol Wypchlo bfc4a6bc14 support accounts on tus uploads 2021-06-09 14:57:10 +02:00
Karol Wypchlo d8e95d4d82 add skynet-skylink header to tus final response 2021-06-09 12:06:15 +02:00
Karol Wypchlo 909cb4916e do not resolve if not http 200 2021-06-04 17:04:44 +02:00
Karol Wypchlo 439f4309a4 move registry tracking to separate file 2021-06-04 13:23:07 +02:00
Karol Wypchlo 3cc3685273 Merge remote-tracking branch 'origin/master' into pin-endpoint 2021-06-04 13:21:47 +02:00
Ivaylo Novakov 3ac8cf2fe9
Merge pull request #826 from SkynetLabs/clean-up-stats-endpoint
Clean up stats endpoint
2021-06-04 12:53:56 +02:00
Karol Wypchlo aa34c1f088 add new lines on eof 2021-06-04 12:35:16 +02:00
Karol Wypchlo ed7c1f71c7 add /skynet/pin endpoint and clean up config 2021-06-04 12:33:37 +02:00
Christopher Schinnerl b35ea89ff6
Merge pull request #829 from SkynetLabs/v2-skylinks-cache
V2 skylinks cache
2021-06-04 12:29:43 +02:00
PJ bd8593039d
Do not increase proxy_connect_timeout 2021-06-04 11:58:38 +02:00
PJ 898a728f5a
Increase request timeout 2021-06-04 11:43:52 +02:00
Karol Wypchlo c84723b159 add sia-auth 2021-06-02 18:15:04 +02:00
Karol Wypchlo 2b9d469f1e fix dir variable name 2021-06-02 18:03:35 +02:00
Karol Wypchlo ece2025561 /skynet/pin endpoint 2021-06-02 17:56:35 +02:00
Karol Wypchlo 3589e2ac04 remove cache key 2021-06-01 12:57:50 +02:00
Karol Wypchlo 20b8a99f14 fix redirect 2021-06-01 12:56:11 +02:00
Karol Wypchlo f59d00e172 log cache key 2021-06-01 12:46:47 +02:00
Karol Wypchlo 9c4f9c8300 log cache key 2021-06-01 12:36:08 +02:00
Karol Wypchlo c9081e9d87 log cache key 2021-06-01 12:33:13 +02:00
Karol Wypchlo 176e5c7a9d fixed caching 2021-06-01 12:29:33 +02:00
Karol Wypchlo a2a4b6ea8f fixed != to ~= 2021-06-01 12:20:25 +02:00
Karol Wypchlo 60cb812148 support v2 caching 2021-06-01 12:17:08 +02:00
Karol Wypchło 45ce3de7c2
disable caching v2 skylinks (#827)
* disable caching v2 skylinks

* amend comment

* fix boolean switch
2021-05-31 20:27:56 +02:00
Karol Wypchlo dec29600c1 clean up stats endpoint 2021-05-31 14:44:36 +02:00
Christopher Schinnerl fda0e2304f
Merge pull request #786 from SkynetLabs/bump-tus-limit
replace limit on body size on tus endpoint
2021-05-31 10:09:37 +02:00
Karol Wypchlo 2db2ae60f6 adjust tus request max body size 2021-05-26 18:02:32 +02:00
Karol Wypchlo f49701f84d bump caddy to 2.4.1 2021-05-26 17:25:32 +02:00
Karol Wypchlo c10353f6d5 bump tus limit to 100G 2021-05-26 16:23:19 +02:00
Karol Wypchlo ac86dfcdee expose tus upload-metadata header 2021-05-25 17:53:05 +02:00
Marcin S 9346898775
Test deploy 2021-05-20 09:39:46 -04:00
Karol Wypchlo c01d340c54 copy over all /go/bin artifacts 2021-05-17 22:05:28 +02:00
Ivaylo Novakov ad79bb369c
Merge branch 'master' into ivo/sia_docker
# Conflicts:
#	packages/website/src/pages/index.js
2021-05-17 09:30:45 +02:00
Karol Wypchlo 24cae03bfe downgrade caddy 2021-05-13 18:34:28 +02:00
Karol Wypchlo 0dce2218d2 upgrade node 2021-05-13 12:30:35 +02:00
Karol Wypchlo 86225c8082 hardcode accounts ip so nginx doesn't die if accounts are not present 2021-05-13 12:25:48 +02:00
Karol Wypchlo d2694c82d3 hardcode health-check ip in nginx 2021-05-13 12:23:46 +02:00
Karol Wypchlo dbbff224d9 upgrade openresty image 2021-05-13 12:23:03 +02:00
Karol Wypchlo 1e9b22977a upgrade caddy to 2.4.0 2021-05-13 12:21:23 +02:00
Karol Wypchło bd6763b47c
disable api access from subdomained skapps (#719)
* disable api access from subdomained skapps

* temporary reroute from skynet-mysky to ann1 dev version

* revert dev change

* mistakenly deleted try
2021-05-11 18:32:02 +02:00
Karol Wypchlo dc47164e45 dont block on nginx level 2021-05-11 11:26:19 +02:00