Commit Graph

390 Commits

Author SHA1 Message Date
Karol Wypchlo f7f03d183a
replace api env vars with domain vars 2022-02-16 14:59:15 +01:00
Karol Wypchlo 26a0451d32
upgrade nginx linux distro from ubuntu 18 LTS to 20 LTS 2022-02-16 14:40:29 +01:00
Karol Wypchlo ce7c2cdc13
add user-agent override 2022-02-16 14:25:42 +01:00
Karol Wypchło f8f39ea936
update limit_conn to 100
Co-authored-by: Michał Leszczyk <michasko37@gmail.com>
2022-02-16 11:41:56 +01:00
Karol Wypchlo 166c452dbb
expose /skynet/trustless/basesector 2022-02-16 10:55:19 +01:00
Ivaylo Novakov 6371ee57e5
Update docker/nginx/conf.d/include/cors-headers
Co-authored-by: Karol Wypchło <kwypchlo@gmail.com>
2022-02-15 15:21:03 +01:00
Ivaylo Novakov 0c8fa3283b
Allow the Skynet-API-Key header.
Add a health-check command for fetching the test user's API key.
2022-02-15 14:59:19 +01:00
Karol Wypchlo b827616fab
disable nginx cache when skyd cache is enabled 2022-02-10 14:55:04 +01:00
Karol Wypchlo 1d006ef163
changelog entry 2022-02-09 17:00:01 +01:00
Karol Wypchlo d91b71ae48
escape uri on subdomain skylink requests 2022-02-09 16:47:34 +01:00
Karol Wypchlo 04bced818f
never restrict options requests 2022-01-26 23:56:37 +01:00
Karol Wypchlo 4e240f2ad8
add option to limit access to subscription users only 2022-01-21 17:43:30 +01:00
Karol Wypchlo ce3b3d035d
check if blocklist is not null 2022-01-20 11:06:34 +01:00
Karol Wypchlo 634bf8d6ba
enable cors on /logout endpoint 2022-01-19 18:08:14 +01:00
Karol Wypchlo cafa312e10
Revert "enable cors on /logout endpoint"
This reverts commit 377a154da0.
2022-01-19 18:07:43 +01:00
Karol Wypchlo 377a154da0
enable cors on /logout endpoint 2022-01-19 18:07:24 +01:00
Karol Wypchlo 46b4cdf0bf
fix empty check on nginx sourced env variable 2022-01-19 17:50:46 +01:00
Karol Wypchlo e4d2dffe86
allow to use skyd api password from env 2022-01-19 15:35:18 +01:00
Karol Wypchlo 4b74ced941
changed ACCOUNTS_AUTH_REQUIRED to ACCOUNTS_LIMIT_ACCESS string var for more flexibility 2022-01-12 14:05:25 +01:00
Karol Wypchlo 15aea1da40
Merge remote-tracking branch 'origin/master' into account-only-portals 2022-01-12 13:44:36 +01:00
Karol Wypchlo c04fd5067d
introduce portals for authenticated users only 2022-01-11 17:07:57 +01:00
Karol Wypchło a7bad7411a
Merge pull request #1497 from SkynetLabs/adjust-blocklist-airtable-script
do not prune nginx cache on airtable blocklist script
2022-01-11 16:38:07 +01:00
Karol Wypchlo b7a7d078ea
remove not exisiting dir copy after #1533 2022-01-11 12:56:29 +01:00
Karol Wypchło a86cb6e5b3
Merge pull request #1533 from SkynetLabs/get-rid-of-cache-purging-code
get rid of unused cache purgin code
2022-01-11 10:21:53 +01:00
Karol Wypchlo a73858e8e9
get rid of unused cache purgin code 2022-01-10 17:10:59 +01:00
Karol Wypchlo 6a889ad793
registry subscription endpoint 2022-01-10 14:51:16 +01:00
Karol Wypchło 31e80e129e
Merge pull request #1519 from SkynetLabs/use-portal-modules-to-discover-services
use portal modules env to discover services in nginx
2022-01-07 13:59:50 +01:00
Karol Wypchlo 31b7090863
change var name and add description 2022-01-07 13:36:04 +01:00
Karol Wypchlo d24c677a30
use portal modules env to discover services in nginx 2022-01-07 11:53:16 +01:00
Karol Wypchlo 669f700a9e
prevent files larger than 1GB from being stored in cache 2022-01-05 16:14:13 +01:00
Karol Wypchlo 5cf5acb4e2
do not prune blocklist manually 2021-12-23 13:17:07 +01:00
Karol Wypchlo 928e038749
fix skapp link redirect 2021-12-21 16:29:41 +01:00
Karol Wypchlo 51b56d2e42
fix skapp link redirect 2021-12-21 16:28:52 +01:00
Karol Wypchlo f456f1c850
remove /usr/local/bin /usr/bin /bin /usr/sbin /sbin /Applications/VMware Fusion.app/Contents/Public /usr/local/MacGPG2/bin /Library/Apple/usr/bin redirecting to 2021-12-21 16:17:40 +01:00
Karol Wypchlo 6b9e825966
expose /abuse and /abuse/report endpoints 2021-12-21 16:07:18 +01:00
Karol Wypchło 5b1d281ee1
Merge pull request #1479 from SkynetLabs/pj/abuse-skapp
Abuse Skapp: Update CORS rules
2021-12-21 15:56:13 +01:00
Karol Wypchło 76e302aa2a
Merge pull request #1478 from SkynetLabs/blake-hashing-lua
no delay blocklisting
2021-12-20 17:25:25 +01:00
Karol Wypchlo d34366aefc
improve get_stale usage docs 2021-12-20 16:55:14 +01:00
Karol Wypchlo 871712c3f8
improve docs around shared dict size 2021-12-20 16:50:54 +01:00
Karol Wypchlo 9805ac9b2a
limit local networks 2021-12-20 14:54:42 +01:00
Karol Wypchło a95a2627d8
Update docker/nginx/conf.d/server.local.conf
Co-authored-by: Ivaylo Novakov <ro-tex@users.noreply.github.com>
2021-12-20 14:18:48 +01:00
Karol Wypchlo 5673f44d1a
blocklist improvements 2021-12-20 13:12:56 +01:00
Ivaylo Novakov d09950f1e0
Fix the port of malware-scanner. 2021-12-20 12:52:17 +02:00
Karol Wypchlo b72c997e55
add proxy for stripe webhook endpoint 2021-12-19 16:53:50 +01:00
PJ a78d0cd98c
Use plain CORS 2021-12-17 16:00:01 +01:00
Ivaylo Novakov b37008b497
Merge pull request #1364 from SkynetLabs/sevey/update-default-limit
Update default limit for Uploads
2021-12-17 15:32:33 +01:00
PJ 91cd98eaa1
Add newline 2021-12-17 15:20:31 +01:00
PJ 98dc87ba6f
Update CORS rules 2021-12-17 15:15:06 +01:00
Karol Wypchlo a3711b1e0f
expose accounts /health endpoint 2021-12-15 12:44:01 +01:00
Ivaylo Novakov 412ba559fa
Expect 200s. 2021-12-14 14:38:40 +02:00
Ivaylo Novakov 60cef34bfc
Move blocker from .102 to .110 2021-12-14 11:10:15 +02:00
Ivaylo Novakov 95e8b85df9
Merge branch 'master' into ivo/clamav 2021-12-14 09:30:54 +02:00
PJ d0da240ab9
Move script 2021-12-10 17:15:49 +01:00
Ivaylo Novakov bf5aa247dd
Add nginx triggers that would let malware-scanner know that it needs to scan a given skylink. 2021-12-09 16:21:49 +01:00
Ivaylo Novakov a4242a9234
Merge branch 'master' into accounts-api-refactor
# Conflicts:
#	.gitignore
2021-12-09 14:03:59 +01:00
Matthew Sevey 7bf366db24
Add serverload endpoint (#1410)
* write usage script for cpu and free disk space tracking, testing new endpoint

* Test alias nginx path

* testing json

* fix server load json file being served by nginx

* Fix filenames

* Add changelog

* Add systemd file for serverload

* Update setup-scripts/serverload.sh

Co-authored-by: Peter-Jan Brone <peter-jan@settlemint.com>
2021-12-06 12:49:58 +01:00
Chris Schinnerl 495dd8d14b
Merge remote-tracking branch 'origin/master' into accounts-api-refactor 2021-12-03 10:20:33 +01:00
Christopher Schinnerl b2dbe4bdb4
Merge pull request #1408 from SkynetLabs/pj/abuse
Abuse Reports
2021-12-02 19:12:28 +01:00
PJ 341f313839
Remove comments 2021-12-02 17:28:40 +01:00
PJ 6e1af409c6
Remove commented out code 2021-12-02 17:23:37 +01:00
PJ 938c5905c5
Remove CORS settings 2021-12-02 17:07:11 +01:00
PJ c89663b393
Add missing semi colon 2021-12-02 14:05:41 +01:00
PJ 6c99803749
Bypass CORS issue 2021-12-01 16:51:40 +01:00
PJ 25fd697d5f
Configure routes 2021-12-01 16:23:56 +01:00
PJ 63b283fc42
Update block routes 2021-12-01 12:56:25 +01:00
PJ 1fe2c3d76f
Add abuse location 2021-12-01 11:18:25 +01:00
PJ d1cbbb4ebb
Add min_free param to proxy_cache_path directive 2021-12-01 10:38:25 +01:00
Matthew Sevey c273634e27
Update docker/nginx/conf.d/server/server.api 2021-11-30 07:43:17 -05:00
Ivaylo Novakov ec94429f2a
Expose accounts's challenge-response endpoints + CORS. 2021-11-16 09:27:04 +01:00
Matthew Sevey 0e9d9a624e
Merge branch 'master' into sevey/update-default-limit 2021-11-15 10:12:07 -08:00
Matthew Sevey aba544aa2e
increase to 5GB limit for uploading large directories: 2021-11-15 10:11:38 -08:00
Karol Wypchlo 74084a8da8
upgrade accounts to new api 2021-11-13 01:34:00 +01:00
Ivaylo Novakov 030b8b9419
Set burst to 10, parallel to 5. 2021-11-12 18:10:38 +01:00
Ivaylo Novakov c0eb41d10d
Set burst to 2. 2021-11-11 17:17:53 +01:00
Karol Wypchlo e0520de05e
introduce hard upload limits 2021-11-11 16:59:51 +01:00
Matthew Sevey 6a3edd6848
Drop unused requested skylink header 2021-11-08 13:13:44 -05:00
Karol Wypchło d4eb04f702
Merge pull request #1346 from SkynetLabs/ivo/inc_body_restore
Increase the request body size of the /skynet/restore endpoint to 5MB.
2021-11-08 16:31:40 +01:00
Karol Wypchlo c4e771759b
unit tests 2021-11-05 17:12:01 +01:00
Karol Wypchlo a4ce3c935d
implement base32 decoder 2021-11-05 13:29:33 +01:00
Karol Wypchlo 878660c52a
remove siapath 2021-11-03 17:16:28 +01:00
Karol Wypchlo d4b9146ecf
add siapath 2021-11-03 15:06:09 +01:00
Karol Wypchlo eec5150264
fix /restore endpoint 2021-11-03 14:51:10 +01:00
Karol Wypchlo 040ea5b581
fix /restore endpoint 2021-11-03 14:50:20 +01:00
Ivaylo Novakov 7787903c06
Proxy-pass /skynet/restore to skyd. 2021-11-03 14:22:05 +01:00
Ivaylo Novakov c34a32a3fd
Require auth. 2021-11-03 12:51:29 +01:00
Ivaylo Novakov adff743fde
Add CORS. 2021-11-03 10:17:44 +01:00
Ivaylo Novakov 45688eeab1
Increase the request body size of the /skynet/restore endpoint to 5MB. 2021-11-03 09:57:55 +01:00
Karol Wypchlo 40d0bb0e4d
fix caching 2021-10-26 16:47:06 +02:00
Karol Wypchlo d13a68d825
fix caching 2021-10-26 16:44:06 +02:00
Karol Wypchlo 81a1338f00
move cache to lua to minimise number of requests 2021-10-26 13:01:15 +02:00
Karol Wypchlo d4bc9df1ce
Merge remote-tracking branch 'origin/master' into wildcard-api 2021-10-26 12:48:00 +02:00
Karol Wypchło 97b1920409
fix registry tracking method (#1299) 2021-10-19 16:59:23 +02:00
Karol Wypchlo ffb1e499b9
use skynet to load our homepage 2021-10-18 16:24:23 +01:00
Karol Wypchlo aa99006822
Merge remote-tracking branch 'origin/master' into wildcard-api 2021-10-15 15:04:06 +02:00
Karol Wypchlo 26a3e6a81d
expose upload-concat header for tus 2021-10-05 21:08:53 +02:00
Karol Wypchlo a96158d5a4
add / 2021-09-20 22:28:38 +02:00
Karol Wypchlo f1346f23ad
expose skylink endpoint over external domains 2021-09-20 22:21:45 +02:00
Karol Wypchlo f802165509
/skynet/tus should handle options response 2021-09-10 17:13:06 +02:00
Karol Wypchlo 3946ad4a77
use 308 as new skyd redirect code 2021-09-07 12:56:25 +02:00
dependabot[bot] 0304298437
Bump openresty/openresty in /docker/nginx
Bumps openresty/openresty from 1.19.3.2-3-bionic to 1.19.9.1-bionic.

---
updated-dependencies:
- dependency-name: openresty/openresty
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-09-06 11:05:20 +00:00
Karol Wypchlo f6f3863736
fix tus upload limits not set 2021-09-02 10:16:41 +02:00
Karol Wypchlo 2cb0707fa5
allow If-None-Match 2021-08-31 16:55:18 +02:00
Karol Wypchlo c5afe554b5
do not expose Skynet-Requested-Skylink 2021-08-31 16:39:42 +02:00
Karol Wypchlo f01bc7ff7a
expose ETag 2021-08-31 16:01:55 +02:00
Karol Wypchlo 9ff776fdea
fix account endpoint nginx subrequests 2021-08-27 18:33:27 +02:00
Karol Wypchlo ecb73e7498
drop caddy as proxy 2021-08-27 14:15:22 +02:00
Karol Wypchlo 3b4a6bbd58
extend timeout on health endpoint and cache result for 1 minute 2021-08-24 19:02:11 +02:00
Karol Wypchlo 999a0d85aa
expose /skynet/health endpoint 2021-08-24 16:42:33 +02:00
Karol Wypchlo 2798254988 add missing skylink headers 2021-08-16 21:17:11 +02:00
Karol Wypchło b00d93cfa6
increase min uses and cache size (#1060)
* increase min uses and cache size

* lower the time from 14 days to 2 days
2021-08-11 11:48:15 +02:00
Karol Wypchło a7db096fe9
expose Skynet-Proof header (#1059) 2021-08-10 12:12:33 +02:00
Karol Wypchlo c59991c2e0 bump worker_connections number and auto detect worker_processes number 2021-08-09 12:14:12 +02:00
Karol Wypchlo 776be50de9 fix broken skylink v2 redirects 2021-08-06 16:52:18 +02:00
Karol Wypchlo 7304a0fc5d increase size of the buffer to fit jwt in cache key 2021-08-05 14:51:19 +02:00
Karol Wypchło 4a9828d6fb
newline 2021-08-05 14:46:04 +02:00
Karol Wypchlo f1bf2d75c2 use include file to skip unnecessary proxy 2021-08-05 14:34:00 +02:00
Karol Wypchło ec60e00bf4
fix for TUS uploads timing out (#1052)
* increase timeouts

* align

* remove client_header_timeout

* temporarily increase limit

* disable proxy buffering off

* formatting

* disable proxy request bufferring

* do not use upgrade

* 6 parallel connections

* test

* test

* test

* test

* test

* test

* test

* test

* test

* make sure it all works

* make sure it all works

* limit back to 1
2021-08-05 13:44:31 +02:00
Karol Wypchło 30da6c4699
Proof not showing up (#1028)
* fix proof header

* fix set directive

* var mismatch

* var mismatch

* add comments
2021-08-02 16:48:04 +02:00
Karol Wypchło c78d47209c
disable slice module (#1025) 2021-07-30 09:23:04 +02:00
Karol Wypchlo 0278d4740d use true instead of 1 2021-07-26 12:31:12 +02:00
Karol Wypchlo 278482ab72 os.getenv doesn't take default value in lua 2021-07-26 01:54:03 +02:00
Karol Wypchło b31d3bf680
request skylink v2 instead of v1 (#990)
* request skylink v2 instead of v1

* skylink_v2 => skylink
2021-07-23 16:57:20 +02:00
Karol Wypchło 3b026b4c59
add missing new line 2021-07-09 14:45:46 +02:00
Karol Wypchlo 191d97b2c2 already contains leading slash 2021-07-09 13:59:31 +02:00
Karol Wypchlo 84d31fed00 increase timeouts on nginx locations that proxy pass internally 2021-07-09 13:58:55 +02:00
Karol Wypchło 6ae40bb6bd
Merge pull request #942 from SkynetLabs/dnslink
dnslink beta support
2021-07-08 17:51:23 +02:00
Karol Wypchło 6b5e09620d
Fix skylink v2 redirect (#946)
* replace skylink in location header

* missing ;

* add comments for skylink v2 resolver
2021-07-08 14:44:13 +02:00
Karol Wypchlo 1385354074 dnslink beta support 2021-07-07 15:49:45 +02:00
Karol Wypchlo cf64fd2107 missed return 2021-06-18 17:00:53 +02:00
Karol Wypchlo 800fc543f7 support dynamic max upload size on tus endpoint 2021-06-18 14:03:38 +02:00
Karol Wypchło 9729bf7cff proxy_redirect typo 2021-06-16 16:50:05 +02:00
Karol Wypchlo fc2a3b4290 expose Skynet-Server-Api header 2021-06-16 16:50:05 +02:00
Karol Wypchlo 5214d2d298 use host overwrite instead of proxy_redirect 2021-06-16 16:50:05 +02:00
Karol Wypchlo 308e37f63f clean up failing part 2021-06-16 16:50:05 +02:00
Karol Wypchlo 4c3aa72424 use in context of location 2021-06-16 16:50:05 +02:00
Karol Wypchlo db1a50a999 use set_by_lua instead 2021-06-16 16:50:05 +02:00
Karol Wypchlo e463199022 use perl_set to expose env variables 2021-06-16 16:50:05 +02:00
Karol Wypchlo cb85ed355a use skynet server api env variable to rewrite proxy response on /tus endpoint 2021-06-16 16:50:05 +02:00
Karol Wypchlo bfc4a6bc14 support accounts on tus uploads 2021-06-09 14:57:10 +02:00
Karol Wypchlo d8e95d4d82 add skynet-skylink header to tus final response 2021-06-09 12:06:15 +02:00
Karol Wypchlo 909cb4916e do not resolve if not http 200 2021-06-04 17:04:44 +02:00
Karol Wypchlo 439f4309a4 move registry tracking to separate file 2021-06-04 13:23:07 +02:00
Karol Wypchlo 3cc3685273 Merge remote-tracking branch 'origin/master' into pin-endpoint 2021-06-04 13:21:47 +02:00
Ivaylo Novakov 3ac8cf2fe9
Merge pull request #826 from SkynetLabs/clean-up-stats-endpoint
Clean up stats endpoint
2021-06-04 12:53:56 +02:00
Karol Wypchlo aa34c1f088 add new lines on eof 2021-06-04 12:35:16 +02:00
Karol Wypchlo ed7c1f71c7 add /skynet/pin endpoint and clean up config 2021-06-04 12:33:37 +02:00
Christopher Schinnerl b35ea89ff6
Merge pull request #829 from SkynetLabs/v2-skylinks-cache
V2 skylinks cache
2021-06-04 12:29:43 +02:00
PJ bd8593039d
Do not increase proxy_connect_timeout 2021-06-04 11:58:38 +02:00
PJ 898a728f5a
Increase request timeout 2021-06-04 11:43:52 +02:00
Karol Wypchlo c84723b159 add sia-auth 2021-06-02 18:15:04 +02:00