Commit Graph

302 Commits

Author SHA1 Message Date
Karol Wypchlo d13a68d825
fix caching 2021-10-26 16:44:06 +02:00
Karol Wypchlo 81a1338f00
move cache to lua to minimise number of requests 2021-10-26 13:01:15 +02:00
Karol Wypchlo d4bc9df1ce
Merge remote-tracking branch 'origin/master' into wildcard-api 2021-10-26 12:48:00 +02:00
Karol Wypchło 97b1920409
fix registry tracking method (#1299) 2021-10-19 16:59:23 +02:00
Karol Wypchlo ffb1e499b9
use skynet to load our homepage 2021-10-18 16:24:23 +01:00
Karol Wypchlo aa99006822
Merge remote-tracking branch 'origin/master' into wildcard-api 2021-10-15 15:04:06 +02:00
Karol Wypchlo 26a3e6a81d
expose upload-concat header for tus 2021-10-05 21:08:53 +02:00
Karol Wypchlo a96158d5a4
add / 2021-09-20 22:28:38 +02:00
Karol Wypchlo f1346f23ad
expose skylink endpoint over external domains 2021-09-20 22:21:45 +02:00
Karol Wypchlo f802165509
/skynet/tus should handle options response 2021-09-10 17:13:06 +02:00
Karol Wypchlo 3946ad4a77
use 308 as new skyd redirect code 2021-09-07 12:56:25 +02:00
dependabot[bot] 0304298437
Bump openresty/openresty in /docker/nginx
Bumps openresty/openresty from 1.19.3.2-3-bionic to 1.19.9.1-bionic.

---
updated-dependencies:
- dependency-name: openresty/openresty
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-09-06 11:05:20 +00:00
Karol Wypchlo f6f3863736
fix tus upload limits not set 2021-09-02 10:16:41 +02:00
Karol Wypchlo 2cb0707fa5
allow If-None-Match 2021-08-31 16:55:18 +02:00
Karol Wypchlo c5afe554b5
do not expose Skynet-Requested-Skylink 2021-08-31 16:39:42 +02:00
Karol Wypchlo f01bc7ff7a
expose ETag 2021-08-31 16:01:55 +02:00
Karol Wypchlo 9ff776fdea
fix account endpoint nginx subrequests 2021-08-27 18:33:27 +02:00
Karol Wypchlo ecb73e7498
drop caddy as proxy 2021-08-27 14:15:22 +02:00
Karol Wypchlo 3b4a6bbd58
extend timeout on health endpoint and cache result for 1 minute 2021-08-24 19:02:11 +02:00
Karol Wypchlo 999a0d85aa
expose /skynet/health endpoint 2021-08-24 16:42:33 +02:00
Karol Wypchlo 2798254988 add missing skylink headers 2021-08-16 21:17:11 +02:00
Karol Wypchło b00d93cfa6
increase min uses and cache size (#1060)
* increase min uses and cache size

* lower the time from 14 days to 2 days
2021-08-11 11:48:15 +02:00
Karol Wypchło a7db096fe9
expose Skynet-Proof header (#1059) 2021-08-10 12:12:33 +02:00
Karol Wypchlo c59991c2e0 bump worker_connections number and auto detect worker_processes number 2021-08-09 12:14:12 +02:00
Karol Wypchlo 776be50de9 fix broken skylink v2 redirects 2021-08-06 16:52:18 +02:00
Karol Wypchlo 7304a0fc5d increase size of the buffer to fit jwt in cache key 2021-08-05 14:51:19 +02:00
Karol Wypchło 4a9828d6fb
newline 2021-08-05 14:46:04 +02:00
Karol Wypchlo f1bf2d75c2 use include file to skip unnecessary proxy 2021-08-05 14:34:00 +02:00
Karol Wypchło ec60e00bf4
fix for TUS uploads timing out (#1052)
* increase timeouts

* align

* remove client_header_timeout

* temporarily increase limit

* disable proxy buffering off

* formatting

* disable proxy request bufferring

* do not use upgrade

* 6 parallel connections

* test

* test

* test

* test

* test

* test

* test

* test

* test

* make sure it all works

* make sure it all works

* limit back to 1
2021-08-05 13:44:31 +02:00
Karol Wypchło 30da6c4699
Proof not showing up (#1028)
* fix proof header

* fix set directive

* var mismatch

* var mismatch

* add comments
2021-08-02 16:48:04 +02:00
Karol Wypchło c78d47209c
disable slice module (#1025) 2021-07-30 09:23:04 +02:00
Karol Wypchlo 0278d4740d use true instead of 1 2021-07-26 12:31:12 +02:00
Karol Wypchlo 278482ab72 os.getenv doesn't take default value in lua 2021-07-26 01:54:03 +02:00
Karol Wypchło b31d3bf680
request skylink v2 instead of v1 (#990)
* request skylink v2 instead of v1

* skylink_v2 => skylink
2021-07-23 16:57:20 +02:00
Karol Wypchło 3b026b4c59
add missing new line 2021-07-09 14:45:46 +02:00
Karol Wypchlo 191d97b2c2 already contains leading slash 2021-07-09 13:59:31 +02:00
Karol Wypchlo 84d31fed00 increase timeouts on nginx locations that proxy pass internally 2021-07-09 13:58:55 +02:00
Karol Wypchło 6ae40bb6bd
Merge pull request #942 from SkynetLabs/dnslink
dnslink beta support
2021-07-08 17:51:23 +02:00
Karol Wypchło 6b5e09620d
Fix skylink v2 redirect (#946)
* replace skylink in location header

* missing ;

* add comments for skylink v2 resolver
2021-07-08 14:44:13 +02:00
Karol Wypchlo 1385354074 dnslink beta support 2021-07-07 15:49:45 +02:00
Karol Wypchlo cf64fd2107 missed return 2021-06-18 17:00:53 +02:00
Karol Wypchlo 800fc543f7 support dynamic max upload size on tus endpoint 2021-06-18 14:03:38 +02:00
Karol Wypchło 9729bf7cff proxy_redirect typo 2021-06-16 16:50:05 +02:00
Karol Wypchlo fc2a3b4290 expose Skynet-Server-Api header 2021-06-16 16:50:05 +02:00
Karol Wypchlo 5214d2d298 use host overwrite instead of proxy_redirect 2021-06-16 16:50:05 +02:00
Karol Wypchlo 308e37f63f clean up failing part 2021-06-16 16:50:05 +02:00
Karol Wypchlo 4c3aa72424 use in context of location 2021-06-16 16:50:05 +02:00
Karol Wypchlo db1a50a999 use set_by_lua instead 2021-06-16 16:50:05 +02:00
Karol Wypchlo e463199022 use perl_set to expose env variables 2021-06-16 16:50:05 +02:00
Karol Wypchlo cb85ed355a use skynet server api env variable to rewrite proxy response on /tus endpoint 2021-06-16 16:50:05 +02:00
Karol Wypchlo bfc4a6bc14 support accounts on tus uploads 2021-06-09 14:57:10 +02:00
Karol Wypchlo d8e95d4d82 add skynet-skylink header to tus final response 2021-06-09 12:06:15 +02:00
Karol Wypchlo 909cb4916e do not resolve if not http 200 2021-06-04 17:04:44 +02:00
Karol Wypchlo 439f4309a4 move registry tracking to separate file 2021-06-04 13:23:07 +02:00
Karol Wypchlo 3cc3685273 Merge remote-tracking branch 'origin/master' into pin-endpoint 2021-06-04 13:21:47 +02:00
Ivaylo Novakov 3ac8cf2fe9
Merge pull request #826 from SkynetLabs/clean-up-stats-endpoint
Clean up stats endpoint
2021-06-04 12:53:56 +02:00
Karol Wypchlo aa34c1f088 add new lines on eof 2021-06-04 12:35:16 +02:00
Karol Wypchlo ed7c1f71c7 add /skynet/pin endpoint and clean up config 2021-06-04 12:33:37 +02:00
Christopher Schinnerl b35ea89ff6
Merge pull request #829 from SkynetLabs/v2-skylinks-cache
V2 skylinks cache
2021-06-04 12:29:43 +02:00
PJ bd8593039d
Do not increase proxy_connect_timeout 2021-06-04 11:58:38 +02:00
PJ 898a728f5a
Increase request timeout 2021-06-04 11:43:52 +02:00
Karol Wypchlo c84723b159 add sia-auth 2021-06-02 18:15:04 +02:00
Karol Wypchlo 2b9d469f1e fix dir variable name 2021-06-02 18:03:35 +02:00
Karol Wypchlo ece2025561 /skynet/pin endpoint 2021-06-02 17:56:35 +02:00
Karol Wypchlo 3589e2ac04 remove cache key 2021-06-01 12:57:50 +02:00
Karol Wypchlo 20b8a99f14 fix redirect 2021-06-01 12:56:11 +02:00
Karol Wypchlo f59d00e172 log cache key 2021-06-01 12:46:47 +02:00
Karol Wypchlo 9c4f9c8300 log cache key 2021-06-01 12:36:08 +02:00
Karol Wypchlo c9081e9d87 log cache key 2021-06-01 12:33:13 +02:00
Karol Wypchlo 176e5c7a9d fixed caching 2021-06-01 12:29:33 +02:00
Karol Wypchlo a2a4b6ea8f fixed != to ~= 2021-06-01 12:20:25 +02:00
Karol Wypchlo 60cb812148 support v2 caching 2021-06-01 12:17:08 +02:00
Karol Wypchło 45ce3de7c2
disable caching v2 skylinks (#827)
* disable caching v2 skylinks

* amend comment

* fix boolean switch
2021-05-31 20:27:56 +02:00
Karol Wypchlo dec29600c1 clean up stats endpoint 2021-05-31 14:44:36 +02:00
Karol Wypchlo 2db2ae60f6 adjust tus request max body size 2021-05-26 18:02:32 +02:00
Karol Wypchlo c10353f6d5 bump tus limit to 100G 2021-05-26 16:23:19 +02:00
Karol Wypchlo ac86dfcdee expose tus upload-metadata header 2021-05-25 17:53:05 +02:00
Marcin S 9346898775
Test deploy 2021-05-20 09:39:46 -04:00
Karol Wypchlo 86225c8082 hardcode accounts ip so nginx doesn't die if accounts are not present 2021-05-13 12:25:48 +02:00
Karol Wypchlo d2694c82d3 hardcode health-check ip in nginx 2021-05-13 12:23:46 +02:00
Karol Wypchlo dbbff224d9 upgrade openresty image 2021-05-13 12:23:03 +02:00
Karol Wypchło bd6763b47c
disable api access from subdomained skapps (#719)
* disable api access from subdomained skapps

* temporary reroute from skynet-mysky to ann1 dev version

* revert dev change

* mistakenly deleted try
2021-05-11 18:32:02 +02:00
Karol Wypchlo dc47164e45 dont block on nginx level 2021-05-11 11:26:19 +02:00
Karol Wypchlo cc23a1eed6 return method not allowed 2021-05-11 11:24:18 +02:00
Karol Wypchlo 39d0bc593b return method not allowed 2021-05-11 11:19:59 +02:00
Karol Wypchlo e95dd0195d Sia-UI 2021-05-11 11:12:44 +02:00
Karol Wypchlo 0209ae7f60 new GET /skynet/metadata endpoint 2021-05-11 11:08:27 +02:00
Karol Wypchlo db2a553252 decrease cache time on /skynet/stats from 10 minutes to 1 minute 2021-05-10 16:11:12 +02:00
Karol Wypchlo 8b5a426a97 cache /accounts internal response for 1 minute 2021-05-04 14:57:46 +02:00
Karol Wypchlo fb2193c3d0 restore sia-auth 2021-04-30 13:59:50 +02:00
Karol Wypchlo 07bd6ef883 user agent 2021-04-30 13:50:46 +02:00
Karol Wypchlo 2c258c65ec support tus.io standard 2021-04-30 13:05:21 +02:00
Karol Wypchlo 3bfdd820dc increase buffer size for apps with large headers to load 2021-04-29 17:51:21 +02:00
Karol Wypchlo 7fab576e6a atomic writes 2021-04-29 16:56:53 +02:00
Karol Wypchlo 16a1bcaef8 move to SkynetLabs 2021-04-12 17:38:50 +02:00
Karol Wypchlo a96b929909 pass all headers to /track endpoint 2021-04-12 13:37:18 +02:00
Marcin S a345737964
Merge branch 'master' into website 2021-04-09 14:47:25 -04:00
Marcin S 3cc22ee4d7
Update docs location 2021-04-09 14:05:39 -04:00
Karol Wypchlo 63efcc4b37 use authenticated status 2021-04-08 14:02:35 +02:00
Karol Wypchlo 3021032464 fix response 2021-04-08 12:57:15 +02:00
Karol Wypchlo c8e87bf2ba fix accounts endpoint 2021-04-08 12:53:19 +02:00
Karol Wypchlo 01e9ea57cc add internal endpoint for user info 2021-04-08 12:36:04 +02:00
Karol Wypchlo e855458d86 Merge remote-tracking branch 'origin/master' into website 2021-04-01 15:22:55 +02:00
Karol Wypchło fede204c6b
Accounts (#554)
* stripe env

* stripe env

* stripe env

* allow post

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* favicon

* foo

* foo

* foo

* foo

* foo

* foo

* title

* fix dashboard timestamp

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* prices

* Revert "prices"

This reverts commit 7071ed4ef4.

* Make sure we don't accidentally commit `kratos.yml`.

* Add Oathkeeper access rules for Stripe.

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* Add `max_breaches` to Kratos's sample config file.

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* cache .next folder

* Use own fork of Kratos's `master` in order to get the fix for the migrations issue.

* Don't retry running Kratos migrations.

* payments

* restart: no

* no

* no

* no

* no

* no

* no

* no

* no

* no

* payments

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* limits

* limits

* nginx depends on accounts and kratos-migrate depends on cockroach.

* upload limit rate

* upload limit rate - 2

* upload limit rate - 3

* upload limit rate - 4

* upload limit rate - 5

* upload limit rate - 6

* upload limit rate - 7

* upload limit rate - 8

* upload limit rate - 9

* forgotten password link

* use header for skylink

* use header for skylink

* use header for skylink

* use header for skylink

* use header for skylink

* use header for skylink

* use header for skylink

* use header for skylink

* copy to clipboard

* fix ratelimit issue

* Allow access to the stripe webhook.

* enable allow_promotion_codes

* Allow POST on webhook.

* Add all env vars accounts need to docker-compose.

* Don't use custom port for accounts.

* print recovery

* recovery sign up link

* refactor cors header response

* refactor cors header response

* do not log unauthorized

* fix registration link

* settings logging

* update node and tailwindcss

* move webapp from volume

* host 0.0.0.0

* refactor dockerfile

* enable accounts

* cache public

* uncache public

* remove cache control

* no-cache

* no cache

* Do not use the person's name for registration.

* add verify route

* add verify route

* add verify route

* Go back to using the stock kratos image.

* add verify route

* fix settings link

* clean up verify flow

* refactor Dockerfile

* Remove first and last name from used traits.

* Remove account verification via email.

* Allow additional properties.

* Cookies and tokens last for 30 days now.

* Rename secure.siasky.net to account.siasky.net.

* redirect secure to account

Co-authored-by: Ivaylo Novakov <inovakov@gmail.com>
Co-authored-by: Ivaylo Novakov <ro-tex@users.noreply.github.com>
2021-04-01 15:15:37 +02:00
Karol Wypchlo d3357e6cbc replace webapp with website 2021-04-01 14:04:20 +02:00
Karol Wypchlo 6eed5227cc allow credentials 2021-03-19 15:18:52 +01:00
Karol Wypchlo 69940ffc27 add skynet-portal-api header 2021-02-18 10:10:04 +01:00
Karol Wypchlo c9672b0f1d do not add cache status on this request 2021-01-28 18:16:42 +01:00
Karol Wypchlo 783cff28e6 fix protocol version issue 2021-01-28 18:12:34 +01:00
Karol Wypchlo 4a3fafa9e5 fix docker/nginx/conf.d/client.conf 2021-01-28 15:47:18 +01:00
Karol Wypchlo 1a691038b7 cache only registry calls from hns endpoint 2021-01-28 15:02:51 +01:00
Karol Wypchlo 1177b7cf94 cache registry endpoint for 30s 2021-01-28 14:25:38 +01:00
Karol Wypchlo 203ff0fd84 ensure skylink_rest is local 2021-01-27 13:39:00 +01:00
Karol Wypchlo 5576c223ce fix hns links redirects 2021-01-27 13:27:41 +01:00
Ivaylo Novakov 903fe96751
Merge pull request #585 from NebulousLabs/expose-skynet-skylink-header
expose skynet skylink header
2021-01-18 14:37:32 +01:00
Karol Wypchło c4a6e71260
reduce directory tree nesting size (#583) 2021-01-18 12:33:17 +01:00
Karol Wypchlo a7cc85acd4 improve nginx cache 2021-01-15 16:11:06 +01:00
Karol Wypchlo fb1b41a52c expose skynet skylink header 2021-01-15 12:34:46 +01:00
Karol Wypchło 7923506052
add hns_domain and remove named variables 2021-01-13 17:49:24 +01:00
Karol Wypchlo 6053cb3eb2 add new nginx metrics to measure performance 2021-01-13 15:13:34 +01:00
Karol Wypchlo 1a9e4f1a4d upgrade openresty image to ubuntu 18 2021-01-08 13:47:30 +01:00
Karol Wypchło 83d2aa396e
allow to include previous skynet stats (#562)
* allow to include previous skynet stats

* explain chunked response
2020-12-10 14:43:59 +01:00
Karol Wypchło cd7696c97d
fix /portals and /stats rewrites (#561) 2020-12-08 12:21:20 +01:00
Ivaylo Novakov e201b8de8f
Merge pull request #370 from NebulousLabs/drop-health-checks-from-access-log
drop health-check endpoint from access.log
2020-12-07 14:13:11 +01:00
Karol Wypchło 92f9ca3efe
improve nginx skylinks cache purging (#553)
* purge test

* purge test

* purge test

* purge test

* purge test

* purge test

* purge test

* purge test
2020-12-03 12:59:50 +01:00
Karol Wypchlo ca22cb2c45 limit registry access in nginx 2020-12-01 10:59:45 +01:00
Karol Wypchlo a03c41130a use instead of 2020-11-26 16:10:54 +01:00
Karol Wypchlo 701eccbb2d fix downloading skylink 2020-11-26 15:49:54 +01:00
Karol Wypchło a0aba97298
add server override includes and redirect legacy endpoints (#541)
* add server override includes

* adjusting directory name
2020-11-26 11:44:55 +01:00
Peter-Jan Brone 3eaef976cf
Revert wildcard include (#540)
* Revert wildcard include

* Revert gitignore
2020-11-25 17:26:44 +01:00
Christopher Schinnerl 991d2a076e
Merge pull request #529 from NebulousLabs/pj/rate-limit-ips
Ratelimit
2020-11-25 15:42:06 +01:00
PJ 0a028dbc1a
Move ratelimited 2020-11-25 15:30:29 +01:00
PJ 0040aa5be1
rename zones 2020-11-25 15:15:23 +01:00
Peter-Jan Brone acf7fabe47
Add Skynet-Skylink response header (#526) 2020-11-25 13:26:33 +01:00
PJ 5a9b630f79
Fix typo 2020-11-19 18:27:08 +01:00
PJ 7daebd6d04
Add ratelimit mechanism on upload 2020-11-19 17:08:28 +01:00
Karol Wypchlo 05e34b5aaa rename blacklist to blocklist 2020-11-13 17:29:40 +01:00
Karol Wypchlo c946014e7c fix skylink not accessible 2020-11-04 17:28:45 +01:00
Karol Wypchlo 48b1f0d067 tighten if-else and add empty skylink protection 2020-11-04 12:04:24 +01:00
Karol Wypchło 9b09f9ba5c
Update docker/nginx/conf.d/client.conf comment copy 2020-11-04 11:54:38 +01:00
Karol Wypchlo 04ff998beb support skydb in hns 2020-11-03 16:26:33 +01:00
Karol Wypchlo 4dc3588f81 support skydb in hns 2020-11-03 16:24:56 +01:00
Karol Wypchlo 11186f3fd6 support skydb in hns 2020-11-03 16:18:23 +01:00
Karol Wypchlo 86497337ec fix nginx conf 2020-10-27 13:36:31 +01:00
Karol Wypchlo 153bed829b extend registry proxy timeout to 10 minutes 2020-10-26 12:35:31 +01:00
Karol Wypchlo 831defeca3 add /docs proxy 2020-10-16 14:59:36 +02:00
Karol Wypchło bd724ede60
add registry endpoint (#473) 2020-10-15 12:15:10 +02:00
PJ 1051a73bdf
Oops 2020-10-09 16:41:47 +02:00
PJ efb76c43a2
Add portal domain to log format 2020-10-09 16:35:34 +02:00
Karol Wypchło 468527c22d
add portal_subdomain to nginx regex and fill documentation (#435) 2020-09-29 12:35:34 +02:00