Commit Graph

256 Commits

Author SHA1 Message Date
Karol Wypchlo 4c3aa72424 use in context of location 2021-06-16 16:50:05 +02:00
Karol Wypchlo db1a50a999 use set_by_lua instead 2021-06-16 16:50:05 +02:00
Karol Wypchlo e463199022 use perl_set to expose env variables 2021-06-16 16:50:05 +02:00
Karol Wypchlo cb85ed355a use skynet server api env variable to rewrite proxy response on /tus endpoint 2021-06-16 16:50:05 +02:00
Karol Wypchlo bfc4a6bc14 support accounts on tus uploads 2021-06-09 14:57:10 +02:00
Karol Wypchlo d8e95d4d82 add skynet-skylink header to tus final response 2021-06-09 12:06:15 +02:00
Karol Wypchlo 909cb4916e do not resolve if not http 200 2021-06-04 17:04:44 +02:00
Karol Wypchlo 439f4309a4 move registry tracking to separate file 2021-06-04 13:23:07 +02:00
Karol Wypchlo 3cc3685273 Merge remote-tracking branch 'origin/master' into pin-endpoint 2021-06-04 13:21:47 +02:00
Ivaylo Novakov 3ac8cf2fe9
Merge pull request #826 from SkynetLabs/clean-up-stats-endpoint
Clean up stats endpoint
2021-06-04 12:53:56 +02:00
Karol Wypchlo aa34c1f088 add new lines on eof 2021-06-04 12:35:16 +02:00
Karol Wypchlo ed7c1f71c7 add /skynet/pin endpoint and clean up config 2021-06-04 12:33:37 +02:00
Christopher Schinnerl b35ea89ff6
Merge pull request #829 from SkynetLabs/v2-skylinks-cache
V2 skylinks cache
2021-06-04 12:29:43 +02:00
PJ bd8593039d
Do not increase proxy_connect_timeout 2021-06-04 11:58:38 +02:00
PJ 898a728f5a
Increase request timeout 2021-06-04 11:43:52 +02:00
Karol Wypchlo c84723b159 add sia-auth 2021-06-02 18:15:04 +02:00
Karol Wypchlo 2b9d469f1e fix dir variable name 2021-06-02 18:03:35 +02:00
Karol Wypchlo ece2025561 /skynet/pin endpoint 2021-06-02 17:56:35 +02:00
Karol Wypchlo 3589e2ac04 remove cache key 2021-06-01 12:57:50 +02:00
Karol Wypchlo 20b8a99f14 fix redirect 2021-06-01 12:56:11 +02:00
Karol Wypchlo f59d00e172 log cache key 2021-06-01 12:46:47 +02:00
Karol Wypchlo 9c4f9c8300 log cache key 2021-06-01 12:36:08 +02:00
Karol Wypchlo c9081e9d87 log cache key 2021-06-01 12:33:13 +02:00
Karol Wypchlo 176e5c7a9d fixed caching 2021-06-01 12:29:33 +02:00
Karol Wypchlo a2a4b6ea8f fixed != to ~= 2021-06-01 12:20:25 +02:00
Karol Wypchlo 60cb812148 support v2 caching 2021-06-01 12:17:08 +02:00
Karol Wypchło 45ce3de7c2
disable caching v2 skylinks (#827)
* disable caching v2 skylinks

* amend comment

* fix boolean switch
2021-05-31 20:27:56 +02:00
Karol Wypchlo dec29600c1 clean up stats endpoint 2021-05-31 14:44:36 +02:00
Karol Wypchlo 2db2ae60f6 adjust tus request max body size 2021-05-26 18:02:32 +02:00
Karol Wypchlo c10353f6d5 bump tus limit to 100G 2021-05-26 16:23:19 +02:00
Karol Wypchlo ac86dfcdee expose tus upload-metadata header 2021-05-25 17:53:05 +02:00
Marcin S 9346898775
Test deploy 2021-05-20 09:39:46 -04:00
Karol Wypchlo 86225c8082 hardcode accounts ip so nginx doesn't die if accounts are not present 2021-05-13 12:25:48 +02:00
Karol Wypchlo d2694c82d3 hardcode health-check ip in nginx 2021-05-13 12:23:46 +02:00
Karol Wypchlo dbbff224d9 upgrade openresty image 2021-05-13 12:23:03 +02:00
Karol Wypchło bd6763b47c
disable api access from subdomained skapps (#719)
* disable api access from subdomained skapps

* temporary reroute from skynet-mysky to ann1 dev version

* revert dev change

* mistakenly deleted try
2021-05-11 18:32:02 +02:00
Karol Wypchlo dc47164e45 dont block on nginx level 2021-05-11 11:26:19 +02:00
Karol Wypchlo cc23a1eed6 return method not allowed 2021-05-11 11:24:18 +02:00
Karol Wypchlo 39d0bc593b return method not allowed 2021-05-11 11:19:59 +02:00
Karol Wypchlo e95dd0195d Sia-UI 2021-05-11 11:12:44 +02:00
Karol Wypchlo 0209ae7f60 new GET /skynet/metadata endpoint 2021-05-11 11:08:27 +02:00
Karol Wypchlo db2a553252 decrease cache time on /skynet/stats from 10 minutes to 1 minute 2021-05-10 16:11:12 +02:00
Karol Wypchlo 8b5a426a97 cache /accounts internal response for 1 minute 2021-05-04 14:57:46 +02:00
Karol Wypchlo fb2193c3d0 restore sia-auth 2021-04-30 13:59:50 +02:00
Karol Wypchlo 07bd6ef883 user agent 2021-04-30 13:50:46 +02:00
Karol Wypchlo 2c258c65ec support tus.io standard 2021-04-30 13:05:21 +02:00
Karol Wypchlo 3bfdd820dc increase buffer size for apps with large headers to load 2021-04-29 17:51:21 +02:00
Karol Wypchlo 7fab576e6a atomic writes 2021-04-29 16:56:53 +02:00
Karol Wypchlo 16a1bcaef8 move to SkynetLabs 2021-04-12 17:38:50 +02:00
Karol Wypchlo a96b929909 pass all headers to /track endpoint 2021-04-12 13:37:18 +02:00
Marcin S a345737964
Merge branch 'master' into website 2021-04-09 14:47:25 -04:00
Marcin S 3cc22ee4d7
Update docs location 2021-04-09 14:05:39 -04:00
Karol Wypchlo 63efcc4b37 use authenticated status 2021-04-08 14:02:35 +02:00
Karol Wypchlo 3021032464 fix response 2021-04-08 12:57:15 +02:00
Karol Wypchlo c8e87bf2ba fix accounts endpoint 2021-04-08 12:53:19 +02:00
Karol Wypchlo 01e9ea57cc add internal endpoint for user info 2021-04-08 12:36:04 +02:00
Karol Wypchlo e855458d86 Merge remote-tracking branch 'origin/master' into website 2021-04-01 15:22:55 +02:00
Karol Wypchło fede204c6b
Accounts (#554)
* stripe env

* stripe env

* stripe env

* allow post

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* favicon

* foo

* foo

* foo

* foo

* foo

* foo

* title

* fix dashboard timestamp

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* prices

* Revert "prices"

This reverts commit 7071ed4ef4.

* Make sure we don't accidentally commit `kratos.yml`.

* Add Oathkeeper access rules for Stripe.

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* Add `max_breaches` to Kratos's sample config file.

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* cache .next folder

* Use own fork of Kratos's `master` in order to get the fix for the migrations issue.

* Don't retry running Kratos migrations.

* payments

* restart: no

* no

* no

* no

* no

* no

* no

* no

* no

* no

* payments

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* limits

* limits

* nginx depends on accounts and kratos-migrate depends on cockroach.

* upload limit rate

* upload limit rate - 2

* upload limit rate - 3

* upload limit rate - 4

* upload limit rate - 5

* upload limit rate - 6

* upload limit rate - 7

* upload limit rate - 8

* upload limit rate - 9

* forgotten password link

* use header for skylink

* use header for skylink

* use header for skylink

* use header for skylink

* use header for skylink

* use header for skylink

* use header for skylink

* use header for skylink

* copy to clipboard

* fix ratelimit issue

* Allow access to the stripe webhook.

* enable allow_promotion_codes

* Allow POST on webhook.

* Add all env vars accounts need to docker-compose.

* Don't use custom port for accounts.

* print recovery

* recovery sign up link

* refactor cors header response

* refactor cors header response

* do not log unauthorized

* fix registration link

* settings logging

* update node and tailwindcss

* move webapp from volume

* host 0.0.0.0

* refactor dockerfile

* enable accounts

* cache public

* uncache public

* remove cache control

* no-cache

* no cache

* Do not use the person's name for registration.

* add verify route

* add verify route

* add verify route

* Go back to using the stock kratos image.

* add verify route

* fix settings link

* clean up verify flow

* refactor Dockerfile

* Remove first and last name from used traits.

* Remove account verification via email.

* Allow additional properties.

* Cookies and tokens last for 30 days now.

* Rename secure.siasky.net to account.siasky.net.

* redirect secure to account

Co-authored-by: Ivaylo Novakov <inovakov@gmail.com>
Co-authored-by: Ivaylo Novakov <ro-tex@users.noreply.github.com>
2021-04-01 15:15:37 +02:00
Karol Wypchlo d3357e6cbc replace webapp with website 2021-04-01 14:04:20 +02:00
Karol Wypchlo 6eed5227cc allow credentials 2021-03-19 15:18:52 +01:00
Karol Wypchlo 69940ffc27 add skynet-portal-api header 2021-02-18 10:10:04 +01:00
Karol Wypchlo c9672b0f1d do not add cache status on this request 2021-01-28 18:16:42 +01:00
Karol Wypchlo 783cff28e6 fix protocol version issue 2021-01-28 18:12:34 +01:00
Karol Wypchlo 4a3fafa9e5 fix docker/nginx/conf.d/client.conf 2021-01-28 15:47:18 +01:00
Karol Wypchlo 1a691038b7 cache only registry calls from hns endpoint 2021-01-28 15:02:51 +01:00
Karol Wypchlo 1177b7cf94 cache registry endpoint for 30s 2021-01-28 14:25:38 +01:00
Karol Wypchlo 203ff0fd84 ensure skylink_rest is local 2021-01-27 13:39:00 +01:00
Karol Wypchlo 5576c223ce fix hns links redirects 2021-01-27 13:27:41 +01:00
Ivaylo Novakov 903fe96751
Merge pull request #585 from NebulousLabs/expose-skynet-skylink-header
expose skynet skylink header
2021-01-18 14:37:32 +01:00
Karol Wypchło c4a6e71260
reduce directory tree nesting size (#583) 2021-01-18 12:33:17 +01:00
Karol Wypchlo a7cc85acd4 improve nginx cache 2021-01-15 16:11:06 +01:00
Karol Wypchlo fb1b41a52c expose skynet skylink header 2021-01-15 12:34:46 +01:00
Karol Wypchło 7923506052
add hns_domain and remove named variables 2021-01-13 17:49:24 +01:00
Karol Wypchlo 6053cb3eb2 add new nginx metrics to measure performance 2021-01-13 15:13:34 +01:00
Karol Wypchlo 1a9e4f1a4d upgrade openresty image to ubuntu 18 2021-01-08 13:47:30 +01:00
Karol Wypchło 83d2aa396e
allow to include previous skynet stats (#562)
* allow to include previous skynet stats

* explain chunked response
2020-12-10 14:43:59 +01:00
Karol Wypchło cd7696c97d
fix /portals and /stats rewrites (#561) 2020-12-08 12:21:20 +01:00
Ivaylo Novakov e201b8de8f
Merge pull request #370 from NebulousLabs/drop-health-checks-from-access-log
drop health-check endpoint from access.log
2020-12-07 14:13:11 +01:00
Karol Wypchło 92f9ca3efe
improve nginx skylinks cache purging (#553)
* purge test

* purge test

* purge test

* purge test

* purge test

* purge test

* purge test

* purge test
2020-12-03 12:59:50 +01:00
Karol Wypchlo ca22cb2c45 limit registry access in nginx 2020-12-01 10:59:45 +01:00
Karol Wypchlo a03c41130a use instead of 2020-11-26 16:10:54 +01:00
Karol Wypchlo 701eccbb2d fix downloading skylink 2020-11-26 15:49:54 +01:00
Karol Wypchło a0aba97298
add server override includes and redirect legacy endpoints (#541)
* add server override includes

* adjusting directory name
2020-11-26 11:44:55 +01:00
Peter-Jan Brone 3eaef976cf
Revert wildcard include (#540)
* Revert wildcard include

* Revert gitignore
2020-11-25 17:26:44 +01:00
Christopher Schinnerl 991d2a076e
Merge pull request #529 from NebulousLabs/pj/rate-limit-ips
Ratelimit
2020-11-25 15:42:06 +01:00
PJ 0a028dbc1a
Move ratelimited 2020-11-25 15:30:29 +01:00
PJ 0040aa5be1
rename zones 2020-11-25 15:15:23 +01:00
Peter-Jan Brone acf7fabe47
Add Skynet-Skylink response header (#526) 2020-11-25 13:26:33 +01:00
PJ 5a9b630f79
Fix typo 2020-11-19 18:27:08 +01:00
PJ 7daebd6d04
Add ratelimit mechanism on upload 2020-11-19 17:08:28 +01:00
Karol Wypchlo 05e34b5aaa rename blacklist to blocklist 2020-11-13 17:29:40 +01:00
Karol Wypchlo c946014e7c fix skylink not accessible 2020-11-04 17:28:45 +01:00
Karol Wypchlo 48b1f0d067 tighten if-else and add empty skylink protection 2020-11-04 12:04:24 +01:00
Karol Wypchło 9b09f9ba5c
Update docker/nginx/conf.d/client.conf comment copy 2020-11-04 11:54:38 +01:00
Karol Wypchlo 04ff998beb support skydb in hns 2020-11-03 16:26:33 +01:00
Karol Wypchlo 4dc3588f81 support skydb in hns 2020-11-03 16:24:56 +01:00
Karol Wypchlo 11186f3fd6 support skydb in hns 2020-11-03 16:18:23 +01:00
Karol Wypchlo 86497337ec fix nginx conf 2020-10-27 13:36:31 +01:00
Karol Wypchlo 153bed829b extend registry proxy timeout to 10 minutes 2020-10-26 12:35:31 +01:00
Karol Wypchlo 831defeca3 add /docs proxy 2020-10-16 14:59:36 +02:00
Karol Wypchło bd724ede60
add registry endpoint (#473) 2020-10-15 12:15:10 +02:00
PJ 1051a73bdf
Oops 2020-10-09 16:41:47 +02:00
PJ efb76c43a2
Add portal domain to log format 2020-10-09 16:35:34 +02:00
Karol Wypchło 468527c22d
add portal_subdomain to nginx regex and fill documentation (#435) 2020-09-29 12:35:34 +02:00
Karol Wypchło 3469943a0b
Support hns subdomains (#420)
* support hns subdomains

* document feature
2020-09-24 16:33:07 +02:00
Karol Wypchło 279e051207
improve nginx config (#418)
* improve nginx config

* add support for base32 skylink
2020-09-23 15:51:37 +02:00
Karol Wypchło 22b9c368db
drop legacy upload node support (#417) 2020-09-22 11:49:57 +02:00
Karol Wypchło 98cd70faea
Fix broken hns redirect (#415) 2020-09-21 18:29:47 +02:00
Karol Wypchlo 8b88331065 drop 404 not found on hnsres error 2020-09-16 17:07:05 +02:00
Karol Wypchlo 936d4ecd0c add more comments 2020-09-16 14:37:14 +02:00
Karol Wypchlo 54cda20b32 adjust hns endpoint 2020-09-16 14:28:47 +02:00
Karol Wypchlo b7578c00c9 Merge remote-tracking branch 'origin/master' into handshake-proxy-improvements 2020-09-16 10:58:08 +02:00
PJ ff02482ee6
Fix newline 2020-09-16 10:48:52 +02:00
PJ 7e5cacabca
Include subdomain in the cachekey 2020-09-16 10:23:49 +02:00
Karol Wypchlo 06d0466a1c decrease cache time 2020-09-15 17:27:44 +02:00
Karol Wypchlo c050948d23 improve caching 2020-09-15 17:22:49 +02:00
Karol Wypchlo c155fcfa55 move handshake proxy to nginx 2020-09-15 17:13:10 +02:00
PJ 41514c3660
Fix servername regex 2020-09-11 11:21:39 +02:00
Peter-Jan Brone 96aff33135
Wildcard Subdomains (#329)
* Add server rule and loation block to handle the base32 encoded skylink through the wildcard subdomain

* Instead of redirecting, proxy pass

* Add trailing slash

* Fix regex to handle server names

* Update docker/nginx/conf.d/client.conf

Co-authored-by: Karol Wypchło <kwypchlo@gmail.com>

* Implement PR remarks

* Implement PR remarks

Co-authored-by: Karol Wypchło <kwypchlo@gmail.com>
2020-09-10 17:14:43 +02:00
Karol Wypchło c2138f1d15
always use request_id path (#390) 2020-09-10 16:29:19 +02:00
Karol Wypchło 0593b41201
Nginx Log Format (#356)
* add filebeat

* nginx.conf access.log

* nginx.conf access.log

* fix filebeat

* add upstream data to access log

* Update nginx.conf

* Add content type header to access_log format

* Add quotes

* logs with wildcard to include gzipped ones

* Remove filebeat config

Co-authored-by: PJ <peterjan.brone@gmail.com>
2020-09-09 10:17:12 +02:00
Karol Wypchlo 44c38faa0b drop health-check endpoint from access.log 2020-09-04 13:00:27 +02:00
Christopher Schinnerl 93341a3d4d
fix byte range caching (#362) 2020-09-01 15:26:48 +02:00
Karol Wypchło 05b8b32a2a
Fix cors issues (#345)
* enable cord

* enable cors

* enable cors

* enable cors

* enable cors

* enable cors

* enable cors

* enable cors

* enable cors

* enable cors

* enable cors

* enable cors

* enable cors

* enable cors
2020-08-18 14:42:17 +02:00
Karol Wypchlo 0a5f51d988 fix merge conflicts resolution errors 2020-08-18 11:11:10 +02:00
Karol Wypchlo 8a21dc8ce1 Merge remote-tracking branch 'origin/master' into docker 2020-08-18 10:55:09 +02:00
Karol Wypchło 69abeee707
Update proxy-buffer 2020-08-17 09:50:37 +02:00
Karol Wypchlo 06f0946317 fix hns header overflow and redirects 2020-07-31 15:27:08 +02:00
Karol Wypchlo 75caa84992 fix hns redirects 2020-07-31 15:22:04 +02:00
Karol Wypchlo cc48c09845 fix hns redirects 2020-07-31 15:20:05 +02:00
Karol Wypchlo 3ac40b5b22 adjust cache time 2020-07-31 00:50:42 +02:00
Karol Wypchlo 87e6e8c7a9 add Cache-Control to skynet links 2020-07-31 00:50:42 +02:00
Karol Wypchlo e30fa02142 set user root for nginx 2020-07-31 00:50:42 +02:00
Karol Wypchlo 30dbb8ced5 migrate to yarn workspaces 2020-07-31 00:50:42 +02:00
Karol Wypchlo 17d4a1ad53 sia-upload-legacy container 2020-07-31 00:50:42 +02:00
Karol Wypchlo 259e3ddffa docker setup
docker progress

docker works

env variables
2020-07-31 00:50:42 +02:00
Karol Wypchlo d571288b8e upgrade node images to 14.6.0 2020-07-30 11:52:45 +02:00
Karol Wypchlo 7ff0c9d09a add cache bypass option 2020-07-29 12:05:26 +02:00
Karol Wypchlo 4c7ad44f08 extend timeout on stats endpoints 2020-07-29 11:06:53 +02:00
Karol Wypchlo 12a0859235 restore siad-upload for /statsdown 2020-07-28 13:56:25 +02:00
Karol Wypchlo 955425d321 clean up double siad setup 2020-07-28 13:22:07 +02:00
Karol Wypchlo 0f035fdaf7 use same node image 2020-07-28 12:30:25 +02:00
Karol Wypchlo 919edb439c auth uploads 2020-07-28 11:19:03 +02:00
Karol Wypchlo 5890b5e8ef fix cors 2020-07-27 17:48:45 +02:00
Karol Wypchlo dd53f31171 skynet endpoints 2020-07-27 17:37:17 +02:00
Karol Wypchlo 2a64b33cc9 ?skynet stats 2020-07-27 17:34:30 +02:00
Karol Wypchlo 3b75226e0b apipassword 2020-07-27 17:30:05 +02:00
Karol Wypchlo 18ae436087 new line 2020-07-27 17:18:09 +02:00
Karol Wypchlo 7090edc5e7 cors 2020-07-27 17:16:17 +02:00
Karol Wypchlo 1dbc842c55 cors 2020-07-27 17:04:21 +02:00