Commit Graph

513 Commits

Author SHA1 Message Date
Karol Wypchlo db2a553252 decrease cache time on /skynet/stats from 10 minutes to 1 minute 2021-05-10 16:11:12 +02:00
Karol Wypchło 0c0be50e89
accounts health checks and testing improvements (#717)
* add account health check

* circular dep resolution

* error cannot be undefined
2021-05-05 14:18:10 +02:00
Karol Wypchlo 8b5a426a97 cache /accounts internal response for 1 minute 2021-05-04 14:57:46 +02:00
Karol Wypchlo fb2193c3d0 restore sia-auth 2021-04-30 13:59:50 +02:00
Karol Wypchlo 07bd6ef883 user agent 2021-04-30 13:50:46 +02:00
Karol Wypchlo 2c258c65ec support tus.io standard 2021-04-30 13:05:21 +02:00
Ivaylo Novakov 58c1fa94bf
Merge pull request #701 from SkynetLabs/upgrade-node-docker-image
upgrade node docker image to 16.0.0
2021-04-29 18:27:18 +02:00
Karol Wypchlo 23646e9969 upgrade node docker image to 16.0.0 2021-04-29 17:57:32 +02:00
Karol Wypchlo 3bfdd820dc increase buffer size for apps with large headers to load 2021-04-29 17:51:21 +02:00
Karol Wypchlo 7fab576e6a atomic writes 2021-04-29 16:56:53 +02:00
Karol Wypchlo c9f871e5b4 fix api routes 2021-04-22 14:14:30 +02:00
Karol Wypchlo 941641ae7a fix account redirects to static next assets 2021-04-22 14:06:31 +02:00
Ivaylo Novakov d7ee2e5782
Support Sia versions before 1.5.6. 2021-04-20 14:07:43 +02:00
Karol Wypchlo dd905fb302 missing an 2021-04-20 12:35:56 +02:00
Karol Wypchlo b41d9b540f fix typo 2021-04-20 12:34:35 +02:00
Karol Wypchło 06fe6fa89e
Update docker/caddy/Caddyfile
Co-authored-by: Peter-Jan Brone <peter-jan@settlemint.com>
2021-04-20 11:46:33 +02:00
Karol Wypchlo 2f5c27d78e use SSL_CERTIFICATE_STRING 2021-04-20 11:42:00 +02:00
Karol Wypchlo cd4a062e90 fix ssl certificate generation 2021-04-20 11:27:17 +02:00
Karol Wypchlo 143ef617fe set defaults for caddyfile 2021-04-20 11:09:01 +02:00
Karol Wypchlo 1034e7b572 Merge remote-tracking branch 'origin/master' into website 2021-04-15 11:04:22 +02:00
Ivaylo Novakov 96c5b5df73
Configure accounts' branch from docker-compose.accounts.yml. 2021-04-14 12:43:57 +02:00
Karol Wypchlo 16a1bcaef8 move to SkynetLabs 2021-04-12 17:38:50 +02:00
Karol Wypchlo a96b929909 pass all headers to /track endpoint 2021-04-12 13:37:18 +02:00
Marcin S a345737964
Merge branch 'master' into website 2021-04-09 14:47:25 -04:00
Marcin S 3cc22ee4d7
Update docs location 2021-04-09 14:05:39 -04:00
Karol Wypchlo 63efcc4b37 use authenticated status 2021-04-08 14:02:35 +02:00
Karol Wypchlo 3021032464 fix response 2021-04-08 12:57:15 +02:00
Karol Wypchlo c8e87bf2ba fix accounts endpoint 2021-04-08 12:53:19 +02:00
Karol Wypchlo 01e9ea57cc add internal endpoint for user info 2021-04-08 12:36:04 +02:00
Karol Wypchlo 987fa62c67 upgrade node to 15.14.0 2021-04-08 11:12:23 +02:00
Ivaylo Novakov d268a99e60
When rebuilding `sia` use the `portal-latest` branch and the `latest` container by default. 2021-04-07 11:55:43 +02:00
Karol Wypchlo 91263e05dc update gitlab link 2021-04-02 16:46:23 +02:00
Karol Wypchlo e855458d86 Merge remote-tracking branch 'origin/master' into website 2021-04-01 15:22:55 +02:00
Karol Wypchło fede204c6b
Accounts (#554)
* stripe env

* stripe env

* stripe env

* allow post

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* favicon

* foo

* foo

* foo

* foo

* foo

* foo

* title

* fix dashboard timestamp

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* prices

* Revert "prices"

This reverts commit 7071ed4ef4.

* Make sure we don't accidentally commit `kratos.yml`.

* Add Oathkeeper access rules for Stripe.

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* Add `max_breaches` to Kratos's sample config file.

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* cache .next folder

* Use own fork of Kratos's `master` in order to get the fix for the migrations issue.

* Don't retry running Kratos migrations.

* payments

* restart: no

* no

* no

* no

* no

* no

* no

* no

* no

* no

* payments

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* limits

* limits

* nginx depends on accounts and kratos-migrate depends on cockroach.

* upload limit rate

* upload limit rate - 2

* upload limit rate - 3

* upload limit rate - 4

* upload limit rate - 5

* upload limit rate - 6

* upload limit rate - 7

* upload limit rate - 8

* upload limit rate - 9

* forgotten password link

* use header for skylink

* use header for skylink

* use header for skylink

* use header for skylink

* use header for skylink

* use header for skylink

* use header for skylink

* use header for skylink

* copy to clipboard

* fix ratelimit issue

* Allow access to the stripe webhook.

* enable allow_promotion_codes

* Allow POST on webhook.

* Add all env vars accounts need to docker-compose.

* Don't use custom port for accounts.

* print recovery

* recovery sign up link

* refactor cors header response

* refactor cors header response

* do not log unauthorized

* fix registration link

* settings logging

* update node and tailwindcss

* move webapp from volume

* host 0.0.0.0

* refactor dockerfile

* enable accounts

* cache public

* uncache public

* remove cache control

* no-cache

* no cache

* Do not use the person's name for registration.

* add verify route

* add verify route

* add verify route

* Go back to using the stock kratos image.

* add verify route

* fix settings link

* clean up verify flow

* refactor Dockerfile

* Remove first and last name from used traits.

* Remove account verification via email.

* Allow additional properties.

* Cookies and tokens last for 30 days now.

* Rename secure.siasky.net to account.siasky.net.

* redirect secure to account

Co-authored-by: Ivaylo Novakov <inovakov@gmail.com>
Co-authored-by: Ivaylo Novakov <ro-tex@users.noreply.github.com>
2021-04-01 15:15:37 +02:00
Karol Wypchlo d3357e6cbc replace webapp with website 2021-04-01 14:04:20 +02:00
Karol Wypchlo 7ec5e5106f update to 1.5.5 2021-03-22 12:31:17 +01:00
Christopher Schinnerl 387ab92270
Merge pull request #644 from NebulousLabs/ivo/fix_skyd_binary_names
Adjust the binary names.
2021-03-19 16:30:09 +01:00
Karol Wypchlo 6eed5227cc allow credentials 2021-03-19 15:18:52 +01:00
Ivaylo Novakov 9e9c13767f
Adjust the binary names. 2021-03-18 17:54:41 +01:00
Karol Wypchło 33d169c4ed
Update Dockerfile (#642) 2021-03-18 17:03:50 +01:00
PJ 18cca5c256
Target new skyd repo 2021-03-18 16:36:29 +01:00
Karol Wypchlo 69940ffc27 add skynet-portal-api header 2021-02-18 10:10:04 +01:00
Karol Wypchlo e91d0cb78c upgrade to node 15.8.0 2021-02-09 11:28:15 +01:00
Karol Wypchlo c9672b0f1d do not add cache status on this request 2021-01-28 18:16:42 +01:00
Karol Wypchlo 783cff28e6 fix protocol version issue 2021-01-28 18:12:34 +01:00
Karol Wypchlo 4a3fafa9e5 fix docker/nginx/conf.d/client.conf 2021-01-28 15:47:18 +01:00
Karol Wypchlo 1a691038b7 cache only registry calls from hns endpoint 2021-01-28 15:02:51 +01:00
Karol Wypchlo 1177b7cf94 cache registry endpoint for 30s 2021-01-28 14:25:38 +01:00
Karol Wypchlo 203ff0fd84 ensure skylink_rest is local 2021-01-27 13:39:00 +01:00
Karol Wypchlo 5576c223ce fix hns links redirects 2021-01-27 13:27:41 +01:00
Karol Wypchło dab6f10a41
Merge pull request #580 from NebulousLabs/caddy-2.3.0
upgrade caddy to 2.3.0
2021-01-23 15:11:33 +01:00
Ivaylo Novakov 903fe96751
Merge pull request #585 from NebulousLabs/expose-skynet-skylink-header
expose skynet skylink header
2021-01-18 14:37:32 +01:00
Karol Wypchło c4a6e71260
reduce directory tree nesting size (#583) 2021-01-18 12:33:17 +01:00
Karol Wypchlo a7cc85acd4 improve nginx cache 2021-01-15 16:11:06 +01:00
Karol Wypchlo fb1b41a52c expose skynet skylink header 2021-01-15 12:34:46 +01:00
Karol Wypchło 7923506052
add hns_domain and remove named variables 2021-01-13 17:49:24 +01:00
Karol Wypchlo 6053cb3eb2 add new nginx metrics to measure performance 2021-01-13 15:13:34 +01:00
Karol Wypchło 83a2170afc
upgrade sia to 1.5.4 (#582)
* upgrade sia to 1.5.4

* bump builder image
2021-01-13 12:42:49 +01:00
Karol Wypchlo 1a9e4f1a4d upgrade openresty image to ubuntu 18 2021-01-08 13:47:30 +01:00
Karol Wypchlo 6a35c8e58e upgrade caddy to 2.3.0 2021-01-08 13:13:10 +01:00
Karol Wypchło 83d2aa396e
allow to include previous skynet stats (#562)
* allow to include previous skynet stats

* explain chunked response
2020-12-10 14:43:59 +01:00
Karol Wypchło cd7696c97d
fix /portals and /stats rewrites (#561) 2020-12-08 12:21:20 +01:00
Ivaylo Novakov e201b8de8f
Merge pull request #370 from NebulousLabs/drop-health-checks-from-access-log
drop health-check endpoint from access.log
2020-12-07 14:13:11 +01:00
Karol Wypchło 92f9ca3efe
improve nginx skylinks cache purging (#553)
* purge test

* purge test

* purge test

* purge test

* purge test

* purge test

* purge test

* purge test
2020-12-03 12:59:50 +01:00
Karol Wypchlo ca22cb2c45 limit registry access in nginx 2020-12-01 10:59:45 +01:00
Karol Wypchlo a03c41130a use instead of 2020-11-26 16:10:54 +01:00
Karol Wypchlo 701eccbb2d fix downloading skylink 2020-11-26 15:49:54 +01:00
Karol Wypchło a0aba97298
add server override includes and redirect legacy endpoints (#541)
* add server override includes

* adjusting directory name
2020-11-26 11:44:55 +01:00
Peter-Jan Brone 3eaef976cf
Revert wildcard include (#540)
* Revert wildcard include

* Revert gitignore
2020-11-25 17:26:44 +01:00
Christopher Schinnerl 991d2a076e
Merge pull request #529 from NebulousLabs/pj/rate-limit-ips
Ratelimit
2020-11-25 15:42:06 +01:00
PJ 0a028dbc1a
Move ratelimited 2020-11-25 15:30:29 +01:00
PJ 0040aa5be1
rename zones 2020-11-25 15:15:23 +01:00
Peter-Jan Brone acf7fabe47
Add Skynet-Skylink response header (#526) 2020-11-25 13:26:33 +01:00
PJ 5a9b630f79
Fix typo 2020-11-19 18:27:08 +01:00
PJ 7daebd6d04
Add ratelimit mechanism on upload 2020-11-19 17:08:28 +01:00
Karol Wypchlo 5e735c519b update sia image to use as builder 2020-11-18 17:10:04 +01:00
Karol Wypchlo 05e34b5aaa rename blacklist to blocklist 2020-11-13 17:29:40 +01:00
Karol Wypchlo c946014e7c fix skylink not accessible 2020-11-04 17:28:45 +01:00
Karol Wypchlo 48b1f0d067 tighten if-else and add empty skylink protection 2020-11-04 12:04:24 +01:00
Karol Wypchło 9b09f9ba5c
Update docker/nginx/conf.d/client.conf comment copy 2020-11-04 11:54:38 +01:00
Karol Wypchlo 04ff998beb support skydb in hns 2020-11-03 16:26:33 +01:00
Karol Wypchlo 4dc3588f81 support skydb in hns 2020-11-03 16:24:56 +01:00
Karol Wypchlo 11186f3fd6 support skydb in hns 2020-11-03 16:18:23 +01:00
Karol Wypchlo 61d7df781f update node to 14.15.0 2020-10-30 10:25:37 +01:00
Karol Wypchlo 86497337ec fix nginx conf 2020-10-27 13:36:31 +01:00
Karol Wypchlo 153bed829b extend registry proxy timeout to 10 minutes 2020-10-26 12:35:31 +01:00
Karol Wypchlo f9722f2974 use 1.5.0.4 with fixed logrotate 2020-10-16 17:01:13 +02:00
Karol Wypchlo 831defeca3 add /docs proxy 2020-10-16 14:59:36 +02:00
Karol Wypchło bd724ede60
add registry endpoint (#473) 2020-10-15 12:15:10 +02:00
Karol Wypchlo b06ebaea72 fix handshake node build 2020-10-13 15:13:07 +02:00
Karol Wypchlo 2e74aea8dd update node docker image 2020-10-13 14:33:47 +02:00
PJ 1051a73bdf
Oops 2020-10-09 16:41:47 +02:00
PJ efb76c43a2
Add portal domain to log format 2020-10-09 16:35:34 +02:00
Karol Wypchlo 83ec608dfb update node docker to 14.11.0 2020-09-29 12:48:45 +02:00
Karol Wypchło 468527c22d
add portal_subdomain to nginx regex and fill documentation (#435) 2020-09-29 12:35:34 +02:00
Karol Wypchlo 970cf8caf7 set max retries to something big 2020-09-28 10:57:47 +02:00
Karol Wypchlo 25ebea697d adjust max retries 2020-09-28 10:50:11 +02:00
Karol Wypchlo f2c9c774d2 update caddy 2020-09-28 10:24:14 +02:00
Karol Wypchło 3469943a0b
Support hns subdomains (#420)
* support hns subdomains

* document feature
2020-09-24 16:33:07 +02:00
Karol Wypchło 279e051207
improve nginx config (#418)
* improve nginx config

* add support for base32 skylink
2020-09-23 15:51:37 +02:00
Karol Wypchło 22b9c368db
drop legacy upload node support (#417) 2020-09-22 11:49:57 +02:00
Karol Wypchło 98cd70faea
Fix broken hns redirect (#415) 2020-09-21 18:29:47 +02:00
Karol Wypchlo 8b88331065 drop 404 not found on hnsres error 2020-09-16 17:07:05 +02:00
Karol Wypchlo 936d4ecd0c add more comments 2020-09-16 14:37:14 +02:00
Karol Wypchlo 54cda20b32 adjust hns endpoint 2020-09-16 14:28:47 +02:00
Karol Wypchlo b7578c00c9 Merge remote-tracking branch 'origin/master' into handshake-proxy-improvements 2020-09-16 10:58:08 +02:00
Karol Wypchło 2bc0010ec7
Merge pull request #404 from NebulousLabs/pj/subdomain-cache-key
Include subdomain in the cachekey
2020-09-16 10:49:45 +02:00
PJ ff02482ee6
Fix newline 2020-09-16 10:48:52 +02:00
PJ 7e5cacabca
Include subdomain in the cachekey 2020-09-16 10:23:49 +02:00
Karol Wypchlo 06d0466a1c decrease cache time 2020-09-15 17:27:44 +02:00
Karol Wypchlo c050948d23 improve caching 2020-09-15 17:22:49 +02:00
Karol Wypchlo c155fcfa55 move handshake proxy to nginx 2020-09-15 17:13:10 +02:00
Karol Wypchlo bc62bb5274 update to 1.5.0.3 docker-sia 2020-09-15 12:38:03 +02:00
PJ 41514c3660
Fix servername regex 2020-09-11 11:21:39 +02:00
Peter-Jan Brone 96aff33135
Wildcard Subdomains (#329)
* Add server rule and loation block to handle the base32 encoded skylink through the wildcard subdomain

* Instead of redirecting, proxy pass

* Add trailing slash

* Fix regex to handle server names

* Update docker/nginx/conf.d/client.conf

Co-authored-by: Karol Wypchło <kwypchlo@gmail.com>

* Implement PR remarks

* Implement PR remarks

Co-authored-by: Karol Wypchło <kwypchlo@gmail.com>
2020-09-10 17:14:43 +02:00
Karol Wypchło c2138f1d15
always use request_id path (#390) 2020-09-10 16:29:19 +02:00
Karol Wypchło 0593b41201
Nginx Log Format (#356)
* add filebeat

* nginx.conf access.log

* nginx.conf access.log

* fix filebeat

* add upstream data to access log

* Update nginx.conf

* Add content type header to access_log format

* Add quotes

* logs with wildcard to include gzipped ones

* Remove filebeat config

Co-authored-by: PJ <peterjan.brone@gmail.com>
2020-09-09 10:17:12 +02:00
Karol Wypchlo 44c38faa0b drop health-check endpoint from access.log 2020-09-04 13:00:27 +02:00
Karol Wypchlo 559960645e fix docker build 2020-09-03 19:19:40 +02:00
Christopher Schinnerl 93341a3d4d
fix byte range caching (#362) 2020-09-01 15:26:48 +02:00
Karol Wypchlo 66163b69cd update to 1.5.0.2 to fix mime type issues 2020-08-26 13:31:45 +02:00
Karol Wypchlo 5f574fbb0c use 1.5.0.1 docker image 2020-08-26 11:39:37 +02:00
Karol Wypchło 05b8b32a2a
Fix cors issues (#345)
* enable cord

* enable cors

* enable cors

* enable cors

* enable cors

* enable cors

* enable cors

* enable cors

* enable cors

* enable cors

* enable cors

* enable cors

* enable cors

* enable cors
2020-08-18 14:42:17 +02:00
Karol Wypchlo cbf7705598 FROM dynamic args are not supported 2020-08-18 11:54:51 +02:00
Karol Wypchlo 9681aa04f9 fix image version issue for builder 2020-08-18 11:31:45 +02:00
Karol Wypchlo 0a5f51d988 fix merge conflicts resolution errors 2020-08-18 11:11:10 +02:00
Karol Wypchlo 8a21dc8ce1 Merge remote-tracking branch 'origin/master' into docker 2020-08-18 10:55:09 +02:00
Karol Wypchło 69abeee707
Update proxy-buffer 2020-08-17 09:50:37 +02:00
Karol Wypchlo 06f0946317 fix hns header overflow and redirects 2020-07-31 15:27:08 +02:00
Karol Wypchlo 75caa84992 fix hns redirects 2020-07-31 15:22:04 +02:00
Karol Wypchlo cc48c09845 fix hns redirects 2020-07-31 15:20:05 +02:00
Karol Wypchlo 3ac40b5b22 adjust cache time 2020-07-31 00:50:42 +02:00
Karol Wypchlo 87e6e8c7a9 add Cache-Control to skynet links 2020-07-31 00:50:42 +02:00
Karol Wypchlo e30fa02142 set user root for nginx 2020-07-31 00:50:42 +02:00
Karol Wypchlo 30dbb8ced5 migrate to yarn workspaces 2020-07-31 00:50:42 +02:00
Karol Wypchlo 714c183797 move package files to improve docker performance 2020-07-31 00:50:42 +02:00
Karol Wypchlo bcb73eceb2 improve sia docker builder image 2020-07-31 00:50:42 +02:00
Karol Wypchlo 17d4a1ad53 sia-upload-legacy container 2020-07-31 00:50:42 +02:00
Karol Wypchlo 259e3ddffa docker setup
docker progress

docker works

env variables
2020-07-31 00:50:42 +02:00
Karol Wypchlo d571288b8e upgrade node images to 14.6.0 2020-07-30 11:52:45 +02:00
Karol Wypchlo 7ff0c9d09a add cache bypass option 2020-07-29 12:05:26 +02:00
Karol Wypchlo 4c7ad44f08 extend timeout on stats endpoints 2020-07-29 11:06:53 +02:00
Karol Wypchlo 12a0859235 restore siad-upload for /statsdown 2020-07-28 13:56:25 +02:00
Karol Wypchlo 955425d321 clean up double siad setup 2020-07-28 13:22:07 +02:00
Karol Wypchlo 0f035fdaf7 use same node image 2020-07-28 12:30:25 +02:00
Karol Wypchlo 919edb439c auth uploads 2020-07-28 11:19:03 +02:00
Karol Wypchlo 5890b5e8ef fix cors 2020-07-27 17:48:45 +02:00
Karol Wypchlo dd53f31171 skynet endpoints 2020-07-27 17:37:17 +02:00
Karol Wypchlo 2a64b33cc9 ?skynet stats 2020-07-27 17:34:30 +02:00
Karol Wypchlo 3b75226e0b apipassword 2020-07-27 17:30:05 +02:00
Karol Wypchlo 18ae436087 new line 2020-07-27 17:18:09 +02:00
Karol Wypchlo 7090edc5e7 cors 2020-07-27 17:16:17 +02:00
Karol Wypchlo 1dbc842c55 cors 2020-07-27 17:04:21 +02:00
Karol Wypchlo af1f4896f0 route53 2020-07-27 15:55:08 +02:00
Karol Wypchlo 025d8f5d94 purge caddy more or less 2020-07-27 15:40:26 +02:00
Karol Wypchło a7c57b3c5a
Handshake integration (#302) 2020-07-27 11:30:55 +02:00
Karol Wypchlo 7e06436aa6 do not enable custom.domain by default and improve docs 2020-07-17 21:12:18 +02:00
Karol Wypchło 387c0e31c0
increase download by ip limit from 10 to 100 (#295) 2020-07-16 18:31:03 +02:00
Karol Wypchło 45f2cd7de0
Update Caddy to 2.1.1 (#292) 2020-07-16 13:08:35 +02:00
Karol Wypchlo 0494389f20 do not match empty skyfile path 2020-07-15 17:09:22 +02:00
Karol Wypchlo 88ecfd00cf don't download cypress on production build 2020-07-08 14:09:21 +02:00
Karol Wypchlo ef7afd4c4e add /blacklist endpoint 2020-06-23 18:20:59 +02:00
Karol Wypchło f067c50648
Improve server infrastructure setup and scripts (#231) 2020-06-22 11:54:01 +02:00