Commit Graph

342 Commits

Author SHA1 Message Date
Karol Wypchlo 1a691038b7 cache only registry calls from hns endpoint 2021-01-28 15:02:51 +01:00
Karol Wypchlo 1177b7cf94 cache registry endpoint for 30s 2021-01-28 14:25:38 +01:00
Karol Wypchlo 203ff0fd84 ensure skylink_rest is local 2021-01-27 13:39:00 +01:00
Karol Wypchlo 5576c223ce fix hns links redirects 2021-01-27 13:27:41 +01:00
Ivaylo Novakov 903fe96751
Merge pull request #585 from NebulousLabs/expose-skynet-skylink-header
expose skynet skylink header
2021-01-18 14:37:32 +01:00
Karol Wypchło c4a6e71260
reduce directory tree nesting size (#583) 2021-01-18 12:33:17 +01:00
Karol Wypchlo a7cc85acd4 improve nginx cache 2021-01-15 16:11:06 +01:00
Karol Wypchlo fb1b41a52c expose skynet skylink header 2021-01-15 12:34:46 +01:00
Karol Wypchło 7923506052
add hns_domain and remove named variables 2021-01-13 17:49:24 +01:00
Karol Wypchlo 6053cb3eb2 add new nginx metrics to measure performance 2021-01-13 15:13:34 +01:00
Karol Wypchlo 1a9e4f1a4d upgrade openresty image to ubuntu 18 2021-01-08 13:47:30 +01:00
Karol Wypchło 83d2aa396e
allow to include previous skynet stats (#562)
* allow to include previous skynet stats

* explain chunked response
2020-12-10 14:43:59 +01:00
Karol Wypchło cd7696c97d
fix /portals and /stats rewrites (#561) 2020-12-08 12:21:20 +01:00
Ivaylo Novakov e201b8de8f
Merge pull request #370 from NebulousLabs/drop-health-checks-from-access-log
drop health-check endpoint from access.log
2020-12-07 14:13:11 +01:00
Karol Wypchło 92f9ca3efe
improve nginx skylinks cache purging (#553)
* purge test

* purge test

* purge test

* purge test

* purge test

* purge test

* purge test

* purge test
2020-12-03 12:59:50 +01:00
Karol Wypchlo ca22cb2c45 limit registry access in nginx 2020-12-01 10:59:45 +01:00
Karol Wypchlo a03c41130a use instead of 2020-11-26 16:10:54 +01:00
Karol Wypchlo 701eccbb2d fix downloading skylink 2020-11-26 15:49:54 +01:00
Karol Wypchło a0aba97298
add server override includes and redirect legacy endpoints (#541)
* add server override includes

* adjusting directory name
2020-11-26 11:44:55 +01:00
Peter-Jan Brone 3eaef976cf
Revert wildcard include (#540)
* Revert wildcard include

* Revert gitignore
2020-11-25 17:26:44 +01:00
Christopher Schinnerl 991d2a076e
Merge pull request #529 from NebulousLabs/pj/rate-limit-ips
Ratelimit
2020-11-25 15:42:06 +01:00
PJ 0a028dbc1a
Move ratelimited 2020-11-25 15:30:29 +01:00
PJ 0040aa5be1
rename zones 2020-11-25 15:15:23 +01:00
Peter-Jan Brone acf7fabe47
Add Skynet-Skylink response header (#526) 2020-11-25 13:26:33 +01:00
PJ 5a9b630f79
Fix typo 2020-11-19 18:27:08 +01:00
PJ 7daebd6d04
Add ratelimit mechanism on upload 2020-11-19 17:08:28 +01:00
Karol Wypchlo 05e34b5aaa rename blacklist to blocklist 2020-11-13 17:29:40 +01:00
Karol Wypchlo c946014e7c fix skylink not accessible 2020-11-04 17:28:45 +01:00
Karol Wypchlo 48b1f0d067 tighten if-else and add empty skylink protection 2020-11-04 12:04:24 +01:00
Karol Wypchło 9b09f9ba5c
Update docker/nginx/conf.d/client.conf comment copy 2020-11-04 11:54:38 +01:00
Karol Wypchlo 04ff998beb support skydb in hns 2020-11-03 16:26:33 +01:00
Karol Wypchlo 4dc3588f81 support skydb in hns 2020-11-03 16:24:56 +01:00
Karol Wypchlo 11186f3fd6 support skydb in hns 2020-11-03 16:18:23 +01:00
Karol Wypchlo 86497337ec fix nginx conf 2020-10-27 13:36:31 +01:00
Karol Wypchlo 153bed829b extend registry proxy timeout to 10 minutes 2020-10-26 12:35:31 +01:00
Karol Wypchlo 831defeca3 add /docs proxy 2020-10-16 14:59:36 +02:00
Karol Wypchło bd724ede60
add registry endpoint (#473) 2020-10-15 12:15:10 +02:00
PJ 1051a73bdf
Oops 2020-10-09 16:41:47 +02:00
PJ efb76c43a2
Add portal domain to log format 2020-10-09 16:35:34 +02:00
Karol Wypchło 468527c22d
add portal_subdomain to nginx regex and fill documentation (#435) 2020-09-29 12:35:34 +02:00
Karol Wypchło 3469943a0b
Support hns subdomains (#420)
* support hns subdomains

* document feature
2020-09-24 16:33:07 +02:00
Karol Wypchło 279e051207
improve nginx config (#418)
* improve nginx config

* add support for base32 skylink
2020-09-23 15:51:37 +02:00
Karol Wypchło 22b9c368db
drop legacy upload node support (#417) 2020-09-22 11:49:57 +02:00
Karol Wypchło 98cd70faea
Fix broken hns redirect (#415) 2020-09-21 18:29:47 +02:00
Karol Wypchlo 8b88331065 drop 404 not found on hnsres error 2020-09-16 17:07:05 +02:00
Karol Wypchlo 936d4ecd0c add more comments 2020-09-16 14:37:14 +02:00
Karol Wypchlo 54cda20b32 adjust hns endpoint 2020-09-16 14:28:47 +02:00
Karol Wypchlo b7578c00c9 Merge remote-tracking branch 'origin/master' into handshake-proxy-improvements 2020-09-16 10:58:08 +02:00
PJ ff02482ee6
Fix newline 2020-09-16 10:48:52 +02:00
PJ 7e5cacabca
Include subdomain in the cachekey 2020-09-16 10:23:49 +02:00
Karol Wypchlo 06d0466a1c decrease cache time 2020-09-15 17:27:44 +02:00
Karol Wypchlo c050948d23 improve caching 2020-09-15 17:22:49 +02:00
Karol Wypchlo c155fcfa55 move handshake proxy to nginx 2020-09-15 17:13:10 +02:00
PJ 41514c3660
Fix servername regex 2020-09-11 11:21:39 +02:00
Peter-Jan Brone 96aff33135
Wildcard Subdomains (#329)
* Add server rule and loation block to handle the base32 encoded skylink through the wildcard subdomain

* Instead of redirecting, proxy pass

* Add trailing slash

* Fix regex to handle server names

* Update docker/nginx/conf.d/client.conf

Co-authored-by: Karol Wypchło <kwypchlo@gmail.com>

* Implement PR remarks

* Implement PR remarks

Co-authored-by: Karol Wypchło <kwypchlo@gmail.com>
2020-09-10 17:14:43 +02:00
Karol Wypchło c2138f1d15
always use request_id path (#390) 2020-09-10 16:29:19 +02:00
Karol Wypchło 0593b41201
Nginx Log Format (#356)
* add filebeat

* nginx.conf access.log

* nginx.conf access.log

* fix filebeat

* add upstream data to access log

* Update nginx.conf

* Add content type header to access_log format

* Add quotes

* logs with wildcard to include gzipped ones

* Remove filebeat config

Co-authored-by: PJ <peterjan.brone@gmail.com>
2020-09-09 10:17:12 +02:00
Karol Wypchlo 44c38faa0b drop health-check endpoint from access.log 2020-09-04 13:00:27 +02:00
Christopher Schinnerl 93341a3d4d
fix byte range caching (#362) 2020-09-01 15:26:48 +02:00
Karol Wypchło 05b8b32a2a
Fix cors issues (#345)
* enable cord

* enable cors

* enable cors

* enable cors

* enable cors

* enable cors

* enable cors

* enable cors

* enable cors

* enable cors

* enable cors

* enable cors

* enable cors

* enable cors
2020-08-18 14:42:17 +02:00
Karol Wypchlo 0a5f51d988 fix merge conflicts resolution errors 2020-08-18 11:11:10 +02:00
Karol Wypchlo 8a21dc8ce1 Merge remote-tracking branch 'origin/master' into docker 2020-08-18 10:55:09 +02:00
Karol Wypchło 69abeee707
Update proxy-buffer 2020-08-17 09:50:37 +02:00
Karol Wypchlo 06f0946317 fix hns header overflow and redirects 2020-07-31 15:27:08 +02:00
Karol Wypchlo 75caa84992 fix hns redirects 2020-07-31 15:22:04 +02:00
Karol Wypchlo cc48c09845 fix hns redirects 2020-07-31 15:20:05 +02:00
Karol Wypchlo 3ac40b5b22 adjust cache time 2020-07-31 00:50:42 +02:00
Karol Wypchlo 87e6e8c7a9 add Cache-Control to skynet links 2020-07-31 00:50:42 +02:00
Karol Wypchlo e30fa02142 set user root for nginx 2020-07-31 00:50:42 +02:00
Karol Wypchlo 30dbb8ced5 migrate to yarn workspaces 2020-07-31 00:50:42 +02:00
Karol Wypchlo 17d4a1ad53 sia-upload-legacy container 2020-07-31 00:50:42 +02:00
Karol Wypchlo 259e3ddffa docker setup
docker progress

docker works

env variables
2020-07-31 00:50:42 +02:00
Karol Wypchlo d571288b8e upgrade node images to 14.6.0 2020-07-30 11:52:45 +02:00
Karol Wypchlo 7ff0c9d09a add cache bypass option 2020-07-29 12:05:26 +02:00
Karol Wypchlo 4c7ad44f08 extend timeout on stats endpoints 2020-07-29 11:06:53 +02:00
Karol Wypchlo 12a0859235 restore siad-upload for /statsdown 2020-07-28 13:56:25 +02:00
Karol Wypchlo 955425d321 clean up double siad setup 2020-07-28 13:22:07 +02:00
Karol Wypchlo 0f035fdaf7 use same node image 2020-07-28 12:30:25 +02:00
Karol Wypchlo 919edb439c auth uploads 2020-07-28 11:19:03 +02:00
Karol Wypchlo 5890b5e8ef fix cors 2020-07-27 17:48:45 +02:00
Karol Wypchlo dd53f31171 skynet endpoints 2020-07-27 17:37:17 +02:00
Karol Wypchlo 2a64b33cc9 ?skynet stats 2020-07-27 17:34:30 +02:00
Karol Wypchlo 3b75226e0b apipassword 2020-07-27 17:30:05 +02:00
Karol Wypchlo 18ae436087 new line 2020-07-27 17:18:09 +02:00
Karol Wypchlo 7090edc5e7 cors 2020-07-27 17:16:17 +02:00
Karol Wypchlo 1dbc842c55 cors 2020-07-27 17:04:21 +02:00
Karol Wypchlo 025d8f5d94 purge caddy more or less 2020-07-27 15:40:26 +02:00
Karol Wypchło a7c57b3c5a
Handshake integration (#302) 2020-07-27 11:30:55 +02:00
Karol Wypchło 387c0e31c0
increase download by ip limit from 10 to 100 (#295) 2020-07-16 18:31:03 +02:00
Karol Wypchlo 0494389f20 do not match empty skyfile path 2020-07-15 17:09:22 +02:00
Karol Wypchlo ef7afd4c4e add /blacklist endpoint 2020-06-23 18:20:59 +02:00
Karol Wypchło f067c50648
Improve server infrastructure setup and scripts (#231) 2020-06-22 11:54:01 +02:00