Commit Graph

362 Commits

Author SHA1 Message Date
Filip Rysavy b4e2eec2fe
Block skylinks in batches 2021-12-13 17:35:00 +01:00
Matthew Sevey c77e793360
Merge pull request #1430 from SkynetLabs/fil/disk-usage-root-dirs
Fil/disk usage root dirs
2021-12-13 08:44:55 -05:00
PJ 9be3e29aaf
Add newline 2021-12-10 17:33:23 +01:00
PJ 644f7f3e84
Add command to crontab 2021-12-10 17:32:01 +01:00
Filip Rysavy 66e914e649
Update root dir output 2021-12-08 12:20:57 +01:00
Filip Rysavy 0b1ea2b598
Add skynet-webportal dir sizes to dump on health checker disable 2021-12-08 11:29:31 +01:00
Filip Rysavy 0f8384436b
Add root dir sizes to dump on health checker disable 2021-12-08 09:59:46 +01:00
Ivaylo Novakov fd26441077
Merge pull request #1428 from SkynetLabs/sevey/mute-more-pings
Mute check failures unless server is down
2021-12-06 19:37:06 +01:00
Matthew Sevey 9fe0628fe7
Mute check failures unless server is down 2021-12-06 13:28:30 -05:00
Matthew Sevey 82d258008f
Merge pull request #1427 from SkynetLabs/fil/nginx-prune
Add pruning Nginx cache
2021-12-06 10:55:14 -05:00
Filip Rysavy 0af14d32db
Add pruning Nginx cache 2021-12-06 13:35:17 +01:00
Matthew Sevey 7bf366db24
Add serverload endpoint (#1410)
* write usage script for cpu and free disk space tracking, testing new endpoint

* Test alias nginx path

* testing json

* fix server load json file being served by nginx

* Fix filenames

* Add changelog

* Add systemd file for serverload

* Update setup-scripts/serverload.sh

Co-authored-by: Peter-Jan Brone <peter-jan@settlemint.com>
2021-12-06 12:49:58 +01:00
Matthew Sevey c45b9c41bd
format 2021-12-01 14:16:46 -05:00
Matthew Sevey 3e17c1a9ee
remove ping instead of disable 2021-12-01 12:07:15 -05:00
Matthew Sevey 3d11ca503f
Merge branch 'master' into sevey/disabl-load-check 2021-12-01 12:06:08 -05:00
Filip Rysavy ec3a26e8b5
Fix script permissions 2021-12-01 13:49:02 +01:00
Filip Rysavy 5ae447f9b2
Dump disk usage on health-checker critical disk space 2021-12-01 13:27:33 +01:00
Filip Rysavy f5b81d1287
Fix disabling portal in health checker 2021-11-26 16:38:53 +01:00
Matthew Sevey 31cf9fb59e
Disable load check until we have a process of actively addressing it 2021-11-24 14:13:26 -05:00
Filip Rysavy bf2e7cb7cf
Add Airtable skylinks whitespace trimming 2021-11-18 13:04:20 +01:00
Filip Rysavy 24e77ff575
Fix merge conflict 2021-11-10 15:13:14 +01:00
Filip Rysavy e99fdfe460
Fix missing colon 2021-11-10 15:10:28 +01:00
firyx c3d3f2b0e5
Update setup-scripts/blocklist-airtable.py
Co-authored-by: Karol Wypchło <kwypchlo@gmail.com>
2021-11-10 14:32:08 +01:00
Filip Rysavy efeddd6c70
Add check if Airtable vars are defined 2021-11-10 14:22:00 +01:00
Filip Rysavy 07b99b8192
Add check if Airtable vars are defined 2021-11-10 13:52:32 +01:00
Filip Rysavy d68f896988
Add check if Airtable vars are defined 2021-11-10 13:46:43 +01:00
Filip Rysavy 2e15826f58
Remove Airtable hardcoded default values 2021-11-10 11:49:16 +01:00
Filip Rysavy 838c2084a9
Add note to sync changes in blocklist scripts 2021-10-26 09:49:03 +02:00
Matthew Sevey b001e953cc
Remove duplicated documentation and point to developer docs 2021-10-12 09:42:30 -04:00
Karol Wypchlo 9026d56777
fix health check script invalid syntax
python lint job
2021-10-06 14:21:58 +02:00
Karol Wypchlo b768ca9973
fix transitioning to cli command 2021-09-15 12:50:22 +02:00
Matthew Sevey b75c0c2c3b
Merge pull request #1178 from SkynetLabs/round-full-hours
round reporting datetime to full hours
2021-09-10 14:25:30 -04:00
Karol Wypchlo bcea4d5b90
do not send message on server down 2021-09-10 17:00:37 +02:00
Karol Wypchlo 4fddbb2fc8
do not notify on portal disabled 2021-09-10 16:23:05 +02:00
Karol Wypchlo 5ba4f54302
round reporting datetime to full hours 2021-09-10 13:24:19 +02:00
Matthew Sevey 0f60a395b3
Remove outdated NebulousLabs references 2021-09-08 15:04:02 -04:00
Karol Wypchło c294abc5c3
remove old Karol's key 2021-09-03 11:38:26 +02:00
Daniel Helm ad5372959a
add ssh key for daniel@siasky.net 2021-09-02 18:43:50 -05:00
Karol Wypchlo ecb73e7498
drop caddy as proxy 2021-08-27 14:15:22 +02:00
Karol Wypchlo 72f2b56f17
include skapps checks 2021-08-23 16:21:09 +02:00
Matthew Sevey 9d312c061f
Merge pull request #1071 from SkynetLabs/ivo/es_cleaner
ES Cleaner in crontab
2021-08-17 11:34:24 -04:00
Karol Wypchło 1c8816530c
cleanup unused discord import (#1073) 2021-08-17 09:58:00 +02:00
Ivaylo Novakov bbdea48633
Just make the scripts runnable. 2021-08-16 15:48:59 +03:00
Ivaylo Novakov 9d2ac488cb
Add the es_cleaner.py script to crontab and make sure that it's executable. 2021-08-16 15:44:07 +03:00
Karol Wypchło 379f87ea27
increase disk space size that warrants a warning (#1063) 2021-08-12 13:14:00 +02:00
Karol Wypchlo c08709ff45 do not try to run interactive docker function 2021-07-23 16:48:19 +02:00
Karol Wypchlo 0e419d820c don't include logrotate, included by mistake 2021-07-19 12:21:51 +02:00
Karol Wypchlo ae6043817b btach size 1k 2021-07-18 09:28:24 +02:00
Karol Wypchlo 7f448fb31f smaller batch fix 2021-07-18 09:25:23 +02:00
Karol Wypchlo ed19736e22 smaller batch 2021-07-18 09:24:45 +02:00
Karol Wypchlo 6c1b96606e one less search 2021-07-18 09:17:29 +02:00
Karol Wypchlo 7c9d1debd2 one less search 2021-07-18 09:13:30 +02:00
Karol Wypchlo 73cf5b510e improve 2021-07-18 09:10:54 +02:00
Karol Wypchlo 52e5a345cf improve 2021-07-18 09:09:55 +02:00
Karol Wypchlo 273bcbcb8f fix cache busting 2021-07-18 09:07:15 +02:00
Karol Wypchlo fdee9b46ee concatenate string 2021-07-18 08:55:29 +02:00
Karol Wypchlo 96ade5f36d airtable retries logic 2021-07-18 08:22:32 +02:00
Karol Wypchło bdff7bb0b1
Update setup-scripts/setup-health-check-scripts.sh
Co-authored-by: firyx <29089732+firyx@users.noreply.github.com>
2021-07-16 14:38:02 +02:00
Karol Wypchlo fc10a49054 DiscordWebhook => discord_webhook 2021-07-16 14:31:19 +02:00
Karol Wypchło 71f9d5280e
use webhook instead of discrod bot to send messages (#979)
* initial refactor

* do not use before define

* forgot to remove client

* test notification

* add /cc

* fix /cc

* fix /cc role

* fix /cc

* test file upload

* test file upload

* test file upload

* default to no mentions

* unformat

* replace discord with DiscordWebhook

* add readme

* don't fail on failures in message send
2021-07-16 13:12:58 +02:00
Karol Wypchlo 36aa7c8311 improve health check reliability 2021-07-12 14:53:12 +02:00
Karol Wypchlo a2aa850632 improve health check reliability 2021-07-12 14:49:53 +02:00
Karol Wypchlo 7fd97b5824 improve health check reliability 2021-07-12 14:48:13 +02:00
Karol Wypchlo af80a84094 server-health => skynet-server-health 2021-06-30 15:31:38 +02:00
Karol Wypchlo fde760ec86 add option to pass channel and notify role to health check script 2021-06-30 15:15:51 +02:00
Karol Wypchlo a6b9f1fe06 clean up webapp directory and update some deps 2021-06-17 14:40:02 +02:00
Karol Wypchlo 34eb822cf8 explain env vars 2021-06-17 13:45:53 +02:00
Karol Wypchlo f6299e4e9d use SKYNET_SERVER_API in discord bot 2021-06-16 16:50:05 +02:00
Karol Wypchlo 49bb6dd2e2 fix portal size check reporting zero files 2021-06-15 11:41:01 +02:00
Karol Wypchło b8a6816876
fixed health check blowing up on eu-fin-3 (#838)
* request 127.0.0.1 over https - http localhost causes issues

* reformat with black
2021-06-07 15:08:18 +02:00
Karol Wypchło 7c344e7d4e
Merge pull request #773 from SkynetLabs/fil-ssh-key-fix
Fix email in Fil ssh key
2021-05-26 18:30:54 +02:00
firyx 86f6dcbd0f
Merge pull request #771 from SkynetLabs/ssh-marcin
Add Marcin's ssh key
2021-05-24 20:45:17 +02:00
Marcin S 75fb474895
Switch to ed25519 and change key comment 2021-05-21 10:12:41 -04:00
Ivaylo Novakov e3066604c0
Block outgoing traffic to local networks. 2021-05-18 11:41:25 +02:00
Filip Rysavy 89e21e22f3 Fix email in Fil ssh key 2021-05-18 11:26:51 +02:00
Ivaylo Novakov 09fc534249
Merge pull request #752 from SkynetLabs/ivo/db_backups_fix
Fix DB backups creation
2021-05-18 10:38:53 +02:00
Marcin S 0763526b77
Add Marcin's ssh key 2021-05-17 14:38:31 -04:00
Karol Wypchło 670cecbebf
Merge branch 'master' into deploy-machine-ssh-key 2021-05-12 11:02:38 +02:00
Ivaylo Novakov 03e9fbf481
Update awscli every time we run the script, otherwise Python will break randomly. 2021-05-11 11:26:11 +02:00
Karol Wypchło a910e8a8bb
Karol's new ed25519 ssh key (#720)
* add my new ed25519 ssh key

* remove old David'd key

* update emails on employees ssh keys

* update PJ ssh key

* update PJ email

Co-authored-by: PJ <peterjan.brone@gmail.com>
2021-05-10 16:27:47 +02:00
firyx e2bd227d78
Update SSH key user with FQDN 2021-05-06 10:13:13 +02:00
Filip Rysavy e8e953d3e9 Add deployment machine SSH key 2021-05-05 11:34:59 +02:00
Ivaylo Novakov 865b3fbc9a
Add the new deps to be installed. 2021-05-04 13:55:17 +02:00
Karol Wypchlo cd7dac5b7e verbose => extended 2021-04-29 13:43:40 +02:00
Karol Wypchło ddf56dc21b
Update setup-scripts/README.md 2021-04-20 13:08:24 +02:00
Karol Wypchlo 89573df976 adjust readme 2021-04-20 11:56:06 +02:00
Karol Wypchlo 163f29ce78 replace DOMAIN_NAME with SSL_CERTIFICATE_STRING 2021-04-20 11:45:40 +02:00
Karol Wypchlo 143ef617fe set defaults for caddyfile 2021-04-20 11:09:01 +02:00
Karol Wypchlo 1034e7b572 Merge remote-tracking branch 'origin/master' into website 2021-04-15 11:04:22 +02:00
Matthew Sevey 0a0b17e455
Sevey: update ssh key 2021-04-14 11:34:17 -04:00
Karol Wypchlo 1c99da3af8 fix repair string 2021-04-14 12:17:01 +02:00
Karol Wypchlo f48a8d9302 fix health-check 2021-04-13 16:19:42 +02:00
Ivaylo Novakov 7ecb234072
Better cron for backups. 2021-04-13 12:08:26 +02:00
Ivaylo Novakov 6971b3938b
Update the READMEs after setting up a couple of portals. 2021-04-06 18:12:24 +02:00
Ivaylo Novakov 482f9655c4
Merge branch 'ivo/db_backups' into ivo/db_backups_new 2021-04-01 15:30:06 +02:00
Karol Wypchło fede204c6b
Accounts (#554)
* stripe env

* stripe env

* stripe env

* allow post

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* favicon

* foo

* foo

* foo

* foo

* foo

* foo

* title

* fix dashboard timestamp

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* prices

* Revert "prices"

This reverts commit 7071ed4ef4.

* Make sure we don't accidentally commit `kratos.yml`.

* Add Oathkeeper access rules for Stripe.

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* Add `max_breaches` to Kratos's sample config file.

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* cache .next folder

* Use own fork of Kratos's `master` in order to get the fix for the migrations issue.

* Don't retry running Kratos migrations.

* payments

* restart: no

* no

* no

* no

* no

* no

* no

* no

* no

* no

* payments

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* limits

* limits

* nginx depends on accounts and kratos-migrate depends on cockroach.

* upload limit rate

* upload limit rate - 2

* upload limit rate - 3

* upload limit rate - 4

* upload limit rate - 5

* upload limit rate - 6

* upload limit rate - 7

* upload limit rate - 8

* upload limit rate - 9

* forgotten password link

* use header for skylink

* use header for skylink

* use header for skylink

* use header for skylink

* use header for skylink

* use header for skylink

* use header for skylink

* use header for skylink

* copy to clipboard

* fix ratelimit issue

* Allow access to the stripe webhook.

* enable allow_promotion_codes

* Allow POST on webhook.

* Add all env vars accounts need to docker-compose.

* Don't use custom port for accounts.

* print recovery

* recovery sign up link

* refactor cors header response

* refactor cors header response

* do not log unauthorized

* fix registration link

* settings logging

* update node and tailwindcss

* move webapp from volume

* host 0.0.0.0

* refactor dockerfile

* enable accounts

* cache public

* uncache public

* remove cache control

* no-cache

* no cache

* Do not use the person's name for registration.

* add verify route

* add verify route

* add verify route

* Go back to using the stock kratos image.

* add verify route

* fix settings link

* clean up verify flow

* refactor Dockerfile

* Remove first and last name from used traits.

* Remove account verification via email.

* Allow additional properties.

* Cookies and tokens last for 30 days now.

* Rename secure.siasky.net to account.siasky.net.

* redirect secure to account

Co-authored-by: Ivaylo Novakov <inovakov@gmail.com>
Co-authored-by: Ivaylo Novakov <ro-tex@users.noreply.github.com>
2021-04-01 15:15:37 +02:00
Karol Wypchlo aee6976734 xrange 2021-03-05 23:53:19 +01:00
Karol Wypchlo eda08a22bf batching 2021-03-05 23:53:12 +01:00
Karol Wypchlo 1762c7f7b7 fixed writing to file 2021-03-05 23:52:47 +01:00
Karol Wypchlo e816a33da1 blocklist from file 2021-03-05 23:52:38 +01:00