Karol Wypchło
bdff7bb0b1
Update setup-scripts/setup-health-check-scripts.sh
...
Co-authored-by: firyx <29089732+firyx@users.noreply.github.com>
2021-07-16 14:38:02 +02:00
Karol Wypchlo
fc10a49054
DiscordWebhook => discord_webhook
2021-07-16 14:31:19 +02:00
Karol Wypchło
71f9d5280e
use webhook instead of discrod bot to send messages ( #979 )
...
* initial refactor
* do not use before define
* forgot to remove client
* test notification
* add /cc
* fix /cc
* fix /cc role
* fix /cc
* test file upload
* test file upload
* test file upload
* default to no mentions
* unformat
* replace discord with DiscordWebhook
* add readme
* don't fail on failures in message send
2021-07-16 13:12:58 +02:00
Karol Wypchlo
36aa7c8311
improve health check reliability
2021-07-12 14:53:12 +02:00
Karol Wypchlo
a2aa850632
improve health check reliability
2021-07-12 14:49:53 +02:00
Karol Wypchlo
7fd97b5824
improve health check reliability
2021-07-12 14:48:13 +02:00
Karol Wypchlo
af80a84094
server-health => skynet-server-health
2021-06-30 15:31:38 +02:00
Karol Wypchlo
fde760ec86
add option to pass channel and notify role to health check script
2021-06-30 15:15:51 +02:00
Karol Wypchlo
a6b9f1fe06
clean up webapp directory and update some deps
2021-06-17 14:40:02 +02:00
Karol Wypchlo
34eb822cf8
explain env vars
2021-06-17 13:45:53 +02:00
Karol Wypchlo
f6299e4e9d
use SKYNET_SERVER_API in discord bot
2021-06-16 16:50:05 +02:00
Karol Wypchlo
49bb6dd2e2
fix portal size check reporting zero files
2021-06-15 11:41:01 +02:00
Karol Wypchło
b8a6816876
fixed health check blowing up on eu-fin-3 ( #838 )
...
* request 127.0.0.1 over https - http localhost causes issues
* reformat with black
2021-06-07 15:08:18 +02:00
Karol Wypchło
7c344e7d4e
Merge pull request #773 from SkynetLabs/fil-ssh-key-fix
...
Fix email in Fil ssh key
2021-05-26 18:30:54 +02:00
firyx
86f6dcbd0f
Merge pull request #771 from SkynetLabs/ssh-marcin
...
Add Marcin's ssh key
2021-05-24 20:45:17 +02:00
Marcin S
75fb474895
Switch to ed25519 and change key comment
2021-05-21 10:12:41 -04:00
Ivaylo Novakov
e3066604c0
Block outgoing traffic to local networks.
2021-05-18 11:41:25 +02:00
Filip Rysavy
89e21e22f3
Fix email in Fil ssh key
2021-05-18 11:26:51 +02:00
Ivaylo Novakov
09fc534249
Merge pull request #752 from SkynetLabs/ivo/db_backups_fix
...
Fix DB backups creation
2021-05-18 10:38:53 +02:00
Marcin S
0763526b77
Add Marcin's ssh key
2021-05-17 14:38:31 -04:00
Karol Wypchło
670cecbebf
Merge branch 'master' into deploy-machine-ssh-key
2021-05-12 11:02:38 +02:00
Ivaylo Novakov
03e9fbf481
Update awscli every time we run the script, otherwise Python will break randomly.
2021-05-11 11:26:11 +02:00
Karol Wypchło
a910e8a8bb
Karol's new ed25519 ssh key ( #720 )
...
* add my new ed25519 ssh key
* remove old David'd key
* update emails on employees ssh keys
* update PJ ssh key
* update PJ email
Co-authored-by: PJ <peterjan.brone@gmail.com>
2021-05-10 16:27:47 +02:00
firyx
e2bd227d78
Update SSH key user with FQDN
2021-05-06 10:13:13 +02:00
Filip Rysavy
e8e953d3e9
Add deployment machine SSH key
2021-05-05 11:34:59 +02:00
Ivaylo Novakov
865b3fbc9a
Add the new deps to be installed.
2021-05-04 13:55:17 +02:00
Karol Wypchlo
cd7dac5b7e
verbose => extended
2021-04-29 13:43:40 +02:00
Karol Wypchło
ddf56dc21b
Update setup-scripts/README.md
2021-04-20 13:08:24 +02:00
Karol Wypchlo
89573df976
adjust readme
2021-04-20 11:56:06 +02:00
Karol Wypchlo
163f29ce78
replace DOMAIN_NAME with SSL_CERTIFICATE_STRING
2021-04-20 11:45:40 +02:00
Karol Wypchlo
143ef617fe
set defaults for caddyfile
2021-04-20 11:09:01 +02:00
Karol Wypchlo
1034e7b572
Merge remote-tracking branch 'origin/master' into website
2021-04-15 11:04:22 +02:00
Matthew Sevey
0a0b17e455
Sevey: update ssh key
2021-04-14 11:34:17 -04:00
Karol Wypchlo
1c99da3af8
fix repair string
2021-04-14 12:17:01 +02:00
Karol Wypchlo
f48a8d9302
fix health-check
2021-04-13 16:19:42 +02:00
Ivaylo Novakov
7ecb234072
Better cron for backups.
2021-04-13 12:08:26 +02:00
Ivaylo Novakov
6971b3938b
Update the READMEs after setting up a couple of portals.
2021-04-06 18:12:24 +02:00
Ivaylo Novakov
482f9655c4
Merge branch 'ivo/db_backups' into ivo/db_backups_new
2021-04-01 15:30:06 +02:00
Karol Wypchło
fede204c6b
Accounts ( #554 )
...
* stripe env
* stripe env
* stripe env
* allow post
* accounts/**
* accounts/**
* accounts/**
* accounts/**
* accounts/**
* accounts/**
* accounts/**
* accounts/**
* accounts/**
* accounts/**
* accounts/**
* accounts/**
* accounts/**
* accounts/**
* accounts/**
* accounts/**
* accounts/**
* favicon
* foo
* foo
* foo
* foo
* foo
* foo
* title
* fix dashboard timestamp
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* prices
* Revert "prices"
This reverts commit 7071ed4ef4
.
* Make sure we don't accidentally commit `kratos.yml`.
* Add Oathkeeper access rules for Stripe.
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* Add `max_breaches` to Kratos's sample config file.
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* payments
* cache .next folder
* Use own fork of Kratos's `master` in order to get the fix for the migrations issue.
* Don't retry running Kratos migrations.
* payments
* restart: no
* no
* no
* no
* no
* no
* no
* no
* no
* no
* payments
* accounts
* accounts
* accounts
* accounts
* accounts
* accounts
* accounts
* accounts
* accounts
* accounts
* accounts
* accounts
* accounts
* accounts
* accounts
* accounts
* accounts
* accounts
* limits
* limits
* nginx depends on accounts and kratos-migrate depends on cockroach.
* upload limit rate
* upload limit rate - 2
* upload limit rate - 3
* upload limit rate - 4
* upload limit rate - 5
* upload limit rate - 6
* upload limit rate - 7
* upload limit rate - 8
* upload limit rate - 9
* forgotten password link
* use header for skylink
* use header for skylink
* use header for skylink
* use header for skylink
* use header for skylink
* use header for skylink
* use header for skylink
* use header for skylink
* copy to clipboard
* fix ratelimit issue
* Allow access to the stripe webhook.
* enable allow_promotion_codes
* Allow POST on webhook.
* Add all env vars accounts need to docker-compose.
* Don't use custom port for accounts.
* print recovery
* recovery sign up link
* refactor cors header response
* refactor cors header response
* do not log unauthorized
* fix registration link
* settings logging
* update node and tailwindcss
* move webapp from volume
* host 0.0.0.0
* refactor dockerfile
* enable accounts
* cache public
* uncache public
* remove cache control
* no-cache
* no cache
* Do not use the person's name for registration.
* add verify route
* add verify route
* add verify route
* Go back to using the stock kratos image.
* add verify route
* fix settings link
* clean up verify flow
* refactor Dockerfile
* Remove first and last name from used traits.
* Remove account verification via email.
* Allow additional properties.
* Cookies and tokens last for 30 days now.
* Rename secure.siasky.net to account.siasky.net.
* redirect secure to account
Co-authored-by: Ivaylo Novakov <inovakov@gmail.com>
Co-authored-by: Ivaylo Novakov <ro-tex@users.noreply.github.com>
2021-04-01 15:15:37 +02:00
Karol Wypchlo
aee6976734
xrange
2021-03-05 23:53:19 +01:00
Karol Wypchlo
eda08a22bf
batching
2021-03-05 23:53:12 +01:00
Karol Wypchlo
1762c7f7b7
fixed writing to file
2021-03-05 23:52:47 +01:00
Karol Wypchlo
e816a33da1
blocklist from file
2021-03-05 23:52:38 +01:00
Karol Wypchlo
a16b724583
do not try to attach an empty file
2021-03-03 14:34:27 +01:00
Karol Wypchlo
44b7a85285
filter empty skylinks
2021-03-03 14:07:29 +01:00
Karol Wypchlo
e534aaebca
fix empty Link
2021-03-02 17:33:15 +01:00
Karol Wypchlo
c791f3bf08
passing '' to int() throws an error
2021-03-02 16:44:56 +01:00
Karol Wypchlo
6186d7439f
filter invalid skylinks
2021-03-02 13:44:27 +01:00
Karol Wypchlo
4f055528ca
filter invalid skylinks
2021-03-02 13:41:23 +01:00
Karol Wypchlo
bf0d8f2145
filter invalid skylinks
2021-03-02 13:40:18 +01:00
Karol Wypchlo
f306a1f408
remove leftover
2021-03-02 12:43:23 +01:00
Karol Wypchlo
7e717021f4
black
2021-03-01 23:39:28 +01:00
Karol Wypchlo
43ddd484c2
pagination
2021-03-01 23:22:53 +01:00
Karol Wypchlo
e14a03c912
pagination
2021-03-01 23:15:54 +01:00
Karol Wypchlo
3b5d09ec73
pagination
2021-03-01 23:13:28 +01:00
Karol Wypchlo
002ae6c6d8
pagination
2021-03-01 23:08:38 +01:00
Karol Wypchlo
6af13b4715
typo
2021-03-01 18:50:01 +01:00
Karol Wypchlo
d9ed1decf6
typo
2021-03-01 18:42:33 +01:00
Karol Wypchlo
1d9215fdd1
typo
2021-03-01 18:41:41 +01:00
Karol Wypchlo
b92bfe0150
typo
2021-03-01 18:40:39 +01:00
Karol Wypchlo
5473468dc8
purging script
2021-03-01 18:39:43 +01:00
Karol Wypchlo
ea8ccba3fa
print cached files
2021-03-01 18:26:38 +01:00
Karol Wypchlo
ec77e16806
fix grep pattern
2021-03-01 17:58:43 +01:00
Karol Wypchlo
0677e7c933
clear nginx cache
2021-03-01 17:56:30 +01:00
Karol Wypchlo
1c9bdd4dc6
notification
2021-03-01 17:22:43 +01:00
Karol Wypchlo
fb0ab9bb50
better error handling
2021-03-01 17:21:53 +01:00
Karol Wypchlo
937fe052b3
better error handling
2021-03-01 17:20:42 +01:00
Karol Wypchlo
0d8b50e5a2
better error handling
2021-03-01 17:19:13 +01:00
Karol Wypchlo
46fd77a2e2
AIRTABLE_API_KEY
2021-03-01 17:13:00 +01:00
Karol Wypchlo
cfd74fc26e
AIRTABLE_API_KEY
2021-03-01 17:11:12 +01:00
Karol Wypchlo
acf83ec621
running param
2021-03-01 17:09:18 +01:00
Karol Wypchlo
b0d49e2f2f
more logging
2021-03-01 17:08:10 +01:00
Karol Wypchlo
ac5dc3eca7
discord integration
2021-03-01 16:59:38 +01:00
Karol Wypchlo
98160a0fc8
crontab update
2021-03-01 16:49:08 +01:00
Karol Wypchlo
6a8b9e7ceb
airtable blocklist integration
2021-03-01 16:47:06 +01:00
Chris Schinnerl
7661aff6e3
Chris: update ssh key
2021-02-26 15:32:41 +01:00
Karol Wypchlo
9853e6e197
include SKYNET_PORTAL_API in setup script
2021-02-18 10:43:20 +01:00
firyx
2b98943e20
Update authorized_keys
2021-02-12 12:38:22 +01:00
Karol Wypchło
5f15005f44
adjust funds notifications ( #615 )
2021-02-12 11:39:56 +01:00
Matthew Sevey
c752a17058
Update setup-scripts/health-checker.py
2021-02-03 10:30:27 -07:00
Matthew Sevey
50dff35da8
Update setup-scripts/health-checker.py
...
Co-authored-by: Marcin S. <scatman@bu.edu>
2021-02-03 10:22:24 -07:00
Matthew Sevey
ff183beb66
Add repair size information to health checker
2021-02-03 09:42:55 -07:00
Karol Wypchlo
75b2eeb9ae
do not install authorized_keys by default
2021-01-29 23:26:41 +01:00
Karol Wypchło
e9aecafb09
set timezone to utc on server setup ( #588 )
2021-01-20 15:52:30 +01:00
Karol Wypchło
c0673b3f76
do not ping when server is in maintenance mode ( #552 )
2020-12-01 13:31:59 +01:00
Karol Wypchlo
443eacc844
print wallet address on low funds
2020-11-27 17:13:41 +01:00
Matthew Sevey
5f76d1ca52
remove error alert notification, subtract out siafile alerts
2020-11-24 07:49:51 -07:00
Karol Wypchlo
2dfb6d6a56
restore "or"
2020-11-24 15:26:51 +01:00
Karol Wypchlo
383144b7a6
tweak notifications on number of files in a node
2020-11-24 13:16:25 +01:00
Karol Wypchlo
7946f97d58
tweak notifications on error alerts
2020-11-24 13:08:08 +01:00
Ivaylo Novakov
41460f155f
Moved the container name var to the global space where it belongs.
2020-11-20 22:08:04 +01:00
Ivaylo Novakov
801597ccde
Fixed some typos.
...
Fixed formatting (force of habit...).
2020-11-20 21:45:19 +01:00
Matthew Sevey
05cd1bfb32
fix weird formatting
2020-11-20 11:46:35 -07:00
Matthew Sevey
a337b754a8
run python format
2020-11-20 11:33:07 -07:00
Matthew Sevey
efc6060924
scripts: update file health check to check siac output. Add total files check
2020-11-20 11:26:20 -07:00
Matthew Sevey
243d084b5d
update message for siafile bad health
2020-11-18 11:04:04 -07:00
Matthew Sevey
09a4b646ec
srcipts: add alert check to the python scripts
2020-11-18 10:21:06 -07:00
Karol Wypchlo
05e34b5aaa
rename blacklist to blocklist
2020-11-13 17:29:40 +01:00
Karol Wypchlo
d4d3f6977b
change recommended renewal from 8 weeks to 4 weeks
2020-10-30 13:38:17 +01:00
Karol Wypchlo
f732df9660
fix crontab setup script
2020-10-27 16:39:00 +01:00
Karol Wypchlo
1922c4cd98
use os.popopen manually
2020-10-06 12:12:19 +02:00
Karol Wypchlo
9b6d61aa7e
remove unnecessary time dependency
2020-10-06 11:27:06 +02:00
Karol Wypchlo
60f8371170
stop sia container on critical disk space threshold
2020-10-06 11:24:18 +02:00
Karol Wypchlo
2328e605b7
parse disk size as int before multiplying
2020-10-05 10:03:10 +02:00
Karol Wypchło
e58752571e
add response content to health check failures ( #437 )
2020-09-30 16:20:55 +02:00
Karol Wypchlo
bc879b51cc
update log message
2020-09-29 15:46:40 +02:00
Karol Wypchlo
e7e7adc141
get api password from docker container
2020-09-29 15:42:41 +02:00
Karol Wypchło
468527c22d
add portal_subdomain to nginx regex and fill documentation ( #435 )
2020-09-29 12:35:34 +02:00
Karol Wypchło
10a251c081
reimplement health checks ( #434 )
2020-09-29 12:32:45 +02:00
Matthew Sevey
998bacd93a
Add ssh pubkey for Sevey
2020-09-25 11:54:34 -04:00
Peter-Jan Brone
f3b2a130fe
Wildcard Subdomains Documentation ( #416 )
...
* Add documentation on subdomains
* Update copy
* Fix typo
* Link Karol his repo
* Update copy
* Update setup-scripts/README.md
Co-authored-by: Karol Wypchło <kwypchlo@gmail.com>
Co-authored-by: Karol Wypchło <kwypchlo@gmail.com>
2020-09-22 12:23:53 +02:00
Karol Wypchło
dc73367a66
Merge pull request #371 from NebulousLabs/safe-restart-scripts
...
add safe stop and restart sia scripts
2020-09-18 17:08:19 +02:00
Karol Wypchło
08782de656
update ssh keys
2020-09-17 15:50:47 +02:00
Karol Wypchlo
a02c27664b
adjust scripts
2020-09-14 17:40:18 +02:00
Karol Wypchlo
abacfc1ed1
improve docs
2020-09-14 15:57:44 +02:00
Karol Wypchlo
4f849ddf53
change comments
2020-09-14 15:53:27 +02:00
Karol Wypchlo
2c12b9d009
add safe stop and restart sia scripts
2020-09-14 15:53:27 +02:00
Karol Wypchlo
6acd3309f8
fix blacklist command
2020-09-14 14:45:06 +02:00
Karol Wypchlo
20362fe7c5
fix health checks
2020-09-10 15:16:31 +02:00
Ivaylo Novakov
8235d75795
Only announce healthy status once a day.
2020-09-08 18:20:56 +02:00
Ivaylo Novakov
ddf72ad850
Make the time comparisons in the health checker timezone-aware.
2020-09-08 18:07:33 +02:00
Ivaylo Novakov
2d032dbf17
Docstrings.
2020-09-07 17:59:39 +02:00
Ivaylo Novakov
0838e4f5e5
Add free disk space check to health-checker.py.
...
Move load-average check to health-checker.py.
2020-09-07 17:56:47 +02:00
Ivaylo Novakov
3f4742a436
Only notify the team if critical checks have failed.
2020-09-04 17:17:26 +02:00
Ivaylo Novakov
5eece67b03
Move parameter parsing to the top of the script.
2020-09-04 17:13:36 +02:00
Ivaylo Novakov
1cc20903c6
Move max discord message len to a constant.
...
Report critical checks failed.
Formatting.
2020-09-04 17:07:47 +02:00
Ivaylo Novakov
a0a9137ae7
Update setup-scripts/health-checker.py
...
Co-authored-by: Karol Wypchło <kwypchlo@gmail.com>
2020-09-04 16:44:19 +02:00
Ivaylo Novakov
62e27120cd
Use localhost.
2020-09-04 16:39:39 +02:00
Ivaylo Novakov
59a77bfaf6
Add a health checker script to Gollum.
2020-09-04 16:12:20 +02:00
Matthew Sevey
a911b36f56
Add severe check to log checker
2020-09-03 10:53:52 -04:00
Ivaylo Novakov
25cf5625b4
3 seconds timeout.
2020-08-31 13:39:07 +02:00
Ivaylo Novakov
2fc6d30c01
Use `os._exit` instead of `sys.exit` - we don't want to raise an exception.
2020-08-31 13:38:45 +02:00
Ivaylo Novakov
8761a77e18
Don't call `await client.close()`.
2020-08-31 13:27:49 +02:00
Ivaylo Novakov
ff8c4c2d78
Merge pull request #360 from NebulousLabs/ivo/check_system_load
...
Check system load
2020-08-31 13:25:50 +02:00
Ivaylo Novakov
59bad59cb7
Make it clear that the uptime data comes from the `uptime` command and not something we're putting together ourselves.
2020-08-28 16:05:24 +02:00
Karol Wypchlo
df7decb06c
drop Marcin's key
2020-08-28 14:56:01 +02:00
Ivaylo Novakov
58409b8cee
Switch from the "1 minute" to "15 minutes" average.
2020-08-28 11:59:27 +02:00
Ivaylo Novakov
efb35054f7
When chekcing logs, check also the system load and report it if it's above 10.
2020-08-28 11:54:47 +02:00
Ivaylo Novakov
2126115df4
Send the last 1MB of error log as a file.
2020-08-26 11:32:58 +03:00
Ivaylo Novakov
3b0c597516
Limit the errors sent in a discord message to under 2000 characters (including prefix message).
2020-08-26 11:13:16 +03:00
Ivaylo Novakov
0eb8ab0d7c
Use a clearer log message and add some debug output.
2020-08-24 12:33:03 +03:00
Ivaylo Novakov
af49e65b04
Switch from `/home/user/.sia/sia.env` to `/home/user/skynet-webportal/.env`.
2020-08-19 19:14:55 +03:00
Ivaylo Novakov
341c65eba8
Remove unneeded comment and example commands.
2020-08-19 16:13:56 +03:00
Ivaylo Novakov
81acebad5c
Add the forced exit to funds-checker.py as well.
2020-08-19 10:25:23 +03:00
Ivaylo Novakov
19fff428cd
Move code to the right place.
2020-08-19 10:17:26 +03:00
Ivaylo Novakov
b05af57b54
Cleanup the old function.
2020-08-18 18:37:49 +03:00
Ivaylo Novakov
2a1c06116b
Add a handy command to the readme that checks the logs in a dockerized environment.
2020-08-18 18:36:00 +03:00
Ivaylo Novakov
221902508f
Give the client 10 seconds to properly exits and if it fails to do so `exit` the hard way.
2020-08-18 18:25:54 +03:00
Ivaylo Novakov
00fff39bf2
Add a new log checked for docker.
2020-08-18 17:27:01 +03:00
Karol Wypchlo
259e3ddffa
docker setup
...
docker progress
docker works
env variables
2020-07-31 00:50:42 +02:00