LumeWeb
/
skynet-webportal
Archived
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
4,915 Commits 38 Branches 120 Tags 50 MiB
Commit Graph

360 Commits

Author SHA1 Message Date
Karol Wypchlo 73cf5b510e improve 2021-07-18 09:10:54 +02:00
Karol Wypchlo 52e5a345cf improve 2021-07-18 09:09:55 +02:00
Karol Wypchlo 273bcbcb8f fix cache busting 2021-07-18 09:07:15 +02:00
Karol Wypchlo fdee9b46ee concatenate string 2021-07-18 08:55:29 +02:00
Karol Wypchlo 96ade5f36d airtable retries logic 2021-07-18 08:22:32 +02:00
Karol Wypchło bdff7bb0b1
Update setup-scripts/setup-health-check-scripts.sh 
Co-authored-by: firyx <29089732+firyx@users.noreply.github.com>
 2021-07-16 14:38:02 +02:00
Karol Wypchlo fc10a49054 DiscordWebhook => discord_webhook 2021-07-16 14:31:19 +02:00
Karol Wypchło 71f9d5280e
use webhook instead of discrod bot to send messages (#979) 
* initial refactor

* do not use before define

* forgot to remove client

* test notification

* add /cc

* fix /cc

* fix /cc role

* fix /cc

* test file upload

* test file upload

* test file upload

* default to no mentions

* unformat

* replace discord with DiscordWebhook

* add readme

* don't fail on failures in message send
 2021-07-16 13:12:58 +02:00
Karol Wypchlo 36aa7c8311 improve health check reliability 2021-07-12 14:53:12 +02:00
Karol Wypchlo a2aa850632 improve health check reliability 2021-07-12 14:49:53 +02:00
Karol Wypchlo 7fd97b5824 improve health check reliability 2021-07-12 14:48:13 +02:00
Karol Wypchlo af80a84094 server-health => skynet-server-health 2021-06-30 15:31:38 +02:00
Karol Wypchlo fde760ec86 add option to pass channel and notify role to health check script 2021-06-30 15:15:51 +02:00
Karol Wypchlo a6b9f1fe06 clean up webapp directory and update some deps 2021-06-17 14:40:02 +02:00
Karol Wypchlo 34eb822cf8 explain env vars 2021-06-17 13:45:53 +02:00
Karol Wypchlo f6299e4e9d use SKYNET_SERVER_API in discord bot 2021-06-16 16:50:05 +02:00
Karol Wypchlo 49bb6dd2e2 fix portal size check reporting zero files 2021-06-15 11:41:01 +02:00
Karol Wypchło b8a6816876
fixed health check blowing up on eu-fin-3 (#838) 
* request 127.0.0.1 over https - http localhost causes issues

* reformat with black
 2021-06-07 15:08:18 +02:00
Karol Wypchło 7c344e7d4e
Merge pull request #773 from SkynetLabs/fil-ssh-key-fix 
Fix email in Fil ssh key
 2021-05-26 18:30:54 +02:00
firyx 86f6dcbd0f
Merge pull request #771 from SkynetLabs/ssh-marcin 
Add Marcin's ssh key
 2021-05-24 20:45:17 +02:00
Marcin S 75fb474895
Switch to ed25519 and change key comment 2021-05-21 10:12:41 -04:00
Ivaylo Novakov e3066604c0
Block outgoing traffic to local networks. 2021-05-18 11:41:25 +02:00
Filip Rysavy 89e21e22f3 Fix email in Fil ssh key 2021-05-18 11:26:51 +02:00
Ivaylo Novakov 09fc534249
Merge pull request #752 from SkynetLabs/ivo/db_backups_fix 
Fix DB backups creation
 2021-05-18 10:38:53 +02:00
Marcin S 0763526b77
Add Marcin's ssh key 2021-05-17 14:38:31 -04:00
Karol Wypchło 670cecbebf
Merge branch 'master' into deploy-machine-ssh-key 2021-05-12 11:02:38 +02:00
Ivaylo Novakov 03e9fbf481
Update awscli every time we run the script, otherwise Python will break randomly. 2021-05-11 11:26:11 +02:00
Karol Wypchło a910e8a8bb
Karol's new ed25519 ssh key (#720) 
* add my new ed25519 ssh key

* remove old David'd key

* update emails on employees ssh keys

* update PJ ssh key

* update PJ email

Co-authored-by: PJ <peterjan.brone@gmail.com>
 2021-05-10 16:27:47 +02:00
firyx e2bd227d78
Update SSH key user with FQDN 2021-05-06 10:13:13 +02:00
Filip Rysavy e8e953d3e9 Add deployment machine SSH key 2021-05-05 11:34:59 +02:00
Ivaylo Novakov 865b3fbc9a
Add the new deps to be installed. 2021-05-04 13:55:17 +02:00
Karol Wypchlo cd7dac5b7e verbose => extended 2021-04-29 13:43:40 +02:00
Karol Wypchło ddf56dc21b
Update setup-scripts/README.md 2021-04-20 13:08:24 +02:00
Karol Wypchlo 89573df976 adjust readme 2021-04-20 11:56:06 +02:00
Karol Wypchlo 163f29ce78 replace DOMAIN_NAME with SSL_CERTIFICATE_STRING 2021-04-20 11:45:40 +02:00
Karol Wypchlo 143ef617fe set defaults for caddyfile 2021-04-20 11:09:01 +02:00
Karol Wypchlo 1034e7b572 Merge remote-tracking branch 'origin/master' into website 2021-04-15 11:04:22 +02:00
Matthew Sevey 0a0b17e455
Sevey: update ssh key 2021-04-14 11:34:17 -04:00
Karol Wypchlo 1c99da3af8 fix repair string 2021-04-14 12:17:01 +02:00
Karol Wypchlo f48a8d9302 fix health-check 2021-04-13 16:19:42 +02:00
Ivaylo Novakov 7ecb234072
Better cron for backups. 2021-04-13 12:08:26 +02:00
Ivaylo Novakov 6971b3938b
Update the READMEs after setting up a couple of portals. 2021-04-06 18:12:24 +02:00
Ivaylo Novakov 482f9655c4
Merge branch 'ivo/db_backups' into ivo/db_backups_new 2021-04-01 15:30:06 +02:00
Karol Wypchło fede204c6b
Accounts (#554) 
* stripe env

* stripe env

* stripe env

* allow post

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* favicon

* foo

* foo

* foo

* foo

* foo

* foo

* title

* fix dashboard timestamp

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* prices

* Revert "prices"

This reverts commit 7071ed4ef4.

* Make sure we don't accidentally commit `kratos.yml`.

* Add Oathkeeper access rules for Stripe.

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* Add `max_breaches` to Kratos's sample config file.

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* cache .next folder

* Use own fork of Kratos's `master` in order to get the fix for the migrations issue.

* Don't retry running Kratos migrations.

* payments

* restart: no

* no

* no

* no

* no

* no

* no

* no

* no

* no

* payments

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* limits

* limits

* nginx depends on accounts and kratos-migrate depends on cockroach.

* upload limit rate

* upload limit rate - 2

* upload limit rate - 3

* upload limit rate - 4

* upload limit rate - 5

* upload limit rate - 6

* upload limit rate - 7

* upload limit rate - 8

* upload limit rate - 9

* forgotten password link

* use header for skylink

* use header for skylink

* use header for skylink

* use header for skylink

* use header for skylink

* use header for skylink

* use header for skylink

* use header for skylink

* copy to clipboard

* fix ratelimit issue

* Allow access to the stripe webhook.

* enable allow_promotion_codes

* Allow POST on webhook.

* Add all env vars accounts need to docker-compose.

* Don't use custom port for accounts.

* print recovery

* recovery sign up link

* refactor cors header response

* refactor cors header response

* do not log unauthorized

* fix registration link

* settings logging

* update node and tailwindcss

* move webapp from volume

* host 0.0.0.0

* refactor dockerfile

* enable accounts

* cache public

* uncache public

* remove cache control

* no-cache

* no cache

* Do not use the person's name for registration.

* add verify route

* add verify route

* add verify route

* Go back to using the stock kratos image.

* add verify route

* fix settings link

* clean up verify flow

* refactor Dockerfile

* Remove first and last name from used traits.

* Remove account verification via email.

* Allow additional properties.

* Cookies and tokens last for 30 days now.

* Rename secure.siasky.net to account.siasky.net.

* redirect secure to account

Co-authored-by: Ivaylo Novakov <inovakov@gmail.com>
Co-authored-by: Ivaylo Novakov <ro-tex@users.noreply.github.com>
 2021-04-01 15:15:37 +02:00
Karol Wypchlo aee6976734 xrange 2021-03-05 23:53:19 +01:00
Karol Wypchlo eda08a22bf batching 2021-03-05 23:53:12 +01:00
Karol Wypchlo 1762c7f7b7 fixed writing to file 2021-03-05 23:52:47 +01:00
Karol Wypchlo e816a33da1 blocklist from file 2021-03-05 23:52:38 +01:00
Karol Wypchlo a16b724583 do not try to attach an empty file 2021-03-03 14:34:27 +01:00
Karol Wypchlo 44b7a85285 filter empty skylinks 2021-03-03 14:07:29 +01:00
Karol Wypchlo e534aaebca fix empty Link 2021-03-02 17:33:15 +01:00
Karol Wypchlo c791f3bf08 passing '' to int() throws an error 2021-03-02 16:44:56 +01:00
Karol Wypchlo 6186d7439f filter invalid skylinks 2021-03-02 13:44:27 +01:00
Karol Wypchlo 4f055528ca filter invalid skylinks 2021-03-02 13:41:23 +01:00
Karol Wypchlo bf0d8f2145 filter invalid skylinks 2021-03-02 13:40:18 +01:00
Karol Wypchlo f306a1f408 remove leftover 2021-03-02 12:43:23 +01:00
Karol Wypchlo 7e717021f4 black 2021-03-01 23:39:28 +01:00
Karol Wypchlo 43ddd484c2 pagination 2021-03-01 23:22:53 +01:00
Karol Wypchlo e14a03c912 pagination 2021-03-01 23:15:54 +01:00
Karol Wypchlo 3b5d09ec73 pagination 2021-03-01 23:13:28 +01:00
Karol Wypchlo 002ae6c6d8 pagination 2021-03-01 23:08:38 +01:00
Karol Wypchlo 6af13b4715 typo 2021-03-01 18:50:01 +01:00
Karol Wypchlo d9ed1decf6 typo 2021-03-01 18:42:33 +01:00
Karol Wypchlo 1d9215fdd1 typo 2021-03-01 18:41:41 +01:00
Karol Wypchlo b92bfe0150 typo 2021-03-01 18:40:39 +01:00
Karol Wypchlo 5473468dc8 purging script 2021-03-01 18:39:43 +01:00
Karol Wypchlo ea8ccba3fa print cached files 2021-03-01 18:26:38 +01:00
Karol Wypchlo ec77e16806 fix grep pattern 2021-03-01 17:58:43 +01:00
Karol Wypchlo 0677e7c933 clear nginx cache 2021-03-01 17:56:30 +01:00
Karol Wypchlo 1c9bdd4dc6 notification 2021-03-01 17:22:43 +01:00
Karol Wypchlo fb0ab9bb50 better error handling 2021-03-01 17:21:53 +01:00
Karol Wypchlo 937fe052b3 better error handling 2021-03-01 17:20:42 +01:00
Karol Wypchlo 0d8b50e5a2 better error handling 2021-03-01 17:19:13 +01:00
Karol Wypchlo 46fd77a2e2 AIRTABLE_API_KEY 2021-03-01 17:13:00 +01:00
Karol Wypchlo cfd74fc26e AIRTABLE_API_KEY 2021-03-01 17:11:12 +01:00
Karol Wypchlo acf83ec621 running param 2021-03-01 17:09:18 +01:00
Karol Wypchlo b0d49e2f2f more logging 2021-03-01 17:08:10 +01:00
Karol Wypchlo ac5dc3eca7 discord integration 2021-03-01 16:59:38 +01:00
Karol Wypchlo 98160a0fc8 crontab update 2021-03-01 16:49:08 +01:00
Karol Wypchlo 6a8b9e7ceb airtable blocklist integration 2021-03-01 16:47:06 +01:00
Chris Schinnerl 7661aff6e3 Chris: update ssh key 2021-02-26 15:32:41 +01:00
Karol Wypchlo 9853e6e197 include SKYNET_PORTAL_API in setup script 2021-02-18 10:43:20 +01:00
firyx 2b98943e20
Update authorized_keys 2021-02-12 12:38:22 +01:00
Karol Wypchło 5f15005f44
adjust funds notifications (#615) 2021-02-12 11:39:56 +01:00
Matthew Sevey c752a17058
Update setup-scripts/health-checker.py 2021-02-03 10:30:27 -07:00
Matthew Sevey 50dff35da8
Update setup-scripts/health-checker.py 
Co-authored-by: Marcin S. <scatman@bu.edu>
 2021-02-03 10:22:24 -07:00
Matthew Sevey ff183beb66 Add repair size information to health checker 2021-02-03 09:42:55 -07:00
Karol Wypchlo 75b2eeb9ae do not install authorized_keys by default 2021-01-29 23:26:41 +01:00
Karol Wypchło e9aecafb09
set timezone to utc on server setup (#588) 2021-01-20 15:52:30 +01:00
Karol Wypchło c0673b3f76
do not ping when server is in maintenance mode (#552) 2020-12-01 13:31:59 +01:00
Karol Wypchlo 443eacc844 print wallet address on low funds 2020-11-27 17:13:41 +01:00
Matthew Sevey 5f76d1ca52 remove error alert notification, subtract out siafile alerts 2020-11-24 07:49:51 -07:00
Karol Wypchlo 2dfb6d6a56 restore "or" 2020-11-24 15:26:51 +01:00
Karol Wypchlo 383144b7a6 tweak notifications on number of files in a node 2020-11-24 13:16:25 +01:00
Karol Wypchlo 7946f97d58 tweak notifications on error alerts 2020-11-24 13:08:08 +01:00
Ivaylo Novakov 41460f155f
Moved the container name var to the global space where it belongs. 2020-11-20 22:08:04 +01:00
Ivaylo Novakov 801597ccde
Fixed some typos. 
Fixed formatting (force of habit...).
 2020-11-20 21:45:19 +01:00
Matthew Sevey 05cd1bfb32 fix weird formatting 2020-11-20 11:46:35 -07:00
Matthew Sevey a337b754a8 run python format 2020-11-20 11:33:07 -07:00
Matthew Sevey efc6060924 scripts: update file health check to check siac output. Add total files check 2020-11-20 11:26:20 -07:00
Matthew Sevey 243d084b5d update message for siafile bad health 2020-11-18 11:04:04 -07:00
Matthew Sevey 09a4b646ec srcipts: add alert check to the python scripts 2020-11-18 10:21:06 -07:00
Karol Wypchlo 05e34b5aaa rename blacklist to blocklist 2020-11-13 17:29:40 +01:00
Karol Wypchlo d4d3f6977b change recommended renewal from 8 weeks to 4 weeks 2020-10-30 13:38:17 +01:00
Karol Wypchlo f732df9660 fix crontab setup script 2020-10-27 16:39:00 +01:00
Karol Wypchlo 1922c4cd98 use os.popopen manually 2020-10-06 12:12:19 +02:00
Karol Wypchlo 9b6d61aa7e remove unnecessary time dependency 2020-10-06 11:27:06 +02:00
Karol Wypchlo 60f8371170 stop sia container on critical disk space threshold 2020-10-06 11:24:18 +02:00
Karol Wypchlo 2328e605b7 parse disk size as int before multiplying 2020-10-05 10:03:10 +02:00
Karol Wypchło e58752571e
add response content to health check failures (#437) 2020-09-30 16:20:55 +02:00
Karol Wypchlo bc879b51cc update log message 2020-09-29 15:46:40 +02:00
Karol Wypchlo e7e7adc141 get api password from docker container 2020-09-29 15:42:41 +02:00
Karol Wypchło 468527c22d
add portal_subdomain to nginx regex and fill documentation (#435) 2020-09-29 12:35:34 +02:00
Karol Wypchło 10a251c081
reimplement health checks (#434) 2020-09-29 12:32:45 +02:00
Matthew Sevey 998bacd93a Add ssh pubkey for Sevey 2020-09-25 11:54:34 -04:00
Peter-Jan Brone f3b2a130fe
Wildcard Subdomains Documentation (#416) 
* Add documentation on subdomains

* Update copy

* Fix typo

* Link Karol his repo

* Update copy

* Update setup-scripts/README.md

Co-authored-by: Karol Wypchło <kwypchlo@gmail.com>

Co-authored-by: Karol Wypchło <kwypchlo@gmail.com>
 2020-09-22 12:23:53 +02:00
Karol Wypchło dc73367a66
Merge pull request #371 from NebulousLabs/safe-restart-scripts 
add safe stop and restart sia scripts
 2020-09-18 17:08:19 +02:00
Karol Wypchło 08782de656
update ssh keys 2020-09-17 15:50:47 +02:00
Karol Wypchlo a02c27664b adjust scripts 2020-09-14 17:40:18 +02:00
Karol Wypchlo abacfc1ed1 improve docs 2020-09-14 15:57:44 +02:00
Karol Wypchlo 4f849ddf53 change comments 2020-09-14 15:53:27 +02:00
Karol Wypchlo 2c12b9d009 add safe stop and restart sia scripts 2020-09-14 15:53:27 +02:00
Karol Wypchlo 6acd3309f8 fix blacklist command 2020-09-14 14:45:06 +02:00
Karol Wypchlo 20362fe7c5 fix health checks 2020-09-10 15:16:31 +02:00
Ivaylo Novakov 8235d75795
Only announce healthy status once a day. 2020-09-08 18:20:56 +02:00
Ivaylo Novakov ddf72ad850
Make the time comparisons in the health checker timezone-aware. 2020-09-08 18:07:33 +02:00
Ivaylo Novakov 2d032dbf17
Docstrings. 2020-09-07 17:59:39 +02:00
Ivaylo Novakov 0838e4f5e5
Add free disk space check to health-checker.py. 
Move load-average check to health-checker.py.
 2020-09-07 17:56:47 +02:00
Ivaylo Novakov 3f4742a436
Only notify the team if critical checks have failed. 2020-09-04 17:17:26 +02:00
Ivaylo Novakov 5eece67b03
Move parameter parsing to the top of the script. 2020-09-04 17:13:36 +02:00
Ivaylo Novakov 1cc20903c6
Move max discord message len to a constant. 
Report critical checks failed.
Formatting.
 2020-09-04 17:07:47 +02:00
Ivaylo Novakov a0a9137ae7
Update setup-scripts/health-checker.py 
Co-authored-by: Karol Wypchło <kwypchlo@gmail.com>
 2020-09-04 16:44:19 +02:00
Ivaylo Novakov 62e27120cd
Use localhost. 2020-09-04 16:39:39 +02:00
Ivaylo Novakov 59a77bfaf6
Add a health checker script to Gollum. 2020-09-04 16:12:20 +02:00
Matthew Sevey a911b36f56 Add severe check to log checker 2020-09-03 10:53:52 -04:00
Ivaylo Novakov 25cf5625b4
3 seconds timeout. 2020-08-31 13:39:07 +02:00
Ivaylo Novakov 2fc6d30c01
Use `os._exit` instead of `sys.exit` - we don't want to raise an exception. 2020-08-31 13:38:45 +02:00
Ivaylo Novakov 8761a77e18
Don't call `await client.close()`. 2020-08-31 13:27:49 +02:00
Ivaylo Novakov ff8c4c2d78
Merge pull request #360 from NebulousLabs/ivo/check_system_load 
Check system load
 2020-08-31 13:25:50 +02:00
Ivaylo Novakov 59bad59cb7
Make it clear that the uptime data comes from the `uptime` command and not something we're putting together ourselves. 2020-08-28 16:05:24 +02:00
Karol Wypchlo df7decb06c drop Marcin's key 2020-08-28 14:56:01 +02:00
Ivaylo Novakov 58409b8cee
Switch from the "1 minute" to "15 minutes" average. 2020-08-28 11:59:27 +02:00
Ivaylo Novakov efb35054f7
When chekcing logs, check also the system load and report it if it's above 10. 2020-08-28 11:54:47 +02:00
Ivaylo Novakov 2126115df4
Send the last 1MB of error log as a file. 2020-08-26 11:32:58 +03:00
Ivaylo Novakov 3b0c597516
Limit the errors sent in a discord message to under 2000 characters (including prefix message). 2020-08-26 11:13:16 +03:00
Ivaylo Novakov 0eb8ab0d7c
Use a clearer log message and add some debug output. 2020-08-24 12:33:03 +03:00
Ivaylo Novakov af49e65b04
Switch from `/home/user/.sia/sia.env` to `/home/user/skynet-webportal/.env`. 2020-08-19 19:14:55 +03:00
Ivaylo Novakov 341c65eba8
Remove unneeded comment and example commands. 2020-08-19 16:13:56 +03:00
Ivaylo Novakov 81acebad5c
Add the forced exit to funds-checker.py as well. 2020-08-19 10:25:23 +03:00
Ivaylo Novakov 19fff428cd
Move code to the right place. 2020-08-19 10:17:26 +03:00