LumeWeb
/
skynet-webportal
Archived
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
4,936 Commits 38 Branches 120 Tags 50 MiB
Commit Graph

364 Commits

Author SHA1 Message Date
Karol Wypchlo 7f448fb31f smaller batch fix 2021-07-18 09:25:23 +02:00
Karol Wypchlo ed19736e22 smaller batch 2021-07-18 09:24:45 +02:00
Karol Wypchlo 6c1b96606e one less search 2021-07-18 09:17:29 +02:00
Karol Wypchlo 7c9d1debd2 one less search 2021-07-18 09:13:30 +02:00
Karol Wypchlo 73cf5b510e improve 2021-07-18 09:10:54 +02:00
Karol Wypchlo 52e5a345cf improve 2021-07-18 09:09:55 +02:00
Karol Wypchlo 273bcbcb8f fix cache busting 2021-07-18 09:07:15 +02:00
Karol Wypchlo fdee9b46ee concatenate string 2021-07-18 08:55:29 +02:00
Karol Wypchlo 96ade5f36d airtable retries logic 2021-07-18 08:22:32 +02:00
Karol Wypchło bdff7bb0b1
Update setup-scripts/setup-health-check-scripts.sh 
Co-authored-by: firyx <29089732+firyx@users.noreply.github.com>
 2021-07-16 14:38:02 +02:00
Karol Wypchlo fc10a49054 DiscordWebhook => discord_webhook 2021-07-16 14:31:19 +02:00
Karol Wypchło 71f9d5280e
use webhook instead of discrod bot to send messages (#979) 
* initial refactor

* do not use before define

* forgot to remove client

* test notification

* add /cc

* fix /cc

* fix /cc role

* fix /cc

* test file upload

* test file upload

* test file upload

* default to no mentions

* unformat

* replace discord with DiscordWebhook

* add readme

* don't fail on failures in message send
 2021-07-16 13:12:58 +02:00
Karol Wypchlo 36aa7c8311 improve health check reliability 2021-07-12 14:53:12 +02:00
Karol Wypchlo a2aa850632 improve health check reliability 2021-07-12 14:49:53 +02:00
Karol Wypchlo 7fd97b5824 improve health check reliability 2021-07-12 14:48:13 +02:00
Karol Wypchlo af80a84094 server-health => skynet-server-health 2021-06-30 15:31:38 +02:00
Karol Wypchlo fde760ec86 add option to pass channel and notify role to health check script 2021-06-30 15:15:51 +02:00
Karol Wypchlo a6b9f1fe06 clean up webapp directory and update some deps 2021-06-17 14:40:02 +02:00
Karol Wypchlo 34eb822cf8 explain env vars 2021-06-17 13:45:53 +02:00
Karol Wypchlo f6299e4e9d use SKYNET_SERVER_API in discord bot 2021-06-16 16:50:05 +02:00
Karol Wypchlo 49bb6dd2e2 fix portal size check reporting zero files 2021-06-15 11:41:01 +02:00
Karol Wypchło b8a6816876
fixed health check blowing up on eu-fin-3 (#838) 
* request 127.0.0.1 over https - http localhost causes issues

* reformat with black
 2021-06-07 15:08:18 +02:00
Karol Wypchło 7c344e7d4e
Merge pull request #773 from SkynetLabs/fil-ssh-key-fix 
Fix email in Fil ssh key
 2021-05-26 18:30:54 +02:00
firyx 86f6dcbd0f
Merge pull request #771 from SkynetLabs/ssh-marcin 
Add Marcin's ssh key
 2021-05-24 20:45:17 +02:00
Marcin S 75fb474895
Switch to ed25519 and change key comment 2021-05-21 10:12:41 -04:00
Ivaylo Novakov e3066604c0
Block outgoing traffic to local networks. 2021-05-18 11:41:25 +02:00
Filip Rysavy 89e21e22f3 Fix email in Fil ssh key 2021-05-18 11:26:51 +02:00
Ivaylo Novakov 09fc534249
Merge pull request #752 from SkynetLabs/ivo/db_backups_fix 
Fix DB backups creation
 2021-05-18 10:38:53 +02:00
Marcin S 0763526b77
Add Marcin's ssh key 2021-05-17 14:38:31 -04:00
Karol Wypchło 670cecbebf
Merge branch 'master' into deploy-machine-ssh-key 2021-05-12 11:02:38 +02:00
Ivaylo Novakov 03e9fbf481
Update awscli every time we run the script, otherwise Python will break randomly. 2021-05-11 11:26:11 +02:00
Karol Wypchło a910e8a8bb
Karol's new ed25519 ssh key (#720) 
* add my new ed25519 ssh key

* remove old David'd key

* update emails on employees ssh keys

* update PJ ssh key

* update PJ email

Co-authored-by: PJ <peterjan.brone@gmail.com>
 2021-05-10 16:27:47 +02:00
firyx e2bd227d78
Update SSH key user with FQDN 2021-05-06 10:13:13 +02:00
Filip Rysavy e8e953d3e9 Add deployment machine SSH key 2021-05-05 11:34:59 +02:00
Ivaylo Novakov 865b3fbc9a
Add the new deps to be installed. 2021-05-04 13:55:17 +02:00
Karol Wypchlo cd7dac5b7e verbose => extended 2021-04-29 13:43:40 +02:00
Karol Wypchło ddf56dc21b
Update setup-scripts/README.md 2021-04-20 13:08:24 +02:00
Karol Wypchlo 89573df976 adjust readme 2021-04-20 11:56:06 +02:00
Karol Wypchlo 163f29ce78 replace DOMAIN_NAME with SSL_CERTIFICATE_STRING 2021-04-20 11:45:40 +02:00
Karol Wypchlo 143ef617fe set defaults for caddyfile 2021-04-20 11:09:01 +02:00
Karol Wypchlo 1034e7b572 Merge remote-tracking branch 'origin/master' into website 2021-04-15 11:04:22 +02:00
Matthew Sevey 0a0b17e455
Sevey: update ssh key 2021-04-14 11:34:17 -04:00
Karol Wypchlo 1c99da3af8 fix repair string 2021-04-14 12:17:01 +02:00
Karol Wypchlo f48a8d9302 fix health-check 2021-04-13 16:19:42 +02:00
Ivaylo Novakov 7ecb234072
Better cron for backups. 2021-04-13 12:08:26 +02:00
Ivaylo Novakov 6971b3938b
Update the READMEs after setting up a couple of portals. 2021-04-06 18:12:24 +02:00
Ivaylo Novakov 482f9655c4
Merge branch 'ivo/db_backups' into ivo/db_backups_new 2021-04-01 15:30:06 +02:00
Karol Wypchło fede204c6b
Accounts (#554) 
* stripe env

* stripe env

* stripe env

* allow post

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* accounts/**

* favicon

* foo

* foo

* foo

* foo

* foo

* foo

* title

* fix dashboard timestamp

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* prices

* Revert "prices"

This reverts commit 7071ed4ef4.

* Make sure we don't accidentally commit `kratos.yml`.

* Add Oathkeeper access rules for Stripe.

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* Add `max_breaches` to Kratos's sample config file.

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* payments

* cache .next folder

* Use own fork of Kratos's `master` in order to get the fix for the migrations issue.

* Don't retry running Kratos migrations.

* payments

* restart: no

* no

* no

* no

* no

* no

* no

* no

* no

* no

* payments

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* accounts

* limits

* limits

* nginx depends on accounts and kratos-migrate depends on cockroach.

* upload limit rate

* upload limit rate - 2

* upload limit rate - 3

* upload limit rate - 4

* upload limit rate - 5

* upload limit rate - 6

* upload limit rate - 7

* upload limit rate - 8

* upload limit rate - 9

* forgotten password link

* use header for skylink

* use header for skylink

* use header for skylink

* use header for skylink

* use header for skylink

* use header for skylink

* use header for skylink

* use header for skylink

* copy to clipboard

* fix ratelimit issue

* Allow access to the stripe webhook.

* enable allow_promotion_codes

* Allow POST on webhook.

* Add all env vars accounts need to docker-compose.

* Don't use custom port for accounts.

* print recovery

* recovery sign up link

* refactor cors header response

* refactor cors header response

* do not log unauthorized

* fix registration link

* settings logging

* update node and tailwindcss

* move webapp from volume

* host 0.0.0.0

* refactor dockerfile

* enable accounts

* cache public

* uncache public

* remove cache control

* no-cache

* no cache

* Do not use the person's name for registration.

* add verify route

* add verify route

* add verify route

* Go back to using the stock kratos image.

* add verify route

* fix settings link

* clean up verify flow

* refactor Dockerfile

* Remove first and last name from used traits.

* Remove account verification via email.

* Allow additional properties.

* Cookies and tokens last for 30 days now.

* Rename secure.siasky.net to account.siasky.net.

* redirect secure to account

Co-authored-by: Ivaylo Novakov <inovakov@gmail.com>
Co-authored-by: Ivaylo Novakov <ro-tex@users.noreply.github.com>
 2021-04-01 15:15:37 +02:00
Karol Wypchlo aee6976734 xrange 2021-03-05 23:53:19 +01:00
Karol Wypchlo eda08a22bf batching 2021-03-05 23:53:12 +01:00
Karol Wypchlo 1762c7f7b7 fixed writing to file 2021-03-05 23:52:47 +01:00
Karol Wypchlo e816a33da1 blocklist from file 2021-03-05 23:52:38 +01:00
Karol Wypchlo a16b724583 do not try to attach an empty file 2021-03-03 14:34:27 +01:00
Karol Wypchlo 44b7a85285 filter empty skylinks 2021-03-03 14:07:29 +01:00
Karol Wypchlo e534aaebca fix empty Link 2021-03-02 17:33:15 +01:00
Karol Wypchlo c791f3bf08 passing '' to int() throws an error 2021-03-02 16:44:56 +01:00
Karol Wypchlo 6186d7439f filter invalid skylinks 2021-03-02 13:44:27 +01:00
Karol Wypchlo 4f055528ca filter invalid skylinks 2021-03-02 13:41:23 +01:00
Karol Wypchlo bf0d8f2145 filter invalid skylinks 2021-03-02 13:40:18 +01:00
Karol Wypchlo f306a1f408 remove leftover 2021-03-02 12:43:23 +01:00
Karol Wypchlo 7e717021f4 black 2021-03-01 23:39:28 +01:00
Karol Wypchlo 43ddd484c2 pagination 2021-03-01 23:22:53 +01:00
Karol Wypchlo e14a03c912 pagination 2021-03-01 23:15:54 +01:00
Karol Wypchlo 3b5d09ec73 pagination 2021-03-01 23:13:28 +01:00
Karol Wypchlo 002ae6c6d8 pagination 2021-03-01 23:08:38 +01:00
Karol Wypchlo 6af13b4715 typo 2021-03-01 18:50:01 +01:00
Karol Wypchlo d9ed1decf6 typo 2021-03-01 18:42:33 +01:00
Karol Wypchlo 1d9215fdd1 typo 2021-03-01 18:41:41 +01:00
Karol Wypchlo b92bfe0150 typo 2021-03-01 18:40:39 +01:00
Karol Wypchlo 5473468dc8 purging script 2021-03-01 18:39:43 +01:00
Karol Wypchlo ea8ccba3fa print cached files 2021-03-01 18:26:38 +01:00
Karol Wypchlo ec77e16806 fix grep pattern 2021-03-01 17:58:43 +01:00
Karol Wypchlo 0677e7c933 clear nginx cache 2021-03-01 17:56:30 +01:00
Karol Wypchlo 1c9bdd4dc6 notification 2021-03-01 17:22:43 +01:00
Karol Wypchlo fb0ab9bb50 better error handling 2021-03-01 17:21:53 +01:00
Karol Wypchlo 937fe052b3 better error handling 2021-03-01 17:20:42 +01:00
Karol Wypchlo 0d8b50e5a2 better error handling 2021-03-01 17:19:13 +01:00
Karol Wypchlo 46fd77a2e2 AIRTABLE_API_KEY 2021-03-01 17:13:00 +01:00
Karol Wypchlo cfd74fc26e AIRTABLE_API_KEY 2021-03-01 17:11:12 +01:00
Karol Wypchlo acf83ec621 running param 2021-03-01 17:09:18 +01:00
Karol Wypchlo b0d49e2f2f more logging 2021-03-01 17:08:10 +01:00
Karol Wypchlo ac5dc3eca7 discord integration 2021-03-01 16:59:38 +01:00
Karol Wypchlo 98160a0fc8 crontab update 2021-03-01 16:49:08 +01:00
Karol Wypchlo 6a8b9e7ceb airtable blocklist integration 2021-03-01 16:47:06 +01:00
Chris Schinnerl 7661aff6e3 Chris: update ssh key 2021-02-26 15:32:41 +01:00
Karol Wypchlo 9853e6e197 include SKYNET_PORTAL_API in setup script 2021-02-18 10:43:20 +01:00
firyx 2b98943e20
Update authorized_keys 2021-02-12 12:38:22 +01:00
Karol Wypchło 5f15005f44
adjust funds notifications (#615) 2021-02-12 11:39:56 +01:00
Matthew Sevey c752a17058
Update setup-scripts/health-checker.py 2021-02-03 10:30:27 -07:00
Matthew Sevey 50dff35da8
Update setup-scripts/health-checker.py 
Co-authored-by: Marcin S. <scatman@bu.edu>
 2021-02-03 10:22:24 -07:00
Matthew Sevey ff183beb66 Add repair size information to health checker 2021-02-03 09:42:55 -07:00
Karol Wypchlo 75b2eeb9ae do not install authorized_keys by default 2021-01-29 23:26:41 +01:00
Karol Wypchło e9aecafb09
set timezone to utc on server setup (#588) 2021-01-20 15:52:30 +01:00
Karol Wypchło c0673b3f76
do not ping when server is in maintenance mode (#552) 2020-12-01 13:31:59 +01:00
Karol Wypchlo 443eacc844 print wallet address on low funds 2020-11-27 17:13:41 +01:00
Matthew Sevey 5f76d1ca52 remove error alert notification, subtract out siafile alerts 2020-11-24 07:49:51 -07:00
Karol Wypchlo 2dfb6d6a56 restore "or" 2020-11-24 15:26:51 +01:00
Karol Wypchlo 383144b7a6 tweak notifications on number of files in a node 2020-11-24 13:16:25 +01:00
Karol Wypchlo 7946f97d58 tweak notifications on error alerts 2020-11-24 13:08:08 +01:00
Ivaylo Novakov 41460f155f
Moved the container name var to the global space where it belongs. 2020-11-20 22:08:04 +01:00
Ivaylo Novakov 801597ccde
Fixed some typos. 
Fixed formatting (force of habit...).
 2020-11-20 21:45:19 +01:00
Matthew Sevey 05cd1bfb32 fix weird formatting 2020-11-20 11:46:35 -07:00
Matthew Sevey a337b754a8 run python format 2020-11-20 11:33:07 -07:00
Matthew Sevey efc6060924 scripts: update file health check to check siac output. Add total files check 2020-11-20 11:26:20 -07:00
Matthew Sevey 243d084b5d update message for siafile bad health 2020-11-18 11:04:04 -07:00
Matthew Sevey 09a4b646ec srcipts: add alert check to the python scripts 2020-11-18 10:21:06 -07:00
Karol Wypchlo 05e34b5aaa rename blacklist to blocklist 2020-11-13 17:29:40 +01:00
Karol Wypchlo d4d3f6977b change recommended renewal from 8 weeks to 4 weeks 2020-10-30 13:38:17 +01:00
Karol Wypchlo f732df9660 fix crontab setup script 2020-10-27 16:39:00 +01:00
Karol Wypchlo 1922c4cd98 use os.popopen manually 2020-10-06 12:12:19 +02:00
Karol Wypchlo 9b6d61aa7e remove unnecessary time dependency 2020-10-06 11:27:06 +02:00
Karol Wypchlo 60f8371170 stop sia container on critical disk space threshold 2020-10-06 11:24:18 +02:00
Karol Wypchlo 2328e605b7 parse disk size as int before multiplying 2020-10-05 10:03:10 +02:00
Karol Wypchło e58752571e
add response content to health check failures (#437) 2020-09-30 16:20:55 +02:00
Karol Wypchlo bc879b51cc update log message 2020-09-29 15:46:40 +02:00
Karol Wypchlo e7e7adc141 get api password from docker container 2020-09-29 15:42:41 +02:00
Karol Wypchło 468527c22d
add portal_subdomain to nginx regex and fill documentation (#435) 2020-09-29 12:35:34 +02:00
Karol Wypchło 10a251c081
reimplement health checks (#434) 2020-09-29 12:32:45 +02:00
Matthew Sevey 998bacd93a Add ssh pubkey for Sevey 2020-09-25 11:54:34 -04:00
Peter-Jan Brone f3b2a130fe
Wildcard Subdomains Documentation (#416) 
* Add documentation on subdomains

* Update copy

* Fix typo

* Link Karol his repo

* Update copy

* Update setup-scripts/README.md

Co-authored-by: Karol Wypchło <kwypchlo@gmail.com>

Co-authored-by: Karol Wypchło <kwypchlo@gmail.com>
 2020-09-22 12:23:53 +02:00
Karol Wypchło dc73367a66
Merge pull request #371 from NebulousLabs/safe-restart-scripts 
add safe stop and restart sia scripts
 2020-09-18 17:08:19 +02:00
Karol Wypchło 08782de656
update ssh keys 2020-09-17 15:50:47 +02:00
Karol Wypchlo a02c27664b adjust scripts 2020-09-14 17:40:18 +02:00
Karol Wypchlo abacfc1ed1 improve docs 2020-09-14 15:57:44 +02:00
Karol Wypchlo 4f849ddf53 change comments 2020-09-14 15:53:27 +02:00
Karol Wypchlo 2c12b9d009 add safe stop and restart sia scripts 2020-09-14 15:53:27 +02:00
Karol Wypchlo 6acd3309f8 fix blacklist command 2020-09-14 14:45:06 +02:00
Karol Wypchlo 20362fe7c5 fix health checks 2020-09-10 15:16:31 +02:00
Ivaylo Novakov 8235d75795
Only announce healthy status once a day. 2020-09-08 18:20:56 +02:00
Ivaylo Novakov ddf72ad850
Make the time comparisons in the health checker timezone-aware. 2020-09-08 18:07:33 +02:00
Ivaylo Novakov 2d032dbf17
Docstrings. 2020-09-07 17:59:39 +02:00
Ivaylo Novakov 0838e4f5e5
Add free disk space check to health-checker.py. 
Move load-average check to health-checker.py.
 2020-09-07 17:56:47 +02:00
Ivaylo Novakov 3f4742a436
Only notify the team if critical checks have failed. 2020-09-04 17:17:26 +02:00
Ivaylo Novakov 5eece67b03
Move parameter parsing to the top of the script. 2020-09-04 17:13:36 +02:00
Ivaylo Novakov 1cc20903c6
Move max discord message len to a constant. 
Report critical checks failed.
Formatting.
 2020-09-04 17:07:47 +02:00
Ivaylo Novakov a0a9137ae7
Update setup-scripts/health-checker.py 
Co-authored-by: Karol Wypchło <kwypchlo@gmail.com>
 2020-09-04 16:44:19 +02:00
Ivaylo Novakov 62e27120cd
Use localhost. 2020-09-04 16:39:39 +02:00
Ivaylo Novakov 59a77bfaf6
Add a health checker script to Gollum. 2020-09-04 16:12:20 +02:00
Matthew Sevey a911b36f56 Add severe check to log checker 2020-09-03 10:53:52 -04:00
Ivaylo Novakov 25cf5625b4
3 seconds timeout. 2020-08-31 13:39:07 +02:00
Ivaylo Novakov 2fc6d30c01
Use `os._exit` instead of `sys.exit` - we don't want to raise an exception. 2020-08-31 13:38:45 +02:00
Ivaylo Novakov 8761a77e18
Don't call `await client.close()`. 2020-08-31 13:27:49 +02:00
Ivaylo Novakov ff8c4c2d78
Merge pull request #360 from NebulousLabs/ivo/check_system_load 
Check system load
 2020-08-31 13:25:50 +02:00
Ivaylo Novakov 59bad59cb7
Make it clear that the uptime data comes from the `uptime` command and not something we're putting together ourselves. 2020-08-28 16:05:24 +02:00
Karol Wypchlo df7decb06c drop Marcin's key 2020-08-28 14:56:01 +02:00
Ivaylo Novakov 58409b8cee
Switch from the "1 minute" to "15 minutes" average. 2020-08-28 11:59:27 +02:00
Ivaylo Novakov efb35054f7
When chekcing logs, check also the system load and report it if it's above 10. 2020-08-28 11:54:47 +02:00
Ivaylo Novakov 2126115df4
Send the last 1MB of error log as a file. 2020-08-26 11:32:58 +03:00
Ivaylo Novakov 3b0c597516
Limit the errors sent in a discord message to under 2000 characters (including prefix message). 2020-08-26 11:13:16 +03:00
Ivaylo Novakov 0eb8ab0d7c
Use a clearer log message and add some debug output. 2020-08-24 12:33:03 +03:00