Commit Graph

184 Commits

Author SHA1 Message Date
Ivaylo Novakov 2d032dbf17
Docstrings. 2020-09-07 17:59:39 +02:00
Ivaylo Novakov 0838e4f5e5
Add free disk space check to health-checker.py.
Move load-average check to health-checker.py.
2020-09-07 17:56:47 +02:00
Ivaylo Novakov 3f4742a436
Only notify the team if critical checks have failed. 2020-09-04 17:17:26 +02:00
Ivaylo Novakov 5eece67b03
Move parameter parsing to the top of the script. 2020-09-04 17:13:36 +02:00
Ivaylo Novakov 1cc20903c6
Move max discord message len to a constant.
Report critical checks failed.
Formatting.
2020-09-04 17:07:47 +02:00
Ivaylo Novakov a0a9137ae7
Update setup-scripts/health-checker.py
Co-authored-by: Karol Wypchło <kwypchlo@gmail.com>
2020-09-04 16:44:19 +02:00
Ivaylo Novakov 62e27120cd
Use localhost. 2020-09-04 16:39:39 +02:00
Ivaylo Novakov 59a77bfaf6
Add a health checker script to Gollum. 2020-09-04 16:12:20 +02:00
Matthew Sevey a911b36f56 Add severe check to log checker 2020-09-03 10:53:52 -04:00
Ivaylo Novakov 25cf5625b4
3 seconds timeout. 2020-08-31 13:39:07 +02:00
Ivaylo Novakov 2fc6d30c01
Use `os._exit` instead of `sys.exit` - we don't want to raise an exception. 2020-08-31 13:38:45 +02:00
Ivaylo Novakov 8761a77e18
Don't call `await client.close()`. 2020-08-31 13:27:49 +02:00
Ivaylo Novakov ff8c4c2d78
Merge pull request #360 from NebulousLabs/ivo/check_system_load
Check system load
2020-08-31 13:25:50 +02:00
Ivaylo Novakov 59bad59cb7
Make it clear that the uptime data comes from the `uptime` command and not something we're putting together ourselves. 2020-08-28 16:05:24 +02:00
Karol Wypchlo df7decb06c drop Marcin's key 2020-08-28 14:56:01 +02:00
Ivaylo Novakov 58409b8cee
Switch from the "1 minute" to "15 minutes" average. 2020-08-28 11:59:27 +02:00
Ivaylo Novakov efb35054f7
When chekcing logs, check also the system load and report it if it's above 10. 2020-08-28 11:54:47 +02:00
Ivaylo Novakov 2126115df4
Send the last 1MB of error log as a file. 2020-08-26 11:32:58 +03:00
Ivaylo Novakov 3b0c597516
Limit the errors sent in a discord message to under 2000 characters (including prefix message). 2020-08-26 11:13:16 +03:00
Ivaylo Novakov 0eb8ab0d7c
Use a clearer log message and add some debug output. 2020-08-24 12:33:03 +03:00
Ivaylo Novakov af49e65b04
Switch from `/home/user/.sia/sia.env` to `/home/user/skynet-webportal/.env`. 2020-08-19 19:14:55 +03:00
Ivaylo Novakov 341c65eba8
Remove unneeded comment and example commands. 2020-08-19 16:13:56 +03:00
Ivaylo Novakov 81acebad5c
Add the forced exit to funds-checker.py as well. 2020-08-19 10:25:23 +03:00
Ivaylo Novakov 19fff428cd
Move code to the right place. 2020-08-19 10:17:26 +03:00
Ivaylo Novakov b05af57b54
Cleanup the old function. 2020-08-18 18:37:49 +03:00
Ivaylo Novakov 2a1c06116b
Add a handy command to the readme that checks the logs in a dockerized environment. 2020-08-18 18:36:00 +03:00
Ivaylo Novakov 221902508f
Give the client 10 seconds to properly exits and if it fails to do so `exit` the hard way. 2020-08-18 18:25:54 +03:00
Ivaylo Novakov 00fff39bf2
Add a new log checked for docker. 2020-08-18 17:27:01 +03:00
Karol Wypchlo 259e3ddffa docker setup
docker progress

docker works

env variables
2020-07-31 00:50:42 +02:00
Karol Wypchlo 02b77cfbab clean up after docker changes 2020-07-30 12:00:58 +02:00
Karol Wypchlo cb763241ea give checks more appropriate names 2020-07-28 13:55:42 +02:00
Karol Wypchlo 955425d321 clean up double siad setup 2020-07-28 13:22:07 +02:00
Karol Wypchlo 1dbc842c55 cors 2020-07-27 17:04:21 +02:00
Karol Wypchło a7c57b3c5a
Handshake integration (#302) 2020-07-27 11:30:55 +02:00
Karol Wypchlo 7e06436aa6 do not enable custom.domain by default and improve docs 2020-07-17 21:12:18 +02:00
Karol Wypchlo 79df02fe47 clone whole Sia repo 2020-07-08 14:49:30 +02:00
Karol Wypchlo e97a339789 fix .env file missing 2020-07-08 14:49:06 +02:00
Karol Wypchło f067c50648
Improve server infrastructure setup and scripts (#231) 2020-06-22 11:54:01 +02:00
David cd93302a46
Changed siamux websocket port on upload node (#262) 2020-06-16 22:19:20 +02:00
Karol Wypchlo de1c3e0035 fix api calls that define their own siapath 2020-06-08 10:16:04 +02:00
Karol Wypchlo 5b12f3d41e clear nginx cache after blacklisting 2020-06-01 17:12:57 +02:00
Karol Wypchlo af0e639e6d silence ssh 2020-06-01 11:22:06 +02:00
Karol Wypchlo 9449c34a23 blacklisting script 2020-06-01 11:17:44 +02:00
Delivator d18ce24136 Added levels, use_temp_path and max_size options to cache 2020-05-22 19:27:59 +02:00
Delivator cff9085aae Fixed cache path typo 2020-05-22 17:10:58 +02:00
Delivator 22ca78e219 Update skynet-nginx.conf 2020-05-21 21:59:56 +02:00
Marcin Jachymiak 650e8a23b7 Add limits.conf file 2020-05-19 16:40:59 -04:00
Marcin Jachymiak 3e21ed5a3a Bump version numbers 2020-05-19 16:40:31 -04:00
Marcin Jachymiak 3820a16a9f Increase file limit in systemd services 2020-05-19 16:40:31 -04:00
Karol Wypchlo 33eeb61484 fix proxy_pass for upload not passing query params 2020-05-08 09:49:37 +02:00
Karol Wypchlo 3323ba282a comment adjustment 2020-05-04 17:35:41 +02:00
Karol Wypchlo d875ae2367 uploaded files are stored in random nested directories 2020-05-04 17:35:41 +02:00
Karol Wypchło bb0021de3e fix(typo): skunet => skynet 2020-04-29 18:44:27 +02:00
Karol Wypchlo 0925944e86 fix whitespace encoding for directories 2020-04-29 18:44:27 +02:00
Karol Wypchlo 01bb55507f add /tmp directory cleanup to run every day 2020-04-23 20:02:35 +02:00
Karol Wypchlo bba571c4e3 add frequent downloads cache to improve server responding on popular files 2020-04-23 20:02:02 +02:00
Marcin Jachymiak 0ee522cdcb Clean up message and increase threshold in funds-checker.py 2020-04-14 18:22:37 -04:00
Marcin Jachymiak 2715ab1e9d
Merge pull request #157 from NebulousLabs/update-bots
Update bots
2020-04-14 15:32:52 -04:00
Marcin Jachymiak 06b25382ff Mention role in discord, rather than online users 2020-04-14 14:50:25 -04:00
Marcin Jachymiak 02250ce385 Reduce allowance spending threshold. 2020-04-14 14:50:01 -04:00
David e33ce33651
Changed nginx config to generate random file uuid by default (#149)
* Changed nginx config to generate random file uuid by default

* Added nginx version note to setup readme
2020-04-14 16:06:02 +02:00
Karol Wypchło 250bbdf9d8
include basic ddos protection (#148)
* include basic ddos protection

* more verbose zone names

* set limit http status code to 429
2020-04-07 13:01:38 +02:00
Marcin Jachymiak 321bbd4d0f Fix log checker false positives 2020-03-26 11:12:07 -04:00
Marcin Jachymiak c0e148908e
Merge pull request #124 from NebulousLabs/check-logs-for-panic
Check logs for panics
2020-03-24 13:29:57 -04:00
Karol Wypchło 46400ff39f
Setup scripts improvements (#123)
* fix /Users/karol issue with go path
* do not emit error if /etc/nginx/sites-enabled/default is not found
2020-03-24 15:42:03 +01:00
Marcin Jachymiak a90dc717c6 Check logs for panics 2020-03-24 10:23:09 -04:00
Karol Wypchło fa052550cc
update scripts to support Sia v1.4.4 (#98)
* update scripts to support Sia v1.4.4
* force overwrite symlink
2020-03-20 22:11:20 +01:00
Peter-Jan Brone cd619d7a92
Update Nginx config to use double siad setup (#97)
* Update nginx conf to use double siad setup
* Update documentation
2020-03-19 15:38:34 +01:00
Marcin Jachymiak f7bb6f1493 Add stats endpoints to nginx 2020-03-18 16:36:30 -04:00
Marcin Jachymiak 16fe7acad0 Set siamux port to avoid conflicts 2020-03-18 16:35:48 -04:00
Marcin Jachymiak ccddff4b6a Use journald with persistence 2020-03-13 12:34:42 -04:00
Karol Wypchlo 4e5aca4998 set logs on siad services 2020-03-12 15:24:58 +01:00
Peter-Jan Brone bde39400ae
Expose Skynet-File-Metadata (#86) 2020-03-12 15:15:48 +01:00
Marcin Jachymiak d7ab15a885 Leave TODO about flags 2020-03-10 11:26:02 -04:00
Marcin Jachymiak e7e73977bd Switch log-checks to every 8 hours 2020-03-10 11:25:28 -04:00
Marcin Jachymiak f205f46928 Add hour param to log checker 2020-03-10 11:08:54 -04:00
Peter-Jan Brone 96034cf10d
Directory Upload & Auto UUID (#60) 2020-03-10 14:36:21 +01:00
Karol Wypchło f4760e4481
upload progress status (#73)
* add upload progress status

* resolve cors issues with proxy returning cors error
2020-03-10 14:15:34 +01:00
Marcin Jachymiak bc3e72726e Set force_notify in log check error cases 2020-03-09 16:06:15 -04:00
Marcin Jachymiak 1349440251 Update README and health check setup-scripts 2020-03-09 16:02:16 -04:00
Marcin Jachymiak 285d915602 Rename health-checker to funds-checker 2020-03-09 15:59:21 -04:00
Marcin Jachymiak 6d8fe9ca02 Add log checker 2020-03-09 15:55:03 -04:00
Marcin Jachymiak 4b1ac49ef1 Refactor bot_utils out of health-checker 2020-03-09 12:15:13 -04:00
Peter-Jan Brone 92f07b0dba
Merge pull request #72 from NebulousLabs/large-headers-nginx-issue
add config to get around large headers issue
2020-03-09 12:31:06 +01:00
Karol Wypchlo 66cd736dee add config to get around large headers issue 2020-03-09 12:21:00 +01:00
Marcin Jachymiak 5c87cb93dd Add override to load_dotenv call 2020-03-06 14:10:51 -05:00
Marcin Jachymiak 66218fde30 Check allocation not spent. Cleanup msg format 2020-03-06 10:11:42 -05:00
Marcin Jachymiak b067da67ac fixup... 2020-03-05 12:17:25 -05:00
Marcin Jachymiak 2ba2ac4b9f Fixup 2020-03-05 12:10:35 -05:00
Marcin Jachymiak 3244c1cd89 make script executable 2020-03-05 12:09:30 -05:00
Marcin Jachymiak 29a73e5963 Add health-check setup script 2020-03-05 12:07:37 -05:00
Marcin Jachymiak 2af43ed499 fix api pass env 2020-03-05 10:09:48 -05:00
Marcin Jachymiak d9b27d416c Cleanup Discord msgs and add password var 2020-03-05 10:09:48 -05:00
Marcin Jachymiak 64681bf19d Fixup port env var 2020-03-05 10:09:48 -05:00
Marcin Jachymiak cbe73e14c7 Cleanup health check script 2020-03-05 10:09:48 -05:00
Marcin Jachymiak 6fbf60d84c Start health check script 2020-03-05 10:09:48 -05:00
Karol Wypchlo 44fbe60eff add cypress testing suite 2020-03-05 12:04:54 +01:00
Karol Wypchlo eb0ef30615 add stats-logger.sh script 2020-03-04 18:12:59 +01:00
Marcin Jachymiak 5b390cda9d Update README with notes on running 2 siad nodes 2020-03-03 10:24:51 -05:00
Marcin Jachymiak ac9dfc5d9c Add upload systemd service 2020-03-02 18:10:27 -05:00