Matthew Sevey
efc6060924
scripts: update file health check to check siac output. Add total files check
2020-11-20 11:26:20 -07:00
Matthew Sevey
243d084b5d
update message for siafile bad health
2020-11-18 11:04:04 -07:00
Matthew Sevey
09a4b646ec
srcipts: add alert check to the python scripts
2020-11-18 10:21:06 -07:00
Karol Wypchlo
05e34b5aaa
rename blacklist to blocklist
2020-11-13 17:29:40 +01:00
Karol Wypchlo
d4d3f6977b
change recommended renewal from 8 weeks to 4 weeks
2020-10-30 13:38:17 +01:00
Karol Wypchlo
f732df9660
fix crontab setup script
2020-10-27 16:39:00 +01:00
Karol Wypchlo
1922c4cd98
use os.popopen manually
2020-10-06 12:12:19 +02:00
Karol Wypchlo
9b6d61aa7e
remove unnecessary time dependency
2020-10-06 11:27:06 +02:00
Karol Wypchlo
60f8371170
stop sia container on critical disk space threshold
2020-10-06 11:24:18 +02:00
Karol Wypchlo
2328e605b7
parse disk size as int before multiplying
2020-10-05 10:03:10 +02:00
Karol Wypchło
e58752571e
add response content to health check failures ( #437 )
2020-09-30 16:20:55 +02:00
Karol Wypchlo
bc879b51cc
update log message
2020-09-29 15:46:40 +02:00
Karol Wypchlo
e7e7adc141
get api password from docker container
2020-09-29 15:42:41 +02:00
Karol Wypchło
468527c22d
add portal_subdomain to nginx regex and fill documentation ( #435 )
2020-09-29 12:35:34 +02:00
Karol Wypchło
10a251c081
reimplement health checks ( #434 )
2020-09-29 12:32:45 +02:00
Matthew Sevey
998bacd93a
Add ssh pubkey for Sevey
2020-09-25 11:54:34 -04:00
Peter-Jan Brone
f3b2a130fe
Wildcard Subdomains Documentation ( #416 )
...
* Add documentation on subdomains
* Update copy
* Fix typo
* Link Karol his repo
* Update copy
* Update setup-scripts/README.md
Co-authored-by: Karol Wypchło <kwypchlo@gmail.com>
Co-authored-by: Karol Wypchło <kwypchlo@gmail.com>
2020-09-22 12:23:53 +02:00
Karol Wypchło
dc73367a66
Merge pull request #371 from NebulousLabs/safe-restart-scripts
...
add safe stop and restart sia scripts
2020-09-18 17:08:19 +02:00
Karol Wypchło
08782de656
update ssh keys
2020-09-17 15:50:47 +02:00
Karol Wypchlo
a02c27664b
adjust scripts
2020-09-14 17:40:18 +02:00
Karol Wypchlo
abacfc1ed1
improve docs
2020-09-14 15:57:44 +02:00
Karol Wypchlo
4f849ddf53
change comments
2020-09-14 15:53:27 +02:00
Karol Wypchlo
2c12b9d009
add safe stop and restart sia scripts
2020-09-14 15:53:27 +02:00
Karol Wypchlo
6acd3309f8
fix blacklist command
2020-09-14 14:45:06 +02:00
Karol Wypchlo
20362fe7c5
fix health checks
2020-09-10 15:16:31 +02:00
Ivaylo Novakov
8235d75795
Only announce healthy status once a day.
2020-09-08 18:20:56 +02:00
Ivaylo Novakov
ddf72ad850
Make the time comparisons in the health checker timezone-aware.
2020-09-08 18:07:33 +02:00
Ivaylo Novakov
2d032dbf17
Docstrings.
2020-09-07 17:59:39 +02:00
Ivaylo Novakov
0838e4f5e5
Add free disk space check to health-checker.py.
...
Move load-average check to health-checker.py.
2020-09-07 17:56:47 +02:00
Ivaylo Novakov
3f4742a436
Only notify the team if critical checks have failed.
2020-09-04 17:17:26 +02:00
Ivaylo Novakov
5eece67b03
Move parameter parsing to the top of the script.
2020-09-04 17:13:36 +02:00
Ivaylo Novakov
1cc20903c6
Move max discord message len to a constant.
...
Report critical checks failed.
Formatting.
2020-09-04 17:07:47 +02:00
Ivaylo Novakov
a0a9137ae7
Update setup-scripts/health-checker.py
...
Co-authored-by: Karol Wypchło <kwypchlo@gmail.com>
2020-09-04 16:44:19 +02:00
Ivaylo Novakov
62e27120cd
Use localhost.
2020-09-04 16:39:39 +02:00
Ivaylo Novakov
59a77bfaf6
Add a health checker script to Gollum.
2020-09-04 16:12:20 +02:00
Matthew Sevey
a911b36f56
Add severe check to log checker
2020-09-03 10:53:52 -04:00
Ivaylo Novakov
25cf5625b4
3 seconds timeout.
2020-08-31 13:39:07 +02:00
Ivaylo Novakov
2fc6d30c01
Use `os._exit` instead of `sys.exit` - we don't want to raise an exception.
2020-08-31 13:38:45 +02:00
Ivaylo Novakov
8761a77e18
Don't call `await client.close()`.
2020-08-31 13:27:49 +02:00
Ivaylo Novakov
ff8c4c2d78
Merge pull request #360 from NebulousLabs/ivo/check_system_load
...
Check system load
2020-08-31 13:25:50 +02:00
Ivaylo Novakov
59bad59cb7
Make it clear that the uptime data comes from the `uptime` command and not something we're putting together ourselves.
2020-08-28 16:05:24 +02:00
Karol Wypchlo
df7decb06c
drop Marcin's key
2020-08-28 14:56:01 +02:00
Ivaylo Novakov
58409b8cee
Switch from the "1 minute" to "15 minutes" average.
2020-08-28 11:59:27 +02:00
Ivaylo Novakov
efb35054f7
When chekcing logs, check also the system load and report it if it's above 10.
2020-08-28 11:54:47 +02:00
Ivaylo Novakov
2126115df4
Send the last 1MB of error log as a file.
2020-08-26 11:32:58 +03:00
Ivaylo Novakov
3b0c597516
Limit the errors sent in a discord message to under 2000 characters (including prefix message).
2020-08-26 11:13:16 +03:00
Ivaylo Novakov
0eb8ab0d7c
Use a clearer log message and add some debug output.
2020-08-24 12:33:03 +03:00
Ivaylo Novakov
af49e65b04
Switch from `/home/user/.sia/sia.env` to `/home/user/skynet-webportal/.env`.
2020-08-19 19:14:55 +03:00
Ivaylo Novakov
341c65eba8
Remove unneeded comment and example commands.
2020-08-19 16:13:56 +03:00
Ivaylo Novakov
81acebad5c
Add the forced exit to funds-checker.py as well.
2020-08-19 10:25:23 +03:00
Ivaylo Novakov
19fff428cd
Move code to the right place.
2020-08-19 10:17:26 +03:00
Ivaylo Novakov
b05af57b54
Cleanup the old function.
2020-08-18 18:37:49 +03:00
Ivaylo Novakov
2a1c06116b
Add a handy command to the readme that checks the logs in a dockerized environment.
2020-08-18 18:36:00 +03:00
Ivaylo Novakov
221902508f
Give the client 10 seconds to properly exits and if it fails to do so `exit` the hard way.
2020-08-18 18:25:54 +03:00
Ivaylo Novakov
00fff39bf2
Add a new log checked for docker.
2020-08-18 17:27:01 +03:00
Karol Wypchlo
259e3ddffa
docker setup
...
docker progress
docker works
env variables
2020-07-31 00:50:42 +02:00
Karol Wypchlo
02b77cfbab
clean up after docker changes
2020-07-30 12:00:58 +02:00
Karol Wypchlo
cb763241ea
give checks more appropriate names
2020-07-28 13:55:42 +02:00
Karol Wypchlo
955425d321
clean up double siad setup
2020-07-28 13:22:07 +02:00
Karol Wypchlo
1dbc842c55
cors
2020-07-27 17:04:21 +02:00
Karol Wypchło
a7c57b3c5a
Handshake integration ( #302 )
2020-07-27 11:30:55 +02:00
Karol Wypchlo
7e06436aa6
do not enable custom.domain by default and improve docs
2020-07-17 21:12:18 +02:00
Karol Wypchlo
79df02fe47
clone whole Sia repo
2020-07-08 14:49:30 +02:00
Karol Wypchlo
e97a339789
fix .env file missing
2020-07-08 14:49:06 +02:00
Karol Wypchło
f067c50648
Improve server infrastructure setup and scripts ( #231 )
2020-06-22 11:54:01 +02:00
David
cd93302a46
Changed siamux websocket port on upload node ( #262 )
2020-06-16 22:19:20 +02:00
Karol Wypchlo
de1c3e0035
fix api calls that define their own siapath
2020-06-08 10:16:04 +02:00
Karol Wypchlo
5b12f3d41e
clear nginx cache after blacklisting
2020-06-01 17:12:57 +02:00
Karol Wypchlo
af0e639e6d
silence ssh
2020-06-01 11:22:06 +02:00
Karol Wypchlo
9449c34a23
blacklisting script
2020-06-01 11:17:44 +02:00
Delivator
d18ce24136
Added levels, use_temp_path and max_size options to cache
2020-05-22 19:27:59 +02:00
Delivator
cff9085aae
Fixed cache path typo
2020-05-22 17:10:58 +02:00
Delivator
22ca78e219
Update skynet-nginx.conf
2020-05-21 21:59:56 +02:00
Marcin Jachymiak
650e8a23b7
Add limits.conf file
2020-05-19 16:40:59 -04:00
Marcin Jachymiak
3e21ed5a3a
Bump version numbers
2020-05-19 16:40:31 -04:00
Marcin Jachymiak
3820a16a9f
Increase file limit in systemd services
2020-05-19 16:40:31 -04:00
Karol Wypchlo
33eeb61484
fix proxy_pass for upload not passing query params
2020-05-08 09:49:37 +02:00
Karol Wypchlo
3323ba282a
comment adjustment
2020-05-04 17:35:41 +02:00
Karol Wypchlo
d875ae2367
uploaded files are stored in random nested directories
2020-05-04 17:35:41 +02:00
Karol Wypchło
bb0021de3e
fix(typo): skunet => skynet
2020-04-29 18:44:27 +02:00
Karol Wypchlo
0925944e86
fix whitespace encoding for directories
2020-04-29 18:44:27 +02:00
Karol Wypchlo
01bb55507f
add /tmp directory cleanup to run every day
2020-04-23 20:02:35 +02:00
Karol Wypchlo
bba571c4e3
add frequent downloads cache to improve server responding on popular files
2020-04-23 20:02:02 +02:00
Marcin Jachymiak
0ee522cdcb
Clean up message and increase threshold in funds-checker.py
2020-04-14 18:22:37 -04:00
Marcin Jachymiak
2715ab1e9d
Merge pull request #157 from NebulousLabs/update-bots
...
Update bots
2020-04-14 15:32:52 -04:00
Marcin Jachymiak
06b25382ff
Mention role in discord, rather than online users
2020-04-14 14:50:25 -04:00
Marcin Jachymiak
02250ce385
Reduce allowance spending threshold.
2020-04-14 14:50:01 -04:00
David
e33ce33651
Changed nginx config to generate random file uuid by default ( #149 )
...
* Changed nginx config to generate random file uuid by default
* Added nginx version note to setup readme
2020-04-14 16:06:02 +02:00
Karol Wypchło
250bbdf9d8
include basic ddos protection ( #148 )
...
* include basic ddos protection
* more verbose zone names
* set limit http status code to 429
2020-04-07 13:01:38 +02:00
Marcin Jachymiak
321bbd4d0f
Fix log checker false positives
2020-03-26 11:12:07 -04:00
Marcin Jachymiak
c0e148908e
Merge pull request #124 from NebulousLabs/check-logs-for-panic
...
Check logs for panics
2020-03-24 13:29:57 -04:00
Karol Wypchło
46400ff39f
Setup scripts improvements ( #123 )
...
* fix /Users/karol issue with go path
* do not emit error if /etc/nginx/sites-enabled/default is not found
2020-03-24 15:42:03 +01:00
Marcin Jachymiak
a90dc717c6
Check logs for panics
2020-03-24 10:23:09 -04:00
Karol Wypchło
fa052550cc
update scripts to support Sia v1.4.4 ( #98 )
...
* update scripts to support Sia v1.4.4
* force overwrite symlink
2020-03-20 22:11:20 +01:00
Peter-Jan Brone
cd619d7a92
Update Nginx config to use double siad setup ( #97 )
...
* Update nginx conf to use double siad setup
* Update documentation
2020-03-19 15:38:34 +01:00
Marcin Jachymiak
f7bb6f1493
Add stats endpoints to nginx
2020-03-18 16:36:30 -04:00
Marcin Jachymiak
16fe7acad0
Set siamux port to avoid conflicts
2020-03-18 16:35:48 -04:00
Marcin Jachymiak
ccddff4b6a
Use journald with persistence
2020-03-13 12:34:42 -04:00
Karol Wypchlo
4e5aca4998
set logs on siad services
2020-03-12 15:24:58 +01:00
Peter-Jan Brone
bde39400ae
Expose Skynet-File-Metadata ( #86 )
2020-03-12 15:15:48 +01:00
Marcin Jachymiak
d7ab15a885
Leave TODO about flags
2020-03-10 11:26:02 -04:00
Marcin Jachymiak
e7e73977bd
Switch log-checks to every 8 hours
2020-03-10 11:25:28 -04:00
Marcin Jachymiak
f205f46928
Add hour param to log checker
2020-03-10 11:08:54 -04:00
Peter-Jan Brone
96034cf10d
Directory Upload & Auto UUID ( #60 )
2020-03-10 14:36:21 +01:00
Karol Wypchło
f4760e4481
upload progress status ( #73 )
...
* add upload progress status
* resolve cors issues with proxy returning cors error
2020-03-10 14:15:34 +01:00
Marcin Jachymiak
bc3e72726e
Set force_notify in log check error cases
2020-03-09 16:06:15 -04:00
Marcin Jachymiak
1349440251
Update README and health check setup-scripts
2020-03-09 16:02:16 -04:00
Marcin Jachymiak
285d915602
Rename health-checker to funds-checker
2020-03-09 15:59:21 -04:00
Marcin Jachymiak
6d8fe9ca02
Add log checker
2020-03-09 15:55:03 -04:00
Marcin Jachymiak
4b1ac49ef1
Refactor bot_utils out of health-checker
2020-03-09 12:15:13 -04:00
Peter-Jan Brone
92f07b0dba
Merge pull request #72 from NebulousLabs/large-headers-nginx-issue
...
add config to get around large headers issue
2020-03-09 12:31:06 +01:00
Karol Wypchlo
66cd736dee
add config to get around large headers issue
2020-03-09 12:21:00 +01:00
Marcin Jachymiak
5c87cb93dd
Add override to load_dotenv call
2020-03-06 14:10:51 -05:00
Marcin Jachymiak
66218fde30
Check allocation not spent. Cleanup msg format
2020-03-06 10:11:42 -05:00
Marcin Jachymiak
b067da67ac
fixup...
2020-03-05 12:17:25 -05:00
Marcin Jachymiak
2ba2ac4b9f
Fixup
2020-03-05 12:10:35 -05:00
Marcin Jachymiak
3244c1cd89
make script executable
2020-03-05 12:09:30 -05:00
Marcin Jachymiak
29a73e5963
Add health-check setup script
2020-03-05 12:07:37 -05:00
Marcin Jachymiak
2af43ed499
fix api pass env
2020-03-05 10:09:48 -05:00
Marcin Jachymiak
d9b27d416c
Cleanup Discord msgs and add password var
2020-03-05 10:09:48 -05:00
Marcin Jachymiak
64681bf19d
Fixup port env var
2020-03-05 10:09:48 -05:00
Marcin Jachymiak
cbe73e14c7
Cleanup health check script
2020-03-05 10:09:48 -05:00
Marcin Jachymiak
6fbf60d84c
Start health check script
2020-03-05 10:09:48 -05:00
Karol Wypchlo
44fbe60eff
add cypress testing suite
2020-03-05 12:04:54 +01:00
Karol Wypchlo
eb0ef30615
add stats-logger.sh script
2020-03-04 18:12:59 +01:00
Marcin Jachymiak
5b390cda9d
Update README with notes on running 2 siad nodes
2020-03-03 10:24:51 -05:00
Marcin Jachymiak
ac9dfc5d9c
Add upload systemd service
2020-03-02 18:10:27 -05:00
Marcin Jachymiak
32727c07ea
Add upload env stuff to scripts
2020-03-02 18:05:45 -05:00
Karol Wypchlo
e80ccb0bd5
fix prettier style issue
2020-02-28 12:35:06 +01:00
Marcin Jachymiak
9d6748409c
Merge pull request #45 from marcinja/2020-02-add-systemd-service
...
Add systemd service
2020-02-26 14:39:57 -05:00
Karol Wypchlo
b6d6b655c3
remove redundant Authorization header from GET endpoints
2020-02-26 19:32:08 +01:00
Marcin Jachymiak
bbdb363660
Use an environment variable file
2020-02-26 11:45:50 -05:00
Marcin Jachymiak
c9d1bbddc8
Update setup README with systemctl commands
2020-02-25 12:56:19 -05:00
Marcin Jachymiak
1e72f2ade0
Add systemd service conf. Update setup script
2020-02-25 12:52:04 -05:00
Karol Wypchło
ee86da1b39
move webpage to Gatsby ( #32 )
...
* migrate to gatsby in subfolder
* move gatsby to main package
* use targeted light syntax highlighter
* clean up gatsby leftovers
2020-02-20 17:35:07 +01:00
Karol Wypchlo
a86aeadc5c
rename footer column and fix readme
2020-02-18 18:42:51 +01:00
Karol Wypchlo
9bd9a0b95a
skip nodejs server
2020-02-18 17:47:19 +01:00
Karol Wypchlo
8f28fd6dc6
fix readme
2020-02-18 17:05:44 +01:00
Karol Wypchlo
8e5f65e099
fix readme
2020-02-18 17:05:20 +01:00
Karol Wypchlo
ef154b2793
fix readme
2020-02-18 17:04:57 +01:00
Karol Wypchło
b7f5528506
add logo, fix, nginx config and validate input error ( #29 )
...
add logo, fix, nginx config and validate input error
2020-02-18 16:50:09 +01:00
Karol Wypchlo
23a96eb2bf
update to newest config version
2020-02-18 11:39:36 +01:00
PJ
7b2c61ae67
Add skyfile POST route to nginx + update skylink regex
2020-02-18 11:38:45 +01:00
PJ
99a77c4b7f
Update nginx.conf - remove strreplace of sia:// prefix
2020-02-18 11:38:45 +01:00
rontus
a77ed447ce
Fix a missing ; at end of line 11
...
./setup.sh runs into a nginx error if that line does not end in ";"
2020-02-18 03:48:24 -05:00
Karol Wypchlo
235159fa0e
rewrite nginx configuration for website
2020-02-13 10:25:14 -05:00
Marcin Jachymiak
648a601ff4
Add more letsencrypt notes
2020-02-06 12:08:05 -05:00
Marcin Jachymiak
f95bc38a05
Add reminder to reload nginx
2020-02-06 12:03:12 -05:00
Marcin Jachymiak
cb6aa7b2dc
Update allowance flag. Remove viewnode refs
2020-02-06 11:43:20 -05:00
Marcin Jachymiak
2d5428b9ba
Update location blocks on nginx
2020-02-04 13:57:59 -05:00
PJ
c370c87496
Update .gitignore + update nginx config
2020-02-04 19:26:48 +01:00
Marcin Jachymiak
4ce9ed9b0f
Update viewnode setup command
2020-02-03 17:31:15 -05:00
Marcin Jachymiak
08ce6fab32
Update setup guide
2020-01-31 16:58:30 -05:00
Marcin Jachymiak
f3025bde96
Clean up README. Append to keys file
...
Append to keys file, in case someone forgets to add a key to the file.
This way they won't nuke the file by running the script and lose access
to the server.
2020-01-31 14:16:11 -05:00
Marcin Jachymiak
bfddc3449e
Update READMEs
2020-01-31 14:10:21 -05:00
Marcin Jachymiak
f8a92323ee
Remove authorized keys
2020-01-31 14:06:52 -05:00
Marcin Jachymiak
043dc48ca4
Add domain name param to LE script
2020-01-31 14:06:43 -05:00
Marcin Jachymiak
2d9e26d67b
Add PJ ssh key
2020-01-31 13:32:40 -05:00
Marcin Jachymiak
05adfa3085
Update nginx config
2020-01-31 13:30:36 -05:00
Marcin Jachymiak
d24f3bd554
Add copy-paste to tmux
2020-01-30 17:19:38 -05:00
Marcin Jachymiak
66d5b2d478
Move setup scripts in dir
2020-01-30 13:42:24 -05:00