This repository has been archived on 2022-10-07. You can view files and clone it, but cannot push or open issues or pull requests.
skynet-webportal/setup-scripts
Karol Wypchlo bba571c4e3 add frequent downloads cache to improve server responding on popular files 2020-04-23 20:02:02 +02:00
..
README.md Changed nginx config to generate random file uuid by default (#149) 2020-04-14 16:06:02 +02:00
authorized_keys Remove authorized keys 2020-01-31 14:06:52 -05:00
bashrc Add upload env stuff to scripts 2020-03-02 18:05:45 -05:00
bot_utils.py Mention role in discord, rather than online users 2020-04-14 14:50:25 -04:00
funds-checker.py Clean up message and increase threshold in funds-checker.py 2020-04-14 18:22:37 -04:00
journald.conf Use journald with persistence 2020-03-13 12:34:42 -04:00
letsencrypt-setup.sh Add domain name param to LE script 2020-01-31 14:06:43 -05:00
log-checker.py Fix log checker false positives 2020-03-26 11:12:07 -04:00
setup-health-check-scripts.sh Switch log-checks to every 8 hours 2020-03-10 11:25:28 -04:00
setup.sh Setup scripts improvements (#123) 2020-03-24 15:42:03 +01:00
sia.env Add health-check setup script 2020-03-05 12:07:37 -05:00
siad-upload.service Set siamux port to avoid conflicts 2020-03-18 16:35:48 -04:00
siad.service Use journald with persistence 2020-03-13 12:34:42 -04:00
skynet-nginx.conf add frequent downloads cache to improve server responding on popular files 2020-04-23 20:02:02 +02:00
source-upload.sh Add upload env stuff to scripts 2020-03-02 18:05:45 -05:00
ssh_config Move setup scripts in dir 2020-01-30 13:42:24 -05:00
stats-logger.sh add stats-logger.sh script 2020-03-04 18:12:59 +01:00
tmux.conf Add copy-paste to tmux 2020-01-30 17:19:38 -05:00

README.md

Skynet Portal Setup Scripts

This directory contains a setup guide and scripts that will install and configure some basic requirements for running a Skynet Portal. The assumption is that we are working with a Debian Buster Minimal system or similar.

Initial Setup

(Assumes we are logged in as root on a fresh installation of Debian)

You may want to fork this repository and add your ssh pubkey to authorized_keys and optionally edit the tmux and bash configurations.

NOTE: nginx version 1.11.0 or higher is required. If you use the install script below, the correct version should be installed.

  1. SSH in a freshly installed Debian machine.
  2. apt-get update && apt-get install sudo
  3. adduser user
  4. usermod -a -G sudo user
  5. Quit the ssh session.

You a can now ssh into your machine as the user user.

  1. On your local machine: ssh-copy-id user@ip-addr
  2. On your local machine: ssh user@ip-addr
  3. Now logged in as user: sudo apt-get install git
  4. git clone https://github.com/NebulousLabs/skynet-webportal
  5. cd skynet-webportal/setup-scripts
  6. ./setup.sh
  7. Once DNS records are set you can run: ./letsencrypt-setup.sh
  8. This should edit your nginx configuration for you. If not, you should check that keys were created by letsencrypt in /etc/letsencrypt/live/ and add the following lines into your nginx configuration. Make sure to replace YOUR-DOMAIN with your domain name.
    ssl_certificate /etc/letsencrypt/live/YOUR-DOMAIN/fullchain.pem;
    ssl_certificate_key /etc/letsencrypt/live/YOUR-DOMAIN/privkey.pem;
    
  9. Finally make sure to check your nginx conf and reload nginx: sudo nginx -t sudo systemctl reload nginx

Running siad

NOTE: You must be running siad and siac by building from a version at least as recent as v1.4.4.

You still need to setup siad for the backend to be complete.

The setup script creates a systemd user service that will run siad in the background and automatically restart upon failure. The siad.service file must be placed in ~/.config/systemd/user/

To use the siad.service, first fill out ~/.sia/sia.env environment variables with the correct values. You will need to initialize your wallet if you have not already done so.

To enable the service: systemctl --user enable siad.service

Running 2 siad instances

It is recommended to run 2 siad nodes on the same server. One node to prioritize downloads and one to prioritze uploads. This will drastically improve performance of both up - and download. The setup scripts assume this double siad setup and perform the initial setup for a 2nd siad instance running as a systemd service siad-upload.service in the ~/siad-upload/ directory with environment variables in sia-upload.env. You must fill out the correct values for those environment variables.

Note that running 2 siad nodes is not obligatory. You can run a portal with just one siad node just fine. If you choose to do so, simply ignore the second siad node and point everything to your single node instead.

The bashrc file in this repository also provides an alias siac-upload that loads the correct environment variables and sets the correct ports to interact with the 2nd siad node.

siac is used to operate node 1, and siac-upload is used to operate node 2.

To enable the 2nd service: systemctl --user enable siad-upload.service

Useful Commands

To start the service: systemctl --user start siad

To stop it: systemctl --user stop siad

To check the status of it: systemctl --user status siad

To check standard err/standard out: journalctl --user-unit siad. In addition you can add:

  • -r to view journal from the newest entry
  • -f to follow and -n INTEGER to specify number of lines

Portal Setup

When siad is done syncing, create a new wallet and unlock the wallet.

Then set an allowance (siac renter setallowance), with the suggested values below:

  • 10 KS (keep 25 KS in your wallet)
  • default period
  • default number of hosts
  • 8 week renewal time
  • 500 GB expected storage
  • 500 GB expected upload
  • 5 TB expected download
  • default redundancy

Once your allowance is set you need to set your node to be a viewnode with the following command: siac renter setallowance --payment-contract-initial-funding 10SC

Now your node will begin making 10 contracts per block with many hosts so it can potentially view the whole network's files.

Running the Portal

Make sure you have nodejs and yarn installed. You can check that with node -v and yarn -v commands respectively.

  • run cd /home/user/skynet-webportal
  • run yarn to build dependencies
  • run yarn build to build the client package

Client package will be outputted to /public and nginx configuration will pick it up automatically.

Health Check Scripts.

There are 2 optional health check scripts that can be setup using setup-health-check-scripts.sh. That command will install the necesary Python dependencies and setup 2 cronjobs for each script: one for a downloading siad and for an uploading siad service.

To use the scripts you must setup a Discord bot and provide a bot token. The bot scripts take in 1 or more arguments, the first always being the path to an .env file.

funds-checker checks that the wallet balance and allowance settings are sufficient for portal usage.

log-checker checks if there are any critical warnings in the journal for the running services.