skynet-webportal/setup-scripts

Skynet Portal Setup Scripts

This directory contains a setup guide and scripts that will install and configure some basic requirements for running a Skynet Portal. The assumption is that we are working with a Debian Buster Minimal system or similar.

Initial Setup

You may want to fork this repository and replace ssh keys in setup-scripts/support/authorized_keys and optionally edit the setup-scripts/support/tmux.conf and setup-scripts/support/bashrc configurations to fit your needs.

Step 0: stack overview

• dockerized services inside docker-compose.yml
  • sia (docker hub): storage provider, heart of the portal setup
  • caddy (docker hub): reverse proxy (similar to nginx) that handles ssl out of a box and acts as a transparent entry point
  • openresty (docker hub): nginx custom build, acts as a cached proxy to siad and exposes all api endpoints
  • health-check: simple service that runs periodically and collects health data about the server (status and response times) - read more
  • handshake (github): full handshake node
  • handshake-api: simple API talking to the handshake node - read more
  • webapp: portal frontend application - read more
  • kratos: user account management system
  • oathkeeper: identity and access proxy
• discord integration
  • funds-checker: script that checks wallet balance and sends status messages to discord periodically
  • health-checker: script that monitors health-check service for server health issues and reports them to discord periodically
  • log-checker: script that scans siad logs for critical errors and reports them to discord periodically
• blocklist-skylink: script that can be run locally from a machine that has access to all your skynet portal servers that blocklists provided skylink and prunes nginx cache to ensure it's not available any more (that is a bit much but that's the best we can do right now without paid nginx version) - if you want to use it, make sure to adjust the server addresses

Step 1: setting up server user

1. SSH in a freshly installed Debian machine on a user with sudo access (can be root)
2. apt-get update && apt-get install sudo libnss3-tools -y to make sure sudo is available
3. adduser user to create user called user (creates /home/user directory)
4. usermod -aG sudo user to add this new user to sudo group
5. sudo groupadd docker to create a group for docker (it might already exist)
6. sudo usermod -aG docker user to add your user to that group
7. Quit the ssh session with exit command

You can now ssh into your machine as the user user.

Step 2: setting up environment

1. On your local machine: ssh-copy-id user@ip-addr to copy over your ssh key to server
2. On your local machine: ssh user@ip-addr to log in to server as user user
3. You are now logged in as user

Following step will be executed on remote host logged in as a user:

1. sudo apt-get install git -y to install git
2. git clone https://github.com/SkynetLabs/skynet-webportal
3. cd skynet-webportal
4. run setup scripts in the exact order and provide sudo password when asked (if one of them fails, you can retry just this one before proceeding further)
   1. /home/user/skynet-webportal/setup-scripts/setup-server.sh
   2. /home/user/skynet-webportal/setup-scripts/setup-docker-services.sh
   3. /home/user/skynet-webportal/setup-scripts/setup-health-check-scripts.sh (optional)

Step 3: configuring siad

At this point we have almost everything running, we just need to set up your wallet and allowance:

1. Create a new wallet (remember to save the seed)

   docker exec -it sia siac wallet init

2. Unlock the wallet (use the seed as password)

   docker exec -it sia siac wallet unlock

3. Generate a new wallet address (save it for later to transfer the funds)

   docker exec -it sia siac wallet address

4. Set up allowance

   docker exec -it sia siac renter setallowance

   1. 10 KS (keep 25 KS in your wallet)
   2. default period
   3. default number of hosts
   4. 4 week renewal time
   5. 500 GB expected storage
   6. 500 GB expected upload
   7. 5 TB expected download
   8. default redundancy
5. Set a maximum storage price

   docker exec -it sia siac renter setallowance --max-storage-price 100SC

6. Instruct siad to start making 10 contracts per block with many hosts to potentially view the whole network's files

   docker exec -it sia siac renter setallowance --payment-contract-initial-funding 10SC

Step 4: configuring docker services

1. edit /home/user/skynet-webportal/.env and configure following environment variables

   • SSL_CERTIFICATE_STRING is a list of comma separated paths that caddy will generate ssl certificates for
   • EMAIL_ADDRESS is your email address used for communication regarding SSL certification (required if you're using http-01 challenge)
   • SIA_WALLET_PASSWORD is your wallet password (or seed if you did not set a password)
   • HSD_API_KEY this is a random security key for a handshake integration that gets generated automatically
   • CLOUDFLARE_AUTH_TOKEN (optional) if using cloudflare as dns loadbalancer (need to change it in Caddyfile too)
   • AWS_ACCESS_KEY_ID (optional) if using route53 as a dns loadbalancer
   • AWS_SECRET_ACCESS_KEY (optional) if using route53 as a dns loadbalancer
   • PORTAL_NAME a string representing name of your portal e.g. siasky.xyz or my skynet portal
   • DISCORD_BOT_TOKEN (optional) if you're using Discord notifications for health checks and such
   • SKYNET_DB_USER (optional) if using accounts this is the MongoDB username
   • SKYNET_DB_PASS (optional) if using accounts this is the MongoDB password
   • SKYNET_DB_HOST (optional) if using accounts this is the MongoDB address or container name
   • SKYNET_DB_PORT (optional) if using accounts this is the MongoDB port
   • COOKIE_DOMAIN (optional) if using accounts this is the domain to which your cookies will be issued
   • COOKIE_HASH_KEY (optional) if using accounts hashing secret, at least 32 bytes
   • COOKIE_ENC_KEY (optional) if using accounts encryption key, at least 32 bytes
   • S3_BACKUP_PATH (optional) is using accounts and backing up the databases to S3. This path should be an S3 bucket with path to the location in the bucket where we want to store the daily backups.

2. docker-compose up -d to restart the services so they pick up new env variables

3. docker exec caddy caddy reload --config /etc/caddy/Caddyfile to reload Caddyfile configuration

4. add your custom Kratos configuration to /home/user/skynet-webportal/docker/kratos/config/kratos.yml (in particular, the credentials for your mail server should be here, rather than in your source control). For a starting point you can take docker/kratos/config/kratos.yml.sample.

Subdomains

It might prove useful for certain skapps to be accessible through a custom subdomain. So instead of being accessed through https://portal.com/[skylink], it would be accessible through https://[skylink_base32].portal.com. We call this "subdomain access" and it is made possible by encoding Skylinks using a base32 encoding. We have to use a base32 encoding scheme because subdomains have to be all lower case and the base64 encoded Skylink is case sensitive and thus might contain uppercase characters.

You can convert Skylinks using this converter skapp. To see how the encoding and decoding works, please follow the link to the repo in the application itself.

There is also an option to access handshake domain through the subdomain using https://[domain_name].hns.portal.com.

To configure this on your portal, you have to make sure to configure the following:

Wildcard SSL Certificate

We need to ensure SSL encryption for skapps that are accessed through their subdomain, therefore we need to have a wildcard certificate. This is very easily achieved using wildcard certificates in Caddy.

{$SSL_CERTIFICATE_STRING} {
    ...
}

Where SSL_CERTIFICATE_STRING environment variable should contain the wildcard for subdomains (ie. _.example.com) and wildcard for hns subdomains (ie. _.hns.example.com).

(see docker/caddy/Caddyfile)

Nginx configuration

In Nginx two things need to happen:

Match the specific parts of the uri

# understand the regex https://regex101.com/r/BGQvi6/6
server_name "~^(((?<base32_subdomain>([a-z0-9]{55}))|(?<hns_domain>[^\.]+)\.hns)\.)?((?<portal_domain>[^.]+)\.)?(?<domain>[^.]+)\.(?<tld>[^.]+)$";

Redirect the requests to the appropriate location

First you need to redirect the requests based on the regex above matching either base32_subdomain or hns_domain.

location / {
  # This is the only safe workaround to reroute based on some conditions
  # See https://www.nginx.com/resources/wiki/start/topics/depth/ifisevil/
  recursive_error_pages on;

  # redirect links with base32 encoded skylink in subdomain
  error_page 418 = @base32_subdomain;
  if ($base32_subdomain != "") {
    return 418;
  }

  # redirect links with handshake domain on hns subdomain
  error_page 419 = @hns_domain;
  if ($hns_domain  != "") {
    return 419;
  }

  ...
}

Define locations for @base32_subdomain and @hns_domain redirects.

location @base32_subdomain {
  include /etc/nginx/conf.d/include/proxy-buffer;

  proxy_pass http://127.0.0.1/$base32_subdomain/$request_uri;
}

location @hns_domain {
  include /etc/nginx/conf.d/include/proxy-buffer;

  proxy_pass http://127.0.0.1/hns/$hns_domain/$request_uri;
}

(see docker/nginx/nginx.conf)

Useful Commands

• Starting the whole stack

  docker-compose up -d

• Stopping the whole stack

  docker-compose down

• Accessing siac

  docker exec -it sia siac

• Portal maintenance
  • Pulling portal out for maintenance

    scripts/portal-down.sh

  • Putting portal back into place after maintenance

    scripts/portal-up.sh

  • Upgrading portal containers (takes care of pulling it and putting it back)

    scripts/portal-upgrade.sh

• Restarting caddy gracefully after making changes to Caddyfile (no downtime)

  docker exec caddy caddy reload --config /etc/caddy/Caddyfile

• Restarting nginx gracefully after making changes to nginx configs (no downtime)

  docker exec nginx openresty -s reload

• Checking siad service logs (since last hour)

  docker logs --since 1h $(docker ps -q --filter "name=^sia$")

• Checking caddy logs (for example in case ssl certificate fails)

  docker logs caddy -f

• Checking nginx logs (nginx handles all communication to siad instances)

  tail -n 50 docker/data/nginx/logs/access.log to follow last 50 lines of access log tail -n 50 docker/data/nginx/logs/error.log to follow last 50 lines of error log