Skip to content

Latest commit

 

History

History
148 lines (113 loc) · 7.21 KB

dev-setup.md

File metadata and controls

148 lines (113 loc) · 7.21 KB
Raw

Setup Development Environment

This document describes how to get started with a usable, functional, stable development environment to ultimately develop against RHHI.Next.

Components

dev-scripts

  • Set of scripts to configure some libvirt VMs and associated virtualbmc processes to enable deploying to them as dummy baremetal nodes
  • Launches openshift-installer, creating a (by default) 3-node KNI infrastructure, with a bootstrap node
  • Uses (by default) the libvirt backend
  • Creates a Bootstrap node, responsible for creating an OpenShift cluster
  • Creates an OpenShift cluster comprised of virtual machines, on your dedicated development host
  • Runs installer, launch bootstrap VM, and drive Ironic APIs
  • Launches the Ironic containers using Podman on the Provisioning Host
    • Downloads the current images of RHCOS that are needed for a deployment (bootstrap VM, baremetal hosts)

Environmental Prerequisites

You will need a dedicated hardware host to be effective with your development tasks. This is due to the fact that your deployment environment will host several virtual machines using libvirt. These all get created as part of the execution of dev-scripts.
Later versions of this guide may address passthrough virtualization which allows for development in a cloud space.

Host System

  • Hardware host with at least 32G of RAM (the more, the better)
  • Dedicated CentOS 7 System
    • Fully updated
  • Either console access, or ability to reload the system with a tool such as Beaker
    • Failure is unexpected, but not unheard of, when iterating through development so quickly as RHHI.Next grows. Having a backup plan is the safest bet

Additional Configuration

Ensure that the username you are developing with, has passwordless sudo access. This can be any username. This example uses the username ‘rhhi’:

# useradd rhhi
# echo "rhhi ALL=(ALL) NOPASSWD:ALL" | tee -a /etc/sudoers.d/rhhi
# chmod 0440 /etc/sudoers.d/rhhi

Note that when preforming commands as the new rhhi user, you must include the dash in 'sudo - rhhi', or 'sudo su - rhhi', in order to instantiate some variables such as XDG_RUNTIME_DIR etc.

Software Prerequisites

Luckily, dev-scripts handles much of the prerequisite software installation heavy lifting.

Clone the dev-scripts repository

As the rhhi user, clone the dev-scripts repository to a location of your choosing:

$ git clone [email protected]:openshift-metalkube/dev-scripts.git

Change in to the dev-scripts directory:

$ cd dev-scripts

An OpenShift pull secret is used to pull OpenShift images from the cloud. To generate a pull secret, visit the Red Hat OKD (OpenShift 4) Cloud site (Red Hat SSO required). Click on the “Copy Pull Secret” button towards the bottom of the page, to copy the pull secret in to your clipboard.

The pull secret is stored in an environment file. An example file exists with the name of config_example.sh. Copy this file in to one that matches config_$USER.sh:

$ cp config_example.sh config\_${USER}.sh

If you wish to use an environment file by any other name, you’ll need to prefix each of your run commands with CONFIG=.sh. However by default, the build scripts will search for a file named config_$USER.sh, which will save you some time.

Edit this file, and replace the value of the PULL_SECRET with that of what’s copied in your clipboard, which should be your individual pull secret.
Remember to respect the single quotes already present in the file.

Development Environment Installation with dev-scripts

For more detailed information, consult the dev-scripts git repository. Jumping right in though, you should expect to be able to set up an almost complete development environment by running the following command:

$ make

‘make’ looks for a Makefile, inside of which is a canonical list of steps. These steps execute the following dev-scripts in order:

  • 01_install_requirements.sh
    • Responsible for installing software prerequisites, adding additional repositories as necessary
    • golang, Ironic, and the OpenShift Origin Client Tools, and libvirt are all examples of software that gets installed
  • 02_configure_host.sh
    • Mostly responsible for running a limited implementation of tripleo-quickstart for the virtualized deployments, configuring libvirt, iptables, creating the baremetal and provisioning bridges for system connectivity, and configuring NetworkManager for things such as DNS resolution of internal hostnames
  • 03_ocp_repo_sync.sh
    • clones the baremetal-operator
  • 04_setup_ironic.sh
    • Builds podman containers for Ironic and Ironic Inspector
    • Configures Ironic Inspector for pxebooting of virtualized systems
    • Adds an IP address to the provisioning bridge
    • Massages the Red Hat CoreOS (RHCOS) image along with configuring interfaces inside of it, which nodes will run
  • 05_build_ocp_installer.sh
    • Builds the OpenShift Installer
  • 06_deploy_bootstrap_vm.sh
    • Uses openshift-install to create an ignition file, used to create a bootstrap VM. The OpenShift architecture requries that a bootstrap VM is used to create a set of three OpenShift masters
    • Creates a guest of an appropriate size on the Host, and configures it appropriately
    • Attempts to connect to the bootstrap node to ensure that it’s been built and started properly
  • 07_deploy_masters.sh
    • Uses the OpenStack and Ironic clients to create baremetal nodes to act as the masters
    • A config drive is used by the nodes when they come up, which starts the process of installing the masters and ensuring that they can communicate with each other

Two additional scripts are included as part of dev-scripts. They will rarely need to be invoked directly, but are used by ‘make clean’ to clean up the host system:

  • ocp_cleanup.sh

    • Removes the bootstrap node along with its volumes, disk images, and associated ignition file
    • Removes any residual OpenShift configuration data (found in the ocp/ directory)
    • Removes the dnsmasq configuration created by 06_deploy_bootstrap_vm.sh

  • host-cleanup.sh

    • Kills the Ironic podman containers running on the host
    • Uses an ansible playbook to tear down all the masters and workers

Cleaning up your workspace with dev-scripts

Cleanup is relatively simple by invoking the same ‘make’ process we used for setting up the environment in the first place.

To clean up the entire environment, run:

$ make clean

Q/A

Q: How do I connect to the masters?
A: Connecting to the masters shouldn’t be necessary, but in a pinch, you can access them by ssh [email protected]

Q: How about connecting to the bootstrap node?
A: This might be more common. You can access it by ssh [email protected]

Q: What about the bridges?
A: There are two bridges in use by RHHI.Next:

  • baremetal
    • Public API access
      • Primary interface on the Provision Host (also hosts the ostest-bootstrap VM) and Master nodes
  • provisioning
    • Provisioning
      • Secondary interface on the Provision Host (also hosts the ostest-bootstrap VM) and Master nodes

To see these bridges and which interfaces are associated with them, run:

sudo brctl show