143 lines
2.7 KiB
Markdown
143 lines
2.7 KiB
Markdown
vagrant-k8s
|
|
===========
|
|
Scripts to create libvirt lab with vagrant and prepare some stuff for `k8s` deployment with `kargo`.
|
|
|
|
|
|
Requirements
|
|
------------
|
|
|
|
* `libvirt`
|
|
* `vagrant`
|
|
* `vagrant-libvirt` plugin (`vagrant plugin install vagrant-libvirt`)
|
|
* `$USER` should be able to connect to libvirt (test with `virsh list --all`)
|
|
|
|
Vargant lab preparation
|
|
-----------------------
|
|
|
|
* Change default IP pool for vagrant networks if you want:
|
|
|
|
```bash
|
|
export VAGRANT_POOL="10.100.0.0/16"
|
|
```
|
|
|
|
* Clone this repo
|
|
|
|
```bash
|
|
git clone https://github.com/adidenko/vagrant-k8s
|
|
cd vagrant-k8s
|
|
```
|
|
|
|
* Prepare the virtual lab:
|
|
|
|
```bash
|
|
vagrant up
|
|
```
|
|
|
|
Deployment on a lab
|
|
-------------------
|
|
|
|
* Login to master node and sudo to root:
|
|
|
|
```bash
|
|
vagrant ssh $USER-k8s-00
|
|
sudo su -
|
|
```
|
|
|
|
* Clone this repo
|
|
|
|
```bash
|
|
git clone https://github.com/adidenko/vagrant-k8s ~/mcp
|
|
```
|
|
|
|
* Install required software and pull needed repos (modify script if you're not
|
|
running it on Vagrant lab, you'll need to create `nodes` list manually and
|
|
clone `microservices` and `microservices-repos` repositories, see ccp-pull.sh
|
|
for details)
|
|
|
|
```bash
|
|
cd ~/mcp
|
|
./bootstrap-master.sh
|
|
```
|
|
|
|
* Check nodes list and make sure you have SSH access to them
|
|
|
|
```bash
|
|
cd ~/mcp
|
|
cat nodes
|
|
ansible all -m ping -i nodes_to_inv.py
|
|
```
|
|
|
|
* Deploy k8s using kargo playbooks
|
|
|
|
```bash
|
|
cd ~/mcp
|
|
./deploy-k8s.kargo.sh
|
|
```
|
|
|
|
* Deploy OpenStack CCP:
|
|
|
|
```bash
|
|
cd ~/mcp
|
|
# Build CCP images
|
|
ansible-playbook -i nodes_to_inv.py playbooks/ccp-build.yaml
|
|
# Deploy CCP
|
|
ansible-playbook -i nodes_to_inv.py playbooks/ccp-deploy.yaml
|
|
```
|
|
|
|
Working with kubernetes
|
|
-----------------------
|
|
|
|
* Login to one of your kube-master nodes (see `/root/kargo/inventory/inventory.cfg`
|
|
on master node) and run:
|
|
|
|
```bash
|
|
# List images in registry
|
|
curl -s 127.0.0.1:31500/v2/_catalog | python -mjson.tool
|
|
|
|
# Check CCP jobs status
|
|
kubectl --namespace=openstack get jobs
|
|
|
|
# Check CCP pods
|
|
kubectl --namespace=openstack get pods -o wide
|
|
```
|
|
|
|
* Troubleshooting
|
|
|
|
```bash
|
|
# Get logs from pod
|
|
kubectl --namespace=openstack logs $POD_NAME
|
|
|
|
# Exec command from pod
|
|
kubectl --namespace=openstack exec $POD_NAME -- cat /etc/resolv.conf
|
|
kubectl --namespace=openstack exec $POD_NAME -- curl http://etcd-client:2379/health
|
|
|
|
# Run a container
|
|
docker run -t -i 127.0.0.1:31500/mcp/neutron-dhcp-agent /bin/bash
|
|
```
|
|
|
|
* Network checker
|
|
|
|
```bash
|
|
cd ~/mcp
|
|
./deploy-netchecker.sh
|
|
# or in openstack namespace
|
|
./deploy-netchecker.sh openstack
|
|
```
|
|
|
|
* CCP
|
|
|
|
```bash
|
|
# Run a bash in one of containers
|
|
docker run -t -i 127.0.0.1:31500/mcp/nova-base /bin/bash
|
|
|
|
# Inside container export credentials
|
|
export OS_USERNAME=admin
|
|
export OS_PASSWORD=password
|
|
export OS_TENANT_NAME=admin
|
|
export OS_REGION_NAME=RegionOne
|
|
export OS_AUTH_URL=http://keystone:35357
|
|
|
|
# Run CLI commands
|
|
openstack service list
|
|
neutron agent-list
|
|
```
|