Merge pull request #5211 from kwoodson/provisioning_fixes

Provisioning updates.

1 files changed, 96 insertions, 115 deletions

diff --git a/playbooks/aws/README.md b/playbooks/aws/README.md
index 0fb29ca06..c2da4b632 100644
--- a/playbooks/aws/README.md
+++ b/playbooks/aws/README.md
@@ -32,91 +32,52 @@ Before any provisioning may occur, AWS account credentials must be present in th
 ### Let's Provision!
 
 The newly added playbooks are the following:
-- build_ami.yml
-- provision.yml
-- provision_nodes.yml
+- build_ami.yml - Builds a custom AMI.  This currently requires the user to supply a valid AMI with access to repositories that contain openshift repositories.
+- provision.yml - Create a vpc, elbs, security groups, launch config, asg's, etc.
+- install.yml - Calls the openshift-ansible installer on the newly created instances
+- provision_nodes.yml - Creates the infra and compute node scale groups
+- accept.yml - This is a playbook to accept infra and compute nodes into the cluster
+- provision_install.yml - This is a combination of all 3 of the above playbooks. (provision, install, and provision_nodes as well as accept.yml)
 
-The current expected work flow should be to provide the `vars.yml` file with the
-desired settings for cluster instances.  These settings are AWS specific and should
-be tailored to the consumer's AWS custom account settings.
+The current expected work flow should be to provide an AMI with access to Openshift repositories.  There should be a repository specified in the `openshift_additional_repos` parameter of the inventory file. The next expectation is a minimal set of values in the `provisioning_vars.yml` file to configure the desired settings for cluster instances.  These settings are AWS specific and should be tailored to the consumer's AWS custom account settings.
 
 ```yaml
-clusterid: mycluster
-region: us-east-1
-
-provision:
-  clusterid: "{{ clusterid }}"
-  region: "{{ region }}"
-
-  build:
-    base_image: ami-bdd5d6ab # base image for AMI to build from
-    # when creating an encrypted AMI please specify use_encryption
-    use_encryption: False
-
-  # for s3 registry backend
-  openshift_registry_s3: True
-
-  # if using custom certificates these are required for the ELB
-  iam_cert_ca:
-    name: test_openshift
-    cert_path: '/path/to/wildcard.<clusterid>.example.com.crt'
-    key_path: '/path/to/wildcard.<clusterid>.example.com.key'
-    chain_path: '/path/to/cert.ca.crt'
-
-  instance_users:
-  - key_name: myuser_key
-    username: myuser
-    pub_key: |
-           ssh-rsa aaa<place public ssh key here>aaaaa user@<clusterid>
-
-  node_group_config:
-    tags:
-      clusterid: "{{ clusterid }}"
-      environment: stg
-    ssh_key_name: myuser_key # name of the ssh key from above
-
-    # configure master settings here
-    master:
-      instance_type: m4.xlarge
-      ami: ami-cdeec8b6 # if using an encrypted AMI this will be replaced
-      volumes:
-      - device_name: /dev/sdb
-        volume_size: 100
-        device_type: gp2
-        delete_on_termination: False
-      health_check:
-        period: 60
-        type: EC2
-      # Set the following number to be the same for masters.
-      min_size: 3
-      max_size: 3
-      desired_size: 3
-      tags:
-        host-type: master
-        sub-host-type: default
-      wait_for_instances: True
-...
-  vpc:
-    # name: mycluster  # If missing; will default to clusterid
-    cidr: 172.31.0.0/16
-    subnets:
-      us-east-1:  # These are us-east-1 region defaults. Ensure this matches your region
-      - cidr: 172.31.48.0/20
-        az: "us-east-1c"
-      - cidr: 172.31.32.0/20
-        az: "us-east-1e"
-      - cidr: 172.31.16.0/20
-        az: "us-east-1a"
+---
+openshift_node_bootstrap: True
 
-```
+# specify a clusterid
+# openshift_aws_clusterid: default
 
-Repeat the following setup for the infra and compute node groups.  This most likely
- will not need editing but if the install requires further customization then these parameters
- can be updated.
+# specify a region
+# openshift_aws_region: us-east-1
 
-#### Step 1
+# must specify a base_ami when building an AMI
+# openshift_aws_base_ami: # base image for AMI to build from
+# specify when using a custom AMI
+# openshift_aws_ami:
+
+# when creating an encrypted AMI please specify use_encryption
+# openshift_aws_ami_encrypt: False
+
+# custom certificates are required for the ELB
+# openshift_aws_iam_cert_path: '/path/to/cert/wildcard.<clusterid>.<domain>.com.crt'
+# openshift_aws_iam_cert_key_path: '/path/to/key/wildcard.<clusterid>.<domain>.com.key'
+# openshift_aws_iam_cert_chain_path: '/path/to/ca_cert_file/ca.crt'
+
+# This is required for any ec2 instances
+# openshift_aws_ssh_key_name: myuser_key
+
+# This will ensure these users are created
+#openshift_aws_users:
+#- key_name: myuser_key
+#  username: myuser
+#  pub_key: |
+#         ssh-rsa AAAA
+```
 
-Create an openshift-ansible inventory file to use for a byo installation.  The exception here is that there will be no hosts specified by the inventory file.  Here is an example:
+If customization is required for the instances, scale groups, or any other configurable option please see the ['openshift_aws/defaults/main.yml'](../../roles/openshift_aws/defaults/main.yml) for variables and overrides. These overrides can be placed in the `provisioning_vars.yml`, `inventory`, or `group_vars`.
+
+In order to create the bootstrap-able AMI we need to create an openshift-ansible inventory file.  This file enables us to create the AMI using the openshift-ansible node roles. The exception here is that there will be no hosts specified by the inventory file.  Here is an example:
 
 ```ini
 [OSEv3:children]
@@ -133,6 +94,8 @@ etcd
 ################################################################################
 # Ensure these variables are set for bootstrap
 ################################################################################
+# openshift_deployment_type is required for installation
+openshift_deployment_type=origin
 openshift_master_bootstrap_enabled=True
 
 openshift_hosted_router_wait=False
@@ -153,77 +116,94 @@ openshift_additional_repos=[{'name': 'openshift-repo', 'id': 'openshift-repo',
 
 There are more examples of cluster inventory settings [`here`](../../inventory/byo/).
 
-In order to create the bootstrapable AMI we need to create an openshift-ansible inventory file.  This file enables us to create the AMI using the openshift-ansible node roles.
-
-
-#### Step 2
+#### Step 1
 
-Once the vars.yml file has been updated with the correct settings for the desired AWS account then we are ready to build an AMI.
+Once the `inventory` and the `provisioning_vars.yml` file has been updated with the correct settings for the desired AWS account then we are ready to build an AMI.
 
 ```
-$ ansible-playbook -i inventory.yml build_ami.yml
+$ ansible-playbook -i inventory.yml build_ami.yml -e @provisioning_vars.yml
 ```
 
 1. This script will build a VPC. Default name will be clusterid if not specified.
 2. Create an ssh key required for the instance.
-3. Create an instance.
-4. Run some setup roles to ensure packages and services are correctly configured.
-5. Create the AMI.
-6. If encryption is desired
+3. Create a security group.
+4. Create an instance using the key from step 2 or a specified key.
+5. Run openshift-ansible setup roles to ensure packages and services are correctly configured.
+6. Create the AMI.
+7. If encryption is desired
   - A KMS key is created with the name of $clusterid
   - An encrypted AMI will be produced with $clusterid KMS key
-7. Terminate the instance used to configure the AMI.
+8. Terminate the instance used to configure the AMI.
 
+More AMI specific options can be found in ['openshift_aws/defaults/main.yml'](../../roles/openshift_aws/defaults/main.yml).  When creating an encrypted AMI please specify use_encryption:
+```
+# openshift_aws_ami_encrypt: True  # defaults to false
+```
 
-#### Step 3
+**Note**:  This will ensure to take the recently created AMI and encrypt it to be used later.  If encryption is not desired then set the value to false (defaults to false). The AMI id will be fetched and used according to its most recent creation date.
+
+#### Step 2
+
+Now that we have created an AMI for our Openshift installation, there are two ways to use the AMI.
 
-Now that we have created an AMI for our Openshift installation, that AMI id needs to be placed in the `vars.yml` file.  To do so update the following fields (The AMI can be captured from the output of the previous step or found in the ec2 console under AMIs):
+1. In the default behavior, the AMI id will be found and used in the last created fashion.
+2. The `openshift_aws_ami` option can be specified.  This will allow the user to override the behavior of the role and use a custom AMI specified in the `openshift_aws_ami` variable.
 
+We are now ready to provision and install the cluster.  This can be accomplished by calling all of the following steps at once or one-by-one.  The all in one can be called like this:
 ```
-  # when creating an encrypted AMI please specify use_encryption
-  use_encryption: False # defaults to false
+$ ansible-playbook -i inventory.yml provision_install.yml -e @provisioning_vars.yml
 ```
 
-**Note**: If using encryption, specify with `use_encryption: True`.  This will ensure to take the recently created AMI and encrypt it to be used later.  If encryption is not desired then set the value to false. The AMI id will be fetched and used according to its most recent creation date.
+If this is the first time running through this process, please attempt the following steps one-by-one and ensure the setup works correctly.
 
+#### Step 3
 
-#### Step 4
-
-We are ready to create the master instances and install Openshift.
+We are ready to create the master instances.
 
 ```
-$ ansible-playbook -i <inventory from step 1> provision.yml
+$ ansible-playbook provision.yml -e @provisioning_vars.yml
 ```
 
 This playbook runs through the following steps:
-1. Ensures a VPC is created
-2. Ensures a SSH key exists
-3. Creates an s3 bucket for the registry named $clusterid
-4. Create master security groups
-5. Create a master launch config
-6. Create the master auto scaling groups
-7. If certificates are desired for ELB, they will be uploaded
-8. Create internal and external master ELBs
-9. Add newly created masters to the correct groups
-10. Set a couple of important facts for the masters
-11. Run the [`byo`](../../common/openshift-cluster/config.yml)
+1. Ensures a VPC is created.
+2. Ensures a SSH key exists.
+3. Creates an s3 bucket for the registry named $clusterid-docker-registry
+4. Create master security groups.
+5. Create a master launch config.
+6. Create the master auto scaling groups.
+7. If certificates are desired for ELB, they will be uploaded.
+8. Create internal and external master ELBs.
+9. Add newly created masters to the correct groups.
+10. Set a couple of important facts for the masters.
+
+At this point we have successfully created the infrastructure including the master nodes.
 
-At this point we have created a successful cluster with only the master nodes.
+#### Step 4
+
+Now it is time to install Openshift using the openshift-ansible installer.  This can be achieved by running the following playbook:
+
+```
+$ ansible-playbook -i inventory.yml install.yml @provisioning_vars.yml
+```
+This playbook accomplishes the following:
+1. Builds a dynamic inventory file by querying AWS.
+2. Runs the [`byo`](../../common/openshift-cluster/config.yml)
 
+Once this playbook completes, the cluster masters should be installed and configured.
 
 #### Step 5
 
-Now that we have a cluster deployed it might be more interesting to create some node types.  This can be done easily with the following playbook:
+Now that we have a cluster deployed it will be more interesting to create some node types.  This can be done easily with the following playbook:
 
 ```
-$ ansible-playbook provision_nodes.yml
+$ ansible-playbook provision_nodes.yml -e @provisioning_vars.yml
 ```
 
 Once this playbook completes, it should create the compute and infra node scale groups.  These nodes will attempt to register themselves to the cluster.  These requests must be approved by an administrator.
 
 #### Step 6
 
-The registration of our nodes can be automated by running the following script `accept.yml`.  This script can handle the registration in a few different ways.
+To facilitate the node registration process, nodes may be registered by running the following script `accept.yml`.  This script can register in a few different ways.
 - approve_all - **Note**: this option is for development and test environments.  Security is bypassed
 - nodes - A list of node names that will be accepted into the cluster
 
@@ -233,10 +213,11 @@ The registration of our nodes can be automated by running the following script `
    nodes: < list of nodes here >
    timeout: 0
 ```
+
 Once the desired accept method is chosen, run the following playbook `accept.yml`:
 1. Run the following playbook.
 ```
-$ ansible-playbook accept.yml
+$ ansible-playbook accept.yml -e @provisioning_vars.yml
 ```
 
 Login to a master and run the following command:
@@ -263,6 +244,6 @@ ip-172-31-49-148.ec2.internal   Ready                      1h       v1.6.1+5115d
 
 At this point your cluster should be ready for workloads.  Proceed to deploy applications on your cluster.
 
-### Still to compute
+### Still to come
 
 There are more enhancements that are arriving for provisioning.  These will include more playbooks that enhance the provisioning capabilities.