The instructions below assume Application Gateway Ingress Controller (AGIC) will be installed in an environment with no pre-existing components.
We recommend the use of Azure Cloud Shell for all command line operations below. Launch your shell from shell.azure.com or by clicking the link:
Alternatively, launch Cloud Shell from Azure portal using the following icon:
Your Azure Cloud Shell already has all necessary tools. Should you choose to use another environment, please ensure the following command line tools are installed:
az
- Azure CLI: installation instructionskubectl
- Kubernetes command-line tool: installation instructionshelm
- Kubernetes package manager: installation instructionsjq
- command-line JSON processor: installation instructions
Follow the steps below to create an Azure Active Directory (AAD) service principal object. Please record the appId
, password
, and objectId
values - these will be used in the following steps.
-
Create AD service principal (Read more about RBAC). Paste the following lines in your Azure Cloud Shell:
az ad sp create-for-rbac --skip-assignment -o json > auth.json appId=$(jq -r ".appId" auth.json) password=$(jq -r ".password" auth.json)
These commands will create `appId` and `password` bash variables, which will be used in the steps below. You can view the value of these with `echo $appId` and `echo $password`.
-
Execute the next command in Cloud Shell to create the
objectId
bash variable, which is the new Service Princpial:objectId=$(az ad sp show --id $appId --query "objectId" -o tsv)
The
objectId
bash variable will be used in the ARM template below. View the value withecho $objectId
. -
Paste the entire command below (it is a single command on multiple lines) in Cloud Shell to create the parameters.json file. It will be used in the ARM template deployment.
cat <<EOF > parameters.json { "aksServicePrincipalAppId": { "value": "$appId" }, "aksServicePrincipalClientSecret": { "value": "$password" }, "aksServicePrincipalObjectId": { "value": "$objectId" }, "aksEnableRBAC": { "value": false } } EOF
To deploy an RBAC enabled cluster, set the
aksEnabledRBAC
field totrue
. View the contents of the newly created file withcat parameters.json
. It will contain the values of theappId
,password
, andobjectId
bash variables from the previous steps.
The next few steps will add the following list of components to your Azure subscription:
- Azure Kubernetes Service
- Application Gateway v2
- Virtual Network with 2 subnets
- Public IP Address
- Managed Identity, which will be used by AAD Pod Identity
-
Download the ARM template into template.json file. Paste the following in your shell:
wget https://raw.githubusercontent.com/Azure/application-gateway-kubernetes-ingress/master/deploy/azuredeploy.json -O template.json
-
Deploy the ARM template via Azure Cloud Shell and the
az
tool. Modify the name of the resource group and region/location, then paste each of the following lines into your shell:resourceGroupName="MyResourceGroup" location="westus2" deploymentName="ingress-appgw" az group create -n $resourceGroupName -l $location az group deployment create -g $resourceGroupName -n $deploymentName --template-file template.json --parameters parameters.json
Note: The last command may take a few minutes to complete.
-
Once the deployment finished, download the deployment output into a file named
deployment-outputs.json
.az group deployment show -g $resourceGroupName -n $deploymentName --query "properties.outputs" -o json > deployment-outputs.json
View the content of the newly created file with:
cat deployment-outputs.json
. The file will have the following shape (example):{ "aksApiServerAddress": { "type": "String", "value": "aks-abcd41e9.hcp.westus2.azmk8s.io" }, "aksClusterName": { "type": "String", "value": "aksabcd" }, "applicationGatewayName": { "type": "String", "value": "applicationgatewayabcd" }, "identityClientId": { "type": "String", "value": "7b1a3378-8abe-ab58-cca9-a8ef624db293" }, "identityResourceId": { "type": "String", "value": "/subscriptions/a6466a81-bf0d-147e-2acb-a0ba50f6456e/resourceGroups/MyResourceGroup/providers/Microsoft.ManagedIdentity/userAssignedIdentities/appgwContrIdentityabcd" }, "resourceGroupName": { "type": "String", "value": "MyResourceGroup" }, "subscriptionId": { "type": "String", "value": "a6466a81-bf0d-147e-2acb-a0ba50f6456e" } }
With the instructions in the previous section we created and configured a new AKS cluster and an App Gateway. We are now ready to deploy a sample app and an ingress controller to our new Kubernetes infrastructure.
For the following steps we need setup kubectl command,
which we will use to connect to our new Kubernetes cluster. Cloud Shell has kubectl
already installed. We will use az
CLI to obtain credentials for Kubernetes.
Get credentials for your newly deployed AKS (read more):
# use the deployment-outputs.json created after deployment to get the cluster name and resource group name
aksClusterName=$(jq -r ".aksClusterName.value" deployment-outputs.json)
resourceGroupName=$(jq -r ".resourceGroupName.value" deployment-outputs.json)
az aks get-credentials --resource-group $resourceGroupName --name $aksClusterName
Azure Active Directory Pod Identity provides token-based access to Azure Resource Manager (ARM).
AAD Pod Identity will add the following components to your Kubernetes cluster:
- Kubernetes CRDs:
AzureIdentity
,AzureAssignedIdentity
,AzureIdentityBinding
- Managed Identity Controller (MIC) component
- Node Managed Identity (NMI) component
To install AAD Pod Identity to your cluster:
- RBAC enabled AKS cluster
kubectl apply -f https://raw.githubusercontent.com/Azure/aad-pod-identity/v1.6.0/deploy/infra/deployment-rbac.yaml
- RBAC disabled AKS cluster
kubectl apply -f https://raw.githubusercontent.com/Azure/aad-pod-identity/v1.6.0/deploy/infra/deployment.yaml
Note: AAD Pod Identity introduced a breaking change after v1.5.5 regarding CRD fields become case sensitive, for any AAD Pod Identity version >= 1.6.0 or you plan to apply from master branch such as https://raw.githubusercontent.com/Azure/aad-pod-identity/master/deploy/infra/deployment-rbac.yaml, AGIC version at least v1.2.0-rc2 will be required, more details please refer to troubleshooting.
Helm is a package manager for Kubernetes. This document will use version 3 of helm, which is not backwards compatbile with previous versions.
- Add the AGIC Helm repository:
helm repo add application-gateway-kubernetes-ingress https://appgwingress.blob.core.windows.net/ingress-azure-helm-package/ helm repo update
-
Use the
deployment-outputs.json
file created above and create the following variables.applicationGatewayName=$(jq -r ".applicationGatewayName.value" deployment-outputs.json) resourceGroupName=$(jq -r ".resourceGroupName.value" deployment-outputs.json) subscriptionId=$(jq -r ".subscriptionId.value" deployment-outputs.json) identityClientId=$(jq -r ".identityClientId.value" deployment-outputs.json) identityResourceId=$(jq -r ".identityResourceId.value" deployment-outputs.json)
-
Download helm-config.yaml, which will configure AGIC:
wget https://raw.githubusercontent.com/Azure/application-gateway-kubernetes-ingress/master/docs/examples/sample-helm-config.yaml -O helm-config.yaml
-
Edit the newly downloaded helm-config.yaml and fill out the sections
appgw
andarmAuth
.sed -i "s|<subscriptionId>|${subscriptionId}|g" helm-config.yaml sed -i "s|<resourceGroupName>|${resourceGroupName}|g" helm-config.yaml sed -i "s|<applicationGatewayName>|${applicationGatewayName}|g" helm-config.yaml sed -i "s|<identityResourceId>|${identityResourceId}|g" helm-config.yaml sed -i "s|<identityClientId>|${identityClientId}|g" helm-config.yaml # You can further modify the helm config to enable/disable features nano helm-config.yaml
Values:
-
verbosityLevel
: Sets the verbosity level of the AGIC logging infrastructure. See Logging Levels for possible values. -
appgw.subscriptionId
: The Azure Subscription ID in which App Gateway resides. Example:a123b234-a3b4-557d-b2df-a0bc12de1234
-
appgw.resourceGroup
: Name of the Azure Resource Group in which App Gateway was created. Example:app-gw-resource-group
-
appgw.name
: Name of the Application Gateway. Example:applicationgatewayd0f0
-
appgw.usePrivateIP
: The boolean flag if all Ingresses are exposed over Private IP. Set tofalse
should you use an Application Gateway v2 SKU -
appgw.shared
: This boolean flag should be defaulted tofalse
. Set totrue
should you need a Shared App Gateway. -
kubernetes.watchNamespace
: Specify the name space, which AGIC should watch. This could be a single string value, or a comma-separated list of namespaces. -
armAuth.type
: could beaadPodIdentity
orservicePrincipal
-
armAuth.identityResourceID
: Resource ID of the Azure Managed Identity -
armAuth.identityClientId
: The Client ID of the Identity. See below for more information on Identity -
armAuth.secretJSON
: Only needed when Service Principal Secret type is chosen (whenarmAuth.type
has been set toservicePrincipal
) -
rbac.enabled
: Make sure to set this to true if you have a AKS cluster that is RBAC enabled.Note on Identity: The
identityResourceID
andidentityClientID
are values that were created during the Create an Identity steps, and could be obtained again using the following command:az identity show -g <resource-group> -n <identity-name>
-
<resource-group>
in the command above is the resource group of your App Gateway. -
<identity-name>
is the name of the created identity. All identities for a given subscription can be listed using:az identity list
-
Install the Application Gateway ingress controller package:
helm install ingress-azure \ -f helm-config.yaml \ application-gateway-kubernetes-ingress/ingress-azure \ --version 1.3.0
Note: Use at least version 1.2.0-rc1, i.e.
--version 1.2.0-rc1
, when installing on k8s version >= 1.16
Now that we have App Gateway, AKS, and AGIC installed we can install a sample app via Azure Cloud Shell:
cat <<EOF | kubectl apply -f -
apiVersion: v1
kind: Pod
metadata:
name: aspnetapp
labels:
app: aspnetapp
spec:
containers:
- image: "mcr.microsoft.com/dotnet/core/samples:aspnetapp"
name: aspnetapp-image
ports:
- containerPort: 80
protocol: TCP
---
apiVersion: v1
kind: Service
metadata:
name: aspnetapp
spec:
selector:
app: aspnetapp
ports:
- protocol: TCP
port: 80
targetPort: 80
---
apiVersion: extensions/v1beta1
kind: Ingress
metadata:
name: aspnetapp
annotations:
kubernetes.io/ingress.class: azure/application-gateway
spec:
rules:
- http:
paths:
- path: /
backend:
serviceName: aspnetapp
servicePort: 80
EOF
Alternatively you can:
- Download the YAML file above:
curl https://raw.githubusercontent.com/Azure/application-gateway-kubernetes-ingress/master/docs/examples/aspnetapp.yaml -o aspnetapp.yaml
- Apply the YAML file:
kubectl apply -f aspnetapp.yaml
The tutorials document contains more examples on how toexpose an AKS service via HTTP or HTTPS, to the Internet with App Gateway.