diff --git a/docs/_print/index.html b/docs/_print/index.html index 20044d2e4..6d2593f15 100644 --- a/docs/_print/index.html +++ b/docs/_print/index.html @@ -251,8 +251,10 @@
REVISION: 1 TEST SUITE: None-Note: Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public. -Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
+Note:
+
- +
Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public.
Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
- +
If you’re installing the Helm chart from Terraform, reference the repository as
repository = "oci://ghcr.io/kube-logging/helm-charts/"
(without thelogging-operator
suffix). Otherwise, you’ll get a 403 Forbidden error.Note: By default, the Logging operator Helm chart doesn’t install the
logging
resource. If you want to install it with Helm, set thelogging.enabled
value to true.For details on customizing the installation, see the Helm chart values.
Validate the deployment
To verify that the installation was successful, complete the following steps.
Check the status of the pods. You should see a new logging-operator pod.
kubectl -n logging get pods @@ -2998,8 +3000,10 @@
5.3 - Store Nginx Access Logs in Am
REVISION: 1 TEST SUITE: None-Note: Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public. -Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
- +
Note:
+
- +
Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public.
Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
- +
If you’re installing the Helm chart from Terraform, reference the repository as
repository = "oci://ghcr.io/kube-logging/helm-charts/"
(without thelogging-operator
suffix). Otherwise, you’ll get a 403 Forbidden error.
Create AWS secret
If you have your
$AWS_ACCESS_KEY_ID
and$AWS_SECRET_ACCESS_KEY
set you can use the following snippet.
kubectl -n logging create secret generic logging-cloudwatch --from-literal "awsAccessKeyId=$AWS_ACCESS_KEY_ID" --from-literal "awsSecretAccessKey=$AWS_SECRET_ACCESS_KEY"
Or set up the secret manually.
kubectl -n logging apply -f - <<"EOF"
@@ -3093,8 +3097,10 @@ 5.4 - Transport all logs into Amazo
REVISION: 1
TEST SUITE: None
-Note: Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public. -Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
Note:
Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public.
Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
If you’re installing the Helm chart from Terraform, reference the repository as repository = "oci://ghcr.io/kube-logging/helm-charts/"
(without the logging-operator
suffix). Otherwise, you’ll get a 403 Forbidden error.
Create AWS secret
@@ -3222,8 +3228,10 @@5.5 - Store NGINX access logs in El REVISION: 1 TEST SUITE: None
-Note: Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public. -Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
Note:
Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public.
Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
If you’re installing the Helm chart from Terraform, reference the repository as repository = "oci://ghcr.io/kube-logging/helm-charts/"
(without the logging-operator
suffix). Otherwise, you’ll get a 403 Forbidden error.
Create the logging
resource.
kubectl -n logging apply -f - <<"EOF"
@@ -3468,8 +3476,10 @@ Deploy the Logging o
REVISION: 1
TEST SUITE: None
-Note: Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public. -Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
Note:
Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public.
Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
If you’re installing the Helm chart from Terraform, reference the repository as repository = "oci://ghcr.io/kube-logging/helm-charts/"
(without the logging-operator
suffix). Otherwise, you’ll get a 403 Forbidden error.
Create the logging
resource with a persistent syslog-ng installation.
kubectl apply -f - <<"EOF"
apiVersion: logging.banzaicloud.io/v1beta1
@@ -3587,8 +3597,10 @@ 5.9 - Transport Nginx Access Logs i
REVISION: 1
TEST SUITE: None
-Note: Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public. -Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
Note:
Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public.
Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
If you’re installing the Helm chart from Terraform, reference the repository as repository = "oci://ghcr.io/kube-logging/helm-charts/"
(without the logging-operator
suffix). Otherwise, you’ll get a 403 Forbidden error.
Create the logging
resource.
kubectl -n logging apply -f - <<"EOF"
apiVersion: logging.banzaicloud.io/v1beta1
@@ -3707,8 +3719,10 @@ 5.10 - Store Nginx Access Logs in G
REVISION: 1
TEST SUITE: None
-Note: Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public. -Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
Note:
Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public.
Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
If you’re installing the Helm chart from Terraform, reference the repository as repository = "oci://ghcr.io/kube-logging/helm-charts/"
(without the logging-operator
suffix). Otherwise, you’ll get a 403 Forbidden error.
Create the logging
resource.
kubectl -n logging apply -f - <<"EOF"
apiVersion: logging.banzaicloud.io/v1beta1
kind: Logging
@@ -4936,8 +4950,10 @@ 7.2 - Monitor your logging pipeline
REVISION: 1
TEST SUITE: None
-Note: Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public. -Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
Note:
Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public.
Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
If you’re installing the Helm chart from Terraform, reference the repository as repository = "oci://ghcr.io/kube-logging/helm-charts/"
(without the logging-operator
suffix). Otherwise, you’ll get a 403 Forbidden error.
Create Minio Credential Secret
kubectl -n logging create secret generic logging-s3 --from-literal=accesskey='AKIAIOSFODNN7EXAMPLE' --from-literal=secretkey='wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY'
If you encounter problems while using the Logging operator the documentation does not address, open an issue or talk to us on Discord or on the CNCF Slack.
The following companies provide commercial support for the Logging operator:
If your company offers support for Logging operator and would like to be listed on this page, open a documentation issue.
Note:
Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public.
Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
If you’re installing the Helm chart from Terraform, reference the repository as repository = "oci://ghcr.io/kube-logging/helm-charts/"
(without the logging-operator
suffix). Otherwise, you’ll get a 403 Forbidden error.
Create the logging
resource.
kubectl -n logging apply -f - <<"EOF"
@@ -580,8 +586,10 @@ Deploy the Logging o
REVISION: 1
TEST SUITE: None
-Note: Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public. -Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
Note:
Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public.
Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
If you’re installing the Helm chart from Terraform, reference the repository as repository = "oci://ghcr.io/kube-logging/helm-charts/"
(without the logging-operator
suffix). Otherwise, you’ll get a 403 Forbidden error.
Create the logging
resource with a persistent syslog-ng installation.
kubectl apply -f - <<"EOF"
apiVersion: logging.banzaicloud.io/v1beta1
@@ -699,8 +707,10 @@ 9 - Transport Nginx Access Logs int
REVISION: 1
TEST SUITE: None
-Note: Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public. -Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
Note:
Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public.
Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
If you’re installing the Helm chart from Terraform, reference the repository as repository = "oci://ghcr.io/kube-logging/helm-charts/"
(without the logging-operator
suffix). Otherwise, you’ll get a 403 Forbidden error.
Create the logging
resource.
kubectl -n logging apply -f - <<"EOF"
apiVersion: logging.banzaicloud.io/v1beta1
@@ -819,8 +829,10 @@ 10 - Store Nginx Access Logs in Gra
REVISION: 1
TEST SUITE: None
-Note: Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public. -Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
Note:
Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public.
Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
If you’re installing the Helm chart from Terraform, reference the repository as repository = "oci://ghcr.io/kube-logging/helm-charts/"
(without the logging-operator
suffix). Otherwise, you’ll get a 403 Forbidden error.
Create the logging
resource.
kubectl -n logging apply -f - <<"EOF"
apiVersion: logging.banzaicloud.io/v1beta1
kind: Logging
diff --git a/docs/examples/cloudwatch-nginx/index.html b/docs/examples/cloudwatch-nginx/index.html
index 6f66d15fe..fe2007b0e 100644
--- a/docs/examples/cloudwatch-nginx/index.html
+++ b/docs/examples/cloudwatch-nginx/index.html
@@ -22,12 +22,12 @@
The following figure gives you an overview about how the system works. The Logging operator collects the logs from the application, selects which logs to forward to the output, and sends the selected log messages to the output. For more details about the Logging operator, see the Logging operator overview.">
-
+
-
-
+
+
REVISION: 1
TEST SUITE: None
-Note: Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public. -Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
Note:
Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public.
Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
If you’re installing the Helm chart from Terraform, reference the repository as repository = "oci://ghcr.io/kube-logging/helm-charts/"
(without the logging-operator
suffix). Otherwise, you’ll get a 403 Forbidden error.
Create AWS secret
If you have your
$AWS_ACCESS_KEY_ID
and$AWS_SECRET_ACCESS_KEY
set you can use the following snippet.
kubectl -n logging create secret generic logging-cloudwatch --from-literal "awsAccessKeyId=$AWS_ACCESS_KEY_ID" --from-literal "awsSecretAccessKey=$AWS_SECRET_ACCESS_KEY"
Or set up the secret manually.
kubectl -n logging apply -f - <<"EOF"
@@ -684,7 +686,7 @@ Store Nginx Access Logs in Amazon CloudWatch with Logging Operator
If you don’t get the expected result you can find help in the troubleshooting section.
-Note: Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public. -Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
Note:
Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public.
Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
If you’re installing the Helm chart from Terraform, reference the repository as repository = "oci://ghcr.io/kube-logging/helm-charts/"
(without the logging-operator
suffix). Otherwise, you’ll get a 403 Forbidden error.
Create the logging
resource.
kubectl -n logging apply -f - <<"EOF"
@@ -714,7 +716,7 @@ Store NGINX access logs in Elasticsearch with Logging operator
Open the Kibana dashboard in your browser at https://localhost:5601 and login as elastic using the retrieved password.-
By default, the Logging operator sends the incoming log messages into an index called fluentd. Create an Index Pattern that includes this index (for example, fluentd*), then select Menu > Kibana > Discover. You should see the dashboard and some sample log messages from the demo application.
If you don’t get the expected result you can find help in the troubleshooting section.
-Last modified August 5, 2024: Merge pull request #250 from kube-logging/containerd-fix-to-fluentbit-examples (9560233)
+Last modified August 8, 2024: Merge pull request #251 from kube-logging/terraform-403-helm (81e5509)
-Note: Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public. -Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
Note:
Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public.
Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
If you’re installing the Helm chart from Terraform, reference the repository as repository = "oci://ghcr.io/kube-logging/helm-charts/"
(without the logging-operator
suffix). Otherwise, you’ll get a 403 Forbidden error.
Create AWS secret
@@ -684,7 +686,7 @@Transport all logs into Amazon S3 with Logging operator
FluentOutLogrotate why this was changed and how you can re-enable it if needed.
Check the output. The logs will be available in the bucket on a path
like:
/logs/default.default-logging-simple-fluentbit-lsdp5.fluent-bit/2019/09/11/201909111432_0.gz
If you don’t get the expected result you can find help in the troubleshooting section.
YAML files for simple logging flows with filter examples.
-Note: Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public. -Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
Note:
Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public.
Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
If you’re installing the Helm chart from Terraform, reference the repository as repository = "oci://ghcr.io/kube-logging/helm-charts/"
(without the logging-operator
suffix). Otherwise, you’ll get a 403 Forbidden error.
Create the logging
resource.
kubectl -n logging apply -f - <<"EOF"
apiVersion: logging.banzaicloud.io/v1beta1
@@ -665,7 +667,7 @@ Transport Nginx Access Logs into Kafka with Logging operator
{"stream":"stdout","logtag":"F","kubernetes":{"pod_name":"logging-demo-log-generator-5f9f9cdb9f-mpp98","namespace_name":"logging","pod_id":"e2822c26-961c-4be8-99a2-b17517494ca1","labels":{"app.kubernetes.io/instance":"logging-demo","app.kubernetes.io/name":"log-generator","pod-template-hash":"5f9f9cdb9f"},"host":"ip-192-168-2-102.eu-west-2.compute.internal","container_name":"log-generator","docker_id":"26ffbec769e52e468216fe43a331f4ce5374075f9b2717d9b9ae0a7f0747b3e2","container_hash":"ghcr.io/banzaicloud/log-generator@sha256:814a69be8ab8a67aa6b009d83f6fa6c4776beefbe629a869ff16690fde8ac362","container_image":"ghcr.io/banzaicloud/log-generator:0.3.3"},"remote":"26.220.126.5","host":"-","user":"-","method":"POST","path":"/","code":"200","size":"14370","referer":"-","agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:52.0) Gecko/20100101 Firefox/52.0","http_x_forwarded_for":"-"}
If you don’t get the expected result you can find help in the troubleshooting section.
-Note: Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public. -Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
Note:
Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public.
Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
If you’re installing the Helm chart from Terraform, reference the repository as repository = "oci://ghcr.io/kube-logging/helm-charts/"
(without the logging-operator
suffix). Otherwise, you’ll get a 403 Forbidden error.
Create the logging
resource.
kubectl -n logging apply -f - <<"EOF"
apiVersion: logging.banzaicloud.io/v1beta1
kind: Logging
@@ -712,7 +714,7 @@ Store Nginx Access Logs in Grafana Loki with Logging operator
Use the admin
username and the password retrieved in Step 1 to log in.
Select Menu > Explore, select Data source > Loki, then select Log labels > namespace > logging. A list of logs should appear.
If you don’t get the expected result you can find help in the troubleshooting section.
-Last modified August 5, 2024: Merge pull request #250 from kube-logging/containerd-fix-to-fluentbit-examples (9560233)
+Last modified August 8, 2024: Merge pull request #251 from kube-logging/terraform-403-helm (81e5509)
Check logs coming from both tenants kubectl logs -f -n infra svc/test-receiver
Expected output should show logs from both tenants
[0] tenant_a: [[1695999280.157810965, {}], {"log"=>"15.238.250.48 - - [29/Sep/2023:14:54:38 +0000] "PUT /pro...
[0] tenant_b: [[1695999280.160868923, {}], {"log"=>"252.201.89.36 - - [29/Sep/2023:14:54:33 +0000] "POST /bl...
Open the Splunk dashboard in your browser: http://localhost:8000. You should see the dashboard and some sample log messages from the demo application.
If you don’t get the expected result you can find help in the troubleshooting section.
-Note: Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public. -Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
Note:
Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public.
Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
If you’re installing the Helm chart from Terraform, reference the repository as repository = "oci://ghcr.io/kube-logging/helm-charts/"
(without the logging-operator
suffix). Otherwise, you’ll get a 403 Forbidden error.
Create the logging
resource with a persistent syslog-ng installation.
kubectl apply -f - <<"EOF"
apiVersion: logging.banzaicloud.io/v1beta1
@@ -729,7 +731,7 @@ Deploy the Logging o
Install log-generator to produce logs with the label app.kubernetes.io/name: log-generator
helm upgrade --install --wait --create-namespace --namespace logging log-generator oci://ghcr.io/kube-logging/helm-charts/log-generator
If you don’t get the expected result you can find help in the troubleshooting section.
-Last modified August 5, 2024: Merge pull request #250 from kube-logging/containerd-fix-to-fluentbit-examples (9560233)
+Last modified August 8, 2024: Merge pull request #251 from kube-logging/terraform-403-helm (81e5509)
Helm v3
helm upgrade --install --wait --create-namespace --namespace logging logging ./charts/logging-operator --set image.tag=master
-Note: Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public. -Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
+Note:
+
- +
Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public.
Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
- +
If you’re installing the Helm chart from Terraform, reference the repository as
repository = "oci://ghcr.io/kube-logging/helm-charts/"
(without thelogging-operator
suffix). Otherwise, you’ll get a 403 Forbidden error.
Note: By default, the Logging operator Helm chart doesn’t install the
logging
resource. If you want to install it with Helm, set thelogging.enabled
value to true.For details on customizing the installation, see the Helm chart values.
To verify that the installation was successful, complete the following steps.
Check the status of the pods. You should see a new logging-operator pod.
kubectl -n logging get pods
diff --git a/docs/install/index.html b/docs/install/index.html
index 189612d8a..786665263 100644
--- a/docs/install/index.html
+++ b/docs/install/index.html
@@ -598,8 +598,10 @@ Install
REVISION: 1
TEST SUITE: None
-Note: Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public. -Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
+Note:
+
- +
Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public.
Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
- +
If you’re installing the Helm chart from Terraform, reference the repository as
repository = "oci://ghcr.io/kube-logging/helm-charts/"
(without thelogging-operator
suffix). Otherwise, you’ll get a 403 Forbidden error.
Note: By default, the Logging operator Helm chart doesn’t install the
logging
resource. If you want to install it with Helm, set thelogging.enabled
value to true.For details on customizing the installation, see the Helm chart values.
To verify that the installation was successful, complete the following steps.
Check the status of the pods. You should see a new logging-operator pod.
kubectl -n logging get pods
@@ -623,7 +625,7 @@ Install
syslogngoutputs.logging.banzaicloud.io 2023-08-10T12:05:06Z
Note: If your Logging resource has its spec.loggingRef parameter set, set the same value in the spec.loggingRef parameter of the Flow resource.
Set other Flow parameters as needed for your environment.
Create the outputs (called "output-for-nodegroup-A"
and "output-for-nodegroup-B"
) for the Flows.
Note: To configure readiness probes, see Readiness probe.
The Persistent Volume Claim should be created with the given spec
and with the name
defined in the source
’s claimName
.
To adjust the CPU and memory limits and requests of the pods managed by Logging operator, see CPU and memory requirements.
If both watchNamespaces
and watchNamespaceSelector
are set, the union of them will take effect.
Note: To configure readiness probes, see Readiness probe.
For other parameters of the logging resource, see LoggingSpec.
-Note: Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public. -Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
Note:
Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public.
Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
If you’re installing the Helm chart from Terraform, reference the repository as repository = "oci://ghcr.io/kube-logging/helm-charts/"
(without the logging-operator
suffix). Otherwise, you’ll get a 403 Forbidden error.
Create Minio Credential Secret
kubectl -n logging create secret generic logging-s3 --from-literal=accesskey='AKIAIOSFODNN7EXAMPLE' --from-literal=secretkey='wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY'
On the Prometheus web interface, this rule looks like:
You cannot apply filters for this specific error flow.
Apply the ClusterOutput and Logging to your cluster.
-Note: Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public. -Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
Note:
Helm has a known issue in version 3.13.0 that requires users to log in to the registry, even though the repo is public.
Upgrade to 3.13.1 or higher to avoid having to log in, see: https://github.com/kube-logging/logging-operator/issues/1522
If you’re installing the Helm chart from Terraform, reference the repository as repository = "oci://ghcr.io/kube-logging/helm-charts/"
(without the logging-operator
suffix). Otherwise, you’ll get a 403 Forbidden error.
Create Minio Credential Secret
kubectl -n logging create secret generic logging-s3 --from-literal=accesskey='AKIAIOSFODNN7EXAMPLE' --from-literal=secretkey='wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY'
kubectl -n logging port-forward svc/monitor-grafana 3000:80
The Logging operator watches resources in all namespaces, which is required because it manages cluster-scoped objects, and also objects in multiple namespaces.
However, in a large-scale infrastructure, where the number of resources is large, it makes sense to limit the scope of resources monitored by the Logging operator to save considerable amount of memory and container restarts.
Starting with Logging operator version 3.12.0, this is now available by passing the following command-line arguments to the operator.
watch-namespace
: Watch only objects in this namespace. Note that even if the watch-namespace
option is set, the operator must watch certain objects (like Flows
and Outputs
) in every namespace.watch-logging-name
: Logging resource name to optionally filter the list of watched objects based on which logging they belong to by checking the app.kubernetes.io/managed-by
label.You can add your own custom readiness probes to the spec.ReadinessProbe section of the logging custom resource. For details on the format of readiness probes, see the official Kubernetes documentation.
CAUTION:
If you set any custom readiness probes, they completely override the default probes.Note: When multiple instances send logs to the same output, the output can receive chunks of messages out of order. Some outputs tolerate this (for example, Elasticsearch), some do not, some require fine tuning (for example, Loki).
In a large-scale infrastructure the logging components can get high load as well. The typical sign of this is when fluentd
cannot handle its buffer directory size growth for more than the configured or calculated (timekey + timekey_wait) flush interval. In this case, you can scale the fluentd statefulset.
The Logging Operator supports scaling a Fluentd aggregator statefulset up and down. Scaling statefulset pods down is challenging, because we need to take care of the underlying volumes with buffered data that hasn’t been sent, but the Logging Operator supports that use case as well.
The details for that and how to configure an HPA is described in the following documents:
SyslogNG can be scaled up as well, but persistent disk buffers are not processed automatically when scaling the statefulset down. That is currently a manual process.
After deploying the debug version, you can kubectl exec into the pod using sh
and look around. For example: kubectl exec -it logging-demo-fluentbit-778zg sh
You can check the buffer directory if Fluent Bit is configured to buffer queued log messages to disk instead of in memory. (You can configure it through the InputTail fluentbit config, by setting the storage.type
field to filesystem
.)
kubectl exec -it logging-demo-fluentbit-9dpzg ls /buffers
If you encounter any problems that the documentation does not address, file an issue or talk to us on Discord or on the CNCF Slack.
Before asking for help, prepare the following information to make troubleshooting faster:
Do not forget to remove any sensitive information (for example, passwords and private keys) before sharing.
If you encounter any problems that the documentation does not address, file an issue or talk to us on Discord or on the CNCF Slack.
Before asking for help, prepare the following information to make troubleshooting faster:
Do not forget to remove any sensitive information (for example, passwords and private keys) before sharing.
If you encounter any problems that the documentation does not address, file an issue or talk to us on Discord or on the CNCF Slack.
Before asking for help, prepare the following information to make troubleshooting faster:
Do not forget to remove any sensitive information (for example, passwords and private keys) before sharing.
The Logging operator has a builtin mechanism that validates the generated syslog-ng configuration before applying it to syslog-ng. You should be able to see the configcheck pod and its log output. The result of the check is written into the status
field of the corresponding Logging
resource.
In case the operator is stuck in an error state caused by a failed configcheck, restore the previous configuration by modifying or removing the invalid resources to the point where the configcheck pod is finally able to complete successfully.
Use the following command to display the configuration of syslog-ng:
kubectl get secret logging-demo-syslogng-app -o jsonpath="{.data['syslog-ng\.conf']}" | base64 --decode
If you encounter any problems that the documentation does not address, file an issue or talk to us on Discord or on the CNCF Slack.
Before asking for help, prepare the following information to make troubleshooting faster:
Do not forget to remove any sensitive information (for example, passwords and private keys) before sharing.
Installed a simple receiver to act as the destination of the logs, and configured the the log forwarder to send the logs from the quickstart
namespace to this destination.
Installed a log-generator application to generate sample log messages, and verified that the logs of this application arrive to the output.
If you encounter any problems that the documentation does not address, file an issue or talk to us on Discord or on the CNCF Slack.
Before asking for help, prepare the following information to make troubleshooting faster:
Do not forget to remove any sensitive information (for example, passwords and private keys) before sharing.
use_legacy_template
option to false
.For the list of images used in Logging operator, see Images used by Logging operator.
Fluentd images with versions v1.14
and v1.15
are now EOL due to the fact they are based on ruby 2.7 which is EOL as well.
The currently supported image is v1.15-ruby3 and build configuration for v1.15-staging is available for staging experimental changes.