Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(logging): using init-fluent-bit images #140

Merged
merged 8 commits into from
May 6, 2024

Conversation

thisismana
Copy link
Member

Migrate to Init Process of AWS for Fluent-Bit Image.

We now use the official image and bootstrap it with centralized configs that support our use case (json and envoy logs).

Context: https://github.com/aws/aws-for-fluent-bit/tree/develop/use_cases/init-process-for-fluent-bit

fluentbit.tf Outdated Show resolved Hide resolved
fluentbit.tf Outdated Show resolved Hide resolved
Copy link

github-actions bot commented Apr 7, 2024

This PR has been automatically marked as stale because it has been open 30 days
with no activity. Remove stale label or comment or this PR will be closed in 10 days

@github-actions github-actions bot added the stale label Apr 7, 2024
@moritzzimmer
Copy link
Member

Not stale

@github-actions github-actions bot removed the stale label Apr 8, 2024
@moritzzimmer
Copy link
Member

moritzzimmer commented Apr 26, 2024

@thisismana @saefty I pushed a proposal which allows dynamic configuration of S3 or image local init config files on the client side including (least priviledge) IAM permission for S3 config files.

Example usage on the client side:

init_config_files = [
      "arn:aws:s3:::config-${var.account_id}-${var.region}/ecs/fluent-bit/service-custom.conf",
      "arn:aws:s3:::config-${var.account_id}-${var.region}/ecs/fluent-bit/filters-custom.conf",
      "arn:aws:s3:::config-${var.account_id}-${var.region}/ecs/fluent-bit/parsers-custom.conf",
      "arn:aws:s3:::foo-${var.account_id}-${var.region}/ecs/fluent-bit/parsers-custom.conf",
      "/ecs/s3.conf"
    ]

What do you think?

@moritzzimmer moritzzimmer added the enhancement New feature or request label Apr 26, 2024
thisismana and others added 2 commits April 26, 2024 13:23
Migrate to _Init Process_ of AWS for Fluent-Bit Image.

We now use the official image and bootstrap it with centralized configs that support our use case (json and envoy logs).

Context: https://github.com/aws/aws-for-fluent-bit/tree/develop/use_cases/init-process-for-fluent-bit
fluentbit.tf Outdated Show resolved Hide resolved
@moritzzimmer moritzzimmer merged commit d8e8b31 into stroeer:main May 6, 2024
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants