We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Framework filebeat --> kafka --> fluentd --> elasticsearch
Describe the problem filebeat comes with an array of tags, but fluentd doesn't filter out! The filter in logstash is
mutate { add_field => { "city" => "%{[tags][0]}" "ip" => "%{[tags][1]}" } }
filebeat output configuration
output.kafka: hosts: ["120.0.0.1:9092"] topic: test required_acks: 1 tags: ["xinyi", "19.18.14.168"] Fluentd Filter Configuration <filter **> @type record_transformer enable_ruby true auto_typecast true <record> city %{[tags][0]} ip %{[tags][1]} </record> </filter>
result The city and IP fields inserted into es are %{[tags][0]} and %{[tags][1} So, filtering didn't work, looking forward to answer, thanks
The text was updated successfully, but these errors were encountered:
No branches or pull requests
Framework
filebeat --> kafka --> fluentd --> elasticsearch
Describe the problem
filebeat comes with an array of tags, but fluentd doesn't filter out!
The filter in logstash is
filebeat output configuration
result
The city and IP fields inserted into es are %{[tags][0]} and %{[tags][1}
So, filtering didn't work, looking forward to answer, thanks
The text was updated successfully, but these errors were encountered: