Translate Plugin - Added functionality to provide full path to the source field #3050
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
Removed the iterateOn option. Now the iterateOn functionality will be taken care by source option with the help of full path to the source.
Configuring
source
option with pathThe source provided can be full path to the field in the log that requires translation.
If the source path is something like
field1/field2/source
, all the objects that satisfy the path will be translated based on the provided mappings and the targets fields will be placed in the object along the pathfield1/field2/target
.The fields (
field1
,field2
) leading up to the source field in the path must be JSON arrays or JSON objects. It is important to note that other JSON data types cannot be iterated in this context.The
translate_when
expression if configured will only be applied for the JSON objects with reference to the pathfield1/field2
.As
source
option supports multiple sources to be configured, it is required for all the sources in the array to have a common root path.Let the pipeline configuration be:
Let the contents of
logs_json.log
be:The translated log would look like this:
Issues Resolved
#1914
Check List
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.