- Improvements on plugin's shutdown #500
- Fix: avoid plugin crash when connection terminated but processing the message
- Graceful shutdown: close acceptor group (incoming socket handler) first, ask and wait for the executors which have pending tasks, better message handling when executors terminated
- Fixed to populate the
@metadata
fields even if the source's metadata value is nil
#502
- bump netty to 4.1.109 #495
- Remove Logstash forwarder test cases and add Lumberjack test cases #488
- Added logging the best Netty's
maxOrder
setting when big payload trigger an unpooled allocation #493
- Introduce expert only
event_loop_threads
to tune netty event loop threads count #490
- Restore accidentally removed Lumberjack event parse source lines #486
- bump netty to 4.1.100 and jackson to 2.15.3 #484
- PROTOCOL: adds explicit support for receiving a 0-length window to encapsulate an empty batch. Empty batches are acknowledged with the same 0-sequence ACK's that are used as keep-alives during processing. #479
- [DOC] Fix misleading
enrich/source_data
input beats documentation about the Logstash host. #478
- [DOC] Updated the
ssl_client_authentication
and ssl_verify_mode
documentation explaining that CN and SAN are not validated. #473
- bump netty to 4.1.94 and jackson to 2.15.2 #474
- update netty to 4.1.93 and jackson to 2.13.5 #472
- Reviewed and deprecated SSL settings to comply with Logstash's naming convention #470
- Deprecated
ssl
in favor of ssl_enabled
- Deprecated
ssl_verify_mode
in favor of ssl_client_authentication
- An enrichment
enrich
option added to control ECS passthrough. ssl_peer_metadata
and include_codec_tag
configurations are deprecated and can be managed through the enrich
#464
- Updates Netty dependency to 4.1.87 #466
- [DOC]
executor_threads
default value explanation updated. #461
- Build: do not package jackson dependencies #455
- [DOC] Add direct memory example #454
- Feat: review and deprecate ssl protocol/cipher settings #450
- Fix: Removed use of deprecated
import
of java classes in ruby #449
- Added support for TLSv1.3. #447
- Update guidance regarding the private key format and encoding #445
- Build: do not package log4j-api dependency #441.
Logstash provides the log4j framework and the dependency is not needed except testing and compiling.
- Updated log4j dependency to 2.17.0
- Updated log4j dependency to 2.15.0
- Fix: update to Gradle 7 #432
- [DOC] Edit documentation for
executor_threads
#435
- Fix: LS failing with
ssl_peer_metadata => true
#431
- [DOC] described
executor_threads
configuration parameter #421
- ECS compatibility enablement: Adds alias to support upcoming ECS v8 with the existing ECS v1 implementation
- [DOC] Remove limitations topic and link #428
- [DOC] Applied more attributes to manage plugin name in doc content, and implemented conditional text processing. #423
- Changed jar dependencies to reflect newer versions #425
- Fix: reduce error logging on connection resets #424
- Fix: safe-guard byte buf allocation #420
- Updated Jackson dependencies
- [DOC] Added naming attribute to control plugin name that appears in docs, and set up framework to make attributes viable in code sample
- [DOC] Enhanced ECS compatibility information for ease of use and readability
#413
- ECS compatibility enablement. Adds
ecs_compatibility
setting to declare the level of ECS compatibility (disabled
or v1
) at plugin level. When disabled
, the plugin behaves like before, while v1
does a rename of
host
and @metadata.ip_address
event fields. #404
- Feat: log + unwrap generic SSL context exceptions #405
- [DOC] Update links to use shared attributes
- Fix: log error when SSL context building fails #402.
We've also made sure to log messages on configuration errors as LS 7.8/7.9 only prints details when level set to debug.
- Updated jackson databind and Netty dependencies. Additionally, this release removes the dependency on
tcnative
+
boringssl
, using JVM supplied ciphers instead. This may result in fewer ciphers being available if the JCE
unlimited strength jurisdiction policy is not installed. (This policy is installed by default on versions of the
JDK from u161 onwards)#393
- Added error handling to detect if ssl certificate or key files can't be read #394
- Fixed issue where calling
java_import
on org.logstash.netty.SslContextBuilder
was causing the TCP input to pick up the wrong SslContextBuilder class
potentially causing pipeline creation to fail #388
- Fixed issue where an SslContext was unnecessarily being created for each connection #383
- Fixed issue where
end
was not being called when an Inflater was closed #383
- Reverted changes to netty and tcnative dependencies and removal of CBC ciphers to preserve compatibility with Lumberjack output #381
- Downgraded netty to 4.1.34 due to an issue in IdleStateHandler #380
- Security: update netty deps - avoid CBC ciphers #376
- Updated Jackson dependencies
- Fixed configuration example in doc #371
- Improved handling of invalid compressed content #368
- Updated Jackson dependencies #366
- Removed obsolete setting congestion_threshold and target_field_for_codec
- Changed default value of
add_hostname
to false
- Loosen jar-dependencies manager gem dependency to allow plugin to work with JRubies that include a later version.
- Updated jar dependencies to reflect newer releases
- Docs: Fixed broken link by removing extra space. #347
- Docs: Fixed section ID that was causing doc build errors in the versioned
plugin docs. #346
- Added
add_hostname
flag to enable/disable the population of the host
field from the beats.hostname field #340
- Fixed handling of batches where the sequence numbers do not start with 1 #342
- Changed project to use gradle version 4.8.1. #334
- This is an internal, non user-impacting, change to use a more modern version of gradle for building the plugin.
- Docs: Add more detail about creating versioned indexes for Beats data
- Added ssl_peer_metadata option. #327
- Fixed ssl_verify_mode => peer. #326
- #289 Re-initialise Netty worker group on plugin restart
- Update jackson deps to 2.9.5
- Fix broken 5.0.12 release
- Docs: Set the default_codec doc attribute.
- Ensure that the keep-alive is sent for ALL pending batches when the pipeline is blocked, not only the batches attempting to write to the queue. #310
- Update jackson deps to 2.9.4
- Improvements to back pressure handling and memory management #299
- Update jackson deps to 2.9.1
- Docs: Deprecate
document_type
option
- Re-order Netty pipeline to avoid NullPointerExceptions in KeepAliveHandler when Logstash is under load
- Improve exception logging
- Upgrade to Netty 4.1.18 with tcnative 2.0.7
- Better handle case when remoteAddress is nil to reduce amount of warning messages in logs #269
- Fix an issue with
close_wait
connection and making sure the keep alive are send back to the client all the time. #272
- Change IdleState strategy from
READER_IDLE
to ALL_IDLE
#262
- Additional context when logging from the BeatsHandler #261
- Remove the
LoggingHandler
from the handler stack to reduce noise in the log.
- Fix some documentation issues
- Mark deprecated congestion_threshold and target_field_for_codec as obsolete
- Additional default cipher PR#242
- Fix logging from Java
- Include remote ip_address in metadata. #180
- Require Java 8 #221
- Fix ability to set SSL protocols #228
- Relax version of concurrent-ruby to
~> 1.0
#216
- Breaking change: Logstash will no longer start when multiline codec is used with the Beats input plugin #201
- Version yanked from RubyGems for packaging issues
- Fix ability to set SSL protocols #228
- Relax version of concurrent-ruby to ~> 1.0 #216
- Docs: Add note indicating that the multiline codec should not be used with the Beats input plugin
- Deprecate warning for multiline codec with the Beats input plugin
- Version yanked from RubyGems for packaging issues
- DEBUG: Add information about the remote when an exception is catched #192
- Fix: Make sure idle connection are correctly close for the right client, #185, #178
- Fix: remoge string interpolation for logging in critical path #184
- Fix: remove monkeypatch from the main class to fix the documentation generator issues
- Fix the Logger initialization in logstash 2.4.X #166
- Uses SO_linger for the socket option to force the server to completely disconnect the idle clients elastic/logstash#6300
- Correctly send the client_inactivity_timeout to the Server classe #163
- Mark congestion_threshold as deprecated, the java implementation now use a keep alive mechanism
- Docs: Removed statement about intermediate CAs not being supported
- Fix a typo in the default ciphers suite, added validations for the configured ciphers #156
- validate the presence of
ssl_certificate_authorities
when verify_mode
is set to FORCE_PEER or peer #155
- Fix an issue when only the first CA found in the certificate authorities was taking into consideration to verify clients #153
- Fix an issue with the
READER_IDLE
that was closing a connection in a middle of working on a batch #141
- Fix an issue when the plugin did not accept a specific host to bind to. #146
- Fix an issue when forcing a logstash shutdown that could result in an
InterruptedException
#145
- Fix an issue when using a passphrase was raising a TypeError #138
- Fix the filebeat integration suite to use the new
ssl
option instead of tls
- Use correct log4j logger call to be compatible with 2.4
- Add a note concerning the requirement of the PKCS8 format for the private key.
- Use a relative path for the VERSION, this change is needed by the doc generation tool to read the gemspec.
- Propagate SSL handshake error correctly
- Move back to log4j 1, to make it work better under logstash 2.4
- Remove the SSL Converter, Private Key must be in the PKCS8 format, which is the default of any newer OpenSSL library
- Replace FileInputStream with File reference to let netty handle correctly the certificates
- Tests now uses OpenSSL binary to convert PKCS7 Private generated from ruby to PKCS8
- Remove dependency on bouncycastle
- Fix an issue when the input could hang forever when stopping Logstash
- [Doc changes] Add Logstash config example and clarify use of the
type
config option
- Fix a NullPointer Exception elastic/logstash#5756
- Log4j ERROR will now be propagated upstream, IE: InvalidCertificate OR InvalidFrameType.
- Relax constraints on multiline to make it work under 2.4
- Fix a problem that would would make the server refuse concurrent connection to the server #111
- Jars were missing from the latest release on rubygems
- Better handling of connection timeout, added a new option to set the value for it, the default is 15 seconds #108
- Make sure that incomplete SSL handshake doesn't take down the server #101
- Sending Garbage data will now raise a specific exception `InvalidFrameProtocolException` #100
- Adding assertions on the payload size and the fields count to make the parser more resilient to erronous frames #99
- Rewrite of the beats input in Java using the Netty framewwork, this rewrite is meant to be backward compatible with the previous implementation
- Relax constraint on logstash-core-plugin-api to >= 1.60 <= 2.99
but should yield better throughput and memory usage. #93
- Fix an issue when parsing multiple frames received from a filebeat client using pipelining.
- Republish all the gems under jruby.
- Update the plugin to the version 2.0 of the plugin api, this change is required for Logstash 5.0 compatibility. See elastic/logstash#5141
- Fix #73 Bug in EventTransformCommon#codec_name, use config_name
- Add regression test for fix to #73
- Non deterministic error for the LSF integration test
- Make this plugin really a drop in replacement for the lumberjack input, so LSF can send their events to this plugin.
- More robust test when using a random port #60
- Fix LSF integration tests #52
- Do not use the identity map if we don't explicitly use the
multiline
codec
- Fix failing tests introduce by the
ssl_key_passphrase
changes.
- Added an integration test for the
ssl_key_passphrase
- Add an optional parameter for
auto_flush
- Fix bug where using
ssl_key_passphrase
wouldn't work
- Depend on logstash-core-plugin-api instead of logstash-core, removing the need to mass update plugins on major releases of logstash
- New dependency requirements for logstash-core for the 5.0 release
- The server can now do client side verification by providing a list of certificate authorities and configuring the
ssl_verify_mode
,
the server can use peer
, if the client send a certificate it will be validated. Using force_peer
will make sure the client provide a certificate
and it will be validated with the know CA. #8
- Change the
logger#warn
for logger.debug
when a peer get disconnected, keep alive check from proxy can generate a lot of logs #46
- Make sure we stop all the threads after running the tests #48
- Catch the
java.lang.InterruptedException
in the events broker
- Give a bit more time to the Thread to be started in the test #42
- Release a new version of the gem that doesn't included any other gems, 2.1.0 is yanked from rubygems
- Refactor of the code to make it easier to unit test
- Fix a conncurrency error on high load on the SizeQueue #37
- Drop the internal SizeQueue to rely on Java Synchronous Queue
- Remove the majority of the nested blocks
- Move the CircuitBreaker inside an internal namespace so it doesn't conflict with the input lumberjack
- Add more debugging log statement
- Flush the codec when a disconnect happen
- Tag/Decorate the event when a shutdown occur.
- The name of the threads managed by the input beat are now meaningful.
- Reduce the size of the gem by removing vendor jars
- Copy the
beat.hostname
field into the host
field for better compatibility with the other Logstash plugins #28
- Correctly merge multiple line with the multiline codec ref: #24
- Add support for stream identity, the ID will be generated from beat.id+resource_id or beat.name + beat.source if not present #22 #13
The identity allow the multiline codec to correctly merge string from multiples files.
- Fix an issue with rogue events created by buffered codecs #19
- Correctly decorate the event with the
add_field
and tags
option from the config #12
- Connection#run should rescue
Broken Pipe Error
#5
- Fix a
SystemCallErr
issue on windows when shutting down the server #9
- fix an issue with the incorrectly calculated ack when the window_size was smaller than the ACK_RATIO see #3
- Move the ruby-lumberjack library into the plugin