使用processor_split_log_regex采集java堆栈日志时没有多行合并为一条数据

[apothecary-ap]

以下是我的ilogtail采集配置：
enable: true
inputs:

• Type: file_log
  LogPath: /opt/logs/server/
  FilePattern: '*-error.log'
  EnableLogPositionMeta: true
  processors:
• Type: processor_add_fields
  Fields:
  logtype: error-runlog
  servicename: server
  ilogtail: ilogtail
• Type: processor_split_log_regex
  SplitRegex: ^\d{4}-\d{2}-\d{2}\s\d{2}:\d{2}:\d+.*
  SplitKey: content
  PreserveOthers: true
  flushers:
• Type: flusher_kafka_v2
  Compression: gzip
  Brokers:
  • 120.168.171.227:9092
    Convert:
    ProtocolFieldsRename:
    contents: fields
    Topic: error_collect_log
    使用1.8.0的ilogtail采集java堆栈日志到kafka时没有多行合并为一条数据
    以下是日志数据：
    2023-10-23 18:14:03.378 [scheduling-1] ERROR c.h.a.c.c.ResMethods - [sendxxxxPost,174] - 调用登录的第三方接口异常 url: http://xxxx.xxxx.com/hcos/rest?relation=103852, Exception:
    org.springframework.web.client.ResourceAccessException: I/O error on POST request for "http://xxxx.xxxx.com/hcos/rest": connect timed out; nested exception is java.net.SocketTimeoutException: connect timed out
    at org.springframework.web.client.RestTemplate.doExecute(RestTemplate.java:785)
    at org.springframework.web.client.RestTemplate.execute(RestTemplate.java:711)
    at org.springframework.web.client.RestTemplate.exchange(RestTemplate.java:602)
    at com.xxxx.aiops.core.config.ResMethods.sendxxxxPost(ResMethods.java:163)
    at com.xxxx.aiops.server.service.xxxxOnDutyAlarm.getTotalNonrespAlarmCnt(xxxxOnDutyAlarm.java:71)
    at com.xxxx.aiops.server.job.AlarmSummaryJob.getOnDutyAlarm(AlarmSummaryJob.java:199)
    at sun.reflect.GeneratedMethodAccessor623.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84)
    at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54)
    at org.springframework.scheduling.concurrent.ReschedulingRunnable.run(ReschedulingRunnable.java:95)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)
    Caused by: java.net.SocketTimeoutException: connect timed out
    at java.net.PlainSocketImpl.socketConnect(Native Method)
    at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:476)
    at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:218)
    at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:200)
    at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:394)
    at java.net.Socket.connect(Socket.java:606)
    at sun.net.NetworkClient.doConnect(NetworkClient.java:175)
    at sun.net.www.http.HttpClient.openServer(HttpClient.java:463)
    at sun.net.www.http.HttpClient.openServer(HttpClient.java:558)
    at sun.net.www.http.HttpClient.(HttpClient.java:242)
    at sun.net.www.http.HttpClient.New(HttpClient.java:339)
    at sun.net.www.http.HttpClient.New(HttpClient.java:357)
    at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1240)
    at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1167)
    at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1061)
    at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:995)
    at org.springframework.http.client.SimpleBufferingClientHttpRequest.executeInternal(SimpleBufferingClientHttpRequest.java:76)
    at org.springframework.http.client.AbstractBufferingClientHttpRequest.executeInternal(AbstractBufferingClientHttpRequest.java:48)
    at org.springframework.http.client.AbstractClientHttpRequest.execute(AbstractClientHttpRequest.java:66)
    at org.springframework.web.client.RestTemplate.doExecute(RestTemplate.java:776)
    ... 18 common frames omitted
    以下为采集到kafka的数据：
    
    
    
    
    

[linrunqi08]

@apothecary-ap https://ilogtail.gitbook.io/ilogtail-docs/data-pipeline/processor/processor-split-log-regex 可以看下文档，processor_split_log_regex一定要是processors中第一个，你可以改下试试

[apothecary-ap]

好的我试下

[apothecary-ap]

已解决非常感谢

[linrunqi08]

@apothecary-ap #693 方便的话留一下使用场景吧，感谢