Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: Correct premature file read termination triggered by sender back pressure #1251

Merged
merged 2 commits into from
Nov 28, 2023

Conversation

linrunqi08
Copy link
Collaborator

@linrunqi08 linrunqi08 commented Nov 27, 2023

修复BlockedEvent在update的时候,非预期的事件覆盖行为
问题现象:
NAS场景Json采集,CP文件的方式替代历史文件采集的情况下,发现大量文件只采集了一小部分。

@@ -50,7 +50,14 @@ class BlockedEventManager : public LogstoreFeedBackInterface {
BlockedEvent() : mLogstoreKey(0), mEvent(NULL), mInvalidTime(time(NULL)), mTimeout(1) {}
void Update(const LogstoreFeedBackKey& logstoreKey, Event* pEvent, int32_t curTime) {
if (mEvent != NULL) {
delete mEvent;
// There are only two situations where event coverage is possible
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

评估下加入门槛的时间

@yyuuttaaoo yyuuttaaoo changed the title fix block event fix: Correct premature file read termination triggered by sender back pressure Nov 28, 2023
@yyuuttaaoo yyuuttaaoo merged commit 512c028 into main Nov 28, 2023
23 checks passed
@yyuuttaaoo yyuuttaaoo added the bug Something isn't working label Nov 28, 2023
@yyuuttaaoo yyuuttaaoo added this to the v1.8 milestone Dec 7, 2023
yyuuttaaoo pushed a commit that referenced this pull request Dec 7, 2023
… pressure (#1251)

Resolved an issue where incomplete file reads were occurring as a result of
reader flush timeout events overwriting blocked events. This fix
ensures that blocked events maintain priority, allowing files to be read fully.
@linrunqi08 linrunqi08 deleted the feature/taiye/fix_modify_event branch May 20, 2024 06:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants