Skip to content

Commit

Permalink
[fix](stream load) do not throw exception but skip record when can no…
Browse files Browse the repository at this point in the history
…t find database (#39360) (#39527)

pick (#39360)

When fetch stream load record from BE node, if can not find database,
StreamLoadRecordMgr will throw exception and the remaining records will
not be recorded in memory.

For example: Ten stream load records were pulled, and the database
associated with the stream load of the first record was deleted by the
user. Therefore, the pull will end, resulting in the remaining nine
records not being consumed recorded in memory.

This pr do not throw exception but skip record when can not find
database to solve this problem.
  • Loading branch information
sollhui authored Aug 19, 2024
1 parent a1aa9b8 commit 3d8b04a
Showing 1 changed file with 2 additions and 2 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,6 @@
import org.apache.doris.catalog.Env;
import org.apache.doris.common.ClientPool;
import org.apache.doris.common.Config;
import org.apache.doris.common.UserException;
import org.apache.doris.common.io.Text;
import org.apache.doris.common.io.Writable;
import org.apache.doris.common.util.MasterDaemon;
Expand Down Expand Up @@ -315,7 +314,8 @@ protected void runAfterCatalogReady() {
if (Strings.isNullOrEmpty(streamLoadItem.getCluster())) {
dbName = streamLoadItem.getDb();
}
throw new UserException("unknown database, database=" + dbName);
LOG.warn("unknown database, database=" + dbName);
continue;
}
long dbId = db.getId();
Env.getCurrentEnv().getStreamLoadRecordMgr()
Expand Down

0 comments on commit 3d8b04a

Please sign in to comment.