[#4984] improvement(core, doris): Add the random distribution strategy #4985
Conversation
| EVEN, | ||
|
|
||
| /** Distributes data randomly across partitions or table. */ | ||
| RANDOM; |
There was a problem hiding this comment.
What are the differences between EVEN and RANDOM?
AFAIK, RANDOM is a kind of implementation of EVEN
There was a problem hiding this comment.
Both aim to balance the distribution of data to optimize performance, "Random" emphasizes more on the randomness of the data, while "Even" focuses on maintaining the uniformity of the distribution.
They are slightly different.
There was a problem hiding this comment.
@FANNG1 do you have any comments on this issue.
There was a problem hiding this comment.
IMO, HASH, RANGE RANDOM are the implemetation how we do the distribution, even is the something like distribution result, both HASH and RANDOM are the implementation of EVEN
There was a problem hiding this comment.
So it's recommend to remove EVEN? But I remember that @yuqi1129 has done research and there is a certain kind of table that uses EVEN as a distribution name
There was a problem hiding this comment.
@yuqi1129 , do you remember which kind of table use even distribution, could it be replaced by round-robin or random?
There was a problem hiding this comment.
There was a problem hiding this comment.
@jerryshao any thoughts on this point? #4991 depends on this one.
There was a problem hiding this comment.
You guys have better background on this, you can have a off-line discussion and negotiate out a solution.
There was a problem hiding this comment.
We could not reach an agreement till now, so I postponed it to 0.7.0 as it's not a bugfix.
What changes were proposed in this pull request?
Add the random strategy instead of
evenfor DistributionWhy are the changes needed?
Doris support
randomdistribution instead ofeven.Fix: #4984
Does this PR introduce any user-facing change?
N/A.
How was this patch tested?
IT