[Bug]: Flush func in DataCoord returns only SegmentLevel_L1 segments as flushed segments #33055
Open
1 task done
Labels
kind/bug
Issues or changes related a bug
triage/accepted
Indicates an issue or PR is ready to be actively worked on.
Is there an existing issue for this?
Environment
Current Behavior
Hello,
After upgrading Milvus from v2.3.10 to v2.4.0 in the test environment, milvus-backup tool only backed up three out of five segments in a collection with ~6million entities. The three segments all have
level
:SegmentLevel_L1
and the other two segments havelevel
:SegmentLevel_Legacy
(the default value). All of the segments are inFlushed
state.It seems that there's a change between v2.3.10 and v2.4.0 to the
Flush
func inDataCoord
service which filters only segments oflevel
:SegmentLevel_L1
. This could be the reason that milvus-backup didn't back up all segments since it calledFlush
to get the flushed segments before copying their log files.[Please feel free to correct here] A quick read of the codebase seems to suggest that
level
will be updated toSegmentLevel_L1
for segments after going through compaction and this info is saved to meta.Appreciate it if anyone can look into this issue. It has become a blocker to upgrading in prod until back-up is verified to cover all segments. Thank you.
Expected Behavior
All flushed segments except probably the ones of
SegmentLevel_L0
should be returned fromFlush
in DataCoord.Steps To Reproduce
Milvus Log
N/A
Anything else?
No response
The text was updated successfully, but these errors were encountered: