Skip to content

[fix](regression) isolate ann_index_p0 table names - #62178

Merged
airborne12 merged 2 commits into
apache:masterfrom
RoanHeNaN:fix-ann-index-p0-table-name-isolation
Apr 8, 2026
Merged

[fix](regression) isolate ann_index_p0 table names#62178
airborne12 merged 2 commits into
apache:masterfrom
RoanHeNaN:fix-ann-index-p0-table-name-isolation

Conversation

@RoanHeNaN

Copy link
Copy Markdown
Contributor

Summary

  • rename shared ANN regression tables in ann_index_basic to suite-unique names
  • rename shared ANN regression tables in ivf_index_test to suite-unique names
  • avoid cross-suite table collisions in ann_index_p0 when suites run in parallel against the same regression database

@Thearas

Thearas commented Apr 7, 2026

Copy link
Copy Markdown
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@RoanHeNaN
RoanHeNaN force-pushed the fix-ann-index-p0-table-name-isolation branch from 3d257a3 to 9c08781 Compare April 7, 2026 13:53
@RoanHeNaN

Copy link
Copy Markdown
Contributor Author

run buildall

### What problem does this PR solve?

Issue Number: None

Related PR: None

Problem Summary: IVF and IVF_ON_DISK regression cases only executed several ANN queries without asserting their results, and some snapshot queries relied on implicit row order. This could miss regressions in ANN behavior and make the cases flaky.

### Release note

None

### Check List (For Author)

- Test: Regression test
    - `./run-regression-test.sh --run -f regression-test/suites/ann_index_p0/ivf_index_test.groovy -forceGenOut`
    - `./run-regression-test.sh --run -f regression-test/suites/ann_index_p0/ivf_on_disk_index_test.groovy -forceGenOut`
- Behavior changed: No
- Does this need documentation: No
@RoanHeNaN

Copy link
Copy Markdown
Contributor Author

run buildall

@github-actions

github-actions Bot commented Apr 8, 2026

Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions Bot added approved Indicates a PR has been approved by one committer. reviewed labels Apr 8, 2026
@github-actions

github-actions Bot commented Apr 8, 2026

Copy link
Copy Markdown
Contributor

PR approved by anyone and no changes requested.

@airborne12 airborne12 left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@airborne12
airborne12 merged commit 9c226f5 into apache:master Apr 8, 2026
30 of 31 checks passed
RoanHeNaN added a commit to RoanHeNaN/doris that referenced this pull request Apr 8, 2026
yiguolei pushed a commit that referenced this pull request Apr 9, 2026
…es (#62215)

## Summary
- backport PR #60358, #61160 and #62178 into branch-4.1 as a single
commit
- add IVF on-disk ANN index support, related cache/runtime changes, and
FE session/property updates
- bring over ANN regression coverage updates for IVF, IVF on-disk,
small-segment and min-train-rows scenarios
morningman added a commit to morningman/doris that referenced this pull request Aug 5, 2026
…lect compaction profile BE by tablet replica apache#62178 apache#65552

Backport two upstream regression-test fixes that never reached branch-4.0.
Both cause recurring failures in the daily branch-4.0 P0 pipeline.

1. ann_index_basic vs ivf_index_test table-name collision (apache#62178)

ann_index_basic and ivf_index_test run in the same regression database
(ann_index_p0) and both used tbl_ann_l2 / tbl_ann_ip. With suiteParallel=10
they can run concurrently: FE logs of the failing run show ivf_index_test
dropping and recreating tbl_ann_ip 230ms after ann_index_basic created it,
then inserting 6 rows. ann_index_basic then reads the neighbor's table by
name and fails. This also explains the historical intermittent empty result
of sql_ip_asc (query landing between the neighbor's create and publish);
the insert itself publishes in ~80ms, so the visibility-window theory
behind the waitRowsVisible gate (apache#65942) was wrong, and the 30s gate now
times out against the neighbor's 6-row table instead.

Rename the shared tables with basic_/ivf_ prefixes as upstream did in
9c226f5 (apache#62178) and drop the gate. ann_index_basic.groovy becomes
byte-identical to the upstream post-fix file. ivf_index_test takes only
the renames because the upstream file also carries the apache#60358 behavior
change (insufficient train rows no longer throws) which branch-4.0 BE
does not have. No .out changes needed.

2. test_compaction_profile_action queries an arbitrary BE (apache#65552)

The suite built the /api/compaction/profile URL from
backendId_to_backendIP.keySet()[0]. On a multi-BE pipeline (4 BEs,
replication forced to 3) the chosen BE has ~1/4 chance of not hosting the
tablet replica, so the tablet_id filter returns an empty list (observed
5/26 failures; the case is currently muted as DORIS-26131). Derive the
endpoint from the BackendId of the selected tablet row as upstream did in
fd16ebd (apache#65552); the file becomes byte-identical to the upstream
post-fix version.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/4.1.0-merged reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants