Skip to content

[BUG] The recall rate significantly drops by 20% when using CAGRA with a full 1s prefilter (nothing filtered out). #472

Open
@rhdong

Description

Describe the bug
When using CAGRA with a full ones prefilter, (nothing filtered out), the recall rate significantly drop by 20%

--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Benchmark                                            Time             CPU   Iterations        GPU    Latency     Recall end_to_end items_per_second      itopk          k  n_queries total_queries
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
raft_cagra.dim32/0/0/process_time/real_time       1.17 ms         1.17 ms        11941   1.16104m   1.17158m     0.9385    13.9899        853.548/s        128         10          1       11.941k algo="single_cta"
raft_cagra.dim32/1/0/process_time/real_time       2.14 ms         2.14 ms         6554   2.12471m   2.13548m   **0.789747**    13.9959        468.279/s        256         10          1        6.554k algo="single_cta"
raft_cagra.dim32/0/1/process_time/real_time       2.42 ms         2.42 ms         5768   2.41063m   2.42168m     0.9385    13.9682       412.937k/s        128         10       1000        5.768M algo="single_cta"
raft_cagra.dim32/1/1/process_time/real_time       4.59 ms         4.59 ms         3045   4.58215m   4.59372m    **0.79002**    13.9879       217.689k/s        256         10       1000        3.045M algo="single_cta"

Steps/Code to reproduce bug
CUVS_CAGRA_ANN_BENCH reproduce branch

Expected behavior
The recall rate should be very close to the no prefilter case.

Environment details (please complete the following information):

  • Any benchmark environment.

Additional context
Add any other context about the problem here.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions