Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[HUDI-7146] Integrate secondary index on reader path #11162

Open
wants to merge 3 commits into
base: master
Choose a base branch
from

Conversation

codope
Copy link
Member

@codope codope commented May 6, 2024

Change Logs

This is stacked on top of #11146. This PR integrates the secondary index on the reader path as follows:

  • Add HoodieTableMetadata#readSecondaryIndex API
  • Add SecondaryIndexSupport, a util class to get candidate files based on query filter and secondary index
  • Changes in HoodieFileIndex to use SecondaryIndexSupport

Impact

Can use secondary index in queries.

Risk level (write none, low medium or high below)

medium

Documentation Update

Describe any necessary documentation update if there is any new feature, config, or user-facing change. If not, put "none".

  • The config description must be updated if new configs are added or the default value of the configs are changed
  • Any new feature or user-facing change requires updating the Hudi website. Please create a Jira ticket, attach the
    ticket number here and follow the instruction to make
    changes to the website.

Contributor's checklist

  • Read through contributor's guide
  • Change Logs and Impact were stated clearly
  • Adequate tests were added if applicable
  • CI passed

@github-actions github-actions bot added the size:XL PR with lines of changes > 1000 label May 6, 2024
@codope codope force-pushed the impl-sec-index-read branch 2 times, most recently from dc04695 to 49f3c3f Compare May 7, 2024 17:36
@codope codope force-pushed the impl-sec-index-read branch 2 times, most recently from 1c2c253 to 96b10a6 Compare May 20, 2024 11:06
@codope codope force-pushed the impl-sec-index-read branch 4 times, most recently from 9d0e802 to a602c9c Compare May 30, 2024 06:45
@github-actions github-actions bot added size:L PR with lines of changes in (300, 1000] and removed size:XL PR with lines of changes > 1000 labels May 30, 2024
@hudi-bot
Copy link

CI report:

Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
index release-1.0.0-beta2 size:L PR with lines of changes in (300, 1000]
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants