Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[VL] Reuse native build artifact for different spark version to save resources and time #5721

Closed
Yohahaha opened this issue May 13, 2024 · 2 comments · Fixed by #5768
Closed
Labels
enhancement New feature or request

Comments

@Yohahaha
Copy link
Contributor

Description

native build artifact (velox and gluten cpp) is common for different spark version, we can reuse it and trigger java module when success.

cc @zhouyuan @PHILO-HE

@Yohahaha Yohahaha added the enhancement New feature or request label May 13, 2024
@PHILO-HE
Copy link
Contributor

PHILO-HE commented May 15, 2024

We are still trying to re-use static linked libraries, which are built out in one OS, but can be used in other OS. I guess there are still some issues under fixing. cc @zhouyuan

@PHILO-HE
Copy link
Contributor

PHILO-HE commented May 16, 2024

@Yohahaha, we just had an internal discussion. There is still a gap to re-use static linked libraries across different OS. I will add a cache in CI to save time, as you proposed. Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants