Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create _dlt_* tables even when schema contract is frozen #1366

Draft
wants to merge 7 commits into
base: devel
Choose a base branch
from

Conversation

sultaniman
Copy link
Collaborator

This PR let's dlt to create _dlt_* tables even when schema_contract=freeze

Resolves: #1237

@sultaniman sultaniman self-assigned this May 15, 2024
Copy link

netlify bot commented May 15, 2024

Deploy Preview for dlt-hub-docs canceled.

Name Link
🔨 Latest commit 134ef72
🔍 Latest deploy log https://app.netlify.com/sites/dlt-hub-docs/deploys/6645ec4b7d49b00008b51b36

@sultaniman sultaniman changed the title Create _dlt_* tables even when schema contract is frozen WIP:Create _dlt_* tables even when schema contract is frozen May 15, 2024
@sultaniman sultaniman marked this pull request as draft May 15, 2024 14:01
@sultaniman sultaniman requested a review from rudolfix May 15, 2024 14:46
@sultaniman sultaniman changed the title WIP:Create _dlt_* tables even when schema contract is frozen Create _dlt_* tables even when schema contract is frozen May 15, 2024
@@ -2230,3 +2270,48 @@ def stateful_resource():
assert len(fs_client.list_table_files("_dlt_loads")) == 2
assert len(fs_client.list_table_files("_dlt_version")) == 1
assert len(fs_client.list_table_files("_dlt_pipeline_state")) == 1


def test_pipeline_with_frozen_schema_contract() -> None:
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please reproduce a test case that user described. All starts with a database that already has a table and a pipeline in total freeze mode! then we can look for a fix in the code

@sultaniman sultaniman force-pushed the fix/issue-1237/create__dlt_tables branch from 583e8f1 to c278878 Compare May 16, 2024 08:41
@rudolfix rudolfix assigned burnash and unassigned sultaniman May 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Data Contracts block _dlt tables creation
3 participants