Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test failure: test_delete_ws_groups_should_delete_renamed_and_reflected_groups_only #3547

Open
github-actions bot opened this issue Jan 17, 2025 · 0 comments
Labels
bug Something isn't working

Comments

@github-actions
Copy link

❌ test_delete_ws_groups_should_delete_renamed_and_reflected_groups_only: TimeoutError: Timed out after 0:05:00 (6m28.084s)
TimeoutError: Timed out after 0:05:00
[gw5] linux -- Python 3.10.16 /home/runner/work/ucx/ucx/.venv/bin/python
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ...
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Found 62 Group
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Found 6 WorkspaceGroup
18:03 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_snlfj.groups] fetching groups inventory
18:03 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 633, in _try_fetch
    for row in self._sql_backend.fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 478, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_snlfj`.`groups` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
18:03 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_snlfj.groups] crawling new set of snapshot data for groups
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Found 6 WorkspaceGroup
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Found 83 account groups
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Group listing provided, a subset of all groups will be migrated
18:03 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_snlfj.groups] found 1 new records for groups
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Starting to rename 1 groups for migration...
18:03 DEBUG [databricks.labs.ucx.workspace_access.groups] Renaming group: ucx_G8Ixa-ra78b33a08 (id=904071278282182) -> ucx-temp-ucx_G8Ixa-ra78b33a08
18:03 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename has possibly taken effect: ucx_G8Ixa-ra78b33a08 (id=904071278282182) -> ucx-temp-ucx_G8Ixa-ra78b33a08
18:03 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename has possibly taken effect: ucx_G8Ixa-ra78b33a08 (id=904071278282182) -> ucx-temp-ucx_G8Ixa-ra78b33a08
18:03 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename is assumed complete: ucx_G8Ixa-ra78b33a08 (id=904071278282182) -> ucx-temp-ucx_G8Ixa-ra78b33a08
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ...
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Found 67 WorkspaceGroup
18:03 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration reflects renamed group: 904071278282182 (renamed to ucx-temp-ucx_G8Ixa-ra78b33a08)
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ...
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Found 67 WorkspaceGroup
18:03 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration reflects renamed group: 904071278282182 (renamed to ucx-temp-ucx_G8Ixa-ra78b33a08)
18:03 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration showed all 1 renamed groups; assuming complete.
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Found 83 account groups
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ...
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Found 61 Group
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Found 6 WorkspaceGroup
18:03 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_snlfj.groups] fetching groups inventory
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Starting to reflect 1 account groups into workspace for migration...
18:03 ERROR [databricks.labs.ucx.workspace_access.groups] Skipping ucx_G8Ixa-ra78b33a08: group already exists in workspace
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ...
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Found 61 Group
18:03 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_snlfj.groups] fetching groups inventory
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Starting to remove 1 migrated workspace groups...
18:03 WARNING [databricks.labs.ucx.workspace_access.groups] Not deleting group ucx-temp-ucx_G8Ixa-ra78b33a08(id=904071278282182) (originally ucx_G8Ixa-ra78b33a08): its migrated account group (ucx_G8Ixa-ra78b33a08) cannot be found.
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ...
18:04 INFO [databricks.labs.ucx.workspace_access.groups] Found 67 WorkspaceGroup
18:04 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration does not contain any of the 0 deleted workspace groups; possibly deleted.
18:04 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ...
18:04 INFO [databricks.labs.ucx.workspace_access.groups] Found 67 WorkspaceGroup
18:04 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration does not contain any of the 0 deleted workspace groups; possibly deleted.
18:04 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration omitted all 0 workspace groups; assuming deleted.
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ...
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Found 62 Group
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Found 6 WorkspaceGroup
18:03 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_snlfj.groups] fetching groups inventory
18:03 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 633, in _try_fetch
    for row in self._sql_backend.fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 478, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_snlfj`.`groups` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
18:03 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_snlfj.groups] crawling new set of snapshot data for groups
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Found 6 WorkspaceGroup
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Found 83 account groups
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Group listing provided, a subset of all groups will be migrated
18:03 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_snlfj.groups] found 1 new records for groups
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Starting to rename 1 groups for migration...
18:03 DEBUG [databricks.labs.ucx.workspace_access.groups] Renaming group: ucx_G8Ixa-ra78b33a08 (id=904071278282182) -> ucx-temp-ucx_G8Ixa-ra78b33a08
18:03 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename has possibly taken effect: ucx_G8Ixa-ra78b33a08 (id=904071278282182) -> ucx-temp-ucx_G8Ixa-ra78b33a08
18:03 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename has possibly taken effect: ucx_G8Ixa-ra78b33a08 (id=904071278282182) -> ucx-temp-ucx_G8Ixa-ra78b33a08
18:03 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename is assumed complete: ucx_G8Ixa-ra78b33a08 (id=904071278282182) -> ucx-temp-ucx_G8Ixa-ra78b33a08
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ...
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Found 67 WorkspaceGroup
18:03 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration reflects renamed group: 904071278282182 (renamed to ucx-temp-ucx_G8Ixa-ra78b33a08)
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ...
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Found 67 WorkspaceGroup
18:03 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration reflects renamed group: 904071278282182 (renamed to ucx-temp-ucx_G8Ixa-ra78b33a08)
18:03 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration showed all 1 renamed groups; assuming complete.
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Found 83 account groups
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ...
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Found 61 Group
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Found 6 WorkspaceGroup
18:03 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_snlfj.groups] fetching groups inventory
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Starting to reflect 1 account groups into workspace for migration...
18:03 ERROR [databricks.labs.ucx.workspace_access.groups] Skipping ucx_G8Ixa-ra78b33a08: group already exists in workspace
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ...
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Found 61 Group
18:03 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_snlfj.groups] fetching groups inventory
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Starting to remove 1 migrated workspace groups...
18:03 WARNING [databricks.labs.ucx.workspace_access.groups] Not deleting group ucx-temp-ucx_G8Ixa-ra78b33a08(id=904071278282182) (originally ucx_G8Ixa-ra78b33a08): its migrated account group (ucx_G8Ixa-ra78b33a08) cannot be found.
18:03 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ...
18:04 INFO [databricks.labs.ucx.workspace_access.groups] Found 67 WorkspaceGroup
18:04 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration does not contain any of the 0 deleted workspace groups; possibly deleted.
18:04 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ...
18:04 INFO [databricks.labs.ucx.workspace_access.groups] Found 67 WorkspaceGroup
18:04 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration does not contain any of the 0 deleted workspace groups; possibly deleted.
18:04 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration omitted all 0 workspace groups; assuming deleted.
[gw5] linux -- Python 3.10.16 /home/runner/work/ucx/ucx/.venv/bin/python

Running from nightly #359

@github-actions github-actions bot added the bug Something isn't working label Jan 17, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

0 participants