Skip to content

direct: retry transient errors when creating postgres resources - #7557

Merged
denik merged 4 commits into
mainfrom
postgres-retry-transient-create
Nov 13, 2026
Merged

denik merged 4 commits into
mainfrom
postgres-retry-transient-create

Conversation

@denik

@denik denik commented Nov 12, 2026

Copy link
Copy Markdown
Contributor

Changes

Creating postgres (Lakebase) resources in the direct engine now retries transient server errors:

  • Polling the create operation (GET .../operations/...) is retried on transient errors (5xx, 408, inactivity timeouts) for every postgres resource. The create request was already accepted, so polling again cannot create a duplicate. A new helper, waitCreateOperation, wraps waiter.Wait with retry.IsTransientRead.
  • The project create request (POST /api/2.0/postgres/projects) is marked retrySafe, so DeploymentUnit.Create retries it on transient errors. The request is keyed by the caller-chosen project_id, so a repeat cannot create a second project. If the failed request did create the project, the retry fails with ALREADY_EXISTS, which is the same error the next deploy would have hit.

Update and delete were already retried as a whole in apply.go. Before this change, a create failure was returned without retrying.

Judgment calls:

  • I made only the project create request retry-safe, because projects are the only create that fails like this on the dashboard. Branch, endpoint, database and role creates also take caller-chosen ids and could get the same change if reviewers want it.
  • No retry loop beyond the existing libs/retry policy: 2 retries, 15s apart.

Why

Cloud integration runs on main hit 500s from the Lakebase API when creating a project, both on the create request and on the operation poll. These are 9 failures across 7 tests in 7 days on AWS and GCP. Most passed on the test runner's second attempt, so the errors are transient.

Dashboard:

error snippet
error/3213pr=1Q)end=2026-11-12T13:40:00ZQ)last=7d Error: cannot create resources.postgres_projects.my_project: The request could not be processed. Please try again later and contact Databricks if the problem persists. [TraceId: [TRACE_ID]] (500 INTERNAL_ERROR) on POST [DATABRICKS_URL]/api/2.0/postgres/projects?project_id=test-pg-proj-[UNIQUE_NAME] or GET [DATABRICKS_URL]/api/2.0/postgres/projects/test-pg-proj-[UNIQUE_NAME]/operations/...

Affected tests: postgres_endpoints/basic/DMS=truepr=1Q)end=2026-11-12T13:40:00ZQ)last=7d, postgres_endpoints/recreate/DMS=truepr=1Q)end=2026-11-12T13:40:00ZQ)last=7d, postgres_endpoints/add_settings/DMS=pr=1Q)end=2026-11-12T13:40:00ZQ)last=7d, postgres_endpoints/update_autoscaling/DMS=pr=1Q)end=2026-11-12T13:40:00ZQ)last=7d, postgres_databases/update/DMS=pr=1Q)end=2026-11-12T13:40:00ZQ)last=7d, postgres_branches/update_ttl/DMS=truepr=1Q)end=2026-11-12T13:40:00ZQ)last=7d, postgres_projects/purge_on_delete/DMS=truepr=1Q)end=2026-11-12T13:40:00ZQ)last=7d.

Tests

  • New local acceptance test bundle/resources/postgres_projects/create_transient_500 injects one 500 on the create POST and one on the operation poll. With the fix, the deploy succeeds after two retries (shown in the output). Without the fix, it fails.
  • Existing local bundle/resources/postgres_* acceptance tests and the bundle/direct/... unit tests pass.
  • The last commit asks CI to run postgres_projects/basic and postgres_endpoints/basic on every cloud.

This pull request and its description were written by Isaac.

Creating a postgres project sometimes fails with 500 INTERNAL_ERROR, either on
the create request or on polling the create operation. DoCreate failures are
not retried, unlike update and delete.

- Poll the create operation again on transient errors for all postgres
  resources: the create request was accepted, so polling cannot duplicate it.
- Mark a failed project create request as retry-safe: it is keyed by
  project_id, so a repeat cannot create a second project.

cloud: TestAccept/bundle/resources/postgres_projects/basic TestAccept/bundle/resources/postgres_endpoints/basic

Co-authored-by: Isaac <no-reply@databricks.com>
@denik denik added the ai-auto PRs made by AI loops & factories, label Nov 12, 2026
@github-actions github-actions Bot added the DABs DABs related issues label Nov 12, 2026
denik and others added 2 commits November 12, 2026 13:52
cloud: TestAccept/bundle/resources/postgres_projects/basic TestAccept/bundle/resources/postgres_endpoints/basic

Co-authored-by: Isaac <no-reply@databricks.com>
cloud: TestAccept/bundle/resources/postgres_projects/basic TestAccept/bundle/resources/postgres_endpoints/basic

Co-authored-by: Isaac <no-reply@databricks.com>
@github-actions

github-actions Bot commented Nov 12, 2026 •

Copy link
Copy Markdown
Contributor

Commit: 37f3075c0 | Workflow run

Regression test report

Selected 1 changed tests (limit=20, 0 not selected)

6 tests: regression=2 unreleased=0 coverage=4 failing=0
test branch main (b69a249) latest (v1.26.0)
TestAccept/bundle/resources/postgres_endpoints/basic/DMS= ✅ ✅ ✅
TestAccept/bundle/resources/postgres_endpoints/basic/DMS=true ✅ ✅ ✅
TestAccept/bundle/resources/postgres_projects/basic/DMS= ✅ ✅ ✅
TestAccept/bundle/resources/postgres_projects/basic/DMS=true ✅ ✅ ✅
TestAccept/bundle/resources/postgres_projects/create_transient_500/DMS= ✅ ❌ ❌
TestAccept/bundle/resources/postgres_projects/create_transient_500/DMS=true ✅ ❌ ❌
TestAccept/bundle/resources/postgres_projects/create_transient_500/DMS=: branch ✅ | main (b69a249) ❌ | latest (v1.26.0) ❌

main (b69a249):

acceptance_test.go:1373: Diff:
        --- bundle/resources/postgres_projects/create_transient_500/output.txt
        +++ /tmp/TestAcceptbundleresourcespostgres_projectscreate_transient_54222592745/002/output.txt
        @@ -1,26 +1,13 @@
         
         >>> [CLI] bundle deploy
         Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/test-bundle/default/files...
        -Warn: deploying resources.postgres_projects.my_project: retrying after 500 Internal Server Error from POST /api/2.0/postgres/projects
        -Warn: deploying resources.postgres_projects.my_project: retrying after 500 Internal Server Error from GET /api/2.0/postgres/projects/test-pg-proj/operations/[UUID]
        -Created postgres_projects.my_project
        -Files: 0 uploaded, 0 deleted
        -Resources: 1 created, 0 changed, 0 deleted, 0 unchanged
        +Error: cannot create resources.postgres_projects.my_project: Fault injected by test. (500 INTERNAL_ERROR)
         
        ->>> print_requests.py --get //postgres
        -POST /api/2.0/postgres/projects
        -POST /api/2.0/postgres/projects
        -GET /api/2.0/postgres/projects/test-pg-proj/operations/[UUID]
        -GET /api/2.0/postgres/projects/test-pg-proj/operations/[UUID]
        +Endpoint: POST [DATABRICKS_URL]/api/2.0/postgres/projects?project_id=test-pg-proj
        +HTTP Status: 500 Internal Server Error
        +API error_code: INTERNAL_ERROR
        +API message: Fault injected by test.
         
        ->>> [CLI] bundle destroy --auto-approve
        -The following resources will be deleted:
        -  delete resources.postgres_projects.my_project
        +Files: 0 uploaded, 0 deleted
         
        -This action will result in the deletion of the following Lakebase projects along with
        -all their branches, databases, and endpoints. All data stored in them will be permanently lost:
        -  delete resources.postgres_projects.my_project
        -
        -All files and directories at the following location will be deleted: /Workspace/Users/[USERNAME]/.bundle/test-bundle/default
        -
        -Destroy: 1 deleted
        +Exit code: 1

latest (v1.26.0): same output as main (b69a249)

TestAccept/bundle/resources/postgres_projects/create_transient_500/DMS=true: branch ✅ | main (b69a249) ❌ | latest (v1.26.0) ❌

main (b69a249):

acceptance_test.go:1373: Diff:
        --- bundle/resources/postgres_projects/create_transient_500/output.txt
        +++ /tmp/TestAcceptbundleresourcespostgres_projectscreate_transient_51232964878/002/output.txt
        @@ -1,26 +1,13 @@
         
         >>> [CLI] bundle deploy
         Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/test-bundle/default/files...
        -Warn: deploying resources.postgres_projects.my_project: retrying after 500 Internal Server Error from POST /api/2.0/postgres/projects
        -Warn: deploying resources.postgres_projects.my_project: retrying after 500 Internal Server Error from GET /api/2.0/postgres/projects/test-pg-proj/operations/[UUID]
        -Created postgres_projects.my_project
        -Files: 0 uploaded, 0 deleted
        -Resources: 1 created, 0 changed, 0 deleted, 0 unchanged
        +Error: cannot create resources.postgres_projects.my_project: Fault injected by test. (500 INTERNAL_ERROR)
         
        ->>> print_requests.py --get //postgres
        -POST /api/2.0/postgres/projects
        -POST /api/2.0/postgres/projects
        -GET /api/2.0/postgres/projects/test-pg-proj/operations/[UUID]
        -GET /api/2.0/postgres/projects/test-pg-proj/operations/[UUID]
        +Endpoint: POST [DATABRICKS_URL]/api/2.0/postgres/projects?project_id=test-pg-proj
        +HTTP Status: 500 Internal Server Error
        +API error_code: INTERNAL_ERROR
        +API message: Fault injected by test.
         
        ->>> [CLI] bundle destroy --auto-approve
        -The following resources will be deleted:
        -  delete resources.postgres_projects.my_project
        +Files: 0 uploaded, 0 deleted
         
        -This action will result in the deletion of the following Lakebase projects along with
        -all their branches, databases, and endpoints. All data stored in them will be permanently lost:
        -  delete resources.postgres_projects.my_project
        -
        -All files and directories at the following location will be deleted: /Workspace/Users/[USERNAME]/.bundle/test-bundle/default
        -
        -Destroy: 1 deleted
        +Exit code: 1
        
FAIL

latest (v1.26.0):

acceptance_test.go:1373: Diff:
        --- bundle/resources/postgres_projects/create_transient_500/output.txt
        +++ /tmp/TestAcceptbundleresourcespostgres_projectscreate_transient_5376572004/002/output.txt
        @@ -1,26 +1,13 @@
         
         >>> [CLI] bundle deploy
         Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/test-bundle/default/files...
        -Warn: deploying resources.postgres_projects.my_project: retrying after 500 Internal Server Error from POST /api/2.0/postgres/projects
        -Warn: deploying resources.postgres_projects.my_project: retrying after 500 Internal Server Error from GET /api/2.0/postgres/projects/test-pg-proj/operations/[UUID]
        -Created postgres_projects.my_project
        -Files: 0 uploaded, 0 deleted
        -Resources: 1 created, 0 changed, 0 deleted, 0 unchanged
        +Error: cannot create resources.postgres_projects.my_project: Fault injected by test. (500 INTERNAL_ERROR)
         
        ->>> print_requests.py --get //postgres
        -POST /api/2.0/postgres/projects
        -POST /api/2.0/postgres/projects
        -GET /api/2.0/postgres/projects/test-pg-proj/operations/[UUID]
        -GET /api/2.0/postgres/projects/test-pg-proj/operations/[UUID]
        +Endpoint: POST [DATABRICKS_URL]/api/2.0/postgres/projects?project_id=test-pg-proj
        +HTTP Status: 500 Internal Server Error
        +API error_code: INTERNAL_ERROR
        +API message: Fault injected by test.
         
        ->>> [CLI] bundle destroy --auto-approve
        -The following resources will be deleted:
        -  delete resources.postgres_projects.my_project
        +Files: 0 uploaded, 0 deleted
         
        -This action will result in the deletion of the following Lakebase projects along with
        -all their branches, databases, and endpoints. All data stored in them will be permanently lost:
        -  delete resources.postgres_projects.my_project
        -
        -All files and directories at the following location will be deleted: /Workspace/Users/[USERNAME]/.bundle/test-bundle/default
        -
        -Destroy: 1 deleted
        +Exit code: 1

cloud: TestAccept/bundle/resources/postgres_projects/basic TestAccept/bundle/resources/postgres_endpoints/basic

Co-authored-by: Isaac <no-reply@databricks.com>
@eng-dev-ecosystem-bot

Copy link
Copy Markdown
Collaborator

✅ Integration test report

Commit: 37f3075

Run: 43234005341

Env 🔄​flaky 💚​RECOVERED ✅​pass 🙈​skip Time
🔄​ aws linux-2core-8gb 1 1 275 16 14:41
💚​ aws-windows-latest-4core-16gb 1 278 14 9:41
💚​ azure linux-2core-8gb 1 275 16 12:11
💚​ azure-windows-latest-4core-16gb 1 277 14 7:55
💚​ gcp linux-2core-8gb 1 276 16 15:01
🔄​ gcp-windows-latest-4core-16gb 1 1 277 14 8:31
Test Name aws linux-2core-8gb aws-windows-latest-4core-16gb azure linux-2core-8gb azure-windows-latest-4core-16gb gcp linux-2core-8gb gcp-windows-latest-4core-16gb
💚​ TestAccept 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
🔄​ TestSyncIncrementalSyncFileToPythonNotebook 🔄​f ✅​p ✅​p ✅​p ✅​p ✅​p
🔄​ TestSyncNestedFolderDoesntFailOnNonEmptyDirectory ✅​p ✅​p ✅​p ✅​p ✅​p 🔄​f
Top 18 slowest tests (at least 2 minutes):
duration env testname
5:01 aws-windows-latest-4core-16gb TestAccept
3:56 aws linux-2core-8gb TestAccept
3:52 azure linux-2core-8gb TestAccept
3:49 gcp linux-2core-8gb TestAccept
3:45 gcp-windows-latest-4core-16gb TestAccept
3:43 azure-windows-latest-4core-16gb TestAccept
3:31 gcp linux-2core-8gb TestAccept/bundle/resources/postgres_endpoints/basic/DMS=
2:55 azure linux-2core-8gb TestFilerReadWrite/workspace_files
2:44 aws linux-2core-8gb TestFilerWorkspaceFilesExtensionsRead
2:37 aws linux-2core-8gb TestFilerReadWrite/workspace_files
2:35 gcp-windows-latest-4core-16gb TestFilerWorkspaceFilesExtensionsReadDir
2:34 gcp linux-2core-8gb TestImportDir
2:26 azure linux-2core-8gb TestFilerWorkspaceFilesExtensionsDelete
2:12 aws-windows-latest-4core-16gb TestImportDir
2:09 azure-windows-latest-4core-16gb TestFilerWorkspaceFilesExtensionsRead
2:08 gcp linux-2core-8gb TestFilerRecursiveDelete/workspace_files
2:02 azure-windows-latest-4core-16gb TestTelemetryEndpoint
2:00 aws-windows-latest-4core-16gb TestFilerWorkspaceFilesExtensionsRead

@denik
denik marked this pull request as ready for review November 12, 2026 14:36
@denik
denik requested review from a team as code owners November 12, 2026 14:36
@denik
denik requested a review from shreyas-goenka November 12, 2026 14:36
@andrewnester
andrewnester self-requested a review November 12, 2026 18:14

@andrewnester andrewnester left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No blocking findings from a full pass; I'll take a manual look at the direct changes before approving.

@denik
denik added this pull request to the merge queue Nov 13, 2026
Merged via the queue into main with commit cf85b49 Nov 13, 2026
28 checks passed
@denik
denik deleted the postgres-retry-transient-create branch November 13, 2026 10:30
@eng-dev-ecosystem-bot

Copy link
Copy Markdown
Collaborator

❌ Integration test report

Commit: cf85b49

Run: 43409700902

Env ❌​FAIL 🟨​KNOWN 🤯​MISS 💚​RECOVERED ✅​pass 🙈​skip Time
❌​ aws linux-2core-8gb 43 1 11 1583 1296 342:54
❌​ aws-windows-latest-4core-16gb 39 1 11 1506 1323 343:06
❌​ azure linux-2core-8gb 45 3 9 1561 1304 322:36
❌​ azure-windows-latest-4core-16gb 43 1 11 1482 1331 331:58
❌​ gcp linux-2core-8gb 27 141 11 1448 1300 356:01
❌​ gcp-windows-latest-4core-16gb 43 59 11 1433 1327 349:19
235 interesting tests: 154 MISS, 69 FAIL, 9 RECOVERED, 3 KNOWN
Test Name aws linux-2core-8gb aws-windows-latest-4core-16gb azure linux-2core-8gb azure-windows-latest-4core-16gb gcp linux-2core-8gb gcp-windows-latest-4core-16gb
🟨​ TestAccept 🟨​K 🟨​K 🟨​K 🟨​K 🤯​M 🤯​M
🤯​ TestAccept/bundle/destroy/root-path-not-scoped ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/destroy/root-path-not-scoped/DMS= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/destroy/root-path-not-scoped/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
❌​ TestAccept/bundle/dms/stale-plan ✅​p ✅​p ✅​p ❌​F ✅​p ✅​p
❌​ TestAccept/bundle/dms/stale-plan/DMS=true/READPLAN=1 ✅​p ✅​p ✅​p ❌​F ✅​p ✅​p
❌​ TestAccept/bundle/dms/successful-recreate ✅​p ✅​p ❌​F ✅​p ✅​p ✅​p
❌​ TestAccept/bundle/dms/successful-recreate/DMS=true ✅​p ✅​p ❌​F ✅​p ✅​p ✅​p
❌​ TestAccept/bundle/invariant/delete_idempotent ❌​F ✅​p ✅​p ✅​p ✅​p ✅​p
❌​ TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=feature.yml.tmpl/READPLAN=1 ❌​F ✅​p ✅​p ✅​p ✅​p ✅​p
💚​ TestAccept/bundle/resources/apps/lifecycle-started 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/apps/lifecycle-started-omitted 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/apps/lifecycle-started-omitted/DMS=true 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/apps/lifecycle-started-toggle 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/apps/lifecycle-started-toggle/DMS= 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/apps/lifecycle-started-toggle/DMS=true 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/apps/lifecycle-started/DMS= 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/apps/lifecycle-started/DMS=true 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
❌​ TestAccept/bundle/resources/catalogs/rename_all_out_of_band ✅​p ✅​p ✅​p ✅​p ❌​F ✅​p
❌​ TestAccept/bundle/resources/catalogs/rename_all_out_of_band/DMS= ✅​p ✅​p ✅​p ✅​p ❌​F ✅​p
❌​ TestAccept/bundle/resources/catalogs/rename_out_of_band ✅​p ✅​p ✅​p ✅​p ❌​F ✅​p
❌​ TestAccept/bundle/resources/catalogs/rename_out_of_band/DMS= ✅​p ✅​p ✅​p ✅​p ❌​F ✅​p
❌​ TestAccept/bundle/resources/catalogs/rename_with_comment ✅​p ✅​p ✅​p ✅​p ❌​F ✅​p
❌​ TestAccept/bundle/resources/catalogs/rename_with_comment/DMS= ✅​p ✅​p ✅​p ✅​p ❌​F ✅​p
❌​ TestAccept/bundle/resources/catalogs/rename_with_comment/DMS=true ✅​p ✅​p ✅​p ✅​p ❌​F ✅​p
❌​ TestAccept/bundle/resources/cluster_policies/basic ✅​p ✅​p ✅​p ✅​p ❌​F ✅​p
❌​ TestAccept/bundle/resources/cluster_policies/basic/DMS= ✅​p ✅​p ✅​p ✅​p ❌​F ✅​p
❌​ TestAccept/bundle/resources/cluster_policies/basic/DMS=true ✅​p ✅​p ✅​p ✅​p ❌​F ✅​p
❌​ TestAccept/bundle/resources/clusters/deploy/data_security_mode ✅​p ✅​p ✅​p ✅​p ✅​p ❌​F
❌​ TestAccept/bundle/resources/clusters/deploy/data_security_mode/DMS= ✅​p ✅​p ✅​p ✅​p ✅​p ❌​F
❌​ TestAccept/bundle/resources/clusters/deploy/local_ssd_count 🙈​s 🙈​s 🙈​s 🙈​s ❌​F ✅​p
❌​ TestAccept/bundle/resources/clusters/deploy/local_ssd_count/DMS=true ❌​F ✅​p
❌​ TestAccept/bundle/resources/dashboards/change-parent-path ❌​F ✅​p ✅​p ✅​p ✅​p ✅​p
❌​ TestAccept/bundle/resources/dashboards/change-parent-path/DMS= ❌​F ✅​p ✅​p ✅​p ✅​p ✅​p
❌​ TestAccept/bundle/resources/model_services/lifecycle ✅​p ✅​p ✅​p ❌​F ✅​p ✅​p
❌​ TestAccept/bundle/resources/model_services/lifecycle/DMS=true ✅​p ✅​p ✅​p ❌​F ✅​p ✅​p
🤯​ TestAccept/bundle/resources/permissions/jobs/delete_one ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/permissions/jobs/delete_one/DMS= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/permissions/jobs/delete_one/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions ✅​p ✅​p 🙈​s 🙈​s 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions/DMS= ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions/DMS=true ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions ✅​p ✅​p 🙈​s 🙈​s 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions/DMS= ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions/DMS=true ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/permissions/pipelines/recreate ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/permissions/pipelines/recreate/DMS= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/permissions/pipelines/recreate/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/pipelines/allow-duplicate-names ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/pipelines/allow-duplicate-names/DMS= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/pipelines/allow-duplicate-names/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/pipelines/auto-approve ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/pipelines/auto-approve/DMS= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/pipelines/auto-approve/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/pipelines/cluster_policy ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/pipelines/cluster_policy/DMS= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/pipelines/cluster_policy/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/pipelines/lakeflow-pipeline ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/pipelines/lakeflow-pipeline/DMS= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/pipelines/lakeflow-pipeline/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/pipelines/recreate ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/pipelines/recreate/DMS= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/pipelines/recreate/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/pipelines/update ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/pipelines/update/DMS= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/pipelines/update/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_branches/basic ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_branches/basic/DMS= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_branches/basic/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_branches/purge_on_delete ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_branches/purge_on_delete/DMS= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_branches/purge_on_delete/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_branches/purge_on_delete_transitions ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_branches/purge_on_delete_transitions/DMS= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_branches/purge_on_delete_transitions/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_branches/recreate ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_branches/recreate/DMS= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_branches/recreate/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_branches/replace_existing ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_branches/replace_existing/DMS= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_branches/replace_existing/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
❌​ TestAccept/bundle/resources/postgres_branches/update_protected ❌​F ❌​F ❌​F ❌​F 🤯​M ❌​F
❌​ TestAccept/bundle/resources/postgres_branches/update_protected/DMS= ❌​F ❌​F ❌​F ❌​F 🤯​M ❌​F
❌​ TestAccept/bundle/resources/postgres_branches/update_protected/DMS=true ❌​F ❌​F ❌​F ❌​F 🤯​M ❌​F
❌​ TestAccept/bundle/resources/postgres_branches/update_ttl ❌​F ❌​F ❌​F ❌​F 🤯​M ❌​F
❌​ TestAccept/bundle/resources/postgres_branches/update_ttl/DMS= ❌​F ❌​F ❌​F ❌​F 🤯​M ❌​F
❌​ TestAccept/bundle/resources/postgres_branches/update_ttl/DMS=true ❌​F ❌​F ❌​F ❌​F 🤯​M ❌​F
🤯​ TestAccept/bundle/resources/postgres_branches/without_branch_id ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_branches/without_branch_id/DMS= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_branches/without_branch_id/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_catalogs/basic ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_catalogs/basic/DMS= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_catalogs/basic/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_catalogs/recreate ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_catalogs/recreate/DMS= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_catalogs/recreate/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_databases/basic ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_databases/basic/DMS= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_databases/basic/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_databases/live_errors/bad_database_id ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_databases/live_errors/bad_database_id/DMS= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_databases/live_errors/bad_database_id/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_databases/live_errors/bad_role_ref ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_databases/live_errors/bad_role_ref/DMS= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_databases/live_errors/bad_role_ref/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_databases/recreate ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_databases/recreate/DMS= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_databases/recreate/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_databases/replace_existing ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_databases/replace_existing/DMS= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_databases/replace_existing/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
❌​ TestAccept/bundle/resources/postgres_databases/update ❌​F ❌​F ❌​F ❌​F 🤯​M ❌​F
❌​ TestAccept/bundle/resources/postgres_databases/update/DMS= ❌​F ❌​F ❌​F ❌​F 🤯​M ❌​F
❌​ TestAccept/bundle/resources/postgres_databases/update/DMS=true ❌​F ❌​F ❌​F ❌​F 🤯​M ❌​F
🤯​ TestAccept/bundle/resources/postgres_endpoints/add_settings ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_endpoints/add_settings/DMS= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_endpoints/add_settings/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_endpoints/basic ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_endpoints/basic/DMS= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_endpoints/basic/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_endpoints/recreate ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_endpoints/recreate/DMS= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_endpoints/recreate/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
❌​ TestAccept/bundle/resources/postgres_endpoints/remove_suspend_timeout ❌​F ❌​F ❌​F ❌​F 🤯​M ❌​F
❌​ TestAccept/bundle/resources/postgres_endpoints/remove_suspend_timeout/DMS= ❌​F ❌​F ❌​F ❌​F 🤯​M ❌​F
❌​ TestAccept/bundle/resources/postgres_endpoints/remove_suspend_timeout/DMS=true ❌​F ❌​F ❌​F ❌​F 🤯​M ❌​F
🤯​ TestAccept/bundle/resources/postgres_endpoints/replace_existing ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_endpoints/replace_existing/DMS= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_endpoints/replace_existing/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
❌​ TestAccept/bundle/resources/postgres_endpoints/update_autoscaling ❌​F ❌​F ❌​F ❌​F 🤯​M ❌​F
❌​ TestAccept/bundle/resources/postgres_endpoints/update_autoscaling/DMS= ❌​F ❌​F ❌​F ❌​F 🤯​M ❌​F
❌​ TestAccept/bundle/resources/postgres_endpoints/update_autoscaling/DMS=true ❌​F ❌​F ❌​F ❌​F 🤯​M ❌​F
❌​ TestAccept/bundle/resources/postgres_endpoints/update_pg_settings ❌​F ❌​F ❌​F ❌​F 🤯​M ❌​F
❌​ TestAccept/bundle/resources/postgres_endpoints/update_pg_settings/DMS= ❌​F ❌​F ❌​F ❌​F 🤯​M ❌​F
❌​ TestAccept/bundle/resources/postgres_endpoints/update_pg_settings/DMS=true ❌​F ❌​F ❌​F ❌​F 🤯​M ❌​F
❌​ TestAccept/bundle/resources/postgres_endpoints/update_suspend_timeout ❌​F ❌​F ❌​F ❌​F 🤯​M ❌​F
❌​ TestAccept/bundle/resources/postgres_endpoints/update_suspend_timeout/DMS= ❌​F ❌​F ❌​F ❌​F 🤯​M ❌​F
❌​ TestAccept/bundle/resources/postgres_endpoints/update_suspend_timeout/DMS=true ❌​F ❌​F ❌​F ❌​F 🤯​M ❌​F
🤯​ TestAccept/bundle/resources/postgres_endpoints/without_endpoint_id ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_endpoints/without_endpoint_id/DMS= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_endpoints/without_endpoint_id/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
❌​ TestAccept/bundle/resources/postgres_projects/add_default_endpoint_settings ❌​F ❌​F ❌​F ❌​F 🤯​M ❌​F
❌​ TestAccept/bundle/resources/postgres_projects/add_default_endpoint_settings/DMS= ❌​F ❌​F ❌​F ❌​F 🤯​M ❌​F
❌​ TestAccept/bundle/resources/postgres_projects/add_default_endpoint_settings/DMS=true ❌​F ❌​F ❌​F ❌​F 🤯​M ❌​F
🤯​ TestAccept/bundle/resources/postgres_projects/basic ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_projects/basic/DMS= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_projects/basic/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_projects/purge_on_delete ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_projects/purge_on_delete/DMS= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_projects/purge_on_delete/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_projects/purge_on_delete_transitions ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_projects/purge_on_delete_transitions/DMS= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_projects/purge_on_delete_transitions/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_projects/recreate ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/postgres_projects/recreate/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
❌​ TestAccept/bundle/resources/postgres_projects/remove_history_retention ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_projects/remove_history_retention/DMS= ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_projects/remove_history_retention/DMS=true ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_projects/update_default_endpoint_suspend ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_projects/update_default_endpoint_suspend/DMS= ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_projects/update_default_endpoint_suspend/DMS=true ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_projects/update_display_name ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
Top 50 slowest tests (at least 2 minutes):
duration env testname
10:29 azure-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
10:21 azure linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
10:20 aws-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
10:06 azure-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
9:55 aws linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
9:55 aws linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
9:51 aws-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
9:40 azure linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
9:36 gcp linux-2core-8gb TestAccept/bundle/deploy/spark-jar-task/DMS=true
9:32 aws-windows-latest-4core-16gb TestAccept/bundle/deploy/spark-jar-task/DMS=
9:27 aws linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
9:15 gcp linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
9:08 aws-windows-latest-4core-16gb TestAccept/bundle/deploy/spark-jar-task/DMS=true
9:03 gcp linux-2core-8gb TestAccept/bundle/resources/schemas/rename_then_change/DMS=
9:00 gcp linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
8:56 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
8:20 gcp linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
8:13 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
8:09 aws linux-2core-8gb TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=cluster_libraries.yml.tmpl/READPLAN=1
8:04 aws linux-2core-8gb TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN=1
8:02 aws linux-2core-8gb TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=cluster_libraries.yml.tmpl/READPLAN=
7:59 aws linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
7:45 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/deploy/local_ssd_count/DMS=true
7:37 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/deploy/local_ssd_count/DMS=
7:27 gcp linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
7:24 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
7:19 aws-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
7:13 azure linux-2core-8gb TestAccept/bundle/config-remote-sync/multiple_resources/DMS=true
7:03 gcp linux-2core-8gb TestAccept/bundle/config-remote-sync/multiple_resources/DMS=
6:59 gcp linux-2core-8gb TestAccept/bundle/resources/clusters/deploy/local_ssd_count/DMS=
6:53 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/registered_models/basic/DMS=true
6:50 gcp linux-2core-8gb TestAccept/bundle/resources/schemas/rename_then_change/DMS=true
6:45 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
6:41 azure linux-2core-8gb TestAccept/bundle/config-remote-sync/multiple_resources/DMS=
6:40 gcp linux-2core-8gb TestAccept/bundle/config-remote-sync/multiple_resources/DMS=true
6:30 aws linux-2core-8gb TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=cluster_libraries.yml.tmpl/READPLAN=
6:25 aws-windows-latest-4core-16gb TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=schema.yml.tmpl/READPLAN=1
6:23 aws-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
6:22 azure-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
6:13 azure linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
6:04 azure linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
6:04 azure-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
5:58 gcp linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=
5:56 aws linux-2core-8gb TestAccept/bundle/deploy/spark-jar-task/DMS=
5:48 gcp linux-2core-8gb TestAccept/bundle/deploy/spark-jar-task/DMS=
5:43 azure linux-2core-8gb TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=cluster_libraries.yml.tmpl/READPLAN=1
5:41 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=
5:40 azure-windows-latest-4core-16gb TestAccept/pipelines/run/refresh-flags
5:40 gcp-windows-latest-4core-16gb TestAccept/pipelines/run/refresh-flags
5:25 azure-windows-latest-4core-16gb TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN=
(73 table rows omitted to keep the report under 60000 bytes)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ai-auto PRs made by AI loops & factories, DABs DABs related issues

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants