Skip to content

Wait past the SDK retry window when sync tests read remote state - #7592

Merged
denik merged 1 commit into
mainfrom
sync-eventually-timeout
Nov 13, 2026
Merged

denik merged 1 commit into
mainfrom
sync-eventually-timeout

Conversation

@denik

@denik denik commented Nov 13, 2026

Copy link
Copy Markdown
Contributor

Why

TestSyncIncrementalFileSync and TestSyncFullFileSync flake on all three clouds. Sync uploads the file and prints its completion event, and then the check that reads it back times out:

sync_test.go:161:
    Error:      	Condition never satisfied
runner.go:129: Error running command: context canceled

context canceled is only the test cleanup stopping sync --watch. The real failure is the 30s Eventually in remoteFileContent (and the same 30s in remoteDirContent, objectType and language).

Those reads go through the SDK, which retries throttled (429) requests for up to 5 minutes. The shared test workspace throttles these sync tests heavily; see #7558, which handles the same 429s on the upload side. The timing fits a read that is still retrying: in the failing runs the test fails about 30s after sync finished, then the in-flight read returns and the test exits. Failures include the very first read of a newly created empty file, where stale content can't explain a mismatch.

Changes

  • The four remote-state checks wait up to 6 minutes, past the SDK's 5-minute retry window. When nothing is throttled the first read matches, so passing runs don't get slower.

This complements #7558 (the completion-marker timeout), and the two don't touch the same lines.

Tests

go test ./integration/cmd/sync -run 'TestSyncFullFileSync|TestSyncIncrementalFileSync|TestSyncNestedFolderSync' passes against an AWS test workspace.

Dashboard

link snippet
error/705 Error: context canceled after sync_test.go:161: Condition never satisfied
integration/cmd/sync.TestSyncIncrementalFileSync same, 9 failures in 7 days
integration/cmd/sync.TestSyncFullFileSync same, 5 failures in 7 days

Written by an AI agent (harness_auto).

This pull request and its description were written by Isaac.

Co-authored-by: Isaac <no-reply@databricks.com>
@denik denik added the ai-auto PRs made by AI loops & factories, label Nov 13, 2026
@github-actions github-actions Bot added the test-only-fix PRs that update failing of flaky tests without changing CLI code. label Nov 13, 2026
@eng-dev-ecosystem-bot

Copy link
Copy Markdown
Collaborator

✅ Integration test report

Commit: a1dbd4a

Run: 43396615139

Env 💚​RECOVERED ✅​pass 🙈​skip Time
💚​ aws linux-2core-8gb 1 270 15 7:04
💚​ aws-windows-latest-4core-16gb 1 272 13 5:59
💚​ azure linux-2core-8gb 1 269 15 6:24
💚​ azure-windows-latest-4core-16gb 1 271 13 5:16
💚​ gcp linux-2core-8gb 1 270 15 6:56
💚​ gcp-windows-latest-4core-16gb 1 272 13 5:51
Test Name aws linux-2core-8gb aws-windows-latest-4core-16gb azure linux-2core-8gb azure-windows-latest-4core-16gb gcp linux-2core-8gb gcp-windows-latest-4core-16gb
💚​ TestAccept 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
Top 6 slowest tests (at least 2 minutes):
duration env testname
4:55 aws-windows-latest-4core-16gb TestAccept
3:54 gcp-windows-latest-4core-16gb TestAccept
3:52 azure linux-2core-8gb TestAccept
3:48 aws linux-2core-8gb TestAccept
3:29 gcp linux-2core-8gb TestAccept
3:15 azure-windows-latest-4core-16gb TestAccept

@denik
denik marked this pull request as ready for review November 13, 2026 09:27
@denik
denik requested review from a team as code owners November 13, 2026 09:27
@denik
denik enabled auto-merge November 13, 2026 09:27
@denik
denik requested a review from andrewnester November 13, 2026 09:27
@denik
denik added this pull request to the merge queue Nov 13, 2026
Merged via the queue into main with commit b560b78 Nov 13, 2026
28 checks passed
@denik
denik deleted the sync-eventually-timeout branch November 13, 2026 10:30
@eng-dev-ecosystem-bot

Copy link
Copy Markdown
Collaborator

❌ Integration test report

Commit: b560b78

Run: 43409653779

Env ❌​FAIL 🟨​KNOWN 🤯​MISS 💚​RECOVERED ✅​pass 🙈​skip Time
❌​ aws linux-2core-8gb 41 1 11 1585 1295 341:09
❌​ aws-windows-latest-4core-16gb 41 1 11 1504 1322 347:59
❌​ azure linux-2core-8gb 41 3 9 1565 1303 329:26
❌​ azure-windows-latest-4core-16gb 41 1 11 1484 1330 338:05
❌​ gcp linux-2core-8gb 39 2 59 9 1518 1299 355:49
❌​ gcp-windows-latest-4core-16gb 41 40 11 1454 1326 349:05
140 interesting tests: 79 MISS, 49 FAIL, 8 RECOVERED, 4 KNOWN
Test Name aws linux-2core-8gb aws-windows-latest-4core-16gb azure linux-2core-8gb azure-windows-latest-4core-16gb gcp linux-2core-8gb gcp-windows-latest-4core-16gb
🟨​ TestAccept 🟨​K 🟨​K 🟨​K 🟨​K 🤯​M 🤯​M
🤯​ TestAccept/bundle/apps/job_permissions ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/apps/job_permissions/DMS= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/apps/job_permissions/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/artifacts/artifact_path_with_volume/volume_doesnot_exist ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/artifacts/artifact_path_with_volume/volume_doesnot_exist/DMS= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/artifacts/artifact_path_with_volume/volume_doesnot_exist/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/artifacts/artifact_path_with_volume/volume_not_deployed ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/artifacts/artifact_path_with_volume/volume_not_deployed/DMS= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/artifacts/artifact_path_with_volume/volume_not_deployed/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/config-remote-sync/cli_defaults ✅​p 🙈​s ✅​p 🙈​s 🤯​M 🙈​s
🤯​ TestAccept/bundle/config-remote-sync/cli_defaults/DMS= ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/cli_defaults/DMS=true ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/cluster_policy_cross_target ✅​p 🙈​s ✅​p 🙈​s 🤯​M 🙈​s
🤯​ TestAccept/bundle/config-remote-sync/cluster_policy_cross_target/DMS= ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/cluster_policy_cross_target/DMS=true ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/cluster_policy_remote_addition ✅​p 🙈​s ✅​p 🙈​s 🤯​M 🙈​s
🤯​ TestAccept/bundle/config-remote-sync/cluster_policy_remote_addition/DMS=true ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/config_edits ✅​p 🙈​s ✅​p 🙈​s 🤯​M 🙈​s
🤯​ TestAccept/bundle/config-remote-sync/config_edits/DMS= ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/config_edits/DMS=true ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/dashboard_etag ✅​p 🙈​s ✅​p 🙈​s 🤯​M 🙈​s
🤯​ TestAccept/bundle/config-remote-sync/dashboard_etag/DMS= ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/dashboard_etag/DMS=true ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/external_cluster_policy_cross_target ✅​p 🙈​s ✅​p 🙈​s 🤯​M 🙈​s
🤯​ TestAccept/bundle/config-remote-sync/external_cluster_policy_cross_target/DMS= ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/external_cluster_policy_cross_target/DMS=true ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/flushed_cache ✅​p 🙈​s ✅​p 🙈​s 🤯​M 🙈​s
🤯​ TestAccept/bundle/config-remote-sync/flushed_cache/DMS= ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/flushed_cache/DMS=true ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/formatting_preserved ✅​p 🙈​s ✅​p 🙈​s 🤯​M 🙈​s
🤯​ TestAccept/bundle/config-remote-sync/formatting_preserved/DMS= ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/formatting_preserved/DMS=true ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/job_multiple_tasks ✅​p 🙈​s ✅​p 🙈​s 🤯​M 🙈​s
🤯​ TestAccept/bundle/config-remote-sync/job_multiple_tasks/DMS=true ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/multiple_resources ✅​p 🙈​s ✅​p 🙈​s 🤯​M 🙈​s
🤯​ TestAccept/bundle/config-remote-sync/multiple_resources/DMS= ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/multiple_resources/DMS=true ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/deployment/bind/alert ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/deployment/bind/alert/DMS= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/deployment/bind/alert/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
❌​ TestAccept/bundle/dms/stale-plan ❌​F ✅​p ✅​p ✅​p ✅​p ✅​p
❌​ TestAccept/bundle/dms/stale-plan/DMS=true/READPLAN=1 ❌​F ✅​p ✅​p ✅​p ✅​p ✅​p
❌​ TestAccept/bundle/dms/successful-recreate ✅​p ✅​p ❌​F ✅​p ✅​p ✅​p
❌​ TestAccept/bundle/dms/successful-recreate/DMS=true ✅​p ✅​p ❌​F ✅​p ✅​p ✅​p
❌​ TestAccept/bundle/invariant/destroy_idempotent ✅​p ✅​p ✅​p ✅​p ✅​p ❌​F
❌​ TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=vector_search_index.yml.tmpl/READPLAN= ✅​p ✅​p ✅​p ✅​p ✅​p ❌​F
💚​ TestAccept/bundle/resources/apps/lifecycle-started 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/apps/lifecycle-started-omitted 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/apps/lifecycle-started-omitted/DMS=true 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/apps/lifecycle-started-toggle 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/apps/lifecycle-started-toggle/DMS= 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/apps/lifecycle-started-toggle/DMS=true 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/apps/lifecycle-started/DMS= 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/apps/lifecycle-started/DMS=true 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
❌​ TestAccept/bundle/resources/cluster_policies/permissions/levels ✅​p ✅​p ✅​p ❌​F ✅​p ✅​p
❌​ TestAccept/bundle/resources/cluster_policies/permissions/levels/DMS=true ✅​p ✅​p ✅​p ❌​F ✅​p ✅​p
🤯​ TestAccept/bundle/resources/clusters/lifecycle-started ✅​p ✅​p ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/clusters/lifecycle-started-toggle ✅​p ✅​p ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS= ✅​p ✅​p ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=true ✅​p ✅​p ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/clusters/lifecycle-started/DMS= ✅​p ✅​p ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true ✅​p ✅​p ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/clusters/resize-terminated-fallback ✅​p ✅​p ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/clusters/resize-terminated-fallback/DMS= ✅​p ✅​p ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/clusters/resize-terminated-fallback/DMS=true ✅​p ✅​p ✅​p ✅​p ✅​p 🤯​M
❌​ TestAccept/bundle/resources/dashboards/change-parent-path ✅​p ❌​F ✅​p ✅​p ✅​p ✅​p
❌​ TestAccept/bundle/resources/dashboards/change-parent-path/DMS= ✅​p ❌​F ✅​p ✅​p ✅​p ✅​p
🤯​ TestAccept/bundle/resources/genie_spaces/simple ✅​p ✅​p ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/genie_spaces/simple/DMS= ✅​p ✅​p ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/genie_spaces/simple/DMS=true ✅​p ✅​p ✅​p ✅​p ✅​p 🤯​M
❌​ TestAccept/bundle/resources/postgres_branches/update_protected ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_branches/update_protected/DMS= ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_branches/update_protected/DMS=true ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_branches/update_ttl ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_branches/update_ttl/DMS= ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_branches/update_ttl/DMS=true ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_databases/update ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_databases/update/DMS= ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_databases/update/DMS=true ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_endpoints/remove_suspend_timeout ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_endpoints/remove_suspend_timeout/DMS= ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_endpoints/remove_suspend_timeout/DMS=true ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_endpoints/update_autoscaling ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_endpoints/update_autoscaling/DMS= ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_endpoints/update_autoscaling/DMS=true ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_endpoints/update_pg_settings ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_endpoints/update_pg_settings/DMS= ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_endpoints/update_pg_settings/DMS=true ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_endpoints/update_suspend_timeout ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_endpoints/update_suspend_timeout/DMS= ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_endpoints/update_suspend_timeout/DMS=true ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_projects/add_default_endpoint_settings ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_projects/add_default_endpoint_settings/DMS= ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_projects/add_default_endpoint_settings/DMS=true ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_projects/remove_history_retention ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_projects/remove_history_retention/DMS= ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_projects/remove_history_retention/DMS=true ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_projects/update_default_endpoint_suspend ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_projects/update_default_endpoint_suspend/DMS= ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_projects/update_default_endpoint_suspend/DMS=true ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_projects/update_display_name ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_projects/update_display_name/DMS= ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_projects/update_display_name/DMS=true ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_projects/update_history_retention ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_projects/update_history_retention/DMS= ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_projects/update_history_retention/DMS=true ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_roles/update ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_roles/update/DMS= ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_roles/update/DMS=true ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
🤯​ TestAccept/bundle/resources/postgres_synced_tables/basic ✅​p ✅​p ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/postgres_synced_tables/basic/DMS= ✅​p ✅​p ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/postgres_synced_tables/basic/DMS=true ✅​p ✅​p ✅​p ✅​p ✅​p 🤯​M
🟨​ TestAccept/bundle/resources/postgres_synced_tables/recreate 💚​R 💚​R 🟨​K 💚​R 🟨​K 💚​R
🟨​ TestAccept/bundle/resources/postgres_synced_tables/recreate/DMS= 💚​R 💚​R 🟨​K 💚​R 💚​R 💚​R
🟨​ TestAccept/bundle/resources/postgres_synced_tables/recreate/DMS=true 💚​R 💚​R 💚​R 💚​R 🟨​K 💚​R
🤯​ TestAccept/bundle/resources/quality_monitors/change_assets_dir ✅​p ✅​p ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/quality_monitors/change_assets_dir/DMS= ✅​p ✅​p ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/quality_monitors/change_assets_dir/DMS=true ✅​p ✅​p ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/schemas/rename_out_of_band_old_state ✅​p ✅​p ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/schemas/rename_out_of_band_old_state/DMS=/READPLAN= ✅​p ✅​p ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/schemas/rename_out_of_band_old_state/DMS=/READPLAN=1 ✅​p ✅​p ✅​p ✅​p ✅​p 🤯​M
🤯​ TestCIUniqueName ✅​p ✅​p ✅​p ✅​p 🤯​M 🤯​M
🤯​ TestClassifyRegression ✅​p ✅​p ✅​p ✅​p 🤯​M 🤯​M
🤯​ TestDbrAcceptance 🙈​s 🙈​s 🙈​s 🙈​s 🤯​M 🤯​M
🤯​ TestInprocessMode 🙈​s 🙈​s 🙈​s 🙈​s 🤯​M 🤯​M
🤯​ TestInvariantConfigsCoverage ✅​p ✅​p ✅​p ✅​p 🤯​M 🤯​M
🤯​ TestLeafTests ✅​p ✅​p ✅​p ✅​p 🤯​M 🤯​M
🤯​ TestParseTestOutput ✅​p ✅​p ✅​p ✅​p 🤯​M 🤯​M
🤯​ TestRenderRegressionReport ✅​p ✅​p ✅​p ✅​p 🤯​M 🤯​M
🤯​ TestRenderRegressionReportDedupesIdenticalFailures ✅​p ✅​p ✅​p ✅​p 🤯​M 🤯​M
🤯​ TestSubsetApproximatesPct ✅​p ✅​p ✅​p ✅​p 🤯​M 🤯​M
🤯​ TestSubsetChangedAlwaysRuns ✅​p ✅​p ✅​p ✅​p 🤯​M 🤯​M
🤯​ TestSubsetChangedVariantFilter ✅​p ✅​p ✅​p ✅​p 🤯​M 🤯​M
🤯​ TestSubsetChangedVariantFilterAlternatives ✅​p ✅​p ✅​p ✅​p 🤯​M 🤯​M
🤯​ TestSubsetDisabled ✅​p ✅​p ✅​p ✅​p 🤯​M 🤯​M
🤯​ TestSubsetPctBoundaries ✅​p ✅​p ✅​p ✅​p 🤯​M 🤯​M
🤯​ TestSubsetSeedChangesSelection ✅​p ✅​p ✅​p ✅​p 🤯​M 🤯​M
🤯​ TestSubsetSeedDeterministic ✅​p ✅​p ✅​p ✅​p 🤯​M 🤯​M
🤯​ TestSubsetVariantsIndependent ✅​p ✅​p ✅​p ✅​p 🤯​M 🤯​M
Top 50 slowest tests (at least 2 minutes):
duration env testname
17:22 aws-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
12:25 gcp linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
11:57 aws-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
10:44 aws-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
10:03 aws linux-2core-8gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=cluster_libraries.yml.tmpl/READPLAN=1
10:01 aws linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
9:53 aws linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
9:39 azure-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
9:24 azure linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
9:09 azure-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
9:03 azure linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
8:56 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/deploy/local_ssd_count/DMS=
8:53 aws linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
8:46 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
8:23 gcp linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
8:22 aws linux-2core-8gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN=
8:17 gcp linux-2core-8gb TestAccept/bundle/resources/clusters/deploy/local_ssd_count/DMS=true
7:59 gcp linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
7:59 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
7:48 aws linux-2core-8gb TestAccept/bundle/config-remote-sync/multiple_resources/DMS=true
7:35 azure-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
7:35 aws-windows-latest-4core-16gb TestAccept/bundle/invariant/no_drift/DMS=/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN=
7:27 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/deploy/local_ssd_count/DMS=true
7:25 aws-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/deploy/simple/DMS=true
7:25 aws linux-2core-8gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=cluster.yml.tmpl/READPLAN=1
7:19 gcp linux-2core-8gb TestAccept/bundle/resources/clusters/deploy/local_ssd_count/DMS=
7:12 aws linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
7:06 aws linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started-toggle/DMS=true
6:56 aws linux-2core-8gb TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=app.yml.tmpl/READPLAN=1
6:52 gcp linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
6:49 azure-windows-latest-4core-16gb TestAccept/bundle/resources/materialization_sets/batch/DMS=true
6:36 aws-windows-latest-4core-16gb TestAccept/bundle/invariant/no_drift/DMS=/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN=1
6:29 gcp linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=true
6:27 azure-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
6:25 aws-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
6:22 azure linux-2core-8gb TestAccept/bundle/config-remote-sync/multiple_resources/DMS=true
6:02 azure linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
5:59 aws linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started-toggle/DMS=
5:58 aws-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/deploy/data_security_mode/DMS=
5:56 gcp linux-2core-8gb TestAccept/bundle/templates/default-python/combinations/classic/DLT=yes/DMS=/NBOOK=yes/PY=yes/READPLAN=
5:51 azure linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
5:43 azure-windows-latest-4core-16gb TestAccept/pipelines/run/refresh-flags
5:41 gcp linux-2core-8gb TestAccept/bundle/resources/experiments/basic/DMS=true
5:39 aws-windows-latest-4core-16gb TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=pipeline.yml.tmpl/READPLAN=1
5:38 aws linux-2core-8gb TestAccept/bundle/deploy/spark-jar-task/DMS=
5:34 azure linux-2core-8gb TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=cluster_libraries.yml.tmpl/READPLAN=
5:33 gcp linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=
5:32 aws linux-2core-8gb TestAccept/bundle/deploy/spark-jar-task/DMS=true
5:32 gcp linux-2core-8gb TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=cluster.yml.tmpl/READPLAN=
5:30 aws-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/deploy/update-after-create/DMS=true

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ai-auto PRs made by AI loops & factories, test-only-fix PRs that update failing of flaky tests without changing CLI code.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants