Skip to content

acceptance: invariant that every deployed resource generates back into a valid bundle - #7440

Draft
janniklasrose wants to merge 3 commits into
janniklasrose/bundle-generate-machineryfrom
janniklasrose/bundle-generate-invariant
Draft

janniklasrose wants to merge 3 commits into
janniklasrose/bundle-generate-machineryfrom
janniklasrose/bundle-generate-invariant

Conversation

@janniklasrose

Copy link
Copy Markdown
Member

Changes

Adds the invariant target acceptance/bundle/invariant/generate. It runs over the same per-resource config matrix as no_drift: deploy the minimal config, then for every resource recorded in state run bundle generate <group> --existing-id <id> --key <key> into a fresh bundle, then bundle validate that bundle. The target is local only (Cloud = false): the round-trip from deployment state to configuration is the CLI's own, and the fake server exercises it as well as a workspace would.

acceptance/bin/generate_from_state.py drives the loop from resources.json. It is silent on success so every config records the same two lines, and on failure it prints the failing command and its output, in the style of the other invariants.

The job generator downloads the notebooks a job references, so the script imports /Shared/notebook into the fake workspace first; the invariant job configs all point there.

Excluded configs

  • job_run*: job runs have no generate command.
  • app: the app generator downloads the app's source files, which the fake workspace does not serve.
  • TODO, generate rejects the type because the engine state does not map onto the bundle resource: secret_scope* (state uses scope/scope_backend_type), secret (PrepareState clears metadata RemapState keeps), vector_search_index (same for endpoint_uuid).
  • TODO, postgres_endpoint: GET does not return the spec, so the generated endpoint_type is empty and validate warns.

Each exclusion is a TODO in test.toml; dropping it is the acceptance criterion for the adapter fix.

Why

The base PR makes bundle generate cover every resource type by deriving it from the direct-engine adapters. This target is what proves the derivation per type without per-type test code, and it found the four TODOs above on its first run.

Tests

57 configs pass locally. ./task ws and ./task lint-python pass.

This pull request and its description were written by Isaac.

…o a valid bundle

New invariant target bundle/invariant/generate runs over the same per-resource
config matrix as no_drift: deploy, then `bundle generate <group> --existing-id`
for every resource in state into a fresh bundle, then `bundle validate` it.
Local only; the round-trip under test is the CLI's own.

generate_from_state.py drives the loop from resources.json and is silent on
success so all configs record the same output. Types the round-trip check
rejects today (secret scopes, secrets, vector search indexes) and the Postgres
endpoint, whose GET returns no spec, are excluded with TODOs; app sources are
not served by the fake workspace.

Co-authored-by: Isaac <no-reply@databricks.com>
@github-actions

github-actions Bot commented Nov 10, 2026 •

Copy link
Copy Markdown
Contributor

Commit: 2d33f679e | Workflow run

Regression test report

Selected 7 changed tests (limit=20, 0 not selected)

69 tests: regression=68 unreleased=0 coverage=1 failing=0
test branch main (6a8d9bf) latest (v1.25.0)
TestAccept/bundle/generate/catalog/DMS= ✅ ❌ ❌
TestAccept/bundle/generate/catalog/DMS=true ✅ ❌ ❌
TestAccept/bundle/help/bundle-generate-dashboard/DMS= ✅ ❌ ❌
TestAccept/bundle/help/bundle-generate-dashboard/DMS=true ✅ ❌ ❌
TestAccept/bundle/help/bundle-generate-job/DMS= ✅ ❌ ❌
TestAccept/bundle/help/bundle-generate-job/DMS=true ✅ ❌ ❌
TestAccept/bundle/help/bundle-generate-pipeline/DMS= ✅ ❌ ❌
TestAccept/bundle/help/bundle-generate-pipeline/DMS=true ✅ ❌ ❌
TestAccept/bundle/help/bundle-generate/DMS= ✅ ❌ ❌
TestAccept/bundle/help/bundle-generate/DMS=true ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=alert.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=catalog.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=catalog_optional_fields.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=cluster.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=cluster_libraries.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=cluster_policy.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=dashboard.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=data_quality_monitor.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=database_catalog.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=database_instance.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=experiment.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=external_location.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=feature.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=genie_space.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=instance_pool.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=job.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=job_apply_policy_default_values_for_each_task.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=job_apply_policy_default_values_job_cluster.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=job_apply_policy_default_values_task_cluster.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=job_cross_resource_ref.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=job_escaped_refs.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=job_permission_ref.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=job_pydabs_1000_tasks.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=job_pydabs_10_tasks.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=job_table_update_trigger.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=job_with_depends_on.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=job_with_task.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=model.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=model_service.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=model_serving_endpoint.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=model_serving_endpoint_telemetry.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=model_with_permissions.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=pipeline.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=pipeline_allow_duplicate_names.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=pipeline_apply_policy_default_values.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=pipeline_config_dots.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=postgres_branch.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=postgres_catalog.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=postgres_data_api.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=postgres_database.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=postgres_project.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=postgres_role.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=postgres_synced_table.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=registered_model.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=schema.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=schema_empty_grants.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=schema_grant_ref.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=schema_tf_compat.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=schema_uppercase_name.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=sql_warehouse.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=synced_database_table.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=uc_trailing_slash.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=vector_search_endpoint.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=volume.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=volume_external.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=volume_path_job_ref.yml.tmpl ✅ ❌ ❌
TestAccept/bundle/invariant/generate/INPUT_CONFIG=volume_uppercase_name.yml.tmpl ✅ ❌ ❌
TestAccept/selftest/selection ✅ ✅ ✅
TestAccept/bundle/generate/catalog/DMS=: branch ✅ | main (6a8d9bf) ❌ | latest (v1.25.0) ❌

main (6a8d9bf):

acceptance_test.go:1346: Diff:
        --- bundle/generate/catalog/output.txt
        +++ /tmp/TestAcceptbundlegeneratecatalogDMS=2787490913/002/output.txt
        @@ -1,19 +1,30 @@
         
         >>> [CLI] bundle generate catalog --existing-id my_catalog
        -Catalog configuration successfully saved to [TEST_TMP_DIR]/resources/my_catalog.catalog.yml
        +Error: unknown flag: --existing-id
         
        ->>> cat resources/my_catalog.catalog.yml
        -resources:
        -  catalogs:
        -    my_catalog:
        -      comment: primary catalog
        -      name: my_catalog
        +Usage:
        +  databricks bundle generate [command]
         
        ->>> [CLI] bundle validate
        -Name: generate-catalog
        -Target: default
        -Workspace:
        -  User: [USERNAME]
        -  Path: /Workspace/Users/[USERNAME]/.bundle/generate-catalog/default
        +Available Commands:
        +  alert       Generate configuration for an alert
        +  app         Generate bundle configuration for a Databricks app
        +  dashboard   Generate configuration for a dashboard
        +  genie-space Generate configuration for a Genie space
        +  job         Generate bundle configuration for a job
        +  pipeline    Generate bundle configuration for a pipeline
         
        -Validation OK!
        +Flags:
        +  -h, --help         help for generate
        +      --key string   resource key to use for the generated configuration
        +
        +Global Flags:
        +      --debug            enable debug logging
        +  -o, --output type      output type: text or json (default text)
        +  -p, --profile string   ~/.databrickscfg profile
        +  -t, --target string    bundle target to use (if applicable)
        +      --var strings      set values for variables defined in bundle config. Example: --var="foo=bar"
        +
        +Use "databricks bundle generate [command] --help" for more information about a command.
        +
        +
        +Exit code: 1

latest (v1.25.0): same output as main (6a8d9bf)

TestAccept/bundle/generate/catalog/DMS=true: branch ✅ | main (6a8d9bf) ❌ | latest (v1.25.0) ❌

main (6a8d9bf):

acceptance_test.go:1346: Diff:
        --- bundle/generate/catalog/output.txt
        +++ /tmp/TestAcceptbundlegeneratecatalogDMS=true3036316016/002/output.txt
        @@ -1,19 +1,30 @@
         
         >>> [CLI] bundle generate catalog --existing-id my_catalog
        -Catalog configuration successfully saved to [TEST_TMP_DIR]/resources/my_catalog.catalog.yml
        +Error: unknown flag: --existing-id
         
        ->>> cat resources/my_catalog.catalog.yml
        -resources:
        -  catalogs:
        -    my_catalog:
        -      comment: primary catalog
        -      name: my_catalog
        +Usage:
        +  databricks bundle generate [command]
         
        ->>> [CLI] bundle validate
        -Name: generate-catalog
        -Target: default
        -Workspace:
        -  User: [USERNAME]
        -  Path: /Workspace/Users/[USERNAME]/.bundle/generate-catalog/default
        +Available Commands:
        +  alert       Generate configuration for an alert
        +  app         Generate bundle configuration for a Databricks app
        +  dashboard   Generate configuration for a dashboard
        +  genie-space Generate configuration for a Genie space
        +  job         Generate bundle configuration for a job
        +  pipeline    Generate bundle configuration for a pipeline
         
        -Validation OK!
        +Flags:
        +  -h, --help         help for generate
        +      --key string   resource key to use for the generated configuration
        +
        +Global Flags:
        +      --debug            enable debug logging
        +  -o, --output type      output type: text or json (default text)
        +  -p, --profile string   ~/.databrickscfg profile
        +  -t, --target string    bundle target to use (if applicable)
        +      --var strings      set values for variables defined in bundle config. Example: --var="foo=bar"
        +
        +Use "databricks bundle generate [command] --help" for more information about a command.
        +
        +
        +Exit code: 1

latest (v1.25.0): same output as main (6a8d9bf)

TestAccept/bundle/help/bundle-generate-dashboard/DMS=: branch ✅ | main (6a8d9bf) ❌ | latest (v1.25.0) ❌

main (6a8d9bf):

acceptance_test.go:1346: Diff:
        --- bundle/help/bundle-generate-dashboard/output.txt
        +++ /tmp/TestAcceptbundlehelpbundle-generate-dashboardDMS=1977752126/002/output.txt
        @@ -35,9 +35,6 @@
         Usage:
           databricks bundle generate dashboard [flags]
         
        -Aliases:
        -  dashboard, dashboards
        -
         Flags:
           -s, --dashboard-dir string   directory to write the dashboard representation to (default "src")
               --existing-id string     ID of the dashboard to generate configuration for

latest (v1.25.0): same output as main (6a8d9bf)

TestAccept/bundle/help/bundle-generate-dashboard/DMS=true: branch ✅ | main (6a8d9bf) ❌ | latest (v1.25.0) ❌

main (6a8d9bf):

acceptance_test.go:1346: Diff:
        --- bundle/help/bundle-generate-dashboard/output.txt
        +++ /tmp/TestAcceptbundlehelpbundle-generate-dashboardDMS=true845204021/002/output.txt
        @@ -35,9 +35,6 @@
         Usage:
           databricks bundle generate dashboard [flags]
         
        -Aliases:
        -  dashboard, dashboards
        -
         Flags:
           -s, --dashboard-dir string   directory to write the dashboard representation to (default "src")
               --existing-id string     ID of the dashboard to generate configuration for

latest (v1.25.0): same output as main (6a8d9bf)

TestAccept/bundle/help/bundle-generate-job/DMS=: branch ✅ | main (6a8d9bf) ❌ | latest (v1.25.0) ❌

main (6a8d9bf):

acceptance_test.go:1346: Diff:
        --- bundle/help/bundle-generate-job/output.txt
        +++ /tmp/TestAcceptbundlehelpbundle-generate-jobDMS=3914757179/002/output.txt
        @@ -28,9 +28,6 @@
         Usage:
           databricks bundle generate job [flags]
         
        -Aliases:
        -  job, jobs
        -
         Flags:
           -d, --config-dir string             Dir path where the output config will be stored (default "resources")
               --download-spark-python-files   download workspace files referenced by spark_python_task and rewrite them to a relative path

latest (v1.25.0): same output as main (6a8d9bf)

TestAccept/bundle/help/bundle-generate-job/DMS=true: branch ✅ | main (6a8d9bf) ❌ | latest (v1.25.0) ❌

main (6a8d9bf):

acceptance_test.go:1346: Diff:
        --- bundle/help/bundle-generate-job/output.txt
        +++ /tmp/TestAcceptbundlehelpbundle-generate-jobDMS=true1026339197/002/output.txt
        @@ -28,9 +28,6 @@
         Usage:
           databricks bundle generate job [flags]
         
        -Aliases:
        -  job, jobs
        -
         Flags:
           -d, --config-dir string             Dir path where the output config will be stored (default "resources")
               --download-spark-python-files   download workspace files referenced by spark_python_task and rewrite them to a relative path

latest (v1.25.0): same output as main (6a8d9bf)

TestAccept/bundle/help/bundle-generate-pipeline/DMS=: branch ✅ | main (6a8d9bf) ❌ | latest (v1.25.0) ❌

main (6a8d9bf):

acceptance_test.go:1346: Diff:
        --- bundle/help/bundle-generate-pipeline/output.txt
        +++ /tmp/TestAcceptbundlehelpbundle-generate-pipelineDMS=8774821/002/output.txt
        @@ -27,9 +27,6 @@
         Usage:
           databricks bundle generate pipeline [flags]
         
        -Aliases:
        -  pipeline, pipelines
        -
         Flags:
           -d, --config-dir string             Dir path where the output config will be stored (default "resources")
               --existing-pipeline-id string   ID of the pipeline to generate config for

latest (v1.25.0): same output as main (6a8d9bf)

TestAccept/bundle/help/bundle-generate-pipeline/DMS=true: branch ✅ | main (6a8d9bf) ❌ | latest (v1.25.0) ❌

main (6a8d9bf):

acceptance_test.go:1346: Diff:
        --- bundle/help/bundle-generate-pipeline/output.txt
        +++ /tmp/TestAcceptbundlehelpbundle-generate-pipelineDMS=true1909074566/002/output.txt
        @@ -27,9 +27,6 @@
         Usage:
           databricks bundle generate pipeline [flags]
         
        -Aliases:
        -  pipeline, pipelines
        -
         Flags:
           -d, --config-dir string             Dir path where the output config will be stored (default "resources")
               --existing-pipeline-id string   ID of the pipeline to generate config for

latest (v1.25.0): same output as main (6a8d9bf)

TestAccept/bundle/help/bundle-generate/DMS=: branch ✅ | main (6a8d9bf) ❌ | latest (v1.25.0) ❌

main (6a8d9bf):

acceptance_test.go:1346: Diff:
        --- bundle/help/bundle-generate/output.txt
        +++ /tmp/TestAcceptbundlehelpbundle-generateDMS=242860887/002/output.txt
        @@ -27,47 +27,12 @@
           databricks bundle generate [command]
         
         Available Commands:
        -  alert                      Generate configuration for an alert
        -  app                        Generate bundle configuration for a Databricks app
        -  catalog                    Generate bundle configuration for a catalog
        -  cluster                    Generate bundle configuration for a cluster
        -  cluster-policy             Generate bundle configuration for a cluster policy
        -  dashboard                  Generate configuration for a dashboard
        -  data-quality-monitor       Generate bundle configuration for a data quality monitor
        -  database-catalog           Generate bundle configuration for a database catalog
        -  database-instance          Generate bundle configuration for a database instance
        -  experiment                 Generate bundle configuration for an experiment
        -  external-location          Generate bundle configuration for an external location
        -  feature                    Generate bundle configuration for a feature
        -  genie-space                Generate configuration for a Genie space
        -  instance-pool              Generate bundle configuration for an instance pool
        -  job                        Generate bundle configuration for a job
        -  materialization-set        Generate bundle configuration for a materialization set
        -  mcp-service                Generate bundle configuration for a mcp service
        -  model                      Generate bundle configuration for a model
        -  model-provider-service     Generate bundle configuration for a model provider service
        -  model-service              Generate bundle configuration for a model service
        -  model-serving-endpoint     Generate bundle configuration for a model serving endpoint
        -  pipeline                   Generate bundle configuration for a pipeline
        -  postgres-branch            Generate bundle configuration for a postgres branch
        -  postgres-catalog           Generate bundle configuration for a postgres catalog
        -  postgres-data-api          Generate bundle configuration for a postgres data api
        -  postgres-database          Generate bundle configuration for a postgres database
        -  postgres-endpoint          Generate bundle configuration for a postgres endpoint
        -  postgres-project           Generate bundle configuration for a postgres project
        -  postgres-role              Generate bundle configuration for a postgres role
        -  postgres-snapshot-schedule Generate bundle configuration for a postgres snapshot schedule
        -  postgres-synced-table      Generate bundle configuration for a postgres synced table
        -  quality-monitor            Generate bundle configuration for a quality monitor
        -  registered-model           Generate bundle configuration for a registered model
        -  schema                     Generate bundle configuration for a schema
        -  secret                     Generate bundle configuration for a secret
        -  secret-scope               Generate bundle configuration for a secret scope
        -  sql-warehouse              Generate bundle configuration for a sql warehouse
        -  synced-database-table      Generate bundle configuration for a synced database table
        -  vector-search-endpoint     Generate bundle configuration for a vector search endpoint
        -  vector-search-index        Generate bundle configuration for a vector search index
        -  volume                     Generate bundle configuration for a volume
        +  alert       Generate configuration for an alert
        +  app         Generate bundle configuration for a Databricks app
        +  dashboard   Generate configuration for a dashboard
        +  genie-space Generate configuration for a Genie space
        +  job         Generate bundle configuration for a job
        +  pipeline    Generate bundle configuration for a pipeline
         
         Flags:
           -h, --help         help for generate

latest (v1.25.0): same output as main (6a8d9bf)

TestAccept/bundle/help/bundle-generate/DMS=true: branch ✅ | main (6a8d9bf) ❌ | latest (v1.25.0) ❌

main (6a8d9bf):

acceptance_test.go:1346: Diff:
        --- bundle/help/bundle-generate/output.txt
        +++ /tmp/TestAcceptbundlehelpbundle-generateDMS=true2053286620/002/output.txt
        @@ -27,47 +27,12 @@
           databricks bundle generate [command]
         
         Available Commands:
        -  alert                      Generate configuration for an alert
        -  app                        Generate bundle configuration for a Databricks app
        -  catalog                    Generate bundle configuration for a catalog
        -  cluster                    Generate bundle configuration for a cluster
        -  cluster-policy             Generate bundle configuration for a cluster policy
        -  dashboard                  Generate configuration for a dashboard
        -  data-quality-monitor       Generate bundle configuration for a data quality monitor
        -  database-catalog           Generate bundle configuration for a database catalog
        -  database-instance          Generate bundle configuration for a database instance
        -  experiment                 Generate bundle configuration for an experiment
        -  external-location          Generate bundle configuration for an external location
        -  feature                    Generate bundle configuration for a feature
        -  genie-space                Generate configuration for a Genie space
        -  instance-pool              Generate bundle configuration for an instance pool
        -  job                        Generate bundle configuration for a job
        -  materialization-set        Generate bundle configuration for a materialization set
        -  mcp-service                Generate bundle configuration for a mcp service
        -  model                      Generate bundle configuration for a model
        -  model-provider-service     Generate bundle configuration for a model provider service
        -  model-service              Generate bundle configuration for a model service
        -  model-serving-endpoint     Generate bundle configuration for a model serving endpoint
        -  pipeline                   Generate bundle configuration for a pipeline
        -  postgres-branch            Generate bundle configuration for a postgres branch
        -  postgres-catalog           Generate bundle configuration for a postgres catalog
        -  postgres-data-api          Generate bundle configuration for a postgres data api
        -  postgres-database          Generate bundle configuration for a postgres database
        -  postgres-endpoint          Generate bundle configuration for a postgres endpoint
        -  postgres-project           Generate bundle configuration for a postgres project
        -  postgres-role              Generate bundle configuration for a postgres role
        -  postgres-snapshot-schedule Generate bundle configuration for a postgres snapshot schedule
        -  postgres-synced-table      Generate bundle configuration for a postgres synced table
        -  quality-monitor            Generate bundle configuration for a quality monitor
        -  registered-model           Generate bundle configuration for a registered model
        -  schema                     Generate bundle configuration for a schema
        -  secret                     Generate bundle configuration for a secret
        -  secret-scope               Generate bundle configuration for a secret scope
        -  sql-warehouse              Generate bundle configuration for a sql warehouse
        -  synced-database-table      Generate bundle configuration for a synced database table
        -  vector-search-endpoint     Generate bundle configuration for a vector search endpoint
        -  vector-search-index        Generate bundle configuration for a vector search index
        -  volume                     Generate bundle configuration for a volume
        +  alert       Generate configuration for an alert
        +  app         Generate bundle configuration for a Databricks app
        +  dashboard   Generate configuration for a dashboard
        +  genie-space Generate configuration for a Genie space
        +  job         Generate bundle configuration for a job
        +  pipeline    Generate bundle configuration for a pipeline
         
         Flags:
           -h, --help         help for generate

latest (v1.25.0): same output as main (6a8d9bf)

TestAccept/bundle/invariant/generate/INPUT_CONFIG=alert.yml.tmpl: branch ✅ | main (6a8d9bf) ❌ | latest (v1.25.0) ❌

main (6a8d9bf):

acceptance_test.go:1346: Diff:
        --- bundle/invariant/generate/output.txt
        +++ /tmp/TestAcceptbundleinvariantgenerateINPUT_CONFIG=alert.yml.tmpl3786948815/002/output.txt
        @@ -1,2 +1,31 @@
         INPUT_CONFIG_OK
        -GENERATE_OK
        +bundle generate alerts --existing-id [UUID] --key foo failed with exit code 1:
        +Error: unknown flag: --existing-id
        +
        +Usage:
        +  databricks bundle generate [command]
        +
        +Available Commands:
        +  alert       Generate configuration for an alert
        +  app         Generate bundle configuration for a Databricks app
        +  dashboard   Generate configuration for a dashboard
        +  genie-space Generate configuration for a Genie space
        +  job         Generate bundle configuration for a job
        +  pipeline    Generate bundle configuration for a pipeline
        +
        +Flags:
        +  -h, --help         help for generate
        +      --key string   resource key to use for the generated configuration
        +
        +Global Flags:
        +      --debug            enable debug logging
        +  -o, --output type      output type: text or json (default text)
        +  -p, --profile string   ~/.databrickscfg profile
        +  -t, --target string    bundle target to use (if applicable)
        +      --var strings      set values for variables defined in bundle config. Example: --var="foo=bar"
        +
        +Use "databricks bundle generate [command] --help" for more information about a command.
        +
        +
        +
        +Exit code: 1
        
    acceptance_test.go:1124: 
        LOG.config: bundle:
        LOG.config:   name: test-bundle-ucff6ksnnrg7vlbqwjjqnz27p4
        LOG.config: 
        LOG.config: resources:
        LOG.config:   alerts:
        LOG.config:     foo:
        LOG.config:       warehouse_id: 8ec9edc1-db0c-40df-af8d-7580020fe61e
        LOG.config:       display_name: test-alert-ucff6ksnnrg7vlbqwjjqnz27p4
        LOG.config:       file_path: ./alert.dbalert.json
        LOG.config:       permissions:
        LOG.config:         - level: CAN_MANAGE
        LOG.config:           group_name: users
    acceptance_test.go:1124: LOG.cp: 
    acceptance_test.go:1124: 
        LOG.deploy: 
        LOG.deploy: >>> /tmp/TestAccept1315826033/001/databricks bundle deploy
        LOG.deploy: Uploading bundle files to /Workspace/Users/tester@databricks.com/.bundle/test-bundle-ucff6ksnnrg7vlbqwjjqnz27p4/default/files...
        LOG.deploy: Created alerts.foo
        LOG.deploy: Created alerts.foo.permissions
        LOG.deploy: Files: 14 uploaded, 0 deleted
        LOG.deploy: Resources: 2 created, 0 changed, 0 deleted, 0 unchanged
    acceptance_test.go:1124: 
        LOG.destroy: 
        LOG.destroy: >>> /tmp/TestAccept1315826033/001/databricks bundle destroy --auto-approve
        LOG.destroy: The following resources will be deleted:
        LOG.destroy:   delete resources.alerts.foo
        LOG.destroy: 
        LOG.destroy: All files and directories at the following location will be deleted: /Workspace/Users/tester@databricks.com/.bundle/test-bundle-ucff6ksnnrg7vlbqwjjqnz27p4/default
        LOG.destroy: 
        LOG.destroy: Destroy: 1 deleted
    acceptance_test.go:1124: LOG.import:

latest (v1.25.0):

acceptance_test.go:1346: Diff:
        --- bundle/invariant/generate/output.txt
        +++ /tmp/TestAcceptbundleinvariantgenerateINPUT_CONFIG=alert.yml.tmpl2889102780/002/output.txt
        @@ -1,2 +1,31 @@
         INPUT_CONFIG_OK
        -GENERATE_OK
        +bundle generate alerts --existing-id [UUID] --key foo failed with exit code 1:
        +Error: unknown flag: --existing-id
        +
        +Usage:
        +  databricks bundle generate [command]
        +
        +Available Commands:
        +  alert       Generate configuration for an alert
        +  app         Generate bundle configuration for a Databricks app
        +  dashboard   Generate configuration for a dashboard
        +  genie-space Generate configuration for a Genie space
        +  job         Generate bundle configuration for a job
        +  pipeline    Generate bundle configuration for a pipeline
        +
        +Flags:
        +  -h, --help         help for generate
        +      --key string   resource key to use for the generated configuration
        +
        +Global Flags:
        +      --debug            enable debug logging
        +  -o, --output type      output type: text or json (default text)
        +  -p, --profile string   ~/.databrickscfg profile
        +  -t, --target string    bundle target to use (if applicable)
        +      --var strings      set values for variables defined in bundle config. Example: --var="foo=bar"
        +
        +Use "databricks bundle generate [command] --help" for more information about a command.
        +
        +
        +
        +Exit code: 1
        
    acceptance_test.go:1124: 
        LOG.config: bundle:
        LOG.config:   name: test-bundle-e33mxbypyza6dfnfdmdlrzlewa
        LOG.config: 
        LOG.config: resources:
        LOG.config:   alerts:
        LOG.config:     foo:
        LOG.config:       warehouse_id: 8ec9edc1-db0c-40df-af8d-7580020fe61e
        LOG.config:       display_name: test-alert-e33mxbypyza6dfnfdmdlrzlewa
        LOG.config:       file_path: ./alert.dbalert.json
        LOG.config:       permissions:
        LOG.config:         - level: CAN_MANAGE
        LOG.config:           group_name: users
    acceptance_test.go:1124: LOG.cp: 
    acceptance_test.go:1124: 
        LOG.deploy: 
        LOG.deploy: >>> /home/runner/work/cli/cli/acceptance/build/linux_amd64/1.25.0/databricks bundle deploy
        LOG.deploy: Uploading bundle files to /Workspace/Users/tester@databricks.com/.bundle/test-bundle-e33mxbypyza6dfnfdmdlrzlewa/default/files...
        LOG.deploy: Created alerts.foo
        LOG.deploy: Created alerts.foo.permissions
        LOG.deploy: Files: 14 uploaded, 0 deleted
        LOG.deploy: Resources: 2 created, 0 changed, 0 deleted, 0 unchanged
    acceptance_test.go:1124: 
        LOG.destroy: 
        LOG.destroy: >>> /home/runner/work/cli/cli/acceptance/build/linux_amd64/1.25.0/databricks bundle destroy --auto-approve
        LOG.destroy: The following resources will be deleted:
        LOG.destroy:   delete resources.alerts.foo
        LOG.destroy: 
        LOG.destroy: All files and directories at the following location will be deleted: /Workspace/Users/tester@databricks.com/.bundle/test-bundle-e33mxbypyza6dfnfdmdlrzlewa/default
        LOG.destroy: 
        LOG.destroy: Destroy: 1 deleted
    acceptance_test.go:1124: LOG.import:
TestAccept/bundle/invariant/generate/INPUT_CONFIG=catalog.yml.tmpl: branch ✅ | main (6a8d9bf) ❌ | latest (v1.25.0) ❌

main (6a8d9bf):

acceptance_test.go:1346: Diff:
        --- bundle/invariant/generate/output.txt
        +++ /tmp/TestAcceptbundleinvariantgenerateINPUT_CONFIG=catalog.yml.tm3399294995/002/output.txt
        @@ -1,2 +1,31 @@
         INPUT_CONFIG_OK
        -GENERATE_OK
        +bundle generate catalogs --existing-id test-catalog-[UNIQUE_NAME] --key foo failed with exit code 1:
        +Error: unknown flag: --existing-id
        +
        +Usage:
        +  databricks bundle generate [command]
        +
        +Available Commands:
        +  alert       Generate configuration for an alert
        +  app         Generate bundle configuration for a Databricks app
        +  dashboard   Generate configuration for a dashboard
        +  genie-space Generate configuration for a Genie space
        +  job         Generate bundle configuration for a job
        +  pipeline    Generate bundle configuration for a pipeline
        +
        +Flags:
        +  -h, --help         help for generate
        +      --key string   resource key to use for the generated configuration
        +
        +Global Flags:
        +      --debug            enable debug logging
        +  -o, --output type      output type: text or json (default text)
        +  -p, --profile string   ~/.databrickscfg profile
        +  -t, --target string    bundle target to use (if applicable)
        +      --var strings      set values for variables defined in bundle config. Example: --var="foo=bar"
        +
        +Use "databricks bundle generate [command] --help" for more information about a command.
        +
        +
        +
        +Exit code: 1
        
    acceptance_test.go:1124: 
        LOG.config: bundle:
        LOG.config:   name: test-bundle-m47ha3skhrcldco7iurfwlbgti
        LOG.config: 
        LOG.config: resources:
        LOG.config:   catalogs:
        LOG.config:     foo:
        LOG.config:       name: test-catalog-m47ha3skhrcldco7iurfwlbgti
        LOG.config:       comment: This is a test catalog # CAN_REMOVE
        LOG.config:       grants:
        LOG.config:         - principal: account users
        LOG.config:           privileges:
        LOG.config:             - USE_CATALOG
    acceptance_test.go:1124: LOG.cp: 
    acceptance_test.go:1124: 
        LOG.deploy: 
        LOG.deploy: >>> /tmp/TestAccept1315826033/001/databricks bundle deploy
        LOG.deploy: Uploading bundle files to /Workspace/Users/tester@databricks.com/.bundle/test-bundle-m47ha3skhrcldco7iurfwlbgti/default/files...
        LOG.deploy: Created catalogs.foo
        LOG.deploy: Created catalogs.foo.grants
        LOG.deploy: Files: 14 uploaded, 0 deleted
        LOG.deploy: Resources: 2 created, 0 changed, 0 deleted, 0 unchanged
    acceptance_test.go:1124: 
        LOG.destroy: 
        LOG.destroy: >>> /tmp/TestAccept1315826033/001/databricks bundle destroy --auto-approve
        LOG.destroy: The following resources will be deleted:
        LOG.destroy:   delete resources.catalogs.foo
        LOG.destroy: 
        LOG.destroy: All files and directories at the following location will be deleted: /Workspace/Users/tester@databricks.com/.bundle/test-bundle-m47ha3skhrcldco7iurfwlbgti/default
        LOG.destroy: 
        LOG.destroy: Destroy: 1 deleted
    acceptance_test.go:1124: LOG.import:

latest (v1.25.0):

acceptance_test.go:1346: Diff:
        --- bundle/invariant/generate/output.txt
        +++ /tmp/TestAcceptbundleinvariantgenerateINPUT_CONFIG=catalog.yml.tm3683208455/002/output.txt
        @@ -1,2 +1,31 @@
         INPUT_CONFIG_OK
        -GENERATE_OK
        +bundle generate catalogs --existing-id test-catalog-[UNIQUE_NAME] --key foo failed with exit code 1:
        +Error: unknown flag: --existing-id
        +
        +Usage:
        +  databricks bundle generate [command]
        +
        +Available Commands:
        +  alert       Generate configuration for an alert
        +  app         Generate bundle configuration for a Databricks app
        +  dashboard   Generate configuration for a dashboard
        +  genie-space Generate configuration for a Genie space
        +  job         Generate bundle configuration for a job
        +  pipeline    Generate bundle configuration for a pipeline
        +
        +Flags:
        +  -h, --help         help for generate
        +      --key string   resource key to use for the generated configuration
        +
        +Global Flags:
        +      --debug            enable debug logging
        +  -o, --output type      output type: text or json (default text)
        +  -p, --profile string   ~/.databrickscfg profile
        +  -t, --target string    bundle target to use (if applicable)
        +      --var strings      set values for variables defined in bundle config. Example: --var="foo=bar"
        +
        +Use "databricks bundle generate [command] --help" for more information about a command.
        +
        +
        +
        +Exit code: 1
        
    acceptance_test.go:1124: 
        LOG.config: bundle:
        LOG.config:   name: test-bundle-a35pzuhh4fge7jqu55ojztnrlm
        LOG.config: 
        LOG.config: resources:
        LOG.config:   catalogs:
        LOG.config:     foo:
        LOG.config:       name: test-catalog-a35pzuhh4fge7jqu55ojztnrlm
        LOG.config:       comment: This is a test catalog # CAN_REMOVE
        LOG.config:       grants:
        LOG.config:         - principal: account users
        LOG.config:           privileges:
        LOG.config:             - USE_CATALOG
    acceptance_test.go:1124: LOG.cp: 
    acceptance_test.go:1124: 
        LOG.deploy: 
        LOG.deploy: >>> /home/runner/work/cli/cli/acceptance/build/linux_amd64/1.25.0/databricks bundle deploy
        LOG.deploy: Uploading bundle files to /Workspace/Users/tester@databricks.com/.bundle/test-bundle-a35pzuhh4fge7jqu55ojztnrlm/default/files...
        LOG.deploy: Created catalogs.foo
        LOG.deploy: Created catalogs.foo.grants
        LOG.deploy: Files: 14 uploaded, 0 deleted
        LOG.deploy: Resources: 2 created, 0 changed, 0 deleted, 0 unchanged
    acceptance_test.go:1124: 
        LOG.destroy: 
        LOG.destroy: >>> /home/runner/work/cli/cli/acceptance/build/linux_amd64/1.25.0/databricks bundle destroy --auto-approve
        LOG.destroy: The following resources will be deleted:
        LOG.destroy:   delete resources.catalogs.foo
        LOG.destroy: 
        LOG.destroy: All files and directories at the following location will be deleted: /Workspace/Users/tester@databricks.com/.bundle/test-bundle-a35pzuhh4fge7jqu55ojztnrlm/default
        LOG.destroy: 
        LOG.destroy: Destroy: 1 deleted
    acceptance_test.go:1124: LOG.import:
TestAccept/bundle/invariant/generate/INPUT_CONFIG=catalog_optional_fields.yml.tmpl: branch ✅ | main (6a8d9bf) ❌ | latest (v1.25.0) ❌

main (6a8d9bf):

acceptance_test.go:1346: Diff:
        --- bundle/invariant/generate/output.txt
        +++ /tmp/TestAcceptbundleinvariantgenerateINPUT_CONFIG=catalog_option460358614/002/output.txt
        @@ -1,2 +1,31 @@
         INPUT_CONFIG_OK
        -GENERATE_OK
        +bundle generate catalogs --existing-id test-catalog-[UNIQUE_NAME] --key foo failed with exit code 1:
        +Error: unknown flag: --existing-id
        +
        +Usage:
        +  databricks bundle generate [command]
        +
        +Available Commands:
        +  alert       Generate configuration for an alert
        +  app         Generate bundle configuration for a Databricks app
        +  dashboard   Generate configuration for a dashboard
        +  genie-space Generate configuration for a Genie space
        +  job         Generate bundle configuration for a job
        +  pipeline    Generate bundle configuration for a pipeline
        +
        +Flags:
        +  -h, --help         help for generate
        +      --key string   resource key to use for the generated configuration
        +
        +Global Flags:
        +      --debug            enable debug logging
        +  -o, --output type      output type: text or json (default text)
        +  -p, --profile string   ~/.databrickscfg profile
        +  -t, --target string    bundle target to use (if applicable)
        +      --var strings      set values for variables defined in bundle config. Example: --var="foo=bar"
        +
        +Use "databricks bundle generate [command] --help" for more information about a command.
        +
        +
        +
        +Exit code: 1
        
    acceptance_test.go:1124: 
        LOG.config: bundle:
        LOG.config:   name: test-bundle-lxvezslxabc7tom5om72km3mhi
        LOG.config: 
        LOG.config: resources:
        LOG.config:   catalogs:
        LOG.config:     foo:
        LOG.config:       name: test-catalog-lxvezslxabc7tom5om72km3mhi
        LOG.config:       comment: This is a test catalog
        LOG.config:       custom_max_retention_hours: 48 # CAN_REMOVE
        LOG.config:       managed_encryption_settings:
        LOG.config:         customer_managed_key_id: 00000000-0000-0000-0000-000000000000
        LOG.config:       properties:
        LOG.config:         tier: bronze
        LOG.config:         team: data # CAN_REMOVE
    acceptance_test.go:1124: LOG.cp: 
    acceptance_test.go:1124: 
        LOG.deploy: 
        LOG.deploy: >>> /tmp/TestAccept1315826033/001/databricks bundle deploy
        LOG.deploy: Uploading bundle files to /Workspace/Users/tester@databricks.com/.bundle/test-bundle-lxvezslxabc7tom5om72km3mhi/default/files...
        LOG.deploy: Created catalogs.foo
        LOG.deploy: Files: 14 uploaded, 0 deleted
        LOG.deploy: Resources: 1 created, 0 changed, 0 deleted, 0 unchanged
    acceptance_test.go:1124: 
        LOG.destroy: 
        LOG.destroy: >>> /tmp/TestAccept1315826033/001/databricks bundle destroy --auto-approve
        LOG.destroy: The following resources will be deleted:
        LOG.destroy:   delete resources.catalogs.foo
        LOG.destroy: 
        LOG.destroy: All files and directories at the following location will be deleted: /Workspace/Users/tester@databricks.com/.bundle/test-bundle-lxvezslxabc7tom5om72km3mhi/default
        LOG.destroy: 
        LOG.destroy: Destroy: 1 deleted
    acceptance_test.go:1124: LOG.import:

latest (v1.25.0):

acceptance_test.go:1346: Diff:
        --- bundle/invariant/generate/output.txt
        +++ /tmp/TestAcceptbundleinvariantgenerateINPUT_CONFIG=catalog_option4089397869/002/output.txt
        @@ -1,2 +1,31 @@
         INPUT_CONFIG_OK
        -GENERATE_OK
        +bundle generate catalogs --existing-id test-catalog-[UNIQUE_NAME] --key foo failed with exit code 1:
        +Error: unknown flag: --existing-id
        +
        +Usage:
        +  databricks bundle generate [command]
        +
        +Available Commands:
        +  alert       Generate configuration for an alert
        +  app         Generate bundle configuration for a Databricks app
        +  dashboard   Generate configuration for a dashboard
        +  genie-space Generate configuration for a Genie space
        +  job         Generate bundle configuration for a job
        +  pipeline    Generate bundle configuration for a pipeline
        +
        +Flags:
        +  -h, --help         help for generate
        +      --key string   resource key to use for the generated configuration
        +
        +Global Flags:
        +      --debug            enable debug logging
        +  -o, --output type      output type: text or json (default text)
        +  -p, --profile string   ~/.databrickscfg profile
        +  -t, --target string    bundle target to use (if applicable)
        +      --var strings      set values for variables defined in bundle config. Example: --var="foo=bar"
        +
        +Use "databricks bundle generate [command] --help" for more information about a command.
        +
        +
        +
        +Exit code: 1
        
    acceptance_test.go:1124: 
        LOG.config: bundle:
        LOG.config:   name: test-bundle-6ponwjn55rhe5pdsl6pi3decwu
        LOG.config: 
        LOG.config: resources:
        LOG.config:   catalogs:
        LOG.config:     foo:
        LOG.config:       name: test-catalog-6ponwjn55rhe5pdsl6pi3decwu
        LOG.config:       comment: This is a test catalog
        LOG.config:       custom_max_retention_hours: 48 # CAN_REMOVE
        LOG.config:       managed_encryption_settings:
        LOG.config:         customer_managed_key_id: 00000000-0000-0000-0000-000000000000
        LOG.config:       properties:
        LOG.config:         tier: bronze
        LOG.config:         team: data # CAN_REMOVE
    acceptance_test.go:1124: LOG.cp: 
    acceptance_test.go:1124: 
        LOG.deploy: 
        LOG.deploy: >>> /home/runner/work/cli/cli/acceptance/build/linux_amd64/1.25.0/databricks bundle deploy
        LOG.deploy: Uploading bundle files to /Workspace/Users/tester@databricks.com/.bundle/test-bundle-6ponwjn55rhe5pdsl6pi3decwu/default/files...
        LOG.deploy: Created catalogs.foo
        LOG.deploy: Files: 14 uploaded, 0 deleted
        LOG.deploy: Resources: 1 created, 0 changed, 0 deleted, 0 unchanged
    acceptance_test.go:1124: 
        LOG.destroy: 
        LOG.destroy: >>> /home/runner/work/cli/cli/acceptance/build/linux_amd64/1.25.0/databricks bundle destroy --auto-approve
        LOG.destroy: The following resources will be deleted:
        LOG.destroy:   delete resources.catalogs.foo
        LOG.destroy: 
        LOG.destroy: All files and directories at the following location will be deleted: /Workspace/Users/tester@databricks.com/.bundle/test-bundle-6ponwjn55rhe5pdsl6pi3decwu/default
        LOG.destroy: 
        LOG.destroy: Destroy: 1 deleted
    acceptance_test.go:1124: LOG.import:
TestAccept/bundle/invariant/generate/INPUT_CONFIG=cluster.yml.tmpl: branch ✅ | main (6a8d9bf) ❌ | latest (v1.25.0) ❌

main (6a8d9bf):

acceptance_test.go:1346: Diff:
        --- bundle/invariant/generate/output.txt
        +++ /tmp/TestAcceptbundleinvariantgenerateINPUT_CONFIG=cluster.yml.tm1394643776/002/output.txt
        @@ -1,2 +1,31 @@
         INPUT_CONFIG_OK
        -GENERATE_OK
        +bundle generate clusters --existing-id [UUID] --key foo failed with exit code 1:
        +Error: unknown flag: --existing-id
        +
        +Usage:
        +  databricks bundle generate [command]
        +
        +Available Commands:
        +  alert       Generate configuration for an alert
        +  app         Generate bundle configuration for a Databricks app
        +  dashboard   Generate configuration for a dashboard
        +  genie-space Generate configuration for a Genie space
        +  job         Generate bundle configuration for a job
        +  pipeline    Generate bundle configuration for a pipeline
        +
        +Flags:
        +  -h, --help         help for generate
        +      --key string   resource key to use for the generated configuration
        +
        +Global Flags:
        +      --debug            enable debug logging
        +  -o, --output type      output type: text or json (default text)
        +  -p, --profile string   ~/.databrickscfg profile
        +  -t, --target string    bundle target to use (if applicable)
        +      --var strings      set values for variables defined in bundle config. Example: --var="foo=bar"
        +
        +Use "databricks bundle generate [command] --help" for more information about a command.
        +
        +
        +
        +Exit code: 1
        
    acceptance_test.go:1124: 
        LOG.config: bundle:
        LOG.config:   name: test-bundle-f6xyngu3ajdgnbxxjgs3o6nebq
        LOG.config: 
        LOG.config: resources:
        LOG.config:   clusters:
        LOG.config:     foo:
        LOG.config:       cluster_name: test-cluster-f6xyngu3ajdgnbxxjgs3o6nebq
        LOG.config:       spark_version: 13.3.x-scala2.12
        LOG.config:       node_type_id: i3.xlarge
        LOG.config:       instance_pool_id: 0123-456789-pool0
        LOG.config:       num_workers: 1
        LOG.config:       permissions:
        LOG.config:         - level: CAN_ATTACH_TO
        LOG.config:           group_name: users
    acceptance_test.go:1124: LOG.cp: 
    acceptance_test.go:1124: 
        LOG.deploy: 
        LOG.deploy: >>> /tmp/TestAccept1315826033/001/databricks bundle deploy
        LOG.deploy: Uploading bundle files to /Workspace/Users/tester@databricks.com/.bundle/test-bundle-f6xyngu3ajdgnbxxjgs3o6nebq/default/files...
        LOG.deploy: Created clusters.foo
        LOG.deploy: Created clusters.foo.permissions
        LOG.deploy: Files: 14 uploaded, 0 deleted
        LOG.deploy: Resources: 2 created, 0 changed, 0 deleted, 0 unchanged
    acceptance_test.go:1124: 
        LOG.destroy: 
        LOG.destroy: >>> /tmp/TestAccept1315826033/001/databricks bundle destroy --auto-approve
        LOG.destroy: The following resources will be deleted:
        LOG.destroy:   delete resources.clusters.foo
        LOG.destroy: 
        LOG.destroy: All files and directories at the following location will be deleted: /Workspace/Users/tester@databricks.com/.bundle/test-bundle-f6xyngu3ajdgnbxxjgs3o6nebq/default
        LOG.destroy: 
        LOG.destroy: Destroy: 1 deleted
    acceptance_test.go:1124: LOG.import:

latest (v1.25.0):

acceptance_test.go:1346: Diff:
        --- bundle/invariant/generate/output.txt
        +++ /tmp/TestAcceptbundleinvariantgenerateINPUT_CONFIG=cluster.yml.tm1280832150/002/output.txt
        @@ -1,2 +1,31 @@
         INPUT_CONFIG_OK
        -GENERATE_OK
        +bundle generate clusters --existing-id [UUID] --key foo failed with exit code 1:
        +Error: unknown flag: --existing-id
        +
        +Usage:
        +  databricks bundle generate [command]
        +
        +Available Commands:
        +  alert       Generate configuration for an alert
        +  app         Generate bundle configuration for a Databricks app
        +  dashboard   Generate configuration for a dashboard
        +  genie-space Generate configuration for a Genie space
        +  job         Generate bundle configuration for a job
        +  pipeline    Generate bundle configuration for a pipeline
        +
        +Flags:
        +  -h, --help         help for generate
        +      --key string   resource key to use for the generated configuration
        +
        +Global Flags:
        +      --debug            enable debug logging
        +  -o, --output type      output type: text or json (default text)
        +  -p, --profile string   ~/.databrickscfg profile
        +  -t, --target string    bundle target to use (if applicable)
        +      --var strings      set values for variables defined in bundle config. Example: --var="foo=bar"
        +
        +Use "databricks bundle generate [command] --help" for more information about a command.
        +
        +
        +
        +Exit code: 1
        
    acceptance_test.go:1124: 
        LOG.config: bundle:
        LOG.config:   name: test-bundle-inohn6kaajftpca3dqol5zci6e
        LOG.config: 
        LOG.config: resources:
        LOG.config:   clusters:
        LOG.config:     foo:
        LOG.config:       cluster_name: test-cluster-inohn6kaajftpca3dqol5zci6e
        LOG.config:       spark_version: 13.3.x-scala2.12
        LOG.config:       node_type_id: i3.xlarge
        LOG.config:       instance_pool_id: 0123-456789-pool0
        LOG.config:       num_workers: 1
        LOG.config:       permissions:
        LOG.config:         - level: CAN_ATTACH_TO
        LOG.config:           group_name: users
    acceptance_test.go:1124: LOG.cp: 
    acceptance_test.go:1124: 
        LOG.deploy: 
        LOG.deploy: >>> /home/runner/work/cli/cli/acceptance/build/linux_amd64/1.25.0/databricks bundle deploy
        LOG.deploy: Uploading bundle files to /Workspace/Users/tester@databricks.com/.bundle/test-bundle-inohn6kaajftpca3dqol5zci6e/default/files...
        LOG.deploy: Created clusters.foo
        LOG.deploy: Created clusters.foo.permissions
        LOG.deploy: Files: 14 uploaded, 0 deleted
        LOG.deploy: Resources: 2 created, 0 changed, 0 deleted, 0 unchanged
    acceptance_test.go:1124: 
        LOG.destroy: 
        LOG.destroy: >>> /home/runner/work/cli/cli/acceptance/build/linux_amd64/1.25.0/databricks bundle destroy --auto-approve
        LOG.destroy: The following resources will be deleted:
        LOG.destroy:   delete resources.clusters.foo
        LOG.destroy: 
        LOG.destroy: All files and directories at the following location will be deleted: /Workspace/Users/tester@databricks.com/.bundle/test-bundle-inohn6kaajftpca3dqol5zci6e/default
        LOG.destroy: 
        LOG.destroy: Destroy: 1 deleted
    acceptance_test.go:1124: LOG.import:
TestAccept/bundle/invariant/generate/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl: branch ✅ | main (6a8d9bf) ❌ | latest (v1.25.0) ❌

main (6a8d9bf):

acceptance_test.go:1346: Diff:
        --- bundle/invariant/generate/output.txt
        +++ /tmp/TestAcceptbundleinvariantgenerateINPUT_CONFIG=cluster_apply_496861726/002/output.txt
        @@ -1,2 +1,31 @@
         INPUT_CONFIG_OK
        -GENERATE_OK
        +bundle generate clusters --existing-id [UUID] --key foo failed with exit code 1:
        +Error: unknown flag: --existing-id
        +
        +Usage:
        +  databricks bundle generate [command]
        +
        +Available Commands:
        +  alert       Generate configuration for an alert
        +  app         Generate bundle configuration for a Databricks app
        +  dashboard   Generate configuration for a dashboard
        +  genie-space Generate configuration for a Genie space
        +  job         Generate bundle configuration for a job
        +  pipeline    Generate bundle configuration for a pipeline
        +
        +Flags:
        +  -h, --help         help for generate
        +      --key string   resource key to use for the generated configuration
        +
        +Global Flags:
        +      --debug            enable debug logging
        +  -o, --output type      output type: text or json (default text)
        +  -p, --profile string   ~/.databrickscfg profile
        +  -t, --target string    bundle target to use (if applicable)
        +      --var strings      set values for variables defined in bundle config. Example: --var="foo=bar"
        +
        +Use "databricks bundle generate [command] --help" for more information about a command.
        +
        +
        +
        +Exit code: 1
        
    acceptance_test.go:1124: 
        LOG.config: bundle:
        LOG.config:   name: test-bundle-vh5wh7zg5vbyrdb4yfeuzg4c7e
        LOG.config: 
        LOG.config: resources:
        LOG.config:   clusters:
        LOG.config:     foo:
        LOG.config:       cluster_name: test-cluster-vh5wh7zg5vbyrdb4yfeuzg4c7e
        LOG.config:       spark_version: 13.3.x-scala2.12
        LOG.config:       node_type_id: i3.xlarge
        LOG.config:       instance_pool_id: 0123-456789-pool0
        LOG.config:       num_workers: 1
        LOG.config:       apply_policy_default_values: true
    acceptance_test.go:1124: LOG.cp: 
    acceptance_test.go:1124: 
        LOG.deploy: 
        LOG.deploy: >>> /tmp/TestAccept1315826033/001/databricks bundle deploy
        LOG.deploy: Uploading bundle files to /Workspace/Users/tester@databricks.com/.bundle/test-bundle-vh5wh7zg5vbyrdb4yfeuzg4c7e/default/files...
        LOG.deploy: Created clusters.foo
        LOG.deploy: Files: 14 uploaded, 0 deleted
        LOG.deploy: Resources: 1 created, 0 changed, 0 deleted, 0 unchanged
    acceptance_test.go:1124: 
        LOG.destroy: 
        LOG.destroy: >>> /tmp/TestAccept1315826033/001/databricks bundle destroy --auto-approve
        LOG.destroy: The following resources will be deleted:
        LOG.destroy:   delete resources.clusters.foo
        LOG.destroy: 
        LOG.destroy: All files and directories at the following location will be deleted: /Workspace/Users/tester@databricks.com/.bundle/test-bundle-vh5wh7zg5vbyrdb4yfeuzg4c7e/default
        LOG.destroy: 
        LOG.destroy: Destroy: 1 deleted
    acceptance_test.go:1124: LOG.import:

latest (v1.25.0):

acceptance_test.go:1346: Diff:
        --- bundle/invariant/generate/output.txt
        +++ /tmp/TestAcceptbundleinvariantgenerateINPUT_CONFIG=cluster_apply_2041716615/002/output.txt
        @@ -1,2 +1,31 @@
         INPUT_CONFIG_OK
        -GENERATE_OK
        +bundle generate clusters --existing-id [UUID] --key foo failed with exit code 1:
        +Error: unknown flag: --existing-id
        +
        +Usage:
        +  databricks bundle generate [command]
        +
        +Available Commands:
        +  alert       Generate configuration for an alert
        +  app         Generate bundle configuration for a Databricks app
        +  dashboard   Generate configuration for a dashboard
        +  genie-space Generate configuration for a Genie space
        +  job         Generate bundle configuration for a job
        +  pipeline    Generate bundle configuration for a pipeline
        +
        +Flags:
        +  -h, --help         help for generate
        +      --key string   resource key to use for the generated configuration
        +
        +Global Flags:
        +      --debug            enable debug logging
        +  -o, --output type      output type: text or json (default text)
        +  -p, --profile string   ~/.databrickscfg profile
        +  -t, --target string    bundle target to use (if applicable)
        +      --var strings      set values for variables defined in bundle config. Example: --var="foo=bar"
        +
        +Use "databricks bundle generate [command] --help" for more information about a command.
        +
        +
        +
        +Exit code: 1
        
    acceptance_test.go:1124: 
        LOG.config: bundle:
        LOG.config:   name: test-bundle-4x4r7adi6faevgs32ddlqwpqly
        LOG.config: 
        LOG.config: resources:
        LOG.config:   clusters:
        LOG.config:     foo:
        LOG.config:       cluster_name: test-cluster-4x4r7adi6faevgs32ddlqwpqly
        LOG.config:       spark_version: 13.3.x-scala2.12
        LOG.config:       node_type_id: i3.xlarge
        LOG.config:       instance_pool_id: 0123-456789-pool0
        LOG.config:       num_workers: 1
        LOG.config:       apply_policy_default_values: true
    acceptance_test.go:1124: LOG.cp: 
    acceptance_test.go:1124: 
        LOG.deploy: 
        LOG.deploy: >>> /home/runner/work/cli/cli/acceptance/build/linux_amd64/1.25.0/databricks bundle deploy
        LOG.deploy: Uploading bundle files to /Workspace/Users/tester@databricks.com/.bundle/test-bundle-4x4r7adi6faevgs32ddlqwpqly/default/files...
        LOG.deploy: Created clusters.foo
        LOG.deploy: Files: 14 uploaded, 0 deleted
        LOG.deploy: Resources: 1 created, 0 changed, 0 deleted, 0 unchanged
    acceptance_test.go:1124: 
        LOG.destroy: 
        LOG.destroy: >>> /home/runner/work/cli/cli/acceptance/build/linux_amd64/1.25.0/databricks bundle destroy --auto-approve
        LOG.destroy: The following resources will be deleted:
        LOG.destroy:   delete resources.clusters.foo
        LOG.destroy: 
        LOG.destroy: All files and directories at the following location will be deleted: /Workspace/Users/tester@databricks.com/.bundle/test-bundle-4x4r7adi6faevgs32ddlqwpqly/default
        LOG.destroy: 
        LOG.destroy: Destroy: 1 deleted
    acceptance_test.go:1124: LOG.import:

53 more failure details omitted, see the full report in the run.

@eng-dev-ecosystem-bot

eng-dev-ecosystem-bot commented Nov 10, 2026 •

Copy link
Copy Markdown
Collaborator

✅ Integration test report

Commit: 2d33f67

Run: 42845376618

Env ✅​pass 🙈​skip Time
✅​ aws linux-2core-8gb 271 22 8:08
✅​ aws-windows-latest-4core-16gb 273 20 6:21
✅​ azure linux-2core-8gb 270 22 8:35
✅​ azure-windows-latest-4core-16gb 272 20 5:00
✅​ gcp linux-2core-8gb 271 22 8:50
✅​ gcp-windows-latest-4core-16gb 273 20 6:39
Top 4 slowest tests (at least 2 minutes):
duration env testname
3:16 gcp-windows-latest-4core-16gb TestAccept
3:03 aws-windows-latest-4core-16gb TestAccept
2:48 azure-windows-latest-4core-16gb TestAccept
2:44 gcp-windows-latest-4core-16gb TestTelemetryEndpoint

@github-actions github-actions Bot added the DABs DABs related issues label Nov 10, 2026
@denik denik added the test-only-fix PRs that update failing of flaky tests without changing CLI code. label Nov 11, 2026

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

DABs DABs related issues test-only-fix PRs that update failing of flaky tests without changing CLI code.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants