Skip to content

[air] Say GPU pools are not required in air --help - #7581

Merged
stevenchen-db merged 3 commits into
mainfrom
schen/air-pools-not-required
Nov 13, 2026
Merged

stevenchen-db merged 3 commits into
mainfrom
schen/air-pools-not-required

Conversation

@stevenchen-db

@stevenchen-db stevenchen-db commented Nov 12, 2026 •

Copy link
Copy Markdown
Contributor

Changes

Follow-up to #7512: databricks air -h describes pools as optional.

 Provisioned capacity:
-  pools           View GPU pools provisioned for your workspace
+  pools           View provisioned GPU pools, if any (not required to run)

Why

Few workspaces have GPU pools, and the old line read as something every workspace has or needs before running.

Tests

  • Regenerated acceptance/air/help; all air acceptance tests and acceptance/help pass.
  • ./task checks and lint pass.

This pull request and its description were written by Isaac.

Also say in the `air --help` listing that GPU pools are not required.

Co-authored-by: Isaac <no-reply@databricks.com>
Co-authored-by: Isaac <no-reply@databricks.com>
@github-actions github-actions Bot added the AIR Databricks AI Runtime CLI label Nov 12, 2026
@github-actions

github-actions Bot commented Nov 12, 2026 •

Copy link
Copy Markdown
Contributor

Commit: 9c033ee4e | Workflow run

Regression test report

Selected 1 changed tests (limit=20, 0 not selected)

1 tests: regression=1 unreleased=0 coverage=0 failing=0
test branch main (db52460) latest (v1.26.0)
TestAccept/air/help ✅ ❌ ❌
TestAccept/air/help: branch ✅ | main (db52460) ❌ | latest (v1.26.0) ❌

main (db52460):

acceptance_test.go:1374: Diff:
        --- air/help/output.txt
        +++ /tmp/TestAcceptairhelp2690512956/002/output.txt
        @@ -25,7 +25,7 @@
           images          Push container images for custom environments
         
         Provisioned capacity:
        -  pools           View provisioned GPU pools, if any (not required to run)
        +  pools           View GPU pools provisioned for your workspace
         
         Flags:
           -h, --help   help for air
        
FAIL

latest (v1.26.0):

acceptance_test.go:1374: Diff:
        --- air/help/output.txt
        +++ /tmp/TestAcceptairhelp1468683390/002/output.txt
        @@ -2,31 +2,23 @@
         === help
         
         >>> [CLI] air --help
        -Run GPU workloads on Databricks serverless compute.
        +Run and manage AI Runtime training workloads on Databricks serverless GPU compute.
         
        -Describe a workload in a YAML file and submit it with "databricks air run".
        -Follow a run with "databricks air logs" and "databricks air get", or see your
        -active runs with "databricks air list".
        +These commands are under active development.
         
         Usage:
           databricks air [command]
         
        -Run workloads:
        -  run             Submit a workload from a YAML config
        -
        -Manage runs:
        +Available Commands:
           cancel          Cancel one or more runs
        -  get             Show a run's status, configuration, and timing
        -  list            List your active runs
        -  logs            Stream or fetch a run's logs
        +  convert-to-dabs Convert an AIR run YAML into a Databricks Asset Bundle
        +  get             Show status, configuration, and timing details for a specified run
        +  images          Manage container images for AI Runtime
        +  list            List active runs for the current user
        +  logs            Stream or fetch logs for a run
        +  pools           View provisioned GPU pools
        +  run             Submit a training workload from a YAML config
         
        -Package and deploy:
        -  convert-to-dabs Convert a workload YAML into a Databricks Asset Bundle
        -  images          Push container images for custom environments
        -
        -Provisioned capacity:
        -  pools           View provisioned GPU pools, if any (not required to run)
        -
         Flags:
           -h, --help   help for air
         
        @@ -38,12 +23,6 @@
         
         Use "databricks air [command] --help" for more information about a command.
         
        -Learn more:
        -  YAML fields and example  databricks air run -h config
        -  Quickstart (AWS)         https://docs.databricks.com/aws/en/machine-learning/ai-runtime/quickstart
        -  Quickstart (Azure)       https://learn.microsoft.com/azure/databricks/machine-learning/ai-runtime/quickstart
        -  Coding agent skill       databricks aitools install --skills-only --skills databricks-ai-runtime
        -
         === list help
         
         >>> [CLI] air list --help
        @@ -84,9 +63,9 @@
         === get help
         
         >>> [CLI] air get --help
        -Show a run's status, configuration, and timing.
        +Show status, configuration, and timing details for a specified run.
         
        -JOB_RUN_ID is the job run ID returned by "databricks air run".
        +JOB_RUN_ID is the job run ID returned by "air run".
         
         Usage:
           databricks air get JOB_RUN_ID [flags]
        @@ -103,18 +81,14 @@
         === pools help
         
         >>> [CLI] air pools --help
        -View GPU pools provisioned for your workspace.
        +View provisioned GPU pools
         
        -A GPU pool is dedicated accelerator capacity that your Databricks account team
        -provisions. Pools are optional: a run uses one only when its YAML sets
        -compute.pool_id.
        -
         Usage:
           databricks air pools [flags]
           databricks air pools [command]
         
         Available Commands:
        -  get         Show a GPU pool and its accelerator usage
        +  get         Show a GPU pool, including its accelerator usage (POOL_ID may be omitted when the workspace has exactly one pool)
           list        List the GPU pools available to the current workspace
         
         Flags:
        @@ -131,7 +99,7 @@
         === images help
         
         >>> [CLI] air images --help
        -Push container images for custom environments
        +Manage container images for AI Runtime
         
         Usage:
           databricks air images [flags]
        @@ -155,7 +123,7 @@
         
         >>> [CLI] air images push --help
         This CLI command is in Preview. For current feature status and requirements, see:
        -  AWS: https://docs.databricks.com/aws/en/machine-learning/ai-runtime/connecting/cli/docker-images
        +  AWS: https://docs.databricks.com/aws/en/machine-learning/ai-runtime/cli/docker-images
           Azure: https://learn.microsoft.com/azure/databricks/machine-learning/ai-runtime/connecting/cli/docker-images
         
         Push a container image to Databricks Artifact Registry under the specified Unity Catalog catalog and schema.
        @@ -191,7 +159,7 @@
         Stream logs from an active run until it completes, or fetch logs from a
         completed run.
         
        -JOB_RUN_ID is the job run ID returned by "databricks air run".
        +JOB_RUN_ID is the job run ID returned by "air run".
         
         Usage:
           databricks air logs JOB_RUN_ID [flags]
        
FAIL

`air run -h config` already documents the YAML fields, so the run help
doesn't need separate docs or skill links.

Co-authored-by: Isaac <no-reply@databricks.com>
@stevenchen-db stevenchen-db changed the title [air] Link the YAML reference and agent skill from air run --help [air] Say GPU pools are not required in air --help Nov 12, 2026
@eng-dev-ecosystem-bot

Copy link
Copy Markdown
Collaborator

✅ Integration test report

Commit: 9c033ee

Run: 43323877619

Env 🔄​flaky ✅​pass 🙈​skip Time
🔄​ aws linux-2core-8gb 1 270 16 15:30
🔄​ aws-windows-latest-4core-16gb 1 272 14 11:48
🔄​ azure linux-2core-8gb 2 268 16 15:36
🔄​ azure-windows-latest-4core-16gb 1 271 14 10:17
✅​ gcp linux-2core-8gb 271 16 14:47
🔄​ gcp-windows-latest-4core-16gb 2 271 14 12:18
Test Name aws linux-2core-8gb aws-windows-latest-4core-16gb azure linux-2core-8gb azure-windows-latest-4core-16gb gcp-windows-latest-4core-16gb
🔄​ TestSyncFullFileSync 🔄​f ✅​p 🔄​f ✅​p 🔄​f
🔄​ TestSyncIncrementalFileSync ✅​p 🔄​f ✅​p 🔄​f ✅​p
🔄​ TestSyncIncrementalSyncFileToPythonNotebook ✅​p ✅​p 🔄​f ✅​p 🔄​f
Top 34 slowest tests (at least 2 minutes):
duration env testname
4:15 aws-windows-latest-4core-16gb TestImportDirDoesNotOverwrite
4:00 azure linux-2core-8gb TestAccept
3:52 gcp linux-2core-8gb TestAccept
3:49 aws linux-2core-8gb TestAccept
3:49 aws-windows-latest-4core-16gb TestAccept
3:47 gcp-windows-latest-4core-16gb TestAccept
3:33 azure linux-2core-8gb TestFilerWorkspaceFilesExtensionsStat
3:29 azure-windows-latest-4core-16gb TestImportDirWithOverwriteFlag
3:23 aws linux-2core-8gb TestFilerWorkspaceNotebook/scalaJupyterNb.ipynb
3:22 aws-windows-latest-4core-16gb TestFilerReadWrite/workspace_files
3:09 azure-windows-latest-4core-16gb TestFilerRecursiveDelete/workspace_files_extensions
3:08 azure-windows-latest-4core-16gb TestAccept
3:08 gcp linux-2core-8gb TestFilerWorkspaceFilesExtensionsStat
3:03 gcp-windows-latest-4core-16gb TestFilerWorkspaceFilesExtensionsReadDir
2:59 gcp-windows-latest-4core-16gb TestImportDirDoesNotOverwrite
2:51 gcp linux-2core-8gb TestSyncFullFileSync
2:29 aws-windows-latest-4core-16gb TestFilerWorkspaceNotebook/sqlNb.sql
2:27 azure linux-2core-8gb TestFilerRecursiveDelete/workspace_files
2:24 azure-windows-latest-4core-16gb TestFilerWorkspaceFilesExtensionsReadDir
2:22 gcp linux-2core-8gb TestFilerWorkspaceFilesExtensionsReadDir
2:20 gcp-windows-latest-4core-16gb TestSyncIncrementalFileSync
2:19 gcp-windows-latest-4core-16gb TestExportDir
2:19 gcp-windows-latest-4core-16gb TestFilerWorkspaceFilesExtensionsDelete
2:18 gcp linux-2core-8gb TestFilerRecursiveDelete/workspace_files_extensions
2:18 gcp-windows-latest-4core-16gb TestImportDirWithOverwriteFlag
2:17 gcp-windows-latest-4core-16gb TestFilerWorkspaceFilesExtensionsRead
2:15 aws-windows-latest-4core-16gb TestFilerWorkspaceFilesExtensionsRead
2:13 gcp-windows-latest-4core-16gb TestFilerRecursiveDelete/workspace_files_extensions
2:10 azure-windows-latest-4core-16gb TestFilerWorkspaceFilesExtensionsStat
2:09 gcp linux-2core-8gb TestFilerWorkspaceFilesExtensionsRead
2:07 aws linux-2core-8gb TestFilerRecursiveDelete/workspace_files
2:05 aws linux-2core-8gb TestFilerRecursiveDelete/workspace_files_extensions
2:05 aws linux-2core-8gb TestExportDirDoesNotOverwrite
2:03 aws linux-2core-8gb TestFilerWorkspaceFilesExtensionsReadDir

@stevenchen-db
stevenchen-db added this pull request to the merge queue Nov 13, 2026
Merged via the queue into main with commit 573c36e Nov 13, 2026
28 checks passed
@stevenchen-db
stevenchen-db deleted the schen/air-pools-not-required branch November 13, 2026 19:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

AIR Databricks AI Runtime CLI

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants