Skip to content

Add paramsets and include/exclude filters to run_benchmark - #74

Merged
rcannood merged 5 commits into
mainfrom
feature/run_benchmark_paramsets
Sep 29, 2026
Merged

rcannood merged 5 commits into
mainfrom
feature/run_benchmark_paramsets

Conversation

@rcannood

Copy link
Copy Markdown
Member

Describe your changes

Ports the recent run_benchmark improvements from task_template.

Heads-up: cellmapper_linear (6 variants) and cellmapper_scvi (5 variants) now run once per variant by default, so the full benchmark gets more expensive for those two.

Tested locally on bmmc_cite/normal with --methods_include 'mean_per_gene;cellmapper_linear.cellmapper-pca;cellmapper_linear.cellmapper-cca' --metrics_include correlation: all 13 processes succeeded and the scores are tagged with the right paramsets.

Checklist before requesting a review

  • I have performed a self-review of my code

  • Check the correct box. Does this PR contain:

    • Breaking changes
    • New functionality
    • Major changes
    • Minor changes
    • Bug fixes
  • Proposed changes are described in the CHANGELOG.md

  • CI Tests succeed and look good!

@rcannood
rcannood merged commit 8972ac7 into main Sep 29, 2026
2 checks passed
@rcannood
rcannood deleted the feature/run_benchmark_paramsets branch September 29, 2026 08:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant