Skip to content

docs(workflows): add large data page with size limits and loop result guidance - #10245

Merged
waleedlatif1 merged 2 commits into
stagingfrom
docs/large-data
Nov 20, 2026
Merged

waleedlatif1 merged 2 commits into
stagingfrom
docs/large-data

Conversation

@waleedlatif1

Copy link
Copy Markdown
Collaborator

Summary

  • New Large data page under Workflows. It covers the size limits (64 MiB per block output, 16 MiB loaded into Function code at once, 64 MiB per file read, 10 MiB per sim.files call), which inputs can take a whole large value, why Loop and Parallel results grow with every block in every iteration, and patterns that keep them small.
  • One-line links to it from the Function, Loop and Parallel pages. The Function page now states the sim.files limits instead of "under memory caps".
  • Regenerated the docs manifest for the new page.

Type of Change

  • Documentation

Testing

  • Checked each limit and behavior against lib/execution/payloads/limits.ts, large-value-ref.ts, serializer.ts (compactSubflowResults), executor/variables/resolver.ts and materialization.server.ts.
  • check:docs-manifest passes; docs build and link checks run in CI.

Checklist

  • Code follows project style guidelines
  • Self-reviewed my changes
  • Tests added/updated and passing (new tests pass the test-audit authoring gate)
  • No new warnings introduced
  • I confirm that I have read and agree to the terms outlined in the Contributor License Agreement (CLA)

@vercel

vercel Bot commented Nov 20, 2026 •

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
docs Ready Ready Preview Nov 20, 2026 7:11pm UTC

Request Review

@cubic-dev-ai cubic-dev-ai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No issues found across 6 files

Confidence score: 5/5

  • Automated review surfaced no issues in the provided summaries.
  • No files require special attention.

Turn on auto-fix | Re-trigger cubic

@greptile-apps

greptile-apps Bot commented Nov 20, 2026 •

Copy link
Copy Markdown
Contributor

RetriggerView in GreptileConfidence Score: 5/5

[Low impact] The PR appears safe to merge.

Summary

Adds a Large data guide, links it from the Function, Loop, and Parallel pages, and registers it in the docs manifest.

  • Workflow docs explain how to pass large data within size limits.

Reviews (2) · Last reviewed commit: "docs(workflows): scope large data limits..." · Reviewed by Greptile

@waleedlatif1

Copy link
Copy Markdown
Collaborator Author

@greptile

@waleedlatif1

Copy link
Copy Markdown
Collaborator Author

@cubic-dev-ai review this PR

@cubic-dev-ai

cubic-dev-ai Bot commented Nov 20, 2026

Copy link
Copy Markdown
Contributor

@cubic-dev-ai review this PR

@waleedlatif1 I have started the AI code review. It will take a few minutes to complete.

@cubic-dev-ai cubic-dev-ai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No issues found across 6 files

Confidence score: 5/5

  • Automated review surfaced no issues in the provided summaries.
  • No files require special attention.

Turn on auto-fix | Re-trigger cubic

@waleedlatif1
waleedlatif1 merged commit d34c7cd into staging Nov 20, 2026
86 checks passed
@waleedlatif1
waleedlatif1 deleted the docs/large-data branch November 20, 2026 19:17

This branch was successfully deployed

1 active deployment
Preview — 849ee669 Deployed Nov 20, 2026 by vercel[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant