Skip to content

[core] Clean up data file extra files - #9586

Merged
JingsongLi merged 1 commit into
apache:masterfrom
zjw1111:codex/clean-data-file-extra-files
Sep 4, 2026
Merged

[core] Clean up data file extra files#9586
JingsongLi merged 1 commit into
apache:masterfrom
zjw1111:codex/clean-data-file-extra-files

Conversation

@zjw1111

@zjw1111 zjw1111 commented Sep 3, 2026

Copy link
Copy Markdown
Contributor

Purpose

Clean up data file extra files together with their main files in append-only writer temporary cleanup and commit abort paths.

  • Clean compaction and rewrite outputs through DataFileMeta.collectFiles.
  • Clean aborted new and compacted data files, including external-path sidecar files.
  • Add regression coverage for both cleanup paths.

Tests

  • mvn -pl paimon-core -Pfast-build -DwildcardSuites=none -Dtest=AppendOnlyWriterTest,FileStoreCommitTest test (88 tests passed)
  • mvn -pl paimon-core -DskipTests compile

@zjw1111
zjw1111 force-pushed the codex/clean-data-file-extra-files branch from e70b581 to 29ce959 Compare September 4, 2026 02:49
@JingsongLi

Copy link
Copy Markdown
Contributor

+1

@JingsongLi
JingsongLi merged commit c10da57 into apache:master Sep 4, 2026
13 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants