Skip to content

feat(datafusion): add catalog-level temporary table support#309

Open
JingsongLi wants to merge 7 commits intoapache:mainfrom
JingsongLi:tempTable
Open

feat(datafusion): add catalog-level temporary table support#309
JingsongLi wants to merge 7 commits intoapache:mainfrom
JingsongLi:tempTable

Conversation

@JingsongLi
Copy link
Copy Markdown
Contributor

@JingsongLi JingsongLi commented May 6, 2026

Purpose

  • Add register_temp_table/deregister_temp_table to PaimonCatalogProvider for session-scoped in-memory tables under {catalog}.__temp.{table_name}
  • Refactor merge_into, delete, and update modules to use &SQLContext directly instead of &SessionContext + catalog_name, getting catalog via ctx.current_catalog_name() internally
  • Introduce shared TempTableTracker in merge_into (pub(crate)) to replace per-module TempTableRegistry, delegates registration to SQLContext
  • Update all internal execution functions to call ctx.ctx() when invoking DataFusion's SessionContext methods to avoid recursive SQL routing
  • Add tests and documentation for temporary table usage

Brief change log

Tests

API and Format

Documentation

@JingsongLi JingsongLi changed the title feat(datafusion): add catalog-level temporary table support [WIP] feat(datafusion): add catalog-level temporary table support May 6, 2026
@JingsongLi JingsongLi changed the title [WIP] feat(datafusion): add catalog-level temporary table support feat(datafusion): add catalog-level temporary table support May 7, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant