Skip to content

fix(isthmus): assertFullRoundTrip for any_value#783

Merged
bestbeforetoday merged 3 commits intosubstrait-io:mainfrom
ZorinAnton:zor-781
Mar 27, 2026
Merged

fix(isthmus): assertFullRoundTrip for any_value#783
bestbeforetoday merged 3 commits intosubstrait-io:mainfrom
ZorinAnton:zor-781

Conversation

@ZorinAnton
Copy link
Contributor

fixes #781

The existing AutomaticDynamicFunctionMappingConverterProvider could not handle Substrait functions with parameterized return types (e.g., any1?). Functions like any_value, lag, and first_value failed because the return type inference couldn't resolve parameterized types to concrete Calcite types.

This PR fixes automatic mapping of standard substrait aggregate functions to SqlOperator's and implements a type inference system with separate logic for scalar, aggregate, and window functions, each with appropriate fallback behavior and nullability handling.

Use Calcite's SqlBasicAggFunction instead of defining a custom subclass
of SqlFunction to represent aggregate functions.

Some refactor of toSqlFunction into smaller collaborating functions to
make the logical flow and intent clearer.

Signed-off-by: Mark S. Lewis <Mark.S.Lewis@outlook.com>
Copy link
Member

@bestbeforetoday bestbeforetoday left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I really like the way you have broken out the return type inference into distinct classes with the logic implemented in small focused methods. The testing is also nice and clear.

One suggestion is to use Calcite's SqlBasicAggFunction instead of defining a custom subclass of SqlAggFunction (with no behavioural changes) to represent aggregate functions. I have raised a pull request against your PR branch with my suggested change.

refactor: use SqlBasicAggFunction in toSqlFunction
Copy link
Member

@bestbeforetoday bestbeforetoday left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great contribution. Thank you!

@bestbeforetoday bestbeforetoday merged commit 73c3ac3 into substrait-io:main Mar 27, 2026
11 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

ANY_VALUE (dynamic substrait function) cannot be converted from calcite to substrait

2 participants