DataFusion's casting semantics incompatibilities are causing runtime errors #6357
Replies: 2 comments
-
|
@AdamGS do we get to yay/nay the projection push-down in the same way as filter push-down? If so then we probably need some way of saying whether a particular cast is supported. If not... I'm not sure how we can guarantee forever more that we support a super-set of DataFusion casts. |
Beta Was this translation helpful? Give feedback.
-
|
That's basically the discussion I had with @robert3005. I think formalizing our casting semantics and exposing the expectations programmatically would be very useful, and the splitting logic would be able to take advantage of that (it already does for decimals, but there are many more cases obviously). |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
-
Due to DataFusion's improved projection pushdown, we now push some cast expressions into our scans, in ways that are incompatible with Vortex's cast semantics.
Examples
Beta Was this translation helpful? Give feedback.
All reactions