Release DataFusion-Python 53.0.0

[nuno-faria]

Is your feature request related to a problem or challenge? Please describe what you are trying to do.

Publish the next version of datafusion-python now that datafusion-53 is out.

I noticed that the CI is failing (OOM?), so that has to be fixed first.

@timsaucer are there any TODOs that need to be done before the next version can be published?

PRs to merge

• ci: add swap during build, use tpchgen-cli #1443

Issues to close

• Add missing SessionContext utility methods #1459
• Add missing SessionContext read/write and registration methods #1458
• Add missing SessionContext deregister methods #1457
• Add missing DataFrame methods (window, unnest_columns_with_options, drop_columns) #1456
• Add missing DataFrame methods (set operations and query) #1455
• Add missing aggregate functions (grouping, percentile_cont, var_population) #1454
• Add missing scalar functions (union, arrow metadata, get_field, version, row) #1453
• Add missing array/list functions and aliases #1452
• Add missing date/time functions (current_timestamp, date_format, make_time) #1451
• Add missing string functions (contains, instr, position, substring_index) #1450
• Add missing conditional functions (greatest, least, nvl2, ifnull) #1449
• Add map functions (map, map_keys, map_values, map_extract, map_entries, element_at) #1448

[kevinjqliu]

#1443 for fixing CI

[timsaucer]

Ok, question for both of you: I ran this skill and found a bunch of valid areas where we have APIs upstream that were never exposed in Python. Now have a handful of PRs to resolve all of them. They're all originally AI generated but I've been personally reviewing each one (and making changes) before marking it ready for review.

Question is: should we wait to get all these in and then start the DF53 release or start the release now and get those all in for 54?

[nuno-faria]

Question is: should we wait to get all these in and then start the DF53 release or start the release now and get those all in for 54?

I think we can try to merge them first. With that said, could there also be a 53.1.0 feature release to handle those new APIs, or does the versioning need to be in sync with DataFusion?