DRILL-8542: Support Paimon Format Plugin

[letian-jiang]

DRILL-8542: Support Paimon format plugin

Description

Introduce a Paimon format plugin, enabling Drill users to query Paimon tables directly via filesystem paths.

• support reading data from Paimon tables in Parquet and ORC formats
• support projection/filter/limit pushdown
• support snapshot read via table() with snapshotId or snapshotAsOfTime
• support metadata tables: #snapshots, #schemas, #files, #manifests

Usage examples:

• SELECT * FROM dfs./path/to/paimon_table
• SELECT * FROM table(dfs./path/to/paimon_table, snapshotId => 123)
• SELECT * FROM table(dfs./path/to/paimon_table, snapshotAsOfTime => 1700000000000)
• SELECT * FROM dfs./path/to/paimon_table#snapshots

Reference:

• https://paimon.apache.org/docs

[cgivre]

@letian-jiang
Thank you very much for this submission. I did a quick first pass and overall it looks good.

General comments:

1. You're overriding a lot of methods that I don't think actually need to be overridden. If the methods are not doing anything, I would suggest removing them.
2. Again, thank you for providing robust unit tests. However, I made some refactoring suggestions for this class.
3. Please avoid the x ? y : z notation for complex logic.
4. For non-obvious functions, please add some documentation. We don't need docstrings for getters/setters and other obvious code, but most people working on Drill are likely unfamiliar with Paimon, so any help you could give in the code is greatly appreciated.

[cgivre]

Nit: Please add blank line at the end of classes. Here and elsewhere.

[cgivre]

I was referring to the end of each file. After the last closing brace, there should be a newline.

[letian-jiang]

I believe I have addressed all the review comments. Could you please take another look? @cgivre

[cgivre]

Please add new line at the end of all classes. Here and elsewhere..

[letian-jiang]

Do you mean adding a new line for (inner) classes? This is precisely what is desired.

[letian-jiang]

Please check this again. @cgivre

[cgivre]

@letian-jiang This looks good. Thanks for the contribution!
Could you please verify that there is a new line at the end of each file? Once that is done and CI passes, I'll merge this!

Lastly, could you also add documentation to the Drill documentation site? (https://github.com/apache/drill-site).

I don't know if you have any connection the Paimon team, but if so, a link to Drill would also be greatly appreciated.

LGTM +1

[letian-jiang]

@letian-jiang This looks good. Thanks for the contribution! Could you please verify that there is a new line at the end of each file? Once that is done and CI passes, I'll merge this!

Lastly, could you also add documentation to the Drill documentation site? (https://github.com/apache/drill-site).

I don't know if you have any connection the Paimon team, but if so, a link to Drill would also be greatly appreciated.

LGTM +1

I have already verified it. Let me see how to add the document.