Hi all,

I've completed a systematic triage of Spark 4.x related test issues. Here's a summary of the new issues created and how to get involved.

1. Simple suite fixes in #11550 — self-assign welcome

Several disabled suites in #11550 only require simple exclude + testGluten rewrites with no core-layer changes. These are marked with an empty Owner or "RC" in the table. If you have permission, feel free to assign yourself directly. Otherwise, leave a comment on the issue and I'll update the owner for you.

These include: GlutenExplainSuite, GlutenPlannerSuite, GlutenProjectedOrderingAndPartitioningSuite, GlutenRemoveRedundantProjectsSuite, GlutenRemoveRedundantSortsSuite, etc.

2. Bug sub-issues under #11550

These require deeper fixes at the Gluten core or C++ layer:

3. Feature sub-issues under #11910 (Spark 4.x new feature tracking)

These are new Spark 4.x features that Gluten/Velox does not yet support natively:

Additionally, existing issues #11371 (Variant) and #10134 (ANSI mode) have been linked under #11910 as well.

Note on Variant and ANSI

I've taken #11371 (Variant) and #10134 (ANSI mode) mainly to coordinate the overall effort, not to work on them exclusively. As we dig deeper, more sub-issues may be created. Contributions are very welcome.

Feel free to pick up any issue that interests you. Questions and discussions are welcome in the respective issue threads.

Thanks,
Chang Chen