What is the problem the feature request solves?
Spark supports UDFs that operate on row-based data. I would like Comet to support UDFs that operate on batches of columnar data in Arrow format so that users can implement UDFs and keep execution in Comet.
There is a prototype of this in #4170 where it is being used to implement regexp expressions that are compatible with Spark. If this prototype is successful then we can expose the Comet UDF functionality to users with some more work.
Describe the potential solution
No response
Additional context
No response
What is the problem the feature request solves?
Spark supports UDFs that operate on row-based data. I would like Comet to support UDFs that operate on batches of columnar data in Arrow format so that users can implement UDFs and keep execution in Comet.
There is a prototype of this in #4170 where it is being used to implement regexp expressions that are compatible with Spark. If this prototype is successful then we can expose the Comet UDF functionality to users with some more work.
Describe the potential solution
No response
Additional context
No response