Run Spark tests with Comet native runner #3209
Description
What is the problem the feature request solves?
Comet native writer works for basic ops, however to move forward and keep compatibility with Spark we need to run Spark writer and partition discovery tests with Comet writer enabled first to make sure we have a solid reliable base for Comet native writer changes
Describe the potential solution
No response
Additional context
No response