[FEA] Create Spark 4.0.0 shim and build env

[tgravescs]

Is your feature request related to a problem? Please describe.
Spark 4.0 will be the next major release, create a shim and build env for it.

Note: Need to enable both Scala 2.12 and 2.13

Tasks

Preview Give feedback

1. Add support for the internal repo.
2. Add support for the external repo.

Compilation failures

Preview Give feedback

1. Supporting broadcast of multiple filtering keys in DynamicPruning #10669
   audit_4.0.0 bug +2
   
2. [AUDIT] Rename plan nodes for PythonMapInArrowExec #10673
   audit audit_4.0.0 bug +3
   
3. [AUDIT] uncacheTableOrView changed in CommandUtils #10710
   audit_4.0.0 bug +2
   
4. [AUDIT] Match DataSourceV2ScanExecBase changes to groupPartitions method #10711
   audit_4.0.0 bug +2
   
5. [AUDIT] BatchScanExec/DataSourceV2Relation to group splits by join keys if they differ from partition keys #10712
   audit_4.0.0 bug +2
   
6. [AUDIT][SPARK-42821][SQL] Remove unused parameters in splitFiles methods #10299
   audit audit_4.0.0 +2
   
7. Signature changed for PythonUDFRunner.writeUDFs #10714
   audit_4.0.0 bug +2
   
8. [AUDIT] ReaderIterator signature changed #10713
   audit_4.0.0 bug wontfix +3
   
9. [BUG] Update Plugin to use the new getPartitionedFile method #10606
   audit audit_4.0.0 bug good first issue +4
   
10. Added DateTimeUtilsShims [Databricks] #10828
    Spark 4.0+ +1
    
11. Fix Inheritance Shadowing to add support for Spark 4.0.0 [databricks] #10829
    Spark 4.0+ +1
    
12. Use ErrorClass to Throw AnalysisException [databricks] #10830
    Spark 4.0+ +1
    
13. Spark 4.0 compile errors #10972
    Spark 4.0+ bug +2
    
14. UnaryPositive expression doesn't extend UnaryExpression #11136
    bug +1