Add Spark 3.5 enhancements including dependency updates and script fixes

Add Spark 3.5 enhancements including dependency updates and script fixes #67937