[NSE-876] Fix writing arrow hang with OutputWriter.path

[jackylee-ch]

What changes were proposed in this pull request?

Fix writing arrow hang with OutputWriter.path.

"Executor task launch worker for task 0.0 in stage 2.0 (TID 2)" #182 daemon prio=5 os_prio=0 tid=0x00007fe734024000 nid=0x573c runnable [0x00007fe50cfe3000]
   java.lang.Thread.State: RUNNABLE
	at com.intel.oap.spark.sql.execution.datasources.arrow.ArrowFileFormat$$anon$1$$anon$2.path(ArrowFileFormat.scala:102)
	at org.apache.spark.sql.execution.datasources.SingleDirectoryDataWriter.$anonfun$write$2(FileFormatDataWriter.scala:176)
	at org.apache.spark.sql.execution.datasources.SingleDirectoryDataWriter.$anonfun$write$2$adapted(FileFormatDataWriter.scala:176)

How was this patch tested?

unit tests

[github-actions]

#876

[zhouyuan]

@zhztheplayer

[zhztheplayer]

Thanks @jackylee-ch !