Support HDFS and S3 path as warehouse directory for Hive file catalog

[hantangwangd]

Description

Hive file metastore is a file-based metastore used for testing or development purpose whose document is introduced in PR #24511. This PR enable File-based hive metastore to use HDFS/S3 locations as warehouse dir, as described in issue #19112.

An example configuration to use HDFS path includes:

    connector.name=iceberg
    iceberg.catalog.type=HIVE
    hive.metastore=file
    hive.metastore.catalog.dir=hdfs://hostaddr:9000/warehouse

Besides, by configuring the s3 properties described in https://prestodb.io/docs/current/connector/hive.html#amazon-s3-configuration, we can specify a S3 location as the warehouse dir of Hive file catalog. This way, both metadata and data
of iceberg tables will be maintained on S3 storage.

An example configuration to use S3 path includes:

    connector.name=iceberg
    iceberg.catalog.type=HIVE
    hive.metastore=file
    hive.metastore.catalog.dir=s3://iceberg_bucket/warehouse

    hive.s3.use-instance-credentials=false
    hive.s3.aws-access-key=accesskey
    hive.s3.aws-secret-key=secretkey
    hive.s3.endpoint=http://192.168.0.103:9878
    hive.s3.path-style-access=true

Motivation and Context

Support specifying a HDFS/S3 location directly as warehouse dir for file-based hive metastore

Impact

Lake houses configured with hive file metastore can now specify a HDFS/S3 location directly as the warehouse dir

Test Plan

• Manually test IcebergDistributedTestBase, IcebergDistributedSmokeTestBase and TestIcebergDistributedQueries on Iceberg connector configured with Hive file catalog on local deployed MINIO object storage
• Manually test IcebergDistributedTestBase, IcebergDistributedSmokeTestBase and TestIcebergDistributedQueries on Iceberg connector configured with Hive file catalog on local deployed HDFS

Contributor checklist

• Please make sure your submission complies with our contributing guide, in particular code style and commit standards.
• PR description addresses the issue accurately and concisely. If the change is non-trivial, a GitHub Issue is referenced.
• Documented new properties (with its default value), SQL syntax, functions, or other functionality.
• If release notes are required, they follow the release notes guidelines.
• Adequate tests were added if applicable.
• CI passed.

Release Notes

== RELEASE NOTES ==

General Changes
* Enable file-based hive metastore to use HDFS/S3 location as warehouse dir.

[steveburnett]

Thanks for the doc update! Nits for readability suggested.

[hantangwangd]

Thank you @steveburnett for the suggestion, fixed! Please take a look when available.

[steveburnett]

LGTM! (docs)

Pull updated branch, new local doc build, looks good. Thanks!

[yingsu00]

nit: Ideally this should be after all public methods, but it was not fully complying before either. We can leave it as is now but it will be nice to move it.

[hantangwangd]

Sure, it has been moved to the bottom.

[yingsu00]

Can it be private? It's only used above

[hantangwangd]

Thanks for pointing out this, fixed! And I have moved this method to the bottom as well since it has been modified to private. Please take a look when convenient.