Add additional components for dataproc 1.5

[gengmao]

Community Note

• Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
• Please do not leave "+1" or "me too" comments, they generate extra noise for issue followers and do not help prioritize the request
• If you are interested in working on this issue or have submitted a pull request, please leave a comment. If the issue is assigned to the "modular-magician" user, it is either in the process of being autogenerated, or is planned to be autogenerated soon. If the issue is assigned to a user, that user is claiming responsibility for the issue. If the issue is assigned to "hashibot", a community member has claimed the issue already.

Description

Recently Google announced new additional components in Dataproc 1.5. As per [2], Flink, Docker, HBase are added in 1.5. However there is a validation list [3] for the optional_components property of google_dataproc_cluster, which doesn't include new components yet. Hence we hit error message like this.

Error: expected cluster_config.0.software_config.0.optional_components.1 to be one of [COMPONENT_UNSPECIFIED ANACONDA DRUID HBASE HIVE_WEBHCAT JUPYTER KERBEROS PRESTO RANGER SOLR ZEPPELIN ZOOKEEPER], got FLINK

Can these new components be added into the validation list soon? Or is there a way to bypass such validation list?

New or Affected Resource(s)

• google_dataproc_cluster

Potential Terraform Configuration

resource "google_dataproc_cluster" "cluster" {
  cluster_config {
     software_config {
         optional_components = ["FLINK", "DOCKER","HBASE"]
      }
    }
  }
}

References

• https://cloud.google.com/blog/products/data-analytics/spark-and-hadoop-clusters-in-the-cloud [1]
• https://cloud.google.com/dataproc/docs/concepts/components/overview [2]
• https://github.com/hashicorp/terraform-provider-google/blob/master/google/resource_dataproc_cluster.go#L485 [3]

[ghost]

I'm going to lock this issue because it has been closed for 30 days ⏳. This helps our maintainers find and focus on the active issues.

If you feel this issue should be reopened, we encourage creating a new issue linking back to this one for added context. If you feel I made an error 🤖 🙉 , please reach out to my human friends 👉 hashibot-feedback@hashicorp.com. Thanks!