This directory contains an idiomatic C++ client library for the Cloud Dataproc API, a managed Apache Spark and Apache Hadoop service that lets you take advantage of open source data tools for batch processing, querying, streaming, and machine learning. This library allows you to manage Cloud Dataproc resources, but it does not provide APIs to run C++ applications in Cloud Dataproc.
While this library is GA, please note that the Google Cloud C++ client libraries do not follow Semantic Versioning.
- Windows, macOS, Linux
- C++14 (and higher) compilers (we test with GCC >= 7.3, Clang >= 6.0, and MSVC >= 2017)
- Environments with or without exceptions
- Bazel (>= 4.0) and CMake (>= 3.5) builds
- Official documentation about the Cloud Dataproc API service
- Reference doxygen documentation for each release of this client library
- Detailed header comments in our public
.h
files
The quickstart/ directory contains a minimal environment to get started using this client library in a larger project. The following "Hello World" program is used in this quickstart, and should give you a taste of this library.
#include "google/cloud/dataproc/cluster_controller_client.h"
#include "google/cloud/common_options.h"
#include <iostream>
int main(int argc, char* argv[]) try {
if (argc != 3) {
std::cerr << "Usage: " << argv[0] << " project-id region\n";
return 1;
}
std::string const project_id = argv[1];
std::string const region = argv[2];
namespace dataproc = ::google::cloud::dataproc;
auto client = dataproc::ClusterControllerClient(
dataproc::MakeClusterControllerConnection(region == "global" ? ""
: region));
for (auto c : client.ListClusters(project_id, region)) {
if (!c) throw std::move(c).status();
std::cout << c->cluster_name() << "\n";
}
return 0;
} catch (google::cloud::Status const& status) {
std::cerr << "google::cloud::Status thrown: " << status << "\n";
return 1;
}
- Packaging maintainers or developers who prefer to install the library in a
fixed directory (such as
/usr/local
or/opt
) should consult the packaging guide. - Developers that prefer using a package manager such as vcpkg, Conda, or Conan should follow the instructions for their package manager.
- Developers wanting to use the libraries as part of a larger CMake or Bazel project should consult the quickstart guides for the library or libraries they want to use.
- Developers wanting to compile the library just to run some examples or tests should read the current document.
- Contributors and developers to
google-cloud-cpp
should consult the guide to set up a development workstation.
See CONTRIBUTING.md
for details on how to
contribute to this project, including how to build and test your changes
as well as how to properly format your code.
Apache 2.0; see LICENSE
for details.