Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: dataproc quickstart and createcluster #1908

Merged
merged 29 commits into from
Dec 30, 2019
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
29 commits
Select commit Hold shift + click to select a range
8b74842
Added dataproc quickstart samples
bradmiro Dec 2, 2019
0c132cd
Fixed linting, string formatting, copyrights
bradmiro Dec 2, 2019
c242a0c
added overloaded functions to all samples
bradmiro Dec 2, 2019
aa03238
Formatting changes
bradmiro Dec 2, 2019
e2b74e5
small bug fixes
bradmiro Dec 2, 2019
f4bb1cc
Merge branch 'master' into dataproc-samples
bradmiro Dec 2, 2019
84810dc
Merge branch 'master' into dataproc-samples
bradmiro Dec 3, 2019
ee02b72
Fixed CreateCluster sample and added Quickstart
bradmiro Dec 20, 2019
400617c
Added quickstart sample
bradmiro Dec 20, 2019
d0efbbc
Added dataproc quickstart samples
bradmiro Dec 2, 2019
2970060
Fixed linting, string formatting, copyrights
bradmiro Dec 2, 2019
ebe059d
added overloaded functions to all samples
bradmiro Dec 2, 2019
6b20c68
Formatting changes
bradmiro Dec 2, 2019
9990637
small bug fixes
bradmiro Dec 2, 2019
5a9a3a3
Fixed CreateCluster sample and added Quickstart
bradmiro Dec 20, 2019
b9eaf25
Added quickstart sample
bradmiro Dec 20, 2019
ea1965f
Updates to createCluster and quickstart
bradmiro Dec 26, 2019
539746f
Fixed quickstart and tests
bradmiro Dec 26, 2019
e7b91c2
Fixed quickstart and tests
bradmiro Dec 26, 2019
cdc616e
Changes to tests
bradmiro Dec 27, 2019
df9d3b9
Merge branch 'master' into dataproc-samples
bradmiro Dec 27, 2019
561ca34
Added periods to comments
bradmiro Dec 27, 2019
e6e9e83
Merge branch 'dataproc-samples' of https://github.com/GoogleCloudPlat…
bradmiro Dec 27, 2019
60822ba
Merge branch 'master' into dataproc-samples
bradmiro Dec 30, 2019
1ad40b6
Fixed pom and added handling for ExecutionException
bradmiro Dec 30, 2019
7f61371
Merge branch 'master' into dataproc-samples
bradmiro Dec 30, 2019
64dbb5e
Fixed lint errors
bradmiro Dec 30, 2019
aebba92
Merge branch 'dataproc-samples' of https://github.com/GoogleCloudPlat…
bradmiro Dec 30, 2019
db2c76f
Fixed linting errors
bradmiro Dec 30, 2019
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
small bug fixes
  • Loading branch information
bradmiro committed Dec 2, 2019
commit e2b74e551af7c5bc2549425a063188ee84ed3ade
2 changes: 1 addition & 1 deletion dataproc/src/main/java/ListClusters.java
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@ public static void listClusters() throws IOException, InterruptedException, Exec
}

public static void listClusters(String projectId, String region) throws IOException {
String myEndpoint = String.format("-dataproc.googleapis.com:443");
String myEndpoint = String.format("%s-dataproc.googleapis.com:443", region);

// Configure the settings for the cluster controller client
ClusterControllerSettings clusterControllerSettings =
Expand Down
3 changes: 2 additions & 1 deletion dataproc/src/test/java/DeleteClusterTest.java
Original file line number Diff line number Diff line change
Expand Up @@ -39,7 +39,8 @@
@RunWith(JUnit4.class)
public class DeleteClusterTest {

private static final String CLUSTER_NAME = "test-cluster-" + UUID.randomUUID().toString();
private static final String CLUSTER_NAME =
String.format("test-cluster-%s", UUID.randomUUID().toString());
private static final String REGION = "us-central1";
private static final String PROJECT_ID = System.getenv("GOOGLE_CLOUD_PROJECT");

Expand Down
5 changes: 3 additions & 2 deletions dataproc/src/test/java/UpdateClusterTest.java
Original file line number Diff line number Diff line change
Expand Up @@ -43,8 +43,9 @@ public class UpdateClusterTest {

private static final String REGION = "us-central1";
private static final String PROJECT_ID = System.getenv("GOOGLE_CLOUD_PROJECT");
private static final String ENDPOINT = REGION + "-dataproc.googleapis.com:443";
private static final String CLUSTER_NAME = "test-cluster-" + UUID.randomUUID().toString();
private static final String ENDPOINT = String.format("%s-dataproc.googleapis.com:443", REGION);
private static final String CLUSTER_NAME =
String.format("test-cluster-%s", UUID.randomUUID().toString());
private static final int NUM_WORKERS = 2;
private static final int NEW_WORKERS = NUM_WORKERS * 2;

Expand Down