Skip to content

Commit

Permalink
feat(client-glue): Add schedule support for AWS Glue column statistics
Browse files Browse the repository at this point in the history
  • Loading branch information
awstools committed Oct 31, 2024
1 parent 0260ae8 commit 8a12fe4
Show file tree
Hide file tree
Showing 27 changed files with 2,897 additions and 825 deletions.
50 changes: 49 additions & 1 deletion clients/client-glue/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@ AWS SDK for JavaScript Glue Client for Node.js, Browser and React Native.

## Installing

To install the this package, simply type add or install @aws-sdk/client-glue
To install this package, simply type add or install @aws-sdk/client-glue
using your favorite package manager:

- `npm install @aws-sdk/client-glue`
Expand Down Expand Up @@ -404,6 +404,14 @@ CreateClassifier

[Command API Reference](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/client/glue/command/CreateClassifierCommand/) / [Input](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-glue/Interface/CreateClassifierCommandInput/) / [Output](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-glue/Interface/CreateClassifierCommandOutput/)

</details>
<details>
<summary>
CreateColumnStatisticsTaskSettings
</summary>

[Command API Reference](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/client/glue/command/CreateColumnStatisticsTaskSettingsCommand/) / [Input](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-glue/Interface/CreateColumnStatisticsTaskSettingsCommandInput/) / [Output](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-glue/Interface/CreateColumnStatisticsTaskSettingsCommandOutput/)

</details>
<details>
<summary>
Expand Down Expand Up @@ -604,6 +612,14 @@ DeleteColumnStatisticsForTable

[Command API Reference](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/client/glue/command/DeleteColumnStatisticsForTableCommand/) / [Input](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-glue/Interface/DeleteColumnStatisticsForTableCommandInput/) / [Output](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-glue/Interface/DeleteColumnStatisticsForTableCommandOutput/)

</details>
<details>
<summary>
DeleteColumnStatisticsTaskSettings
</summary>

[Command API Reference](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/client/glue/command/DeleteColumnStatisticsTaskSettingsCommand/) / [Input](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-glue/Interface/DeleteColumnStatisticsTaskSettingsCommandInput/) / [Output](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-glue/Interface/DeleteColumnStatisticsTaskSettingsCommandOutput/)

</details>
<details>
<summary>
Expand Down Expand Up @@ -868,6 +884,14 @@ GetColumnStatisticsTaskRuns

[Command API Reference](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/client/glue/command/GetColumnStatisticsTaskRunsCommand/) / [Input](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-glue/Interface/GetColumnStatisticsTaskRunsCommandInput/) / [Output](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-glue/Interface/GetColumnStatisticsTaskRunsCommandOutput/)

</details>
<details>
<summary>
GetColumnStatisticsTaskSettings
</summary>

[Command API Reference](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/client/glue/command/GetColumnStatisticsTaskSettingsCommand/) / [Input](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-glue/Interface/GetColumnStatisticsTaskSettingsCommandInput/) / [Output](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-glue/Interface/GetColumnStatisticsTaskSettingsCommandOutput/)

</details>
<details>
<summary>
Expand Down Expand Up @@ -1660,6 +1684,14 @@ StartColumnStatisticsTaskRun

[Command API Reference](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/client/glue/command/StartColumnStatisticsTaskRunCommand/) / [Input](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-glue/Interface/StartColumnStatisticsTaskRunCommandInput/) / [Output](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-glue/Interface/StartColumnStatisticsTaskRunCommandOutput/)

</details>
<details>
<summary>
StartColumnStatisticsTaskRunSchedule
</summary>

[Command API Reference](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/client/glue/command/StartColumnStatisticsTaskRunScheduleCommand/) / [Input](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-glue/Interface/StartColumnStatisticsTaskRunScheduleCommandInput/) / [Output](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-glue/Interface/StartColumnStatisticsTaskRunScheduleCommandOutput/)

</details>
<details>
<summary>
Expand Down Expand Up @@ -1756,6 +1788,14 @@ StopColumnStatisticsTaskRun

[Command API Reference](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/client/glue/command/StopColumnStatisticsTaskRunCommand/) / [Input](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-glue/Interface/StopColumnStatisticsTaskRunCommandInput/) / [Output](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-glue/Interface/StopColumnStatisticsTaskRunCommandOutput/)

</details>
<details>
<summary>
StopColumnStatisticsTaskRunSchedule
</summary>

[Command API Reference](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/client/glue/command/StopColumnStatisticsTaskRunScheduleCommand/) / [Input](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-glue/Interface/StopColumnStatisticsTaskRunScheduleCommandInput/) / [Output](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-glue/Interface/StopColumnStatisticsTaskRunScheduleCommandOutput/)

</details>
<details>
<summary>
Expand Down Expand Up @@ -1852,6 +1892,14 @@ UpdateColumnStatisticsForTable

[Command API Reference](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/client/glue/command/UpdateColumnStatisticsForTableCommand/) / [Input](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-glue/Interface/UpdateColumnStatisticsForTableCommandInput/) / [Output](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-glue/Interface/UpdateColumnStatisticsForTableCommandOutput/)

</details>
<details>
<summary>
UpdateColumnStatisticsTaskSettings
</summary>

[Command API Reference](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/client/glue/command/UpdateColumnStatisticsTaskSettingsCommand/) / [Input](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-glue/Interface/UpdateColumnStatisticsTaskSettingsCommandInput/) / [Output](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-glue/Interface/UpdateColumnStatisticsTaskSettingsCommandOutput/)

</details>
<details>
<summary>
Expand Down
138 changes: 138 additions & 0 deletions clients/client-glue/src/Glue.ts
Original file line number Diff line number Diff line change
Expand Up @@ -127,6 +127,11 @@ import {
CreateClassifierCommandInput,
CreateClassifierCommandOutput,
} from "./commands/CreateClassifierCommand";
import {
CreateColumnStatisticsTaskSettingsCommand,
CreateColumnStatisticsTaskSettingsCommandInput,
CreateColumnStatisticsTaskSettingsCommandOutput,
} from "./commands/CreateColumnStatisticsTaskSettingsCommand";
import {
CreateConnectionCommand,
CreateConnectionCommandInput,
Expand Down Expand Up @@ -244,6 +249,11 @@ import {
DeleteColumnStatisticsForTableCommandInput,
DeleteColumnStatisticsForTableCommandOutput,
} from "./commands/DeleteColumnStatisticsForTableCommand";
import {
DeleteColumnStatisticsTaskSettingsCommand,
DeleteColumnStatisticsTaskSettingsCommandInput,
DeleteColumnStatisticsTaskSettingsCommandOutput,
} from "./commands/DeleteColumnStatisticsTaskSettingsCommand";
import {
DeleteConnectionCommand,
DeleteConnectionCommandInput,
Expand Down Expand Up @@ -401,6 +411,11 @@ import {
GetColumnStatisticsTaskRunsCommandInput,
GetColumnStatisticsTaskRunsCommandOutput,
} from "./commands/GetColumnStatisticsTaskRunsCommand";
import {
GetColumnStatisticsTaskSettingsCommand,
GetColumnStatisticsTaskSettingsCommandInput,
GetColumnStatisticsTaskSettingsCommandOutput,
} from "./commands/GetColumnStatisticsTaskSettingsCommand";
import {
GetConnectionCommand,
GetConnectionCommandInput,
Expand Down Expand Up @@ -812,6 +827,11 @@ import {
StartColumnStatisticsTaskRunCommandInput,
StartColumnStatisticsTaskRunCommandOutput,
} from "./commands/StartColumnStatisticsTaskRunCommand";
import {
StartColumnStatisticsTaskRunScheduleCommand,
StartColumnStatisticsTaskRunScheduleCommandInput,
StartColumnStatisticsTaskRunScheduleCommandOutput,
} from "./commands/StartColumnStatisticsTaskRunScheduleCommand";
import {
StartCrawlerCommand,
StartCrawlerCommandInput,
Expand Down Expand Up @@ -868,6 +888,11 @@ import {
StopColumnStatisticsTaskRunCommandInput,
StopColumnStatisticsTaskRunCommandOutput,
} from "./commands/StopColumnStatisticsTaskRunCommand";
import {
StopColumnStatisticsTaskRunScheduleCommand,
StopColumnStatisticsTaskRunScheduleCommandInput,
StopColumnStatisticsTaskRunScheduleCommandOutput,
} from "./commands/StopColumnStatisticsTaskRunScheduleCommand";
import { StopCrawlerCommand, StopCrawlerCommandInput, StopCrawlerCommandOutput } from "./commands/StopCrawlerCommand";
import {
StopCrawlerScheduleCommand,
Expand Down Expand Up @@ -912,6 +937,11 @@ import {
UpdateColumnStatisticsForTableCommandInput,
UpdateColumnStatisticsForTableCommandOutput,
} from "./commands/UpdateColumnStatisticsForTableCommand";
import {
UpdateColumnStatisticsTaskSettingsCommand,
UpdateColumnStatisticsTaskSettingsCommandInput,
UpdateColumnStatisticsTaskSettingsCommandOutput,
} from "./commands/UpdateColumnStatisticsTaskSettingsCommand";
import {
UpdateConnectionCommand,
UpdateConnectionCommandInput,
Expand Down Expand Up @@ -1027,6 +1057,7 @@ const commands = {
CheckSchemaVersionValidityCommand,
CreateBlueprintCommand,
CreateClassifierCommand,
CreateColumnStatisticsTaskSettingsCommand,
CreateConnectionCommand,
CreateCrawlerCommand,
CreateCustomEntityTypeCommand,
Expand All @@ -1052,6 +1083,7 @@ const commands = {
DeleteClassifierCommand,
DeleteColumnStatisticsForPartitionCommand,
DeleteColumnStatisticsForTableCommand,
DeleteColumnStatisticsTaskSettingsCommand,
DeleteConnectionCommand,
DeleteCrawlerCommand,
DeleteCustomEntityTypeCommand,
Expand Down Expand Up @@ -1085,6 +1117,7 @@ const commands = {
GetColumnStatisticsForTableCommand,
GetColumnStatisticsTaskRunCommand,
GetColumnStatisticsTaskRunsCommand,
GetColumnStatisticsTaskSettingsCommand,
GetConnectionCommand,
GetConnectionsCommand,
GetCrawlerCommand,
Expand Down Expand Up @@ -1184,6 +1217,7 @@ const commands = {
SearchTablesCommand,
StartBlueprintRunCommand,
StartColumnStatisticsTaskRunCommand,
StartColumnStatisticsTaskRunScheduleCommand,
StartCrawlerCommand,
StartCrawlerScheduleCommand,
StartDataQualityRuleRecommendationRunCommand,
Expand All @@ -1196,6 +1230,7 @@ const commands = {
StartTriggerCommand,
StartWorkflowRunCommand,
StopColumnStatisticsTaskRunCommand,
StopColumnStatisticsTaskRunScheduleCommand,
StopCrawlerCommand,
StopCrawlerScheduleCommand,
StopSessionCommand,
Expand All @@ -1208,6 +1243,7 @@ const commands = {
UpdateClassifierCommand,
UpdateColumnStatisticsForPartitionCommand,
UpdateColumnStatisticsForTableCommand,
UpdateColumnStatisticsTaskSettingsCommand,
UpdateConnectionCommand,
UpdateCrawlerCommand,
UpdateCrawlerScheduleCommand,
Expand Down Expand Up @@ -1638,6 +1674,23 @@ export interface Glue {
cb: (err: any, data?: CreateClassifierCommandOutput) => void
): void;

/**
* @see {@link CreateColumnStatisticsTaskSettingsCommand}
*/
createColumnStatisticsTaskSettings(
args: CreateColumnStatisticsTaskSettingsCommandInput,
options?: __HttpHandlerOptions
): Promise<CreateColumnStatisticsTaskSettingsCommandOutput>;
createColumnStatisticsTaskSettings(
args: CreateColumnStatisticsTaskSettingsCommandInput,
cb: (err: any, data?: CreateColumnStatisticsTaskSettingsCommandOutput) => void
): void;
createColumnStatisticsTaskSettings(
args: CreateColumnStatisticsTaskSettingsCommandInput,
options: __HttpHandlerOptions,
cb: (err: any, data?: CreateColumnStatisticsTaskSettingsCommandOutput) => void
): void;

/**
* @see {@link CreateConnectionCommand}
*/
Expand Down Expand Up @@ -2007,6 +2060,23 @@ export interface Glue {
cb: (err: any, data?: DeleteColumnStatisticsForTableCommandOutput) => void
): void;

/**
* @see {@link DeleteColumnStatisticsTaskSettingsCommand}
*/
deleteColumnStatisticsTaskSettings(
args: DeleteColumnStatisticsTaskSettingsCommandInput,
options?: __HttpHandlerOptions
): Promise<DeleteColumnStatisticsTaskSettingsCommandOutput>;
deleteColumnStatisticsTaskSettings(
args: DeleteColumnStatisticsTaskSettingsCommandInput,
cb: (err: any, data?: DeleteColumnStatisticsTaskSettingsCommandOutput) => void
): void;
deleteColumnStatisticsTaskSettings(
args: DeleteColumnStatisticsTaskSettingsCommandInput,
options: __HttpHandlerOptions,
cb: (err: any, data?: DeleteColumnStatisticsTaskSettingsCommandOutput) => void
): void;

/**
* @see {@link DeleteConnectionCommand}
*/
Expand Down Expand Up @@ -2505,6 +2575,23 @@ export interface Glue {
cb: (err: any, data?: GetColumnStatisticsTaskRunsCommandOutput) => void
): void;

/**
* @see {@link GetColumnStatisticsTaskSettingsCommand}
*/
getColumnStatisticsTaskSettings(
args: GetColumnStatisticsTaskSettingsCommandInput,
options?: __HttpHandlerOptions
): Promise<GetColumnStatisticsTaskSettingsCommandOutput>;
getColumnStatisticsTaskSettings(
args: GetColumnStatisticsTaskSettingsCommandInput,
cb: (err: any, data?: GetColumnStatisticsTaskSettingsCommandOutput) => void
): void;
getColumnStatisticsTaskSettings(
args: GetColumnStatisticsTaskSettingsCommandInput,
options: __HttpHandlerOptions,
cb: (err: any, data?: GetColumnStatisticsTaskSettingsCommandOutput) => void
): void;

/**
* @see {@link GetConnectionCommand}
*/
Expand Down Expand Up @@ -3981,6 +4068,23 @@ export interface Glue {
cb: (err: any, data?: StartColumnStatisticsTaskRunCommandOutput) => void
): void;

/**
* @see {@link StartColumnStatisticsTaskRunScheduleCommand}
*/
startColumnStatisticsTaskRunSchedule(
args: StartColumnStatisticsTaskRunScheduleCommandInput,
options?: __HttpHandlerOptions
): Promise<StartColumnStatisticsTaskRunScheduleCommandOutput>;
startColumnStatisticsTaskRunSchedule(
args: StartColumnStatisticsTaskRunScheduleCommandInput,
cb: (err: any, data?: StartColumnStatisticsTaskRunScheduleCommandOutput) => void
): void;
startColumnStatisticsTaskRunSchedule(
args: StartColumnStatisticsTaskRunScheduleCommandInput,
options: __HttpHandlerOptions,
cb: (err: any, data?: StartColumnStatisticsTaskRunScheduleCommandOutput) => void
): void;

/**
* @see {@link StartCrawlerCommand}
*/
Expand Down Expand Up @@ -4167,6 +4271,23 @@ export interface Glue {
cb: (err: any, data?: StopColumnStatisticsTaskRunCommandOutput) => void
): void;

/**
* @see {@link StopColumnStatisticsTaskRunScheduleCommand}
*/
stopColumnStatisticsTaskRunSchedule(
args: StopColumnStatisticsTaskRunScheduleCommandInput,
options?: __HttpHandlerOptions
): Promise<StopColumnStatisticsTaskRunScheduleCommandOutput>;
stopColumnStatisticsTaskRunSchedule(
args: StopColumnStatisticsTaskRunScheduleCommandInput,
cb: (err: any, data?: StopColumnStatisticsTaskRunScheduleCommandOutput) => void
): void;
stopColumnStatisticsTaskRunSchedule(
args: StopColumnStatisticsTaskRunScheduleCommandInput,
options: __HttpHandlerOptions,
cb: (err: any, data?: StopColumnStatisticsTaskRunScheduleCommandOutput) => void
): void;

/**
* @see {@link StopCrawlerCommand}
*/
Expand Down Expand Up @@ -4334,6 +4455,23 @@ export interface Glue {
cb: (err: any, data?: UpdateColumnStatisticsForTableCommandOutput) => void
): void;

/**
* @see {@link UpdateColumnStatisticsTaskSettingsCommand}
*/
updateColumnStatisticsTaskSettings(
args: UpdateColumnStatisticsTaskSettingsCommandInput,
options?: __HttpHandlerOptions
): Promise<UpdateColumnStatisticsTaskSettingsCommandOutput>;
updateColumnStatisticsTaskSettings(
args: UpdateColumnStatisticsTaskSettingsCommandInput,
cb: (err: any, data?: UpdateColumnStatisticsTaskSettingsCommandOutput) => void
): void;
updateColumnStatisticsTaskSettings(
args: UpdateColumnStatisticsTaskSettingsCommandInput,
options: __HttpHandlerOptions,
cb: (err: any, data?: UpdateColumnStatisticsTaskSettingsCommandOutput) => void
): void;

/**
* @see {@link UpdateConnectionCommand}
*/
Expand Down
Loading

0 comments on commit 8a12fe4

Please sign in to comment.