Code

Add EMR client to spark connector#1790

Code

Merged

penghuo merged 41 commits intoopensearch-project:mainopensearch-project/sql:mainfrom rupal-bq:emr-clientrupal-bq/opensearch-sql:emr-clientCopy head branch name to clipboardJul 11, 2023

+1,559-44

Commits

Commits on Jun 8, 2023

• Create Spark Connector

  Show description for 70588d6
  vamsimanohar

  committed
  70588d6

  Copy full SHA for 70588d6

Commits on Jun 21, 2023

• Add spark client and engine

  Show description for 2b8ceb7
  rupal-bq

  committed
  2b8ceb7

  Copy full SHA for 2b8ceb7

• Remove vars

  Show description for f595ff4
  rupal-bq

  committed
  f595ff4

  Copy full SHA for f595ff4

Commits on Jun 26, 2023

• Merge branch 'main' into create-spark-connector

  Show description for 95a86d5
  rupal-bq

  committed
  95a86d5

  Copy full SHA for 95a86d5

• Merge branch 'main' into create-spark-connector

  Show description for 51700bd
  rupal-bq

  committed
  51700bd

  Copy full SHA for 51700bd

• Spark connector draft

  Show description for d0d5042
  rupal-bq

  committed
  d0d5042

  Copy full SHA for d0d5042

• nit

  Show description for 5ac01b2
  rupal-bq

  committed
  5ac01b2

  Copy full SHA for 5ac01b2

• Fix checkstyle errors

  Show description for 4fcf4ba
  rupal-bq

  committed
  4fcf4ba

  Copy full SHA for 4fcf4ba

• nit

  Show description for 52a044d
  rupal-bq

  committed
  52a044d

  Copy full SHA for 52a044d

• Fix license header

  Show description for 69ca116
  rupal-bq

  committed
  69ca116

  Copy full SHA for 69ca116

• Add spark storage test

  Show description for 901e762
  rupal-bq

  committed
  901e762

  Copy full SHA for 901e762

• Update comments

  Show description for 1b81453
  rupal-bq

  committed
  1b81453

  Copy full SHA for 1b81453

• Fix checkstyle in comments

  Show description for 106218e
  rupal-bq

  committed
  106218e

  Copy full SHA for 106218e

• Merge branch 'main' into create-spark-connector

  Show description for 6da93f3
  rupal-bq

  committed
  6da93f3

  Copy full SHA for 6da93f3

• Update tests

  Show description for b953aa6
  rupal-bq

  committed
  b953aa6

  Copy full SHA for b953aa6

Commits on Jun 27, 2023

• Add emr client

  Show description for 2f899cd
  rupal-bq

  committed
  2f899cd

  Copy full SHA for 2f899cd

• Set default values for flint args

  Show description for 8ebab1a
  rupal-bq

  committed
  8ebab1a

  Copy full SHA for 8ebab1a

• Validate emr auth type

  Show description for 7dcad73
  rupal-bq

  committed
  7dcad73

  Copy full SHA for 7dcad73

• Add default constants for flint

  Show description for 23f195f
  rupal-bq

  committed
  23f195f

  Copy full SHA for 23f195f

Commits on Jun 28, 2023

• Update unit tests

  Show description for 63e3f6d
  rupal-bq

  committed
  63e3f6d

  Copy full SHA for 63e3f6d

• Address PR comments

  Show description for 0df37a8
  rupal-bq

  committed
  0df37a8

  Copy full SHA for 0df37a8

Commits on Jul 4, 2023

• tests draft

  Show description for 99d561a
  rupal-bq

  committed
  99d561a

  Copy full SHA for 99d561a

• Refactor class name

  Show description for 776bc36
  rupal-bq

  committed
  776bc36

  Copy full SHA for 776bc36

• Merge branch 'main' into create-spark-connector

  Show description for 0eb5e53
  rupal-bq

  committed
  0eb5e53

  Copy full SHA for 0eb5e53

• Merge branch 'create-spark-connector' into emr-client

  Show description for 680268a
  rupal-bq

  committed
  680268a

  Copy full SHA for 680268a

• Rename classes and update tests

  Show description for 890c8c7
  rupal-bq

  committed
  890c8c7

  Copy full SHA for 890c8c7

Commits on Jul 5, 2023

• Update scan operator test

  Show description for 9fc496a
  rupal-bq

  committed
  9fc496a

  Copy full SHA for 9fc496a

• Address PR comment

  Show description for be15dae
  rupal-bq

  committed
  be15dae

  Copy full SHA for be15dae

• Fix Connection pool shut down issue

  Show description for e74e036
  rupal-bq

  committed
  e74e036

  Copy full SHA for e74e036

Commits on Jul 6, 2023

• Update emr unit tests

  Show description for dbf0367
  rupal-bq

  committed
  dbf0367

  Copy full SHA for dbf0367

• Merge branch 'create-spark-connector' into emr-client

  Show description for b8209bd
  rupal-bq

  committed
  b8209bd

  Copy full SHA for b8209bd

• Merge branch 'main' into emr-client

  Show description for 2f73d40
  rupal-bq

  committed
  2f73d40

  Copy full SHA for 2f73d40

• Update doc and tests

  Show description for 7f8c2ab
  rupal-bq

  committed
  7f8c2ab

  Copy full SHA for 7f8c2ab

• nit

  Show description for cd9a4fe
  rupal-bq

  committed
  cd9a4fe

  Copy full SHA for cd9a4fe

• Update EMR clinet impl tests

  Show description for 9e34ce3
  rupal-bq

  committed
  9e34ce3

  Copy full SHA for 9e34ce3

• Address PR comments

  Show description for c029ae5
  rupal-bq

  committed
  c029ae5

  Copy full SHA for c029ae5

• Make spark & flint jars configurable

  Show description for 9d249ee
  rupal-bq

  committed
  9d249ee

  Copy full SHA for 9d249ee

Commits on Jul 7, 2023

• Address comments

  Show description for f9d7382
  rupal-bq

  committed
  f9d7382

  Copy full SHA for f9d7382

• Add spark application id in logs

  Show description for c6e0076
  rupal-bq

  committed
  c6e0076

  Copy full SHA for c6e0076

• nit

  Show description for cc6d8cb
  rupal-bq

  committed
  cc6d8cb

  Copy full SHA for cc6d8cb

• Delete result when not required

  Show description for 5bbda31
  rupal-bq

  committed
  5bbda31

  Copy full SHA for 5bbda31