1.6.0 #33

dqops · 2024-07-22T21:29:45Z

1.6.0

Fixes to some error sampling templates
Redesigned data quality check editor to work in a simplified mode
JDBC drivers are pre-loaded to avoid issues with automatic registration of JDBC drivers by Java
Delta Lake and Iceberg support
Global incident screen redesigned to show the counts of incidents

…ameter

prevented undefined tooltip

fixed infinite loop on tableColumns component

- fixed infinite loop on tableColumns component - unified sorting on TableColumns page

…arison

- fixed placement of checkboxes table comparison - validating 404 status when changing configuration of new created comparison - truncating text if it is too long - truncating text correctly

Related work items: #12408

error sampling removed negations to present invalid rows Related work items: #12429

… extension)

…umns It was like on the picture. The execution of DESCRIBE statement on hive_metastore table with partitioning returns comments along the list of columns. ![image (2).png](https://dev.azure.com/imagetemplates/f6bfc03e-02d8-43e1-803d-c52490ef01e1/_apis/git/repositories/0a9f27c2-54c6-42d6-b790-b9f29bfafecc/pullRequests/2805/attachments/image%20%282%29.png) Related work items: #12426

Now using default setup of extension also works (leaving the compression setup unset) ![image.png](https://dev.azure.com/imagetemplates/f6bfc03e-02d8-43e1-803d-c52490ef01e1/_apis/git/repositories/0a9f27c2-54c6-42d6-b790-b9f29bfafecc/pullRequests/2806/attachments/image.png) Related work items: #12431

…dd connection view ![image.png](https://dev.azure.com/imagetemplates/f6bfc03e-02d8-43e1-803d-c52490ef01e1/_apis/git/repositories/0a9f27c2-54c6-42d6-b790-b9f29bfafecc/pullRequests/2807/attachments/image.png) Related work items: #12427

…tegration tests

…and databricks

…w connection

…table when creating new connec... type csv | json | parquet in duckdb is only editable when creating new connection

…tps://dev.azure.com/imagetemplates/documati.io/_git/dqoado into feature/12548_Verify_DeltaLake_support_in_duckdb

…pport Related work items: #12548

styled checkListItem component

…ti.io/_git/dqoado into bug/12540_hide_buttons_check_editor

…entered 'Enabled' label hidded buttons on dataQualityCheck header and centered 'Enabled' label

displaying tabs depending on the userProfile freetrial

displaying wrapped text correctly

…he connection jdbc drivers are registered manually before opening the connection I can connect to sql server ![image.png](https://dev.azure.com/imagetemplates/f6bfc03e-02d8-43e1-803d-c52490ef01e1/_apis/git/repositories/0a9f27c2-54c6-42d6-b790-b9f29bfafecc/pullRequests/2852/attachments/image.png) Related work items: #12567

Set parameters in blind. Otherwise I will need to create postgresql database with ssl configuration to test the timeout. There are no more client configurable parameters related to establishing the connection. Related work items: #12560

…rvability checks.

Added simplified check names Related work items: #12586

…ti.io/_git/dqoado into develop

…y, and to hide artifacts.

Patryk Jatczak and others added 30 commits July 3, 2024 12:24

duckdb datetime sensor date values in future have max future days par…

2d00c3c

…ameter

typo fix: teh -> the

bf2a1f0

prevented undefined tooltip

394cca7

fixed infinite loop on tableColumns component

42fe883

incidents delete service VIP

37a61f7

unified sorting on TableColumns page

f0bfdee

Merged PR 2798: 12401 prevented undefined tooltip

7a8709c

prevented undefined tooltip

Merged PR 2800: 12403 fixed infinite loop on tableColumns component

94a1dd6

fixed infinite loop on tableColumns component

Merged PR 2801: unified sorting on TableColumns page

788eac6

- fixed infinite loop on tableColumns component - unified sorting on TableColumns page

databricks integration tests fixes

1ec42e3

fixed placement of checkboxes table comparison

a52a1b3

validating 404 status when changing configuration of new created comp…

67bbc19

…arison

truncating text if it is too long

ff6cec5

truncating text correctly

a47f16d

Merged PR 2802: 12417 table comparison component

7835a01

- fixed placement of checkboxes table comparison - validating 404 status when changing configuration of new created comparison - truncating text if it is too long - truncating text correctly

fixed databricks integration tests and sensors

0b8a95f

databricks sets ansi mode when opening connection for integration tests

e3c3687

Merged PR 2803: databricks sensors fixed, jdbc Driver is loaded manually

eef8515

Related work items: #12408

error sampling removed negations to present invalid rows

295b679

Merged PR 2804: error sampling removed negations to present invalid rows

499a3e0

error sampling removed negations to present invalid rows Related work items: #12429

databricks avoids comments from list of available columns

aee208d

pointing extension is not necessary (by removal of the "null" text in…

e526de1

… extension)

initialization sql added to UI's add connection

db127fa

set new expected values in assertions for datetime dates in future in…

e43dd0f

…tegration tests

updated datetime values in future sensor for all db except for spark …

494f399

…and databricks

type csv | json | parquet in duckdb is only editable when creating ne…

de1746a

…w connection

Merged PR 2808: 12433 type csv | json | parquet in duckdb is only edi…

9832675

…table when creating new connec... type csv | json | parquet in duckdb is only editable when creating new connection

Patryk Jatczak and others added 29 commits July 18, 2024 13:09

deltalake support through duckdb, logo, docs

cf75f12

styled checkListItem component

76f5358

fixed name of delta_lake in cli examples of docs

789d310

handled selecting delta lake and displaying formatFile correctly

d103e8c

Merge branch 'feature/12548_Verify_DeltaLake_support_in_duckdb' of ht…

4b64b92

…tps://dev.azure.com/imagetemplates/documati.io/_git/dqoado into feature/12548_Verify_DeltaLake_support_in_duckdb

renamed images

3648f1b

Merged PR 2847: Delta Lake is supported in scope of current duckdb su…

67342f2

…pport Related work items: #12548

Merged PR 2848: styled checkListItem component

74759ba

styled checkListItem component

hidded buttons on dataQualityCheck header and centered 'Enabled' label

97e3823

Merge branch 'develop' of https://dev.azure.com/imagetemplates/documa…

ae0cec3

…ti.io/_git/dqoado into bug/12540_hide_buttons_check_editor

displaying tabs depending on the userProfile freetrial

7663bb2

Merged PR 2849: 12540 hidded buttons on dataQualityCheck header and c…

f7614b8

…entered 'Enabled' label hidded buttons on dataQualityCheck header and centered 'Enabled' label

Merged PR 2850: displaying tabs depending on the userProfile freetrial

a3f331f

displaying tabs depending on the userProfile freetrial

displaying wrapped text correctly

b531e1d

Merged PR 2851: 12564 displaying wrapped text correctly

898d3f8

displaying wrapped text correctly

jdbc drivers are registered manually before opening the connection

3a9d0d6

fixed wrong oracle jdbc driver class path

7ca0700

set postgresql connect timeout to 10 seconds as default

9a3ae20

set postgresql login timeout to 10 seconds as default

383c53f

Version upgraded to 1.6.0. Documentation and client regenerated.

8d4675c

Add the data freshness anomaly check to the list of default data obse…

99f9181

…rvability checks.

Added simplified check names

db70e4e

Merged PR 2855: Added simplified check names

c9058a2

Added simplified check names Related work items: #12586

Merge branch 'develop' of https://dev.azure.com/imagetemplates/documa…

d3ab19a

…ti.io/_git/dqoado into develop

Friendly names of data quality checks added to the documentation.

fa6fc34

Small fixes in the friendly names of data quality checks.

eb3a19b

Small fixes in the check editor, to support default severity correctl…

82a16b2

…y, and to hide artifacts.

dqops merged commit 5b36adb into main Jul 22, 2024
1 check passed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

1.6.0 #33

1.6.0 #33

dqops commented Jul 22, 2024

1.6.0 #33

1.6.0 #33

Conversation

dqops commented Jul 22, 2024

1.6.0