Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Google analytics #5

Closed
wants to merge 2,930 commits into from
Closed

Google analytics #5

wants to merge 2,930 commits into from

Conversation

jonathanpmoraes
Copy link

This pull request introduces several scripts and configuration files to enhance the CI/CD pipeline and automate various tasks in the Marquez project. The most important changes include adding scripts for load testing, database migration, and setting up required tools, as well as updating the CircleCI configuration to integrate these scripts and define new jobs.

New Scripts and Tools:

CircleCI Configuration:

  • .circleci/config.yml: Updated to define new jobs for building and testing different components of the project, including running the new scripts for load testing and database migration.

Miscellaneous:

phixMe and others added 30 commits April 1, 2024 10:00
* Add border to status display, accommodate line-height issue.

* Various css updates and using more labels.

* Minor style tweak.

---------

Co-authored-by: phix <peter.hicks@astronomer.io>
Signed-off-by: sophiely <ly.sophie200@gmail.com>
Co-authored-by: Peter Hicks <phixMe@users.noreply.github.com>
* add key down escape for dialogs

Signed-off-by: sharpd <davidsharp7@gmail.com>

* add truthy condition of refreshTags

Signed-off-by: sharpd <davidsharp7@gmail.com>

* fix freshTags state

Signed-off-by: sharpd <davidsharp7@gmail.com>

* fix failing test

Signed-off-by: sharpd <davidsharp7@gmail.com>

* add tag sort order and update conflict insert sql

Signed-off-by: sharpd <davidsharp7@gmail.com>

* add tag integration ON CONFLICT test

Signed-off-by: sharpd <davidsharp7@gmail.com>

* draft changes to tagging

Signed-off-by: sharpd <davidsharp7@gmail.com>

* add missing freesolo

Signed-off-by: sharpd <davidsharp7@gmail.com>

* add field tag toggle

Signed-off-by: sharpd <davidsharp7@gmail.com>

* add multi select/fix fresh

Signed-off-by: sharpd <davidsharp7@gmail.com>

* fix failing test

Signed-off-by: sharpd <davidsharp7@gmail.com>

* fix DOM underline error

Signed-off-by: sharpd <davidsharp7@gmail.com>

* remove selectOption for tag update

Signed-off-by: sharpd <davidsharp7@gmail.com>

* add auto highlight prop to aid user selection

Signed-off-by: sharpd <davidsharp7@gmail.com>

* change tag deletion updated based on feedback

Signed-off-by: sharpd <davidsharp7@gmail.com>

---------

Signed-off-by: sharpd <davidsharp7@gmail.com>
Co-authored-by: Willy Lulciuc <willy@datakin.com>
* Visual tweaks for truncating tables and other misc display improvements.

* Fix loading state issue.

* Refinements

* Adding meta info for tab view.

* Job detail page update.

* Fixing icon.

* Fixing accidental change.

* Minor updates for styling.

* Fixing test.

* Minor style changes.

* Fixing multi tag change.

---------

Co-authored-by: phix <peter.hicks@astronomer.io>
* fix show tags fresh

Signed-off-by: sharpd <davidsharp7@gmail.com>

* disable show tags on version load

Signed-off-by: sharpd <davidsharp7@gmail.com>

---------

Signed-off-by: sharpd <davidsharp7@gmail.com>
* Removing old unused files and dependencies.

* Removing old test.

---------

Co-authored-by: phix <peter.hicks@astronomer.io>
…Project#2789)

Signed-off-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
…t#2781)

Signed-off-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
…ject#2803)

Signed-off-by: Chih-Wei Fang <dodo0822@gmail.com>
Co-authored-by: Peter Hicks <phixMe@users.noreply.github.com>
Co-authored-by: Willy Lulciuc <willy@datakin.com>
* Adding in column lineage link.

* Sticky placement on job details page.

* Adding sticky to the job details tab.

* Minor revisions to fonts, casing, and column lineage links.

* nil guard.

* Fixing description

---------

Co-authored-by: phix <peter.hicks@astronomer.io>
Co-authored-by: phix <peter.hicks@astronomer.io>
* Updating tooltips and fixing rendering issue in column lineage table display.

* Icons for jobs and datasets on lineage panels.

---------

Co-authored-by: phix <peter.hicks@astronomer.io>
Signed-off-by: David Goss <david@davidgoss.co>
Signed-off-by: sophiely <ly.sophie200@gmail.com>
Co-authored-by: Willy Lulciuc <willy@datakin.com>
Signed-off-by: wslulciuc <willy@datakin.com>
* add job tagging to API

Signed-off-by: sharpd <davidsharp7@gmail.com>

* fix various tests that were failing

Signed-off-by: sharpd <davidsharp7@gmail.com>

* fix merge commit

Signed-off-by: sharpd <davidsharp7@gmail.com>

* fix liniting

Signed-off-by: sharpd <davidsharp7@gmail.com>

* update based on pr feedback

Signed-off-by: sharpd <davidsharp7@gmail.com>

* lint tag test code

Signed-off-by: sharpd <davidsharp7@gmail.com>

* lint tag  code

Signed-off-by: sharpd <davidsharp7@gmail.com>

* fix log typo

Signed-off-by: sharpd <davidsharp7@gmail.com>

* fix logging

Signed-off-by: sharpd <davidsharp7@gmail.com>

* update based on PR feedback.

Signed-off-by: sharpd <davidsharp7@gmail.com>

* correct db field error

Signed-off-by: sharpd <davidsharp7@gmail.com>

---------

Signed-off-by: sharpd <davidsharp7@gmail.com>
Co-authored-by: Willy Lulciuc <willy@datakin.com>
* Quality and node display

* Fixing display on column lineage title.

* Fixing bad status icon and adding divider to tooltip.

* Fixing minor theme details.

* Minor code review updates.

* UX tweaks

* Adding updated at

---------

Co-authored-by: phix <peter.hicks@astronomer.io>
* Update tooltip refs and other minor visual quirks remedied.

* Longer character limit for tooltips

---------

Co-authored-by: phix <peter.hicks@astronomer.io>
Signed-off-by: sharpd <davidsharp7@gmail.com>
Signed-off-by: merobi-hub <merobi@gmail.com>
Signed-off-by: merobi-hub <merobi@gmail.com>
Signed-off-by: merobi-hub <merobi@gmail.com>
Signed-off-by: merobi-hub <merobi@gmail.com>
Co-authored-by: Willy Lulciuc <willy@datakin.com>
Signed-off-by: Nisarg-Chokshi <nisarg4000@gmail.com>
…#2791)

Signed-off-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
…ect#2788)

Signed-off-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
…zProject#2790)

Signed-off-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Co-authored-by: phix <peter.hicks@astronomer.io>
Signed-off-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
…ezProject#2777)

* Add guidance for windows users to readme.

Signed-off-by: merobi-hub <merobi@gmail.com>

* Add windows guidance to quickstart in docs.

Signed-off-by: merobi-hub <merobi@gmail.com>

* Update compatibility table.

Signed-off-by: merobi-hub <merobi@gmail.com>

* Postgres version req in quickstart.

Signed-off-by: merobi-hub <merobi@gmail.com>

---------

Signed-off-by: merobi-hub <merobi@gmail.com>
davidsharp7 and others added 26 commits February 4, 2025 18:00
Signed-off-by: sharpd <davidsharp7@gmail.com>
Co-authored-by: Willy Lulciuc <willy@datakin.com>
Signed-off-by: Willy Lulciuc <willy.lulciuc@gmail.com>
* Fix tutorial preview card.

Signed-off-by: merobi-hub <merobi@gmail.com>

* Misc minor fixes in tutorial.

Signed-off-by: merobi-hub <merobi@gmail.com>

* Revise description.

Signed-off-by: merobi-hub <merobi@gmail.com>

---------

Signed-off-by: merobi-hub <merobi@gmail.com>
Signed-off-by: lewis.gu <gupeng1208@gmail.com>
Signed-off-by: phixMe <peter.hicks@pdtechsolutions.com>
…t#3013)

* static.yml in .github for publishing docs using github actions.

Signed-off-by: merobi-hub <merobi@gmail.com>

* Fix path.

Signed-off-by: merobi-hub <merobi@gmail.com>

* Promote v2 docs site content to docs dir.

Signed-off-by: merobi-hub <merobi@gmail.com>

* Remove netlify.toml.

Signed-off-by: merobi-hub <merobi@gmail.com>

---------

Signed-off-by: merobi-hub <merobi@gmail.com>
* Add workflows.

Signed-off-by: merobi-hub <merobi@gmail.com>
---------

Signed-off-by: merobi-hub <merobi@gmail.com>
Signed-off-by: merobi-hub <merobi@gmail.com>
Signed-off-by: merobi-hub <merobi@gmail.com>
Signed-off-by: merobi-hub <merobi@gmail.com>
Signed-off-by: merobi-hub <merobi@gmail.com>
…oject#1442)

Signed-off-by: Renovate Bot <bot@renovateapp.com>

Co-authored-by: Renovate Bot <bot@renovateapp.com>
)

Signed-off-by: Pawel Leszczynski <leszczynski.pawel@gmail.com>
…MarquezProject#2984)

* encodeURIComponent namespace and name in GET lineage request

Signed-off-by: Maarten Hubrechts <maarten.hubrechts@hotmail.com>

* Use same coding style for encoding as in jobs and datasets requests

Signed-off-by: Maarten Hubrechts <maarten.hubrechts@hotmail.com>

---------

Signed-off-by: Maarten Hubrechts <maarten.hubrechts@hotmail.com>
…oject#1442)

Signed-off-by: Renovate Bot <bot@renovateapp.com>

Co-authored-by: Renovate Bot <bot@renovateapp.com>
)

Signed-off-by: Pawel Leszczynski <leszczynski.pawel@gmail.com>
* Remove search from gitpod cmd

Signed-off-by: Willy Lulciuc <willy.lulciuc@gmail.com>

* Add arg `--db-port` to `docker/up.sh`

Signed-off-by: Willy Lulciuc <willy.lulciuc@gmail.com>

---------

Signed-off-by: Willy Lulciuc <willy.lulciuc@gmail.com>
Signed-off-by: Willy Lulciuc <willy.lulciuc@gmail.com>
Signed-off-by: Willy Lulciuc <willy.lulciuc@gmail.com>
…t#3013)

* static.yml in .github for publishing docs using github actions.

Signed-off-by: merobi-hub <merobi@gmail.com>

* Fix path.

Signed-off-by: merobi-hub <merobi@gmail.com>

* Promote v2 docs site content to docs dir.

Signed-off-by: merobi-hub <merobi@gmail.com>

* Remove netlify.toml.

Signed-off-by: merobi-hub <merobi@gmail.com>

---------

Signed-off-by: merobi-hub <merobi@gmail.com>
* Add workflows.

Signed-off-by: merobi-hub <merobi@gmail.com>
---------

Signed-off-by: merobi-hub <merobi@gmail.com>
@jonathanpmoraes jonathanpmoraes deleted the google-analytics branch February 6, 2025 14:12
@jonathanpmoraes jonathanpmoraes restored the google-analytics branch February 6, 2025 14:13
jonathanpmoraes pushed a commit that referenced this pull request Feb 6, 2025
* Fixing data quality display. (MarquezProject#2937)

Signed-off-by: phixMe <peter.hicks@pdtechsolutions.com>

* Dataset Version call simplification (MarquezProject#2938)

* Fixing data quality display.

Signed-off-by: phixMe <peter.hicks@pdtechsolutions.com>

* Fixing dataset version calls.

Signed-off-by: phixMe <peter.hicks@pdtechsolutions.com>

---------

Signed-off-by: phixMe <peter.hicks@pdtechsolutions.com>

* feat: allow db-migrate without version (MarquezProject#2936)

Signed-off-by: David Goss <david@davidgoss.co>

* Display full `runID` and check icon when copied (MarquezProject#2940)

Signed-off-by: Willy Lulciuc <willy.lulciuc@gmail.com>

* Deferred copy revert. (MarquezProject#2941)

Signed-off-by: phixMe <peter.hicks@pdtechsolutions.com>

* Long text handling (MarquezProject#2942)

* Deferred copy revert.

Signed-off-by: phixMe <peter.hicks@pdtechsolutions.com>

* Long text handling.

Signed-off-by: phixMe <peter.hicks@pdtechsolutions.com>

* Adding search back in.

Signed-off-by: phixMe <peter.hicks@pdtechsolutions.com>

---------

Signed-off-by: phixMe <peter.hicks@pdtechsolutions.com>

* Use project root for docker volume prefix (MarquezProject#2943)

Signed-off-by: Willy Lulciuc <willy.lulciuc@gmail.com>

* fix: Correct SQL query pagination for DatasetVersion findAll method (MarquezProject#2945)

Signed-off-by: Alper İnan <kurumsal.alper@gmail.com>
Signed-off-by: Alper <kurumsal.alper@gmail.com>

* Update changelog for `0.50.0`

Signed-off-by: Willy Lulciuc <willy.lulciuc@gmail.com>

* Replace `redoc-cli` with `redocly`

Signed-off-by: Willy Lulciuc <willy.lulciuc@gmail.com>

* Prepare for release 0.50.0

Signed-off-by: Willy Lulciuc <willy.lulciuc@gmail.com>

* Prepare next development version 0.51.0-SNAPSHOT

Signed-off-by: Willy Lulciuc <willy.lulciuc@gmail.com>

* Templatize event time in `metadata.json` (MarquezProject#2946)

* Templatize event time in `metadata.json`

Signed-off-by: Willy Lulciuc <willy.lulciuc@gmail.com>

* Use `metadata.template.json`

Signed-off-by: Willy Lulciuc <willy.lulciuc@gmail.com>

---------

Signed-off-by: Willy Lulciuc <willy.lulciuc@gmail.com>

* Update CHANGELOG.md

* Update `web/docs/demo.gif` (MarquezProject#2948)

Signed-off-by: Willy Lulciuc <willy.lulciuc@gmail.com>

* fix(deps): update dependency io.openlineage:openlineage-java to v1.23.0 (MarquezProject#2907)

Signed-off-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>

* fix(deps): update dependency org.assertj:assertj-core to v3.26.3 (MarquezProject#2909)

Signed-off-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Co-authored-by: Willy Lulciuc <willy@datakin.com>

* fix(deps): update dependency org.postgresql:postgresql to v42.7.4 (MarquezProject#2912)

Signed-off-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>

* fix(deps): update dependency org.opensearch.client:opensearch-rest-client to v2.17.1 (MarquezProject#2911)

Signed-off-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Co-authored-by: Willy Lulciuc <willy@datakin.com>

* fix(deps): update dependency org.apache.commons:commons-lang3 to v3.17.0 (MarquezProject#2908)

Signed-off-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>

* Ignore `**/stats/**` (MarquezProject#2952)

Signed-off-by: Willy Lulciuc <willy.lulciuc@gmail.com>

* Update compatibility for `0.50.0`

* fix(deps): update dependency org.opensearch.client:opensearch-java to v2.16.0 (MarquezProject#2910)

Signed-off-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>

* `Dataset.currentVersionUuid` `->` `DatasetVersion.uuid` (MarquezProject#2954)

Signed-off-by: Willy Lulciuc <willy.lulciuc@gmail.com>

* Update Events Page (MarquezProject#2955)

* Tuning the events page for longer events.

Signed-off-by: phixMe <peter.hicks@pdtechsolutions.com>

* Adding events file.

Signed-off-by: phixMe <peter.hicks@pdtechsolutions.com>

* Refetch jobs button.

Signed-off-by: phixMe <peter.hicks@pdtechsolutions.com>

* Refetch jobs button.

Signed-off-by: phixMe <peter.hicks@pdtechsolutions.com>

* Lint

Signed-off-by: phixMe <peter.hicks@pdtechsolutions.com>

---------

Signed-off-by: phixMe <peter.hicks@pdtechsolutions.com>
Co-authored-by: Willy Lulciuc <willy@datakin.com>

* Lineage run attachment issue. (MarquezProject#2953)

Signed-off-by: phixMe <peter.hicks@pdtechsolutions.com>
Co-authored-by: Willy Lulciuc <willy@datakin.com>

* feature: Better handling of missing environment variables in setupProxy.js file. (MarquezProject#2956)

Signed-off-by: Artur Owczarek <owczarek.artur@gmail.com>

---------

Signed-off-by: phixMe <peter.hicks@pdtechsolutions.com>
Signed-off-by: David Goss <david@davidgoss.co>
Signed-off-by: Willy Lulciuc <willy.lulciuc@gmail.com>
Signed-off-by: Alper İnan <kurumsal.alper@gmail.com>
Signed-off-by: Alper <kurumsal.alper@gmail.com>
Signed-off-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Signed-off-by: Artur Owczarek <owczarek.artur@gmail.com>
Co-authored-by: Peter Hicks <phixMe@users.noreply.github.com>
Co-authored-by: davidjgoss <david@davidgoss.co>
Co-authored-by: Willy Lulciuc <willy@datakin.com>
Co-authored-by: Alper İnan <65857758+inanalper@users.noreply.github.com>
Co-authored-by: Willy Lulciuc <willy.lulciuc@gmail.com>
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Co-authored-by: Artur Owczarek <owczarek.artur@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.