Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Simon Data Connector #3705

Closed
wants to merge 13 commits into from
Closed

Conversation

SteveDMurphy
Copy link
Contributor

@SteveDMurphy SteveDMurphy commented Jun 29, 2023

Closes #3699

Description Of Changes

Used the saas connector template via nox 🔥

Code Changes

  • Added config for new connector
  • Added dataset for new connector
  • Validated tests for new connector
  • Added an icon for the new connector

Steps to Confirm

  • The connector can be configured and used when processing a DSR

Pre-Merge Checklist

@SteveDMurphy SteveDMurphy force-pushed the SteveDMurphy-3699-simon-data-connector branch from d7a7d55 to d6f480d Compare July 19, 2023 23:20
@SteveDMurphy SteveDMurphy self-assigned this Jul 19, 2023
@SteveDMurphy SteveDMurphy added the run unsafe ci checks Runs fides-related CI checks that require sensitive credentials label Jul 19, 2023
@cypress
Copy link

cypress bot commented Jul 20, 2023

Passing run #3353 ↗︎

0 4 0 0 Flakiness 0
⚠️ You've recorded test results over your free plan limit.
Upgrade your plan to view test results.

Details:

Merge 923d7b9 into f230108...
Project: fides Commit: 6156d18faf ℹ️
Status: Passed Duration: 00:44 💡
Started: Jul 26, 2023 11:18 PM Ended: Jul 26, 2023 11:19 PM

This comment has been generated by cypress-bot as a result of this project's GitHub integration settings.

@SteveDMurphy SteveDMurphy requested a review from galvana July 20, 2023 16:51
@SteveDMurphy
Copy link
Contributor Author

@galvana - I think I need some help with secrets here potentially? There also appear to be some existing mypy and pytest errors but I think those are known. Thanks for any help here!!

@SteveDMurphy SteveDMurphy marked this pull request as ready for review July 20, 2023 17:01
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Check out tests/ops/integration_tests/saas/test_surveymonkey_task.py for a reference and let's add an assertion to make sure that the first endpoint in the traversal only returns objects that match our identity email. Same thing for the erasures, let's define our expectation of which collections should be affected by the erasure.

simon_data_erasure_identity_email: str,
) -> Generator:
# create the data needed for erasure tests here
yield {}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Does Simon Data allow us to submit an erasure request if we don't have any data for the erasure identity email?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I believe the request succeeded fine, I tested it with an email that shouldn't have existed but will re-verify

SteveDMurphy and others added 2 commits July 24, 2023 21:25
@codecov
Copy link

codecov bot commented Jul 24, 2023

Codecov Report

Patch and project coverage have no change.

Comparison is base (6a446d1) 87.18% compared to head (923d7b9) 87.18%.
Report is 3 commits behind head on main.

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #3705   +/-   ##
=======================================
  Coverage   87.18%   87.18%           
=======================================
  Files         317      317           
  Lines       19350    19350           
  Branches     2485     2485           
=======================================
  Hits        16870    16870           
  Misses       2049     2049           
  Partials      431      431           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@SteveDMurphy
Copy link
Contributor Author

closing in favor of #4552

@SteveDMurphy SteveDMurphy deleted the SteveDMurphy-3699-simon-data-connector branch March 11, 2024 22:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
run unsafe ci checks Runs fides-related CI checks that require sensitive credentials
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Connector for Simon Data
2 participants