[go: nahoru, domu]

Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🐛 Source Hubspot : Fix engagements streams associations configurations #43381

Conversation

kev-datams
Copy link
Contributor
@kev-datams kev-datams commented Aug 8, 2024

What

Partially fixes #43352
-> if state is filled, the Incremental sync was not properly retrieving Deals and Companies associations for all Engagements specific streams (emails, calls, meetings, tasks, notes).

NB: it will not solve the third point: I also noticed in the stream logs a schema validation error specific to the contacts (eg: Schema validation errors found for stream _engagements_meetings. Error messages: [$.contacts[2]: integer found, [null, string] expected, $.contacts[1]: integer found, [null, string] expected, $.contacts[0]: integer found, [null, string] expected])
=> perhaps adding a str() somewhere in the code ? 🤔

How

Fix the associations configuration of EngagementsXxx Python classes to use plural (the same way it was used for Contacts that properly worked)

Review guide

  • stream.py is the only impacted file

User Impact

Collected data quality improved ❤️

Can this PR be safely reverted and rolled back?

  • YES 💚
  • NO ❌

Copy link
vercel bot commented Aug 8, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
airbyte-docs ✅ Ready (Inspect) Visit Preview 💬 Add feedback Aug 18, 2024 10:24pm

@aldogonzalez8
Copy link
Contributor

@kev-datams The Changes make sense to me. I just wanted to check the regression results, but we have some problem rendering them for now. I will check if I can get that fixed.

In the meantime, some unit tests are broken, probably because of the change In the requests. Can you take a look at those?

image

@aldogonzalez8
Copy link
Contributor

@kev-datams The Changes make sense to me. I just wanted to check the regression results, but we have some problem rendering them for now. I will check if I can get that fixed.

In the meantime, some unit tests are broken, probably because of the change In the requests. Can you take a look at those?

image

Also please when fixing the test rebase from master, seems is what we need to have regression working on the branch. Thanks!

@kev-datams
Copy link
Contributor Author

Hi @aldogonzalez8,
Just fixed the unit tests, no remaining failure right now 👍
Also rebased from master as requested
Please could you have a look and accept/merge ASAP ? 🙏

NB: any idea about the complementary fix on the "third point" of the issue ?

@aldogonzalez8
Copy link
Contributor
aldogonzalez8 commented Aug 17, 2024

Hi @kev-datams, there was a problem in unit tests unrelated to your changes that I just fixed. Can you please rebase from master again? I will rerun tests after that.

@kev-datams
Copy link
Contributor Author
kev-datams commented Aug 18, 2024

Hi @kev-datams, there was a problem in unit tests unrelated to your changes that I just fixed. Can you please rebase from master again? I will rerun tests after that.

Hi @aldogonzalez8, done 🙏

All checks have passed
12 skipped and 21 successful checks

🔥

@aldogonzalez8
Copy link
Contributor

@kev-datams I was just informed that regression won't work in the CI process for a fork, but I can clone your repository locally and run regression from here. Your changes seem pretty straightforward, but I want to be sure. I will get back to you on this.

@kev-datams
Copy link
Contributor Author

@kev-datams I was just informed that regression won't work in the CI process for a fork, but I can clone your repository locally and run regression from here. Your changes seem pretty straightforward, but I want to be sure. I will get back to you on this.

@aldogonzalez8, do you know if there is any alternative on our side to save time for future PR and limit workload on your side?

but OK, waiting for your confirmation to merge 🙏

@aldogonzalez8
Copy link
Contributor

Sorry for the delay, I can see your changes in the regressions report, and the response data seems now contain info related to the request :)

image

Copy link
Contributor
@aldogonzalez8 aldogonzalez8 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

APPROVED

@kev-datams
Copy link
Contributor Author

APPROVED

thanks @aldogonzalez8 🔥
what is the next step to merge it and generate the updated connector ?

@aldogonzalez8
Copy link
Contributor

If squash and merge available for you? If not, maybe it is something I have to push.

@kev-datams
Copy link
Contributor Author

If squash and merge available for you? If not, maybe it is something I have to push.

image Unfortunately, I am not granted...

@aldogonzalez8 aldogonzalez8 merged commit 9d3bcd8 into airbytehq:master Aug 19, 2024
34 checks passed
@kev-datams kev-datams deleted the fix/source-hubspot-engagements-associations branch August 19, 2024 18:54
@aldogonzalez8
Copy link
Contributor

Ok, I just merged, the new version should be available in a few minutes.

@kev-datams
Copy link
Contributor Author

Thanks a lot !

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

🐛 [source-hubspot] Engagements associations not retrieved in Incremental sync
4 participants