Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP] Run coroutines in another thread for blocking API #67

Closed
wants to merge 1 commit into from
Closed

[WIP] Run coroutines in another thread for blocking API #67

wants to merge 1 commit into from

Conversation

davidbrochart
Copy link
Member

Trying to get rid of nest_asyncio (see nteract/papermill#490).

@davidbrochart
Copy link
Member Author

@MSeal this seems like the deadlock issue you were mentioning, test_many_parallel_notebooks hangs and it is the test which does multiprocessing.

@MSeal
Copy link
Contributor

MSeal commented May 26, 2020

Yep -- this is basically guaranteed with os threading ontop of forking at the same time because, among other reasons, the os replicates thread local context that's invalid.

@MSeal
Copy link
Contributor

MSeal commented May 26, 2020

Is there anyway we can apply or not apply nest_asyncio and catch the exception to switch modes automatically instead of introducing more concurrent patterns in-place?

@davidbrochart
Copy link
Member Author

Yes, we can try without nest_asyncio and if we catch the exception try again with it. Thanks, I'll open a PR.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants