RuntimeError: asyncio.run() cannot be called from a running event loop

[fangzhangmnm]

crawl4ai version

0.4.247

Expected Behavior

When running the demo code from jupyter notebook

import asyncio
from crawl4ai import AsyncWebCrawler, BrowserConfig, CrawlerRunConfig, CacheMode

async def main():
    # Configure browser
    browser_config = BrowserConfig(headless=True, verbose=True)

    # Set crawl run configurations
    crawl_config = CrawlerRunConfig(cache_mode=CacheMode.BYPASS)

    # Use AsyncWebCrawler
    async with AsyncWebCrawler(browser_config=browser_config) as crawler:
        result = await crawler.arun(
            url="https://www.example.com",
            config=crawl_config
        )
        print("Success:", result.success)

asyncio.run(main())

it should reproduce the demo result

Current Behavior

instead, one get RuntimeError: asyncio.run() cannot be called from a running event loop

[161](file:///D:/miniconda3/Lib/asyncio/runners.py:161) """Execute the coroutine and return the result.
    [162](file:///D:/miniconda3/Lib/asyncio/runners.py:162) 
    [163](file:///D:/miniconda3/Lib/asyncio/runners.py:163) This function runs the passed coroutine, taking care of
   (...)
    [182](file:///D:/miniconda3/Lib/asyncio/runners.py:182)     asyncio.run(main())
    [183](file:///D:/miniconda3/Lib/asyncio/runners.py:183) """
    [184](file:///D:/miniconda3/Lib/asyncio/runners.py:184) if events._get_running_loop() is not None:
    [185](file:///D:/miniconda3/Lib/asyncio/runners.py:185)     # fail fast with short traceback
--> [186](file:///D:/miniconda3/Lib/asyncio/runners.py:186)     raise RuntimeError(
    [187](file:///D:/miniconda3/Lib/asyncio/runners.py:187)         "asyncio.run() cannot be called from a running event loop")
    [189](file:///D:/miniconda3/Lib/asyncio/runners.py:189) with Runner(debug=debug) as runner:
    [190](file:///D:/miniconda3/Lib/asyncio/runners.py:190)     return runner.run(main)

RuntimeError: asyncio.run() cannot be called from a running event loop

Is this reproducible?

Yes

Inputs Causing the Bug

Steps to Reproduce

Code snippets

OS

Windows

Python version

3.11.5

Browser

No response

Browser version

No response

Error logs & Screenshots (if applicable)

No response

[mohahf19]

it depends on the IPython version. New IPython versions (>= 7.0) run in an asynchronous context which is why it raises the cannot be called from a running event loop and older versions run in a synchronous context and then you would need to use asyncio.run

could you try the following:

await main()

instead of

asyncio.run(main())

[unclecode]

@fangzhangmnm Please run the following code in notebook:

import nest_asyncio
nest_asyncio.apply()

Also try the recent version pip install crawl4ai==0.4.300b4