Discussions

• 1 You must be logged in to vote

  ❓

  How to crawl a ReactJS/Native site?

  Novitsh asked Jan 30, 2025 in Forums - Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  ❓

  Crawling same url twice

  yesidc asked Jan 30, 2025 in Forums - Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  💬

  Smart/Agentic Crawler (Invite Collaboration)

  ✨ Enhancement Improvement on an existing feature

  unclecode started Nov 4, 2024 in General

  

  

  

  

  10
• 1 You must be logged in to vote

  ❓

  how to pass raw html to LLMExtractionStrategy?

  prorid3r asked Jan 30, 2025 in Forums - Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💡

  [Feature Request]: Expose CustomHTML2Text as class property in DefaultMarkdownGenerator

  ⚙️ New Feature requests that are still not reviewed

  dmurat started Jan 29, 2025 in Feature requests

  

  

  0
• 1 You must be logged in to vote

  ❓

  Cannot disable caching

  UnDesSix asked Jan 29, 2025 in Forums - Q&A · Answered

  

  

  1
• 3 You must be logged in to vote

  ❓

  Extracting image or video links

  ❓ Question Q&A

  Rm1n90 asked Jan 16, 2025 in Forums - Q&A · Closed · Unanswered

  

  

  

  

  7
• 1 You must be logged in to vote

  ❓

  Download files when doing multi-url crawling

  PhyAMR asked Jan 28, 2025 in Forums - Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  💡

  Can you make a llms.txt file for latest .md files

  ✨ Enhancement Improvement on an existing feature

  Kjdragan started Dec 7, 2024 in Feature requests

  

  

  

  

  2
• 1 You must be logged in to vote

  ❓

  save page elements like scripts, assets, images, styles with html offline

  mllife asked Jan 28, 2025 in Forums - Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💡

  Feature request: Opt out mechanisms

  slatian started Jan 7, 2025 in Feature requests

  

  

  

  

  2
• 1 You must be logged in to vote

  ❓

  RuntimeError: asyncio.run() cannot be called from a running event loop

  ❓ Question Q&A

  fangzhangmnm asked Jan 26, 2025 in Forums - Q&A · Unanswered

  

  

  

  

  2
• 2 You must be logged in to vote

  💡

  [Feature Request]: Show pipeline steps and ability to enable/disable

  ⚙️ New Feature requests that are still not reviewed

  marctorsoc started Jan 27, 2025 in Feature requests

  

  

  0
• 1 You must be logged in to vote

  ❓

  Am I using CrawlerRunConfig parameters correctly?

  pliny-TheElder asked Jan 27, 2025 in Forums - Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  💡

  [Feature Request]: Allow Playwright Selectors

  ⚙️ New Feature requests that are still not reviewed

  cjoecker started Jan 26, 2025 in Feature requests

  

  

  0
• 1 You must be logged in to vote

  💡

  [Feature Request]: Add image OCR

  ⚙️ New Feature requests that are still not reviewed

  cjoecker started Jan 26, 2025 in Feature requests

  

  

  0
• 1 You must be logged in to vote

  ❓

  Google Chrome or Mozilla Firefox?

  Snegovik777 asked Jan 24, 2025 in Forums - Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  ❓

  Wrong markup link format

  dopo70 asked Jan 24, 2025 in Forums - Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  ❓

  How to prevent generating internal links in resulting markdown

  dmurat asked Jan 22, 2025 in Forums - Q&A · Closed · Answered

  

  

  1
• 2 You must be logged in to vote

  ❓

  Enhancing Web Automation with Nodriver: An Alternative to Selenium and Playwright

  prokopis3 asked Jan 23, 2025 in Forums - Q&A · Closed · Answered

  

  

  1
• 1 You must be logged in to vote

  💡

  [Feature Request]: Adding custom request headers and login authentication form information

  ⚙️ New Feature requests that are still not reviewed

  coffeebabeCGG started Jan 24, 2025 in Feature requests · Closed

  

  

  1
• 2 You must be logged in to vote

  🏆

  Scrape exec compensation for S&P 500 companies from the SEC.

  aravindkarnam started Jan 15, 2025 in Challeges

  

  

  2
• 1 You must be logged in to vote

  ❓

  How to Remove Excess URLs from the Top of Generated Markdown?

  AliMoeen asked Jan 17, 2025 in Forums - Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  ❓

  The cache takes up too much disk space

  bigbrother666sh asked Jan 23, 2025 in Forums - Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💡

  [Feature Request]: Document underlying REST API

  ❓ Question Q&A

  ezynda3 started Jan 23, 2025 in Feature requests · Closed

  

  

  2