-
Notifications
You must be signed in to change notification settings - Fork 159
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
JAVLibrary scrape not working. #338
Comments
same (cloudflare protection web) org.jsoup.HttpStatusException: HTTP error fetching URL. Status=403, URL=http://www.r18.com/common/search/floor=movies/searchword=SDAB00004/ |
Right now Javlibrary is working again! Time: 4.30 PM (German Time), Date: 19th October 2020. I am using the fork from User zuko7177 from the post in Issue #335. |
Can confirm, seems to be working again. I don't see anything different in the source though, so it's possible JavLibrary relaxed their cloudfare policy. |
Describe the bug
As of yesterday, it looks like JavLibrary scrapes are not working. As a preface, I have a python script that runs before downloading any torrent files. This script takes the JAV ID in the torrent and attempts to fetch a user rating from JavLibrary. It then downloads the torrent if it's above a certain rating. Monday evening, I found that script stopped working because JavLibrary either enabled or increased Cloudfare protection (my request.get in my script started returning 503s). I haven't been able to get that script to work since. Now, I had some JAV video files already downloaded that sill needed to be scraped. I found that I wasn't getting any response scraping with JavLibrary. I wonder if it's connected somehow? I'm no Java expert by any means, but I'm assuming it's possible for Cloudfare to thwart programs like this?
Give an example
Any file scraped with just JavLibrary comes up blank. I even tested older files that had already been successfully scraped (by renaming them back to the original ID) with no success.
The text was updated successfully, but these errors were encountered: