Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DeviantArt Favorites Gallery #826

Closed
ghost opened this issue Jul 24, 2018 · 8 comments
Closed

DeviantArt Favorites Gallery #826

ghost opened this issue Jul 24, 2018 · 8 comments

Comments

@ghost
Copy link

ghost commented Jul 24, 2018

  • Ripme version:
  • Java version: 1.8
  • Operating system: Windows 10
  • Exact URL you were trying to rip when the problem occurred:

https://www.deviantart.com/kerbal69/favourites/

  • Please include any additional information about how to reproduce the problem:

Expected Behavior

Expected to download the gallery found on the website DeviantArt

Actual Behavior

RipMe is appears to be unable to process the url (I am assuming related to the domain changes done to deviantart in the recent history). Exact error message is:

" Expected URL format: http://www,deviantart.com/username[/gallery/#####], got: https://www.deviantart.com/kerbal69/favourites/gallery "

(Sorry if this is a duplicate post, I could not find any with similar problems to this.)
If you need anymore information please let me know.

@RevStrangeHope
Copy link

Is there any update on this issue? I been trying to find a way to backup my favorites

@cyian-1756
Copy link
Collaborator

Is there any update on this issue?

Nope. Unfortunately DeviantArt is a total pain to work with so no one has managed to get the ripper working well

@rautamiekka
Copy link
Contributor

Is there any update on this issue?

Nope. Unfortunately DeviantArt is a total pain to work with so no one has managed to get the ripper working well

Please explain.

@cyian-1756
Copy link
Collaborator

@rautamiekka

They have insane rate limiting on requests for the api

Even if your using the api you still have to do some html scraping to get a photos UUID (Which makes the entire api pointless)

It's a pain and a half getting a full sized image

They make you log in to view some things which makes development a pain (No one likes handling cookies)

I could go on but this explains it nicely

@rautamiekka
Copy link
Contributor

@rautamiekka

They have insane rate limiting on requests for the api

Even if your using the api you still have to do some html scraping to get a photos UUID (Which makes the entire api pointless)

It's a pain and a half getting a full sized image

They make you log in to view some things which makes development a pain (No one likes handling cookies)

I could go on but this explains it nicely

Gotta admit, that's bad, and not just pretty bad, it's really bad.

I had been coding the program part itself of a DA toolkit in Python which'd do many things but I can't find the code anywhere anymore, and although I had already decided to resort to HTML and JSON scraping it might be a whole lot of problems getting it to work, especially without the help of Seledium ...

@rautamiekka
Copy link
Contributor

@rautamiekka

They have insane rate limiting on requests for the api

Even if your using the api you still have to do some html scraping to get a photos UUID (Which makes the entire api pointless)

It's a pain and a half getting a full sized image

They make you log in to view some things which makes development a pain (No one likes handling cookies)

I could go on but this explains it nicely

I don't suppose you'd write down somewhere everything you know about the process of ripping DA favs, please ? I'm sure you know a whole heap of details about DA favs inner workings, so/and everything you got would help everyone come up with any kinda solution.

@cyian-1756
Copy link
Collaborator

I just merged #1168 so at least ripme now recognizes favourites galleries but it still can't ripme them

I should be able to get this working in a day or so but first I have to deal with a a bug that made it into master

@metaprime
Copy link
Contributor

[Mega-Thread] DeviantArt ripper is broken; yes we know -- de-duping all other DeviantArt issues to this one. #2063

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

5 participants