Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DeviantArt Ripper not using the official API #1113

Closed
Shingedo opened this issue Dec 17, 2018 · 4 comments
Closed

DeviantArt Ripper not using the official API #1113

Shingedo opened this issue Dec 17, 2018 · 4 comments

Comments

@Shingedo
Copy link

After browsing the issues in regards to DeviantArt and encountering multiple issues like #1068, #892, #811, etc. and then diving into the code myself, I was pondering why the Ripper doesn't use the official API https://www.deviantart.com/developers/ ?

As far as I can see it currently uses an unofficial endpoint https://www.deviantart.com/dapi/v1/gallery/ which might be the reason for many issues, for example the issue of not being able to sort the pictures in the right order.

I was interested why that is before starting to implement a new Ripper based on the official API if someone else already encountered a "showstopper" with this approach.

@Hrxn
Copy link

Hrxn commented Dec 17, 2018

You sure that this is the new API?
As far as I know, dA was bought by website building company Wix a while ago, but they moved the whole site to their own CDN infrastructure or something only pretty recently.
I guess this is when these recent issues started to appear, because the old API might not work (properly) anymore.

The new API URL scheme looks something like this https://api-da.wixmp.com/_api/... from what I can see after a cursory glance.

@Shingedo
Copy link
Author

Shingedo commented Dec 17, 2018

Well I wouldn't call it "new", it has been around since 2014:
https://www.deviantart.com/muteor/journal/All-new-DeviantArt-API-492518964

The thing is the ripper never used it as far as i can see, it instead uses the internal logic of the gallery HTML page with POST requests to https://www.deviantart.com/dapi/v1/gallery/ which I personally couldn't really understand because i haven't found a reference to it anywhere. Even in HTML site, except a form for uploading that targets https://www.deviantart.com/dapi/v1/submit/upload

It is like this since 17a3e4e , so perhabs @cyian-1756 can shed some light on why he used it and where he found it.

Also where have you found information/references regarding this new API https://api-da.wixmp.com/_api ?

@Hrxn
Copy link

Hrxn commented Dec 18, 2018

Okay, just as I thought, this is not the new API then. You're probably right about RipMe and its utilization (or rather lack thereof) of said API, but there is at least one other project here on GitHub with support for dA, and this has been using the API so far, and as far as I know there have been some issues recently as well, maybe it is not even working properly at all right now.

Also where have you found information/references regarding this new AP

Well, I haven't seen any official documentation so far. The purchase of dA was in 2017, I think, you can still find the news about it by doing a simple web search. But the transition of their site backend has been not long ago, I've read about that too but I don't really know where. For this example URL I've just visited the dA main page and clicked through some artworks/deviations until I found one that had this Download button on the right-hand side of the page. The URL has been the resulting link from that button.

@metaprime
Copy link
Contributor

[Mega-Thread] DeviantArt ripper is broken; yes we know -- de-duping all other DeviantArt issues to this one. #2063

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants