Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Scraping subreddit comments from Pushshift API not working #134

Open
MarieSrsr opened this issue Jan 18, 2023 · 0 comments
Open

Scraping subreddit comments from Pushshift API not working #134

MarieSrsr opened this issue Jan 18, 2023 · 0 comments

Comments

@MarieSrsr
Copy link

I have seen several comments on this subject, does anyone have an answer why the API is not working anymore ?

I have been trying with this :

getPushshiftData2 = function (postType, ...) {
if (postType == "comment") {
getPushshiftURL(postType, ...) %>% jsonlite::fromJSON() %>%
.$data %>% jsonlite::flatten(recursive = TRUE) %>%
select(author, title, selftext, created_utc, id,
num_comments, score, subreddit) %>% as_tibble()
}
else {
getPushshiftURL(postType, ...) %>% jsonlite::fromJSON() %>%
.$data %>% jsonlite::flatten(recursive = TRUE) %>%
select(author, body, parent_id, score, created_utc, id,
subreddit) %>% as_tibble()
}
}

and save the date in conversion date to epoch

And all I get is empty files with the same date. There seems also to be a problem with the conversion between date to epoch conversion.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant