Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

occ command for executing dataloads #16

Closed
juliusknorr opened this issue Jan 25, 2020 · 7 comments
Closed

occ command for executing dataloads #16

juliusknorr opened this issue Jan 25, 2020 · 7 comments
Assignees
Milestone

Comments

@juliusknorr
Copy link
Contributor

It would be great if scheduled data loading could be configured to run more often than hourly, e.g. with a cronjob scheduled every 5 minutes.

@Rello Rello self-assigned this Jan 25, 2020
@Rello Rello added this to the 2.1.0 milestone Jan 25, 2020
@Rello
Copy link
Owner

Rello commented Jan 25, 2020

Hallo Julius,

yes, I am planning to provide more flexibility here.
But this requests explains your need for #15 now :-)

@Rello
Copy link
Owner

Rello commented Jan 27, 2020

Hello @juliushaertl

currently i am registering a hourly and a daily execution to the cron backend.
potentially I could add 1/2 day or/and 15min execution. but this would add more jobs to cron.

The reason I go that route of registering separate jobs is that I can use the stock-framework which checks the last execution out of the box.
whenever one of the jobs is executed, I search which dataload applies to this d/h category.

to provide a fully flexible way would be to register only one job to every cron execution and develop my own time-checking implementation.

what is your view on this?

@juliusknorr
Copy link
Contributor Author

A different idea would be to have some kind of manual trigger mode, where you could just setup your own cronjob that then calls something like occ analytics:fetch so you can make the runs independent from the nextcloud cron.

@Rello
Copy link
Owner

Rello commented Jan 27, 2020

thats actually a nice idea. registering a command with a dataload-id as input parameter is pretty easy. I will look at it

@Rello Rello changed the title Allow scheduled dataloads to run more often occ command for executing dataloads Jan 27, 2020
@Rello Rello mentioned this issue Jan 27, 2020
31 tasks
@Rello Rello added datasource in progress development in progress labels Jan 27, 2020
@Rello
Copy link
Owner

Rello commented Jan 27, 2020

occ analytics:load 32

@Rello Rello added testing development finished; in testing and removed in progress development in progress labels Jan 27, 2020
Rello added a commit that referenced this issue Jan 27, 2020
Rello added a commit that referenced this issue Jan 27, 2020
@juliusknorr
Copy link
Contributor Author

awesome 🚀

@Rello Rello added pending release part of the next release version and removed testing development finished; in testing pending release part of the next release version labels Mar 10, 2020
@Rello Rello closed this as completed Mar 11, 2020
@Rello
Copy link
Owner

Rello commented Mar 11, 2020

v2.1.0 released

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants