More complex examples

[geopet85]

Hi, thank you for the efforts you put on the project. I personally use it for a toy ETL project I am currently working on, but I think more complex examples and topics are needed to convince people to start using it. 😄
Some suggestions:

• Could you add a more production-like setup and usage? Some complex functions besides printing text but doing some actual asynchronous function.
• Could you please add an example on the usage of RetryWithBackoffEntrypointExecutor? The documentation page seems incomplete without one.

[janbjorge]

Hi @geopet85 ,

Thanks for the kind words and for sharing your feedback! It’s awesome to hear you’re using PGQueuer for your ETL project.

• Production-like setup: I totally get the need for more complex, real-world examples. My use case is pretty simple, so I’ll try to come up with something meaningful without making it feel too “made up.” Maybe something like API calls or database interactions could work.
• RetryWithBackoffEntrypointExecutor example: You’re spot on—this needs more explanation. I’ll prioritize adding an example to show how it works in a retry scenario.

Appreciate the suggestions! If you’ve got specific ideas or use cases in mind, let me know, and I’ll see what I can do.

Cheers,
JB

[geopet85]

Appreciate the suggestions! If you’ve got specific ideas or use cases in mind, let me know, and I’ll see what I can do.

I think the biggest issue I had so far was handling of db restarts. The pgqueuer couldn't reconnect or tasks were stuck on picked state (because db restart was in the middle of a task run) and couldn't move forward or reset anyhow except with manual intervention. I saw that you try to address those in other PRs, feel free to include proper examples in the documentation or examples about it.
In general anything that makes pgqueuer more robust to hard or intermittent failures will be appreciated.

As for the CLI, I believe a find/filter function will strengthen its usability. e.g. I want to search all running tasks for a particular search text (some parameter in the payload). Similar to task filtering in flower.