There is a built-in functionality to ignore result in chaining and others – immutable subtask. You can use .si() shortcut instead of .s() or .subtask(immutable=True) More details here: http://docs.celeryproject.org/en/master/userguide/canvas.html#immutability
Celery 4.0+ does not officially support window already. But it still works on window for some development/test purpose. Use eventlet instead as below: pip install eventlet celery -A <module> worker -l info -P eventlet It works for me on window 10 + celery 4.1 + python 3. This solution solved the following exception: [2017-11-16 21:19:46,938: … Read more
Quoting Ask from celery-users thread where he explained difference between @task a @shared_task. Here is link to the thread TL;DR; @shared_task will create the independent instance of the task for each app, making task reusable. There is a difference between @task(shared=True) and @shared_task The task decorator will share tasks between apps by default so that … Read more
Update: We’ve since started using a better way to handle application teardown and set up on a per-task basis, based on the pattern described in the more recent flask documentation. extensions.py import flask from flask.ext.sqlalchemy import SQLAlchemy from celery import Celery class FlaskCelery(Celery): def __init__(self, *args, **kwargs): super(FlaskCelery, self).__init__(*args, **kwargs) self.patch_task() if ‘app’ in kwargs: … Read more
I’ve been using cron for a production website, and have switched to celery on a current project. I’m far more into celery than cron, here is why: Celery + Celerybeat has finer granularity than cron. Cron cannot run more than once a minute, while celery can (I have a task run every 90 seconds which … Read more
According to https://docs.celeryq.dev/en/stable/userguide/workers.html#restarting-the-worker you can restart a worker by sending a HUP signal ps auxww | grep celeryd | grep -v “grep” | awk ‘{print $2}’ | xargs kill -HUP
I wrote Dramatiq specifically because of my increasing frustration with Celery having used it professionally for years. Check out the motivation page the “why” and a feature comparison between Dramatiq, Celery and RQ. Some highlights: actively developed and used in production great docs automatic retries code auto-reload locks and rate limiting redis and rabbitmq support
Celery does not write a state when the task is sent, this is partly an optimization (see the documentation). If you really need it, it’s simple to add: from celery import current_app # `after_task_publish` is available in celery 3.1+ # for older versions use the deprecated `task_sent` signal from celery.signals import after_task_publish # when using … Read more