» Appropriate approach for MQ tasks in Django
Appropriate approach for MQ tasks in Django
|July 2, 2014
Posted by forumadmin
I’m wondering what criteria would need to be considered when we need to use some kind of task queue in a django project, I’m thinking in performace, development speed, flexibility, etc.
I’ve been using Celery+RabbitMQ and Django-ztask+ZeroMQ indistinctly for a while (I’m sure there are another good ones), but I haven’t an accurate canon for picking up the most suitable in each case.
Could you provide some peculiarities for each of them that allows the user chooses between them?, does it might include some another stable MQ approaches as well?
More Related Questions
- Celery multi with queues set up not receiving tasks from django I am running my workers with the following command:
celery -A myapp multi start 4 -l debug -Q1:3 queue1,queue2 -Q:4 queue3
The workers start out very well so when i run
- How to apply Celery signals to a group of tasks I want to do some processing before and after a group of tasks is run. I know I can connect a single task to task_prerun and task_postrun signals, but I'm using task.chunks and need to […]
- Cancel an already executing task with Celery? I am new to Django and Celery. I have been reading the doc and searching but cannot seem to find a straight answer:
Can you cancel an already executing task? (as in the task has started, […]
- Understanding difference between celery and celery milti? When I run Celery with one worker with celery worker -A myapp -l info, everything is fine, tasks are performed.
But when I run celery multi start 2 -Q:1 message_send -Q:2 message_manager […]
- Shared XMPP connection between Celery workers My web app needs to be able to send XMPP messages (Facebook Chat), and I thought Celery might be a good solution for this. A task would consist of querying the database and sending the […]
- Whats the advantage of using celery with rabbitmq over Redis, MongoDB or Django ORM) Is there a speed advantage, functionality advantage?
Also using Django ORM (mysql), is it a lot slower than using rabbitmq, mongodb or redis?
Im currently hosting on webfaction, and […]
- celery save task to database so in my previous project i used django-celery but in my current project i am using celery because djcelery THIS PROJECT IS NO LONGER REQUIRED
Im using Redis as my backend, and i would […]
- django celery redis error ValueError: invalid literal for int() with base 10: OK I keep getting the error "ValueError: invalid literal for int() with base 10: 'OK'" when I am trying to run a delayed task with celery with redis in django. Could some show me what is […]
- CPU Concurrency behavior with celery task that calls a subprocess I have a celery task which uses subprocess.Popen() to call out to an executable which does some CPU-intensive data crunching. It works well but does not take full advantage of the celery […]
- Best Practices for running celery on heroku Lets say I have the following processes declared in my Procfile
web: newrelic-admin run-program python manage.py run_gunicorn -b 0.0.0.0:$PORT -w 9 -k gevent --max-requests 250 --preload […]