6 Commits

Author	SHA1	Message	Date
Ryan Petrello	ff1e8cc356	replace celery task decorators with a kombu-based publisher ... this commit implements the bulk of `awx-manage run_dispatcher`, a new command that binds to RabbitMQ via kombu and balances messages across a pool of workers that are similar to celeryd workers in spirit. Specifically, this includes: - a new decorator, `awx.main.dispatch.task`, which can be used to decorate functions or classes so that they can be designated as "Tasks" - support for fanout/broadcast tasks (at this point in time, only `conf.Setting` memcached flushes use this functionality) - support for job reaping - support for success/failure hooks for job runs (i.e., `handle_work_success` and `handle_work_error`) - support for auto scaling worker pool that scale processes up and down on demand - minimal support for RPC, such as status checks and pool recycle/reload	2018-10-11 10:53:30 -04:00
Matthew Jones	3892e4e389	Tower -> AWX Tooling Migration ... * Switching version number scheme and mechanism * Refactor development tooling towards 'awx' paths and names * Purging packaging details from Makefile	2017-07-21 17:06:45 -04:00
Matthew Jones	9f777f6153	Add some provisions for https into haproxy and the cluster	2017-01-03 13:59:29 -05:00
Matthew Jones	2872409271	Integrate rabbitmqctl interface to cluster and standalone containers	2016-09-15 12:07:16 -04:00
Matthew Jones	807cced571	Implement a more dynamic celery queue system ... * Meant to be a starting point to more efficiently manage work routing and to balance work across all tower nodes * Integrate flower as a dev tool that starts alongside other nodes. Helpful for observing and monitoring the queues/exchanges * For the moment, force the task manager to only run on one node (not sure if this is needed) * Define queues and routes for all task work * Bump celery version to 3.1.23 * Expose flower through haproxy	2016-09-09 15:18:18 -04:00
Matthew Jones	ebf103f345	Initial Docker Compose workflow for Tower cluster ... The goal is to share a common pattern with the existing development work	2016-09-08 10:18:14 -04:00