awx/tools/docker-compose.yml

version: '3'
services:
  # Primary AWX Development Container
  awx:
    image: ${DEV_DOCKER_TAG_BASE}/awx_devel:${TAG}
    hostname: awx
    environment:
      RABBITMQ_HOST: rabbitmq
      RABBITMQ_USER: guest
      RABBITMQ_PASS: guest
      RABBITMQ_VHOST: /
      CELERY_RDB_HOST: 0.0.0.0
      AWX_GROUP_QUEUES: tower
    ports:
      - "8888:8888"
      - "8080:8080"
      - "5555:5555"
      - "8013:8013"
      - "8043:8043"
      - "6899-6999:6899-6999"  # default port range for celery.contrib.rdb
    links:
      - postgres
      - memcached
      - rabbitmq
      - logstash
    #   - sync
    # volumes_from:
    #   - sync
    volumes:
      - "../:/awx_devel"
    privileged: true
  logstash:
    build:
      context: ./docker-compose
      dockerfile: Dockerfile-logstash
  # Postgres Database Container
  postgres:
    image: postgres:9.6
  memcached:
    image: memcached:alpine
    ports:
      - "11211:11211"
  rabbitmq:
    image: rabbitmq:3-management
    ports:
      - "15672:15672"
Adding logstash to default compose file 2017-03-07 20:05:12 +03:00			`version: '3'`
Updating docker dev workflow * Moving to new docker compose file format * Adding some things that will be needed for python dependencies 2016-06-08 19:25:14 +03:00			`services:`
Tower -> AWX Tooling Migration * Switching version number scheme and mechanism * Refactor development tooling towards 'awx' paths and names * Purging packaging details from Makefile 2017-07-18 18:16:18 +03:00			`# Primary AWX Development Container`
			`awx:`
Updating development tooling to be more generic * Not assuming GCR is being used for image hosting * Breaking out the dev environment bootstrapping from service starting 2017-08-09 22:53:25 +03:00			`image: ${DEV_DOCKER_TAG_BASE}/awx_devel:${TAG}`
Tower -> AWX Tooling Migration * Switching version number scheme and mechanism * Refactor development tooling towards 'awx' paths and names * Purging packaging details from Makefile 2017-07-18 18:16:18 +03:00			`hostname: awx`
Initial Docker Compose workflow for Tower cluster The goal is to share a common pattern with the existing development work 2016-09-08 17:18:14 +03:00			`environment:`
			`RABBITMQ_HOST: rabbitmq`
			`RABBITMQ_USER: guest`
			`RABBITMQ_PASS: guest`
Docker compose improvements * Make sure we explicitly set a hostname for tower nodes * Switch rabbit vhost to use the root 2016-09-08 18:02:51 +03:00			`RABBITMQ_VHOST: /`
map docker container ports to allow usage of celery.contrib.rdb http://docs.celeryproject.org/en/latest/reference/celery.contrib.rdb.html allows you to remotely debug running celery tasks with: from celery.contrib import rdb rdb.set_trace() this will bind a remote Python debugger on a random TCP port between 6899-6999, which you can telnet into for remote task debugging 2017-01-31 01:39:04 +03:00			`CELERY_RDB_HOST: 0.0.0.0`
specify all group queues, get supervisor working 2017-08-10 21:56:46 +03:00			`AWX_GROUP_QUEUES: tower`
Updating docker dev workflow * Moving to new docker compose file format * Adding some things that will be needed for python dependencies 2016-06-08 19:25:14 +03:00			`ports:`
Adding jupyter notebook support to the AWX development environment * Jupyter starts alongside the other awx services and is available on 0.0.0.0:8888 * make target: make jupyter * default settings in settings/development.py * Added jupyter, matplotlib, numpy to dev dependencies 2017-12-06 07:46:18 +03:00			`- "8888:8888"`
Updating docker dev workflow * Moving to new docker compose file format * Adding some things that will be needed for python dependencies 2016-06-08 19:25:14 +03:00			`- "8080:8080"`
Implement a more dynamic celery queue system * Meant to be a starting point to more efficiently manage work routing and to balance work across all tower nodes * Integrate flower as a dev tool that starts alongside other nodes. Helpful for observing and monitoring the queues/exchanges * For the moment, force the task manager to only run on one node (not sure if this is needed) * Define queues and routes for all task work * Bump celery version to 3.1.23 * Expose flower through haproxy 2016-09-09 22:18:18 +03:00			`- "5555:5555"`
Update tower_tools image to run nginx 2016-10-18 18:16:38 +03:00			`- "8013:8013"`
			`- "8043:8043"`
map docker container ports to allow usage of celery.contrib.rdb http://docs.celeryproject.org/en/latest/reference/celery.contrib.rdb.html allows you to remotely debug running celery tasks with: from celery.contrib import rdb rdb.set_trace() this will bind a remote Python debugger on a random TCP port between 6899-6999, which you can telnet into for remote task debugging 2017-01-31 01:39:04 +03:00			`- "6899-6999:6899-6999" # default port range for celery.contrib.rdb`
Updating docker dev workflow * Moving to new docker compose file format * Adding some things that will be needed for python dependencies 2016-06-08 19:25:14 +03:00			`links:`
			`- postgres`
Initial qpid development work * Switch base tower devel image from u14.04 to c7 * Switch container image to build python dependencies into itself instead of forcing it to be built on startup * Upgrade venv pip to 8.1.2 * Neuter queue.py which was heavily tied to redis and was basically orphaned code * Alter local_settings to override default cache settings and use memcached * Alter local settings to refer to qpid instead of redis for celery broker * Purge redis python dependencies and add qpid and memcached * Update docker-compose to purge redis and add qpid and memcached 2016-08-24 23:23:47 +03:00			`- memcached`
Merge branch 'ramparts_and_ha' into devel * ramparts_and_ha: Removing qpid from deb packaging Refactor rabbitmq role Integrate memcached into setup playbook Remove mongodb shutdown task Remove dependency on erlang_sd_notify Add initial rabbitmq role Initial rabbitmq setup playbook integration Update development environment for rabbit Replace qpid with rabbitmq Remove redis role from setup playbook Update qpid packaging, remove migrations Integrate packaging for qpid/memcached 2016-09-06 16:47:11 +03:00			`- rabbitmq`
Adding logstash to default compose file 2017-03-07 20:05:12 +03:00			`- logstash`
Updating docker dev workflow * Moving to new docker compose file format * Adding some things that will be needed for python dependencies 2016-06-08 19:25:14 +03:00			`# - sync`
			`# volumes_from:`
			`# - sync`
			`volumes:`
Tower -> AWX Tooling Migration * Switching version number scheme and mechanism * Refactor development tooling towards 'awx' paths and names * Purging packaging details from Makefile 2017-07-18 18:16:18 +03:00			`- "../:/awx_devel"`
turn job templates in jobs via launch 2016-08-30 22:04:21 +03:00			`privileged: true`
Adding logstash to default compose file 2017-03-07 20:05:12 +03:00			`logstash:`
			`build:`
			`context: ./docker-compose`
			`dockerfile: Dockerfile-logstash`
Updating docker dev workflow * Moving to new docker compose file format * Adding some things that will be needed for python dependencies 2016-06-08 19:25:14 +03:00			`# Postgres Database Container`
			`postgres:`
Implementing models for instance groups, updating task manager * New InstanceGroup model and associative relationship with Instances * Associative instances between Organizations, Inventory, and Job Templates and InstanceGroups * Migrations for adding fields and tables for Instance Groups * Adding activity stream reference for instance groups * Task Manager Refactoring: Simplifying task manager relationships and move away from the interstitial hash tables Simplify dependency determination logic ** Reduce task manager runtime complexity by removing the partial references and moving the logic into the task manager directly or relying on Job model logic for determinism 2017-05-03 22:28:31 +03:00			`image: postgres:9.6`
Initial qpid development work * Switch base tower devel image from u14.04 to c7 * Switch container image to build python dependencies into itself instead of forcing it to be built on startup * Upgrade venv pip to 8.1.2 * Neuter queue.py which was heavily tied to redis and was basically orphaned code * Alter local_settings to override default cache settings and use memcached * Alter local settings to refer to qpid instead of redis for celery broker * Purge redis python dependencies and add qpid and memcached * Update docker-compose to purge redis and add qpid and memcached 2016-08-24 23:23:47 +03:00			`memcached:`
			`image: memcached:alpine`
map docker container ports to allow access easier to memcache this eases memcached interaction from your host, e.g., $ echo "get :1:LICENSE" \| nc localhost 11211 2017-02-09 19:00:06 +03:00			`ports:`
			`- "11211:11211"`
Merge branch 'ramparts_and_ha' into devel * ramparts_and_ha: Removing qpid from deb packaging Refactor rabbitmq role Integrate memcached into setup playbook Remove mongodb shutdown task Remove dependency on erlang_sd_notify Add initial rabbitmq role Initial rabbitmq setup playbook integration Update development environment for rabbit Replace qpid with rabbitmq Remove redis role from setup playbook Update qpid packaging, remove migrations Integrate packaging for qpid/memcached 2016-09-06 16:47:11 +03:00			`rabbitmq:`
			`image: rabbitmq:3-management`
Exposing rabbitmq management console interface on compose 2016-09-15 17:46:45 +03:00			`ports:`
			`- "15672:15672"`