2019-10-31 04:42:06,232   DEBUG Dhanu => PING(20)
2019-10-31 04:42:06,934    INFO scheduling health checks:
2019-10-31 04:42:09,313    INFO scheduling jobs:
2019-10-31 04:42:09,316   DEBUG - qemu
2019-10-31 04:42:11,809   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:42:11,810   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:42:13,226    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:42:22,993    INFO [INIT] Dropping privileges
2019-10-31 04:42:22,993   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:42:22,993   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:42:22,995    INFO [INIT] Marking all workers as offline
2019-10-31 04:42:23,028    INFO [INIT] LAVA master has started.
2019-10-31 04:42:23,028    INFO [INIT] Using protocol version 3
2019-10-31 04:42:26,702   DEBUG Dhanu => PING(20)
2019-10-31 04:42:26,703 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:42:32,652   DEBUG lava-logs => PING(20)
2019-10-31 04:42:43,039    INFO scheduling health checks:
2019-10-31 04:42:43,071    INFO scheduling jobs:
2019-10-31 04:42:43,073   DEBUG - qemu
2019-10-31 04:42:43,133   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:42:43,133   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:42:43,138    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:42:44,315    INFO [INIT] Dropping privileges
2019-10-31 04:42:44,315   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:42:44,315   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:42:44,317    INFO [INIT] Marking all workers as offline
2019-10-31 04:42:44,375    INFO [INIT] LAVA master has started.
2019-10-31 04:42:44,375    INFO [INIT] Using protocol version 3
2019-10-31 04:42:46,720   DEBUG Dhanu => PING(20)
2019-10-31 04:42:46,721 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:42:52,672   DEBUG lava-logs => PING(20)
2019-10-31 04:43:04,379    INFO scheduling health checks:
2019-10-31 04:43:04,407    INFO scheduling jobs:
2019-10-31 04:43:04,408   DEBUG - qemu
2019-10-31 04:43:04,481   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:43:04,481   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:43:04,486    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:43:05,825    INFO [INIT] Dropping privileges
2019-10-31 04:43:05,826   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:43:05,826   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:43:05,827    INFO [INIT] Marking all workers as offline
2019-10-31 04:43:05,853    INFO [INIT] LAVA master has started.
2019-10-31 04:43:05,853    INFO [INIT] Using protocol version 3
2019-10-31 04:43:06,737   DEBUG Dhanu => PING(20)
2019-10-31 04:43:06,738 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:43:12,688   DEBUG lava-logs => PING(20)
2019-10-31 04:43:25,867    INFO scheduling health checks:
2019-10-31 04:43:25,897    INFO scheduling jobs:
2019-10-31 04:43:25,899   DEBUG - qemu
2019-10-31 04:43:25,973   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:43:25,974   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:43:25,985    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:43:27,103    INFO [INIT] Dropping privileges
2019-10-31 04:43:27,103   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:43:27,103   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:43:27,105    INFO [INIT] Marking all workers as offline
2019-10-31 04:43:27,144    INFO [INIT] LAVA master has started.
2019-10-31 04:43:27,144    INFO [INIT] Using protocol version 3
2019-10-31 04:43:27,278   DEBUG Dhanu => PING(20)
2019-10-31 04:43:27,278 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:43:32,707   DEBUG lava-logs => PING(20)
2019-10-31 04:43:47,158    INFO scheduling health checks:
2019-10-31 04:43:47,200    INFO scheduling jobs:
2019-10-31 04:43:47,203   DEBUG - qemu
2019-10-31 04:43:47,282   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:43:47,282   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:43:47,292    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:43:48,534    INFO [INIT] Dropping privileges
2019-10-31 04:43:48,534   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:43:48,534   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:43:48,536    INFO [INIT] Marking all workers as offline
2019-10-31 04:43:48,568    INFO [INIT] LAVA master has started.
2019-10-31 04:43:48,568    INFO [INIT] Using protocol version 3
2019-10-31 04:43:48,670   DEBUG Dhanu => PING(20)
2019-10-31 04:43:48,671 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:43:52,723   DEBUG lava-logs => PING(20)
2019-10-31 04:44:08,585    INFO scheduling health checks:
2019-10-31 04:44:08,613    INFO scheduling jobs:
2019-10-31 04:44:08,615   DEBUG - qemu
2019-10-31 04:44:08,688   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:44:08,688   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:44:08,693    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:44:09,795    INFO [INIT] Dropping privileges
2019-10-31 04:44:09,795   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:44:09,795   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:44:09,797    INFO [INIT] Marking all workers as offline
2019-10-31 04:44:09,871    INFO [INIT] LAVA master has started.
2019-10-31 04:44:09,872    INFO [INIT] Using protocol version 3
2019-10-31 04:44:12,738   DEBUG lava-logs => PING(20)
2019-10-31 04:44:28,714   DEBUG Dhanu => PING(20)
2019-10-31 04:44:28,714 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:44:29,873    INFO scheduling health checks:
2019-10-31 04:44:29,892    INFO scheduling jobs:
2019-10-31 04:44:29,894   DEBUG - qemu
2019-10-31 04:44:29,964   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:44:29,964   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:44:29,969    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:44:31,027    INFO [INIT] Dropping privileges
2019-10-31 04:44:31,027   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:44:31,027   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:44:31,029    INFO [INIT] Marking all workers as offline
2019-10-31 04:44:31,062    INFO [INIT] LAVA master has started.
2019-10-31 04:44:31,062    INFO [INIT] Using protocol version 3
2019-10-31 04:44:32,752   DEBUG lava-logs => PING(20)
2019-10-31 04:44:48,736   DEBUG Dhanu => PING(20)
2019-10-31 04:44:48,737 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:44:51,064    INFO scheduling health checks:
2019-10-31 04:44:51,094    INFO scheduling jobs:
2019-10-31 04:44:51,096   DEBUG - qemu
2019-10-31 04:44:51,167   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:44:51,167   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:44:51,172    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:44:52,284    INFO [INIT] Dropping privileges
2019-10-31 04:44:52,284   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:44:52,284   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:44:52,285    INFO [INIT] Marking all workers as offline
2019-10-31 04:44:52,330    INFO [INIT] LAVA master has started.
2019-10-31 04:44:52,330    INFO [INIT] Using protocol version 3
2019-10-31 04:44:52,765   DEBUG lava-logs => PING(20)
2019-10-31 04:46:16,990   DEBUG Dhanu => PING(20)
2019-10-31 04:46:16,990 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:46:17,028   ERROR [STATE] lava-logs goes OFFLINE
2019-10-31 04:46:17,039 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 04:46:21,020   DEBUG lava-logs => PING(20)
2019-10-31 04:46:37,008   DEBUG Dhanu => PING(20)
2019-10-31 04:46:37,043    INFO scheduling health checks:
2019-10-31 04:46:37,063    INFO scheduling jobs:
2019-10-31 04:46:37,065   DEBUG - qemu
2019-10-31 04:46:37,142   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:46:37,142   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:46:37,150    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:46:38,574    INFO [INIT] Dropping privileges
2019-10-31 04:46:38,574   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:46:38,574   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:46:38,576    INFO [INIT] Marking all workers as offline
2019-10-31 04:46:38,610    INFO [INIT] LAVA master has started.
2019-10-31 04:46:38,611    INFO [INIT] Using protocol version 3
2019-10-31 04:46:41,035   DEBUG lava-logs => PING(20)
2019-10-31 04:46:57,030   DEBUG Dhanu => PING(20)
2019-10-31 04:46:57,031 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:46:58,612    INFO scheduling health checks:
2019-10-31 04:46:58,688    INFO scheduling jobs:
2019-10-31 04:46:58,691   DEBUG - qemu
2019-10-31 04:46:58,769   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:46:58,770   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:46:58,778    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:47:00,171    INFO [INIT] Dropping privileges
2019-10-31 04:47:00,171   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:47:00,171   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:47:00,173    INFO [INIT] Marking all workers as offline
2019-10-31 04:47:00,214    INFO [INIT] LAVA master has started.
2019-10-31 04:47:00,214    INFO [INIT] Using protocol version 3
2019-10-31 04:47:01,045   DEBUG lava-logs => PING(20)
2019-10-31 04:47:17,044   DEBUG Dhanu => PING(20)
2019-10-31 04:47:17,045 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:47:20,215    INFO scheduling health checks:
2019-10-31 04:47:20,353    INFO scheduling jobs:
2019-10-31 04:47:20,355   DEBUG - qemu
2019-10-31 04:47:20,461   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:47:20,462   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:47:20,471    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:47:22,017    INFO [INIT] Dropping privileges
2019-10-31 04:47:22,017   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:47:22,017   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:47:22,019    INFO [INIT] Marking all workers as offline
2019-10-31 04:47:22,091    INFO [INIT] LAVA master has started.
2019-10-31 04:47:22,091    INFO [INIT] Using protocol version 3
2019-10-31 04:47:22,102   DEBUG lava-logs => PING(20)
2019-10-31 04:47:37,066   DEBUG Dhanu => PING(20)
2019-10-31 04:47:37,066 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:47:42,097    INFO scheduling health checks:
2019-10-31 04:47:42,125    INFO scheduling jobs:
2019-10-31 04:47:42,127   DEBUG - qemu
2019-10-31 04:47:42,199   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:47:42,199   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:47:42,204    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:47:43,363    INFO [INIT] Dropping privileges
2019-10-31 04:47:43,364   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:47:43,364   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:47:43,365    INFO [INIT] Marking all workers as offline
2019-10-31 04:47:43,405    INFO [INIT] LAVA master has started.
2019-10-31 04:47:43,406    INFO [INIT] Using protocol version 3
2019-10-31 04:47:57,087   DEBUG Dhanu => PING(20)
2019-10-31 04:47:57,088 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:48:02,134   DEBUG lava-logs => PING(20)
2019-10-31 04:48:03,407    INFO scheduling health checks:
2019-10-31 04:48:03,471    INFO scheduling jobs:
2019-10-31 04:48:03,474   DEBUG - qemu
2019-10-31 04:48:03,559   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:48:03,559   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:48:03,564    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:48:04,942    INFO [INIT] Dropping privileges
2019-10-31 04:48:04,942   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:48:04,942   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:48:04,944    INFO [INIT] Marking all workers as offline
2019-10-31 04:48:04,961    INFO [INIT] LAVA master has started.
2019-10-31 04:48:04,962    INFO [INIT] Using protocol version 3
2019-10-31 04:48:17,100   DEBUG Dhanu => PING(20)
2019-10-31 04:48:17,101 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:48:22,148   DEBUG lava-logs => PING(20)
2019-10-31 04:48:24,965    INFO scheduling health checks:
2019-10-31 04:48:25,029    INFO scheduling jobs:
2019-10-31 04:48:25,032   DEBUG - qemu
2019-10-31 04:48:25,104   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:48:25,104   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:48:25,109    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:48:26,299    INFO [INIT] Dropping privileges
2019-10-31 04:48:26,300   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:48:26,300   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:48:26,301    INFO [INIT] Marking all workers as offline
2019-10-31 04:48:26,365    INFO [INIT] LAVA master has started.
2019-10-31 04:48:26,365    INFO [INIT] Using protocol version 3
2019-10-31 04:48:37,112   DEBUG Dhanu => PING(20)
2019-10-31 04:48:37,113 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:48:42,167   DEBUG lava-logs => PING(20)
2019-10-31 04:48:46,370    INFO scheduling health checks:
2019-10-31 04:48:46,397    INFO scheduling jobs:
2019-10-31 04:48:46,399   DEBUG - qemu
2019-10-31 04:48:46,472   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:48:46,472   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:48:46,477    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:48:47,536    INFO [INIT] Dropping privileges
2019-10-31 04:48:47,536   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:48:47,536   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:48:47,538    INFO [INIT] Marking all workers as offline
2019-10-31 04:48:47,601    INFO [INIT] LAVA master has started.
2019-10-31 04:48:47,601    INFO [INIT] Using protocol version 3
2019-10-31 04:48:57,130   DEBUG Dhanu => PING(20)
2019-10-31 04:48:57,130 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:49:02,184   DEBUG lava-logs => PING(20)
2019-10-31 04:49:07,607    INFO scheduling health checks:
2019-10-31 04:49:07,632    INFO scheduling jobs:
2019-10-31 04:49:07,634   DEBUG - qemu
2019-10-31 04:49:07,704   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:49:07,704   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:49:07,708    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:49:08,778    INFO [INIT] Dropping privileges
2019-10-31 04:49:08,779   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:49:08,779   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:49:08,780    INFO [INIT] Marking all workers as offline
2019-10-31 04:49:08,813    INFO [INIT] LAVA master has started.
2019-10-31 04:49:08,813    INFO [INIT] Using protocol version 3
2019-10-31 04:49:17,153   DEBUG Dhanu => PING(20)
2019-10-31 04:49:17,153 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:49:22,200   DEBUG lava-logs => PING(20)
2019-10-31 04:49:28,815    INFO scheduling health checks:
2019-10-31 04:49:28,857    INFO scheduling jobs:
2019-10-31 04:49:28,859   DEBUG - qemu
2019-10-31 04:49:28,934   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:49:28,935   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:49:28,939    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:49:30,041    INFO [INIT] Dropping privileges
2019-10-31 04:49:30,041   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:49:30,041   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:49:30,043    INFO [INIT] Marking all workers as offline
2019-10-31 04:49:30,070    INFO [INIT] LAVA master has started.
2019-10-31 04:49:30,071    INFO [INIT] Using protocol version 3
2019-10-31 04:49:37,172   DEBUG Dhanu => PING(20)
2019-10-31 04:49:37,173 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:49:42,212   DEBUG lava-logs => PING(20)
2019-10-31 04:49:50,080    INFO scheduling health checks:
2019-10-31 04:49:50,114    INFO scheduling jobs:
2019-10-31 04:49:50,116   DEBUG - qemu
2019-10-31 04:49:50,189   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:49:50,189   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:49:50,194    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:49:51,283    INFO [INIT] Dropping privileges
2019-10-31 04:49:51,284   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:49:51,284   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:49:51,285    INFO [INIT] Marking all workers as offline
2019-10-31 04:49:51,361    INFO [INIT] LAVA master has started.
2019-10-31 04:49:51,362    INFO [INIT] Using protocol version 3
2019-10-31 04:49:57,189   DEBUG Dhanu => PING(20)
2019-10-31 04:49:57,189 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:50:02,225   DEBUG lava-logs => PING(20)
2019-10-31 04:50:11,372    INFO scheduling health checks:
2019-10-31 04:50:11,405    INFO scheduling jobs:
2019-10-31 04:50:11,407   DEBUG - qemu
2019-10-31 04:50:11,479   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:50:11,479   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:50:11,484    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:50:12,786    INFO [INIT] Dropping privileges
2019-10-31 04:50:12,786   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:50:12,786   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:50:12,788    INFO [INIT] Marking all workers as offline
2019-10-31 04:50:12,830    INFO [INIT] LAVA master has started.
2019-10-31 04:50:12,830    INFO [INIT] Using protocol version 3
2019-10-31 04:50:17,209   DEBUG Dhanu => PING(20)
2019-10-31 04:50:17,210 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:50:22,244   DEBUG lava-logs => PING(20)
2019-10-31 04:50:32,839    INFO scheduling health checks:
2019-10-31 04:50:32,874    INFO scheduling jobs:
2019-10-31 04:50:32,876   DEBUG - qemu
2019-10-31 04:50:32,948   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:50:32,948   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:50:32,953    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:50:34,046    INFO [INIT] Dropping privileges
2019-10-31 04:50:34,046   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:50:34,046   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:50:34,048    INFO [INIT] Marking all workers as offline
2019-10-31 04:50:34,087    INFO [INIT] LAVA master has started.
2019-10-31 04:50:34,088    INFO [INIT] Using protocol version 3
2019-10-31 04:50:37,232   DEBUG Dhanu => PING(20)
2019-10-31 04:50:37,232 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:50:42,265   DEBUG lava-logs => PING(20)
2019-10-31 04:50:54,099    INFO scheduling health checks:
2019-10-31 04:50:54,131    INFO scheduling jobs:
2019-10-31 04:50:54,133   DEBUG - qemu
2019-10-31 04:50:54,201   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:50:54,201   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:50:54,209    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:50:55,276    INFO [INIT] Dropping privileges
2019-10-31 04:50:55,276   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:50:55,276   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:50:55,278    INFO [INIT] Marking all workers as offline
2019-10-31 04:50:55,312    INFO [INIT] LAVA master has started.
2019-10-31 04:50:55,312    INFO [INIT] Using protocol version 3
2019-10-31 04:50:57,252   DEBUG Dhanu => PING(20)
2019-10-31 04:50:57,253 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:51:02,285   DEBUG lava-logs => PING(20)
2019-10-31 04:51:15,319    INFO scheduling health checks:
2019-10-31 04:51:15,355    INFO scheduling jobs:
2019-10-31 04:51:15,358   DEBUG - qemu
2019-10-31 04:51:15,431   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:51:15,432   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:51:15,436    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:51:16,522    INFO [INIT] Dropping privileges
2019-10-31 04:51:16,523   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:51:16,523   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:51:16,524    INFO [INIT] Marking all workers as offline
2019-10-31 04:51:16,558    INFO [INIT] LAVA master has started.
2019-10-31 04:51:16,558    INFO [INIT] Using protocol version 3
2019-10-31 04:51:17,273   DEBUG Dhanu => PING(20)
2019-10-31 04:51:17,273 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:51:22,303   DEBUG lava-logs => PING(20)
2019-10-31 04:51:36,573    INFO scheduling health checks:
2019-10-31 04:51:36,601    INFO scheduling jobs:
2019-10-31 04:51:36,603   DEBUG - qemu
2019-10-31 04:51:36,674   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:51:36,674   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:51:36,679    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:51:37,793    INFO [INIT] Dropping privileges
2019-10-31 04:51:37,793   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:51:37,793   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:51:37,795    INFO [INIT] Marking all workers as offline
2019-10-31 04:51:37,837    INFO [INIT] LAVA master has started.
2019-10-31 04:51:37,837    INFO [INIT] Using protocol version 3
2019-10-31 04:51:37,838   DEBUG Dhanu => PING(20)
2019-10-31 04:51:37,838 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:51:42,321   DEBUG lava-logs => PING(20)
2019-10-31 04:51:57,853    INFO scheduling health checks:
2019-10-31 04:51:57,881    INFO scheduling jobs:
2019-10-31 04:51:57,883   DEBUG - qemu
2019-10-31 04:51:57,956   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:51:57,956   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:51:57,961    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:51:59,042    INFO [INIT] Dropping privileges
2019-10-31 04:51:59,042   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:51:59,042   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:51:59,044    INFO [INIT] Marking all workers as offline
2019-10-31 04:51:59,084    INFO [INIT] LAVA master has started.
2019-10-31 04:51:59,084    INFO [INIT] Using protocol version 3
2019-10-31 04:52:02,372   DEBUG lava-logs => PING(20)
2019-10-31 04:52:17,882   DEBUG Dhanu => PING(20)
2019-10-31 04:52:17,882 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:52:19,086    INFO scheduling health checks:
2019-10-31 04:52:19,139    INFO scheduling jobs:
2019-10-31 04:52:19,140   DEBUG - qemu
2019-10-31 04:52:19,207   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:52:19,208   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:52:19,217    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:52:20,285    INFO [INIT] Dropping privileges
2019-10-31 04:52:20,285   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:52:20,285   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:52:20,287    INFO [INIT] Marking all workers as offline
2019-10-31 04:52:20,352    INFO [INIT] LAVA master has started.
2019-10-31 04:52:20,352    INFO [INIT] Using protocol version 3
2019-10-31 04:52:22,387   DEBUG lava-logs => PING(20)
2019-10-31 04:52:37,903   DEBUG Dhanu => PING(20)
2019-10-31 04:52:37,904 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:52:40,355    INFO scheduling health checks:
2019-10-31 04:52:40,374    INFO scheduling jobs:
2019-10-31 04:52:40,375   DEBUG - qemu
2019-10-31 04:52:40,445   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:52:40,446   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:52:40,460    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:52:41,531    INFO [INIT] Dropping privileges
2019-10-31 04:52:41,531   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:52:41,531   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:52:41,533    INFO [INIT] Marking all workers as offline
2019-10-31 04:52:41,565    INFO [INIT] LAVA master has started.
2019-10-31 04:52:41,566    INFO [INIT] Using protocol version 3
2019-10-31 04:52:42,401   DEBUG lava-logs => PING(20)
2019-10-31 04:52:57,920   DEBUG Dhanu => PING(20)
2019-10-31 04:52:57,921 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:53:01,570    INFO scheduling health checks:
2019-10-31 04:53:01,621    INFO scheduling jobs:
2019-10-31 04:53:01,624   DEBUG - qemu
2019-10-31 04:53:01,695   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:53:01,695   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:53:01,700    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:53:02,776    INFO [INIT] Dropping privileges
2019-10-31 04:53:02,777   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:53:02,777   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:53:02,778    INFO [INIT] Marking all workers as offline
2019-10-31 04:53:02,812    INFO [INIT] LAVA master has started.
2019-10-31 04:53:02,813    INFO [INIT] Using protocol version 3
2019-10-31 04:53:02,918   DEBUG lava-logs => PING(20)
2019-10-31 04:53:17,939   DEBUG Dhanu => PING(20)
2019-10-31 04:53:17,940 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:53:22,818    INFO scheduling health checks:
2019-10-31 04:53:22,855    INFO scheduling jobs:
2019-10-31 04:53:22,857   DEBUG - qemu
2019-10-31 04:53:22,924   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:53:22,924   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:53:22,929    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:53:24,034    INFO [INIT] Dropping privileges
2019-10-31 04:53:24,034   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:53:24,034   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:53:24,036    INFO [INIT] Marking all workers as offline
2019-10-31 04:53:24,069    INFO [INIT] LAVA master has started.
2019-10-31 04:53:24,069    INFO [INIT] Using protocol version 3
2019-10-31 04:53:24,088   DEBUG lava-logs => PING(20)
2019-10-31 04:53:37,958   DEBUG Dhanu => PING(20)
2019-10-31 04:53:37,958 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:53:44,075    INFO scheduling health checks:
2019-10-31 04:53:44,113    INFO scheduling jobs:
2019-10-31 04:53:44,116   DEBUG - qemu
2019-10-31 04:53:44,184   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:53:44,184   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:53:44,189    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:53:45,293    INFO [INIT] Dropping privileges
2019-10-31 04:53:45,293   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:53:45,294   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:53:45,295    INFO [INIT] Marking all workers as offline
2019-10-31 04:53:45,326    INFO [INIT] LAVA master has started.
2019-10-31 04:53:45,326    INFO [INIT] Using protocol version 3
2019-10-31 04:53:57,980   DEBUG Dhanu => PING(20)
2019-10-31 04:53:57,980 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:54:04,131   DEBUG lava-logs => PING(20)
2019-10-31 04:54:05,328    INFO scheduling health checks:
2019-10-31 04:54:05,348    INFO scheduling jobs:
2019-10-31 04:54:05,349   DEBUG - qemu
2019-10-31 04:54:05,414   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:54:05,414   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:54:05,424    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:54:06,530    INFO [INIT] Dropping privileges
2019-10-31 04:54:06,530   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:54:06,530   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:54:06,532    INFO [INIT] Marking all workers as offline
2019-10-31 04:54:06,562    INFO [INIT] LAVA master has started.
2019-10-31 04:54:06,562    INFO [INIT] Using protocol version 3
2019-10-31 04:54:18,001   DEBUG Dhanu => PING(20)
2019-10-31 04:54:18,001 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:54:24,151   DEBUG lava-logs => PING(20)
2019-10-31 04:54:26,565    INFO scheduling health checks:
2019-10-31 04:54:26,583    INFO scheduling jobs:
2019-10-31 04:54:26,584   DEBUG - qemu
2019-10-31 04:54:26,646   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:54:26,646   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:54:26,651    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:54:27,786    INFO [INIT] Dropping privileges
2019-10-31 04:54:27,786   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:54:27,786   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:54:27,788    INFO [INIT] Marking all workers as offline
2019-10-31 04:54:27,820    INFO [INIT] LAVA master has started.
2019-10-31 04:54:27,820    INFO [INIT] Using protocol version 3
2019-10-31 04:54:38,020   DEBUG Dhanu => PING(20)
2019-10-31 04:54:38,021 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:54:44,171   DEBUG lava-logs => PING(20)
2019-10-31 04:54:47,824    INFO scheduling health checks:
2019-10-31 04:54:47,852    INFO scheduling jobs:
2019-10-31 04:54:47,854   DEBUG - qemu
2019-10-31 04:54:47,922   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:54:47,922   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:54:47,932    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:54:49,039    INFO [INIT] Dropping privileges
2019-10-31 04:54:49,039   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:54:49,039   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:54:49,040    INFO [INIT] Marking all workers as offline
2019-10-31 04:54:49,077    INFO [INIT] LAVA master has started.
2019-10-31 04:54:49,077    INFO [INIT] Using protocol version 3
2019-10-31 04:54:58,043   DEBUG Dhanu => PING(20)
2019-10-31 04:54:58,044 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:55:04,189   DEBUG lava-logs => PING(20)
2019-10-31 04:55:09,082    INFO scheduling health checks:
2019-10-31 04:55:09,110    INFO scheduling jobs:
2019-10-31 04:55:09,112   DEBUG - qemu
2019-10-31 04:55:09,185   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:55:09,185   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:55:09,190    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:55:10,281    INFO [INIT] Dropping privileges
2019-10-31 04:55:10,281   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:55:10,281   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:55:10,283    INFO [INIT] Marking all workers as offline
2019-10-31 04:55:10,322    INFO [INIT] LAVA master has started.
2019-10-31 04:55:10,323    INFO [INIT] Using protocol version 3
2019-10-31 04:55:18,064   DEBUG Dhanu => PING(20)
2019-10-31 04:55:18,065 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:55:24,206   DEBUG lava-logs => PING(20)
2019-10-31 04:55:30,329    INFO scheduling health checks:
2019-10-31 04:55:30,356    INFO scheduling jobs:
2019-10-31 04:55:30,358   DEBUG - qemu
2019-10-31 04:55:30,431   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:55:30,431   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:55:30,436    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:55:31,539    INFO [INIT] Dropping privileges
2019-10-31 04:55:31,539   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:55:31,539   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:55:31,541    INFO [INIT] Marking all workers as offline
2019-10-31 04:55:31,570    INFO [INIT] LAVA master has started.
2019-10-31 04:55:31,570    INFO [INIT] Using protocol version 3
2019-10-31 04:55:38,084   DEBUG Dhanu => PING(20)
2019-10-31 04:55:38,085 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:55:44,221   DEBUG lava-logs => PING(20)
2019-10-31 04:55:51,575    INFO scheduling health checks:
2019-10-31 04:55:51,614    INFO scheduling jobs:
2019-10-31 04:55:51,615   DEBUG - qemu
2019-10-31 04:55:51,687   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:55:51,687   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:55:51,697    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:55:52,822    INFO [INIT] Dropping privileges
2019-10-31 04:55:52,822   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:55:52,822   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:55:52,824    INFO [INIT] Marking all workers as offline
2019-10-31 04:55:52,849    INFO [INIT] LAVA master has started.
2019-10-31 04:55:52,850    INFO [INIT] Using protocol version 3
2019-10-31 04:55:58,104   DEBUG Dhanu => PING(20)
2019-10-31 04:55:58,104 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:56:04,234   DEBUG lava-logs => PING(20)
2019-10-31 04:56:12,859    INFO scheduling health checks:
2019-10-31 04:56:12,893    INFO scheduling jobs:
2019-10-31 04:56:12,896   DEBUG - qemu
2019-10-31 04:56:12,969   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:56:12,969   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:56:12,973    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:56:14,029    INFO [INIT] Dropping privileges
2019-10-31 04:56:14,029   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:56:14,029   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:56:14,031    INFO [INIT] Marking all workers as offline
2019-10-31 04:56:14,062    INFO [INIT] LAVA master has started.
2019-10-31 04:56:14,062    INFO [INIT] Using protocol version 3
2019-10-31 04:56:18,124   DEBUG Dhanu => PING(20)
2019-10-31 04:56:18,124 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:56:24,244   DEBUG lava-logs => PING(20)
2019-10-31 04:56:34,072    INFO scheduling health checks:
2019-10-31 04:56:34,106    INFO scheduling jobs:
2019-10-31 04:56:34,109   DEBUG - qemu
2019-10-31 04:56:34,182   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:56:34,182   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:56:34,187    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:56:35,313    INFO [INIT] Dropping privileges
2019-10-31 04:56:35,314   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:56:35,314   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:56:35,315    INFO [INIT] Marking all workers as offline
2019-10-31 04:56:35,376    INFO [INIT] LAVA master has started.
2019-10-31 04:56:35,376    INFO [INIT] Using protocol version 3
2019-10-31 04:56:38,145   DEBUG Dhanu => PING(20)
2019-10-31 04:56:38,146 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:56:44,264   DEBUG lava-logs => PING(20)
2019-10-31 04:56:55,387    INFO scheduling health checks:
2019-10-31 04:56:55,451    INFO scheduling jobs:
2019-10-31 04:56:55,455   DEBUG - qemu
2019-10-31 04:56:55,535   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:56:55,535   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:56:55,540    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:56:56,804    INFO [INIT] Dropping privileges
2019-10-31 04:56:56,804   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:56:56,804   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:56:56,806    INFO [INIT] Marking all workers as offline
2019-10-31 04:56:56,844    INFO [INIT] LAVA master has started.
2019-10-31 04:56:56,844    INFO [INIT] Using protocol version 3
2019-10-31 04:56:58,166   DEBUG Dhanu => PING(20)
2019-10-31 04:56:58,166 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:57:04,272   DEBUG lava-logs => PING(20)
2019-10-31 04:57:16,855    INFO scheduling health checks:
2019-10-31 04:57:16,888    INFO scheduling jobs:
2019-10-31 04:57:16,889   DEBUG - qemu
2019-10-31 04:57:16,976   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:57:16,976   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:57:16,982    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:57:18,317    INFO [INIT] Dropping privileges
2019-10-31 04:57:18,317   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:57:18,317   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:57:18,318    INFO [INIT] Marking all workers as offline
2019-10-31 04:57:18,379    INFO [INIT] LAVA master has started.
2019-10-31 04:57:18,379    INFO [INIT] Using protocol version 3
2019-10-31 04:57:18,505   DEBUG Dhanu => PING(20)
2019-10-31 04:57:18,506 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:57:24,288   DEBUG lava-logs => PING(20)
2019-10-31 04:57:38,394    INFO scheduling health checks:
2019-10-31 04:57:38,435    INFO scheduling jobs:
2019-10-31 04:57:38,438   DEBUG - qemu
2019-10-31 04:57:38,534   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:57:38,534   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:57:38,541    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:57:39,951    INFO [INIT] Dropping privileges
2019-10-31 04:57:39,952   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:57:39,952   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:57:39,953    INFO [INIT] Marking all workers as offline
2019-10-31 04:57:40,003    INFO [INIT] LAVA master has started.
2019-10-31 04:57:40,004    INFO [INIT] Using protocol version 3
2019-10-31 04:57:44,305   DEBUG lava-logs => PING(20)
2019-10-31 04:57:58,540   DEBUG Dhanu => PING(20)
2019-10-31 04:57:58,541 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:58:00,006    INFO scheduling health checks:
2019-10-31 04:58:00,025    INFO scheduling jobs:
2019-10-31 04:58:00,026   DEBUG - qemu
2019-10-31 04:58:00,103   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:58:00,103   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:58:00,107    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:58:01,390    INFO [INIT] Dropping privileges
2019-10-31 04:58:01,390   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:58:01,390   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:58:01,392    INFO [INIT] Marking all workers as offline
2019-10-31 04:58:01,428    INFO [INIT] LAVA master has started.
2019-10-31 04:58:01,429    INFO [INIT] Using protocol version 3
2019-10-31 04:58:04,319   DEBUG lava-logs => PING(20)
2019-10-31 04:58:18,560   DEBUG Dhanu => PING(20)
2019-10-31 04:58:18,560 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:58:21,431    INFO scheduling health checks:
2019-10-31 04:58:21,517    INFO scheduling jobs:
2019-10-31 04:58:21,520   DEBUG - qemu
2019-10-31 04:58:21,595   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:58:21,595   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:58:21,600    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:58:22,813    INFO [INIT] Dropping privileges
2019-10-31 04:58:22,814   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:58:22,814   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:58:22,815    INFO [INIT] Marking all workers as offline
2019-10-31 04:58:22,841    INFO [INIT] LAVA master has started.
2019-10-31 04:58:22,841    INFO [INIT] Using protocol version 3
2019-10-31 04:58:24,332   DEBUG lava-logs => PING(20)
2019-10-31 04:58:38,576   DEBUG Dhanu => PING(20)
2019-10-31 04:58:38,577 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:58:42,846    INFO scheduling health checks:
2019-10-31 04:58:42,885    INFO scheduling jobs:
2019-10-31 04:58:42,887   DEBUG - qemu
2019-10-31 04:58:42,954   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:58:42,955   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:58:42,959    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:58:44,318    INFO [INIT] Dropping privileges
2019-10-31 04:58:44,318   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:58:44,318   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:58:44,319    INFO [INIT] Marking all workers as offline
2019-10-31 04:58:44,364    INFO [INIT] LAVA master has started.
2019-10-31 04:58:44,365    INFO [INIT] Using protocol version 3
2019-10-31 04:58:44,507   DEBUG lava-logs => PING(20)
2019-10-31 04:58:58,594   DEBUG Dhanu => PING(20)
2019-10-31 04:58:58,595 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:59:04,369    INFO scheduling health checks:
2019-10-31 04:59:04,420    INFO scheduling jobs:
2019-10-31 04:59:04,423   DEBUG - qemu
2019-10-31 04:59:04,500   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:59:04,500   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:59:04,505    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:59:06,111    INFO [INIT] Dropping privileges
2019-10-31 04:59:06,112   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:59:06,112   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:59:06,113    INFO [INIT] Marking all workers as offline
2019-10-31 04:59:06,144    INFO [INIT] LAVA master has started.
2019-10-31 04:59:06,144    INFO [INIT] Using protocol version 3
2019-10-31 04:59:06,300   DEBUG lava-logs => PING(20)
2019-10-31 04:59:18,612   DEBUG Dhanu => PING(20)
2019-10-31 04:59:18,613 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:59:26,151    INFO scheduling health checks:
2019-10-31 04:59:26,178    INFO scheduling jobs:
2019-10-31 04:59:26,180   DEBUG - qemu
2019-10-31 04:59:26,272   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:59:26,272   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:59:26,281    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:59:27,660    INFO [INIT] Dropping privileges
2019-10-31 04:59:27,660   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:59:27,660   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:59:27,662    INFO [INIT] Marking all workers as offline
2019-10-31 04:59:27,691    INFO [INIT] LAVA master has started.
2019-10-31 04:59:27,691    INFO [INIT] Using protocol version 3
2019-10-31 04:59:27,870   DEBUG lava-logs => PING(20)
2019-10-31 04:59:38,624   DEBUG Dhanu => PING(20)
2019-10-31 04:59:38,624 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 04:59:47,700    INFO scheduling health checks:
2019-10-31 04:59:47,735    INFO scheduling jobs:
2019-10-31 04:59:47,738   DEBUG - qemu
2019-10-31 04:59:47,806   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 04:59:47,807   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 04:59:47,811    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 04:59:49,297    INFO [INIT] Dropping privileges
2019-10-31 04:59:49,297   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 04:59:49,298   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 04:59:49,299    INFO [INIT] Marking all workers as offline
2019-10-31 04:59:49,339    INFO [INIT] LAVA master has started.
2019-10-31 04:59:49,339    INFO [INIT] Using protocol version 3
2019-10-31 04:59:49,382   DEBUG lava-logs => PING(20)
2019-10-31 04:59:58,640   DEBUG Dhanu => PING(20)
2019-10-31 04:59:58,641 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:00:09,351    INFO scheduling health checks:
2019-10-31 05:00:09,393    INFO scheduling jobs:
2019-10-31 05:00:09,397   DEBUG - qemu
2019-10-31 05:00:09,475   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:00:09,475   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:00:09,482    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:00:10,813    INFO [INIT] Dropping privileges
2019-10-31 05:00:10,813   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:00:10,813   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:00:10,815    INFO [INIT] Marking all workers as offline
2019-10-31 05:00:10,850    INFO [INIT] LAVA master has started.
2019-10-31 05:00:10,850    INFO [INIT] Using protocol version 3
2019-10-31 05:00:18,660   DEBUG Dhanu => PING(20)
2019-10-31 05:00:18,661 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:00:29,416   DEBUG lava-logs => PING(20)
2019-10-31 05:00:30,851    INFO scheduling health checks:
2019-10-31 05:00:30,895    INFO scheduling jobs:
2019-10-31 05:00:30,898   DEBUG - qemu
2019-10-31 05:00:30,973   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:00:30,974   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:00:30,984    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:00:32,310    INFO [INIT] Dropping privileges
2019-10-31 05:00:32,310   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:00:32,310   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:00:32,312    INFO [INIT] Marking all workers as offline
2019-10-31 05:00:32,341    INFO [INIT] LAVA master has started.
2019-10-31 05:00:32,342    INFO [INIT] Using protocol version 3
2019-10-31 05:00:38,671   DEBUG Dhanu => PING(20)
2019-10-31 05:00:38,672 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:00:49,434   DEBUG lava-logs => PING(20)
2019-10-31 05:00:52,343    INFO scheduling health checks:
2019-10-31 05:00:52,374    INFO scheduling jobs:
2019-10-31 05:00:52,376   DEBUG - qemu
2019-10-31 05:00:52,461   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:00:52,461   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:00:52,465    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:00:53,913    INFO [INIT] Dropping privileges
2019-10-31 05:00:53,913   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:00:53,913   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:00:53,915    INFO [INIT] Marking all workers as offline
2019-10-31 05:00:53,954    INFO [INIT] LAVA master has started.
2019-10-31 05:00:53,954    INFO [INIT] Using protocol version 3
2019-10-31 05:00:58,689   DEBUG Dhanu => PING(20)
2019-10-31 05:00:58,690 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:01:09,450   DEBUG lava-logs => PING(20)
2019-10-31 05:01:13,959    INFO scheduling health checks:
2019-10-31 05:01:13,988    INFO scheduling jobs:
2019-10-31 05:01:13,989   DEBUG - qemu
2019-10-31 05:01:14,057   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:01:14,057   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:01:14,062    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:01:15,292    INFO [INIT] Dropping privileges
2019-10-31 05:01:15,292   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:01:15,292   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:01:15,294    INFO [INIT] Marking all workers as offline
2019-10-31 05:01:15,335    INFO [INIT] LAVA master has started.
2019-10-31 05:01:15,335    INFO [INIT] Using protocol version 3
2019-10-31 05:01:18,711   DEBUG Dhanu => PING(20)
2019-10-31 05:01:18,711 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:01:29,465   DEBUG lava-logs => PING(20)
2019-10-31 05:01:35,339    INFO scheduling health checks:
2019-10-31 05:01:35,379    INFO scheduling jobs:
2019-10-31 05:01:35,381   DEBUG - qemu
2019-10-31 05:01:35,459   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:01:35,459   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:01:35,466    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:01:36,653    INFO [INIT] Dropping privileges
2019-10-31 05:01:36,654   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:01:36,654   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:01:36,655    INFO [INIT] Marking all workers as offline
2019-10-31 05:01:36,680    INFO [INIT] LAVA master has started.
2019-10-31 05:01:36,681    INFO [INIT] Using protocol version 3
2019-10-31 05:01:38,732   DEBUG Dhanu => PING(20)
2019-10-31 05:01:38,733 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:01:49,478   DEBUG lava-logs => PING(20)
2019-10-31 05:01:56,687    INFO scheduling health checks:
2019-10-31 05:01:56,725    INFO scheduling jobs:
2019-10-31 05:01:56,726   DEBUG - qemu
2019-10-31 05:01:56,799   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:01:56,799   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:01:56,804    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:01:58,070    INFO [INIT] Dropping privileges
2019-10-31 05:01:58,070   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:01:58,071   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:01:58,072    INFO [INIT] Marking all workers as offline
2019-10-31 05:01:58,105    INFO [INIT] LAVA master has started.
2019-10-31 05:01:58,105    INFO [INIT] Using protocol version 3
2019-10-31 05:01:58,747   DEBUG Dhanu => PING(20)
2019-10-31 05:01:58,747 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:02:09,494   DEBUG lava-logs => PING(20)
2019-10-31 05:02:18,114    INFO scheduling health checks:
2019-10-31 05:02:18,160    INFO scheduling jobs:
2019-10-31 05:02:18,164   DEBUG - qemu
2019-10-31 05:02:18,244   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:02:18,244   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:02:18,254    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:02:19,652    INFO [INIT] Dropping privileges
2019-10-31 05:02:19,652   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:02:19,652   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:02:19,654    INFO [INIT] Marking all workers as offline
2019-10-31 05:02:19,699    INFO [INIT] LAVA master has started.
2019-10-31 05:02:19,699    INFO [INIT] Using protocol version 3
2019-10-31 05:02:19,731   DEBUG Dhanu => PING(20)
2019-10-31 05:02:19,732 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:02:29,517   DEBUG lava-logs => PING(20)
2019-10-31 05:02:39,707    INFO scheduling health checks:
2019-10-31 05:02:39,740    INFO scheduling jobs:
2019-10-31 05:02:39,744   DEBUG - qemu
2019-10-31 05:02:39,832   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:02:39,832   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:02:39,837    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:02:41,087    INFO [INIT] Dropping privileges
2019-10-31 05:02:41,087   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:02:41,087   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:02:41,089    INFO [INIT] Marking all workers as offline
2019-10-31 05:02:41,132    INFO [INIT] LAVA master has started.
2019-10-31 05:02:41,133    INFO [INIT] Using protocol version 3
2019-10-31 05:02:49,536   DEBUG lava-logs => PING(20)
2019-10-31 05:02:59,764   DEBUG Dhanu => PING(20)
2019-10-31 05:02:59,765 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:03:01,135    INFO scheduling health checks:
2019-10-31 05:03:01,165    INFO scheduling jobs:
2019-10-31 05:03:01,167   DEBUG - qemu
2019-10-31 05:03:01,238   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:03:01,239   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:03:01,243    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:03:02,794    INFO [INIT] Dropping privileges
2019-10-31 05:03:02,794   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:03:02,794   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:03:02,796    INFO [INIT] Marking all workers as offline
2019-10-31 05:03:02,844    INFO [INIT] LAVA master has started.
2019-10-31 05:03:02,845    INFO [INIT] Using protocol version 3
2019-10-31 05:03:09,547   DEBUG lava-logs => PING(20)
2019-10-31 05:03:19,781   DEBUG Dhanu => PING(20)
2019-10-31 05:03:19,782 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:03:22,847    INFO scheduling health checks:
2019-10-31 05:03:22,866    INFO scheduling jobs:
2019-10-31 05:03:22,868   DEBUG - qemu
2019-10-31 05:03:22,945   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:03:22,946   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:03:22,951    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:03:24,188    INFO [INIT] Dropping privileges
2019-10-31 05:03:24,188   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:03:24,188   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:03:24,190    INFO [INIT] Marking all workers as offline
2019-10-31 05:03:24,236    INFO [INIT] LAVA master has started.
2019-10-31 05:03:24,237    INFO [INIT] Using protocol version 3
2019-10-31 05:03:29,562   DEBUG lava-logs => PING(20)
2019-10-31 05:03:39,796   DEBUG Dhanu => PING(20)
2019-10-31 05:03:39,796 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:03:44,239    INFO scheduling health checks:
2019-10-31 05:03:44,280    INFO scheduling jobs:
2019-10-31 05:03:44,283   DEBUG - qemu
2019-10-31 05:03:44,386   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:03:44,386   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:03:44,392    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:03:45,706    INFO [INIT] Dropping privileges
2019-10-31 05:03:45,706   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:03:45,707   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:03:45,708    INFO [INIT] Marking all workers as offline
2019-10-31 05:03:45,749    INFO [INIT] LAVA master has started.
2019-10-31 05:03:45,750    INFO [INIT] Using protocol version 3
2019-10-31 05:03:49,575   DEBUG lava-logs => PING(20)
2019-10-31 05:03:59,812   DEBUG Dhanu => PING(20)
2019-10-31 05:03:59,813 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:04:05,755    INFO scheduling health checks:
2019-10-31 05:04:05,793    INFO scheduling jobs:
2019-10-31 05:04:05,795   DEBUG - qemu
2019-10-31 05:04:05,875   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:04:05,875   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:04:05,879    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:04:07,039    INFO [INIT] Dropping privileges
2019-10-31 05:04:07,039   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:04:07,039   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:04:07,041    INFO [INIT] Marking all workers as offline
2019-10-31 05:04:07,085    INFO [INIT] LAVA master has started.
2019-10-31 05:04:07,085    INFO [INIT] Using protocol version 3
2019-10-31 05:04:09,587   DEBUG lava-logs => PING(20)
2019-10-31 05:04:19,829   DEBUG Dhanu => PING(20)
2019-10-31 05:04:19,830 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:04:27,093    INFO scheduling health checks:
2019-10-31 05:04:27,128    INFO scheduling jobs:
2019-10-31 05:04:27,132   DEBUG - qemu
2019-10-31 05:04:27,206   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:04:27,207   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:04:27,211    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:04:28,285    INFO [INIT] Dropping privileges
2019-10-31 05:04:28,286   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:04:28,286   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:04:28,287    INFO [INIT] Marking all workers as offline
2019-10-31 05:04:28,318    INFO [INIT] LAVA master has started.
2019-10-31 05:04:28,318    INFO [INIT] Using protocol version 3
2019-10-31 05:04:29,600   DEBUG lava-logs => PING(20)
2019-10-31 05:04:39,850   DEBUG Dhanu => PING(20)
2019-10-31 05:04:39,851 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:04:48,327    INFO scheduling health checks:
2019-10-31 05:04:48,364    INFO scheduling jobs:
2019-10-31 05:04:48,366   DEBUG - qemu
2019-10-31 05:04:48,440   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:04:48,440   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:04:48,445    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:04:49,534    INFO [INIT] Dropping privileges
2019-10-31 05:04:49,535   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:04:49,535   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:04:49,536    INFO [INIT] Marking all workers as offline
2019-10-31 05:04:49,578    INFO [INIT] LAVA master has started.
2019-10-31 05:04:49,578    INFO [INIT] Using protocol version 3
2019-10-31 05:04:49,686   DEBUG lava-logs => PING(20)
2019-10-31 05:04:59,864   DEBUG Dhanu => PING(20)
2019-10-31 05:04:59,865 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:05:09,589    INFO scheduling health checks:
2019-10-31 05:05:09,621    INFO scheduling jobs:
2019-10-31 05:05:09,623   DEBUG - qemu
2019-10-31 05:05:09,698   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:05:09,698   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:05:09,703    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:05:10,793    INFO [INIT] Dropping privileges
2019-10-31 05:05:10,793   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:05:10,794   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:05:10,795    INFO [INIT] Marking all workers as offline
2019-10-31 05:05:10,824    INFO [INIT] LAVA master has started.
2019-10-31 05:05:10,824    INFO [INIT] Using protocol version 3
2019-10-31 05:05:10,838   DEBUG lava-logs => PING(20)
2019-10-31 05:05:19,886   DEBUG Dhanu => PING(20)
2019-10-31 05:05:19,887 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:05:30,831    INFO scheduling health checks:
2019-10-31 05:05:30,867    INFO scheduling jobs:
2019-10-31 05:05:30,869   DEBUG - qemu
2019-10-31 05:05:30,948   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:05:30,948   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:05:30,953    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:05:32,024    INFO [INIT] Dropping privileges
2019-10-31 05:05:32,024   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:05:32,024   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:05:32,026    INFO [INIT] Marking all workers as offline
2019-10-31 05:05:32,059    INFO [INIT] LAVA master has started.
2019-10-31 05:05:32,060    INFO [INIT] Using protocol version 3
2019-10-31 05:05:39,909   DEBUG Dhanu => PING(20)
2019-10-31 05:05:39,910 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:05:50,881   DEBUG lava-logs => PING(20)
2019-10-31 05:05:52,061    INFO scheduling health checks:
2019-10-31 05:05:52,092    INFO scheduling jobs:
2019-10-31 05:05:52,094   DEBUG - qemu
2019-10-31 05:05:52,166   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:05:52,166   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:05:52,171    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:05:53,285    INFO [INIT] Dropping privileges
2019-10-31 05:05:53,285   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:05:53,285   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:05:53,287    INFO [INIT] Marking all workers as offline
2019-10-31 05:05:53,317    INFO [INIT] LAVA master has started.
2019-10-31 05:05:53,317    INFO [INIT] Using protocol version 3
2019-10-31 05:05:59,931   DEBUG Dhanu => PING(20)
2019-10-31 05:05:59,932 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:06:10,902   DEBUG lava-logs => PING(20)
2019-10-31 05:06:13,320    INFO scheduling health checks:
2019-10-31 05:06:13,361    INFO scheduling jobs:
2019-10-31 05:06:13,364   DEBUG - qemu
2019-10-31 05:06:13,438   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:06:13,438   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:06:13,442    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:06:14,529    INFO [INIT] Dropping privileges
2019-10-31 05:06:14,529   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:06:14,529   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:06:14,531    INFO [INIT] Marking all workers as offline
2019-10-31 05:06:14,563    INFO [INIT] LAVA master has started.
2019-10-31 05:06:14,564    INFO [INIT] Using protocol version 3
2019-10-31 05:06:19,950   DEBUG Dhanu => PING(20)
2019-10-31 05:06:19,950 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:06:30,919   DEBUG lava-logs => PING(20)
2019-10-31 05:06:34,567    INFO scheduling health checks:
2019-10-31 05:06:34,641    INFO scheduling jobs:
2019-10-31 05:06:34,643   DEBUG - qemu
2019-10-31 05:06:34,713   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:06:34,713   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:06:34,718    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:06:35,787    INFO [INIT] Dropping privileges
2019-10-31 05:06:35,788   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:06:35,788   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:06:35,789    INFO [INIT] Marking all workers as offline
2019-10-31 05:06:35,821    INFO [INIT] LAVA master has started.
2019-10-31 05:06:35,821    INFO [INIT] Using protocol version 3
2019-10-31 05:06:39,971   DEBUG Dhanu => PING(20)
2019-10-31 05:06:39,971 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:06:50,937   DEBUG lava-logs => PING(20)
2019-10-31 05:06:55,827    INFO scheduling health checks:
2019-10-31 05:06:55,864    INFO scheduling jobs:
2019-10-31 05:06:55,866   DEBUG - qemu
2019-10-31 05:06:55,933   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:06:55,934   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:06:55,938    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:06:57,032    INFO [INIT] Dropping privileges
2019-10-31 05:06:57,032   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:06:57,033   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:06:57,034    INFO [INIT] Marking all workers as offline
2019-10-31 05:06:57,068    INFO [INIT] LAVA master has started.
2019-10-31 05:06:57,068    INFO [INIT] Using protocol version 3
2019-10-31 05:06:59,992   DEBUG Dhanu => PING(20)
2019-10-31 05:06:59,993 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:07:10,953   DEBUG lava-logs => PING(20)
2019-10-31 05:07:17,074    INFO scheduling health checks:
2019-10-31 05:07:17,111    INFO scheduling jobs:
2019-10-31 05:07:17,113   DEBUG - qemu
2019-10-31 05:07:17,187   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:07:17,187   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:07:17,191    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:07:18,279    INFO [INIT] Dropping privileges
2019-10-31 05:07:18,279   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:07:18,279   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:07:18,281    INFO [INIT] Marking all workers as offline
2019-10-31 05:07:18,314    INFO [INIT] LAVA master has started.
2019-10-31 05:07:18,314    INFO [INIT] Using protocol version 3
2019-10-31 05:07:20,010   DEBUG Dhanu => PING(20)
2019-10-31 05:07:20,010 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:07:30,967   DEBUG lava-logs => PING(20)
2019-10-31 05:07:38,322    INFO scheduling health checks:
2019-10-31 05:07:38,357    INFO scheduling jobs:
2019-10-31 05:07:38,360   DEBUG - qemu
2019-10-31 05:07:38,434   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:07:38,434   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:07:38,439    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:07:39,561    INFO [INIT] Dropping privileges
2019-10-31 05:07:39,561   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:07:39,561   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:07:39,563    INFO [INIT] Marking all workers as offline
2019-10-31 05:07:39,604    INFO [INIT] LAVA master has started.
2019-10-31 05:07:39,604    INFO [INIT] Using protocol version 3
2019-10-31 05:07:40,025   DEBUG Dhanu => PING(20)
2019-10-31 05:07:40,026 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:07:50,982   DEBUG lava-logs => PING(20)
2019-10-31 05:07:59,611    INFO scheduling health checks:
2019-10-31 05:07:59,648    INFO scheduling jobs:
2019-10-31 05:07:59,649   DEBUG - qemu
2019-10-31 05:07:59,768   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:07:59,768   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:07:59,778    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:08:01,162    INFO [INIT] Dropping privileges
2019-10-31 05:08:01,162   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:08:01,162   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:08:01,164    INFO [INIT] Marking all workers as offline
2019-10-31 05:08:01,207    INFO [INIT] LAVA master has started.
2019-10-31 05:08:01,207    INFO [INIT] Using protocol version 3
2019-10-31 05:08:01,279   DEBUG Dhanu => PING(20)
2019-10-31 05:08:01,280 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:08:11,002   DEBUG lava-logs => PING(20)
2019-10-31 05:08:21,215    INFO scheduling health checks:
2019-10-31 05:08:21,262    INFO scheduling jobs:
2019-10-31 05:08:21,264   DEBUG - qemu
2019-10-31 05:08:21,342   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:08:21,342   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:08:21,351    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:08:22,683    INFO [INIT] Dropping privileges
2019-10-31 05:08:22,683   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:08:22,683   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:08:22,685    INFO [INIT] Marking all workers as offline
2019-10-31 05:08:22,742    INFO [INIT] LAVA master has started.
2019-10-31 05:08:22,743    INFO [INIT] Using protocol version 3
2019-10-31 05:08:31,020   DEBUG lava-logs => PING(20)
2019-10-31 05:08:41,312   DEBUG Dhanu => PING(20)
2019-10-31 05:08:41,312 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:08:42,744    INFO scheduling health checks:
2019-10-31 05:08:42,763    INFO scheduling jobs:
2019-10-31 05:08:42,765   DEBUG - qemu
2019-10-31 05:08:42,837   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:08:42,837   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:08:42,842    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:08:44,136    INFO [INIT] Dropping privileges
2019-10-31 05:08:44,136   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:08:44,136   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:08:44,138    INFO [INIT] Marking all workers as offline
2019-10-31 05:08:44,176    INFO [INIT] LAVA master has started.
2019-10-31 05:08:44,176    INFO [INIT] Using protocol version 3
2019-10-31 05:08:51,036   DEBUG lava-logs => PING(20)
2019-10-31 05:09:01,328   DEBUG Dhanu => PING(20)
2019-10-31 05:09:01,329 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:09:04,179    INFO scheduling health checks:
2019-10-31 05:09:04,210    INFO scheduling jobs:
2019-10-31 05:09:04,212   DEBUG - qemu
2019-10-31 05:09:04,292   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:09:04,292   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:09:04,297    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:09:05,593    INFO [INIT] Dropping privileges
2019-10-31 05:09:05,593   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:09:05,593   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:09:05,595    INFO [INIT] Marking all workers as offline
2019-10-31 05:09:05,635    INFO [INIT] LAVA master has started.
2019-10-31 05:09:05,636    INFO [INIT] Using protocol version 3
2019-10-31 05:09:11,052   DEBUG lava-logs => PING(20)
2019-10-31 05:09:21,344   DEBUG Dhanu => PING(20)
2019-10-31 05:09:21,345 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:09:25,640    INFO scheduling health checks:
2019-10-31 05:09:25,679    INFO scheduling jobs:
2019-10-31 05:09:25,680   DEBUG - qemu
2019-10-31 05:09:25,749   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:09:25,749   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:09:25,754    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:09:27,037    INFO [INIT] Dropping privileges
2019-10-31 05:09:27,037   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:09:27,038   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:09:27,039    INFO [INIT] Marking all workers as offline
2019-10-31 05:09:27,070    INFO [INIT] LAVA master has started.
2019-10-31 05:09:27,070    INFO [INIT] Using protocol version 3
2019-10-31 05:09:31,069   DEBUG lava-logs => PING(20)
2019-10-31 05:09:41,367   DEBUG Dhanu => PING(20)
2019-10-31 05:09:41,368 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:09:47,076    INFO scheduling health checks:
2019-10-31 05:09:47,114    INFO scheduling jobs:
2019-10-31 05:09:47,117   DEBUG - qemu
2019-10-31 05:09:47,189   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:09:47,189   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:09:47,194    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:09:48,294    INFO [INIT] Dropping privileges
2019-10-31 05:09:48,295   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:09:48,295   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:09:48,296    INFO [INIT] Marking all workers as offline
2019-10-31 05:09:48,339    INFO [INIT] LAVA master has started.
2019-10-31 05:09:48,339    INFO [INIT] Using protocol version 3
2019-10-31 05:09:51,084   DEBUG lava-logs => PING(20)
2019-10-31 05:10:01,390   DEBUG Dhanu => PING(20)
2019-10-31 05:10:01,390 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:10:08,346    INFO scheduling health checks:
2019-10-31 05:10:08,383    INFO scheduling jobs:
2019-10-31 05:10:08,385   DEBUG - qemu
2019-10-31 05:10:08,452   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:10:08,452   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:10:08,457    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:10:09,534    INFO [INIT] Dropping privileges
2019-10-31 05:10:09,535   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:10:09,535   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:10:09,536    INFO [INIT] Marking all workers as offline
2019-10-31 05:10:09,597    INFO [INIT] LAVA master has started.
2019-10-31 05:10:09,597    INFO [INIT] Using protocol version 3
2019-10-31 05:10:11,099   DEBUG lava-logs => PING(20)
2019-10-31 05:10:21,410   DEBUG Dhanu => PING(20)
2019-10-31 05:10:21,410 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:10:29,599    INFO scheduling health checks:
2019-10-31 05:10:29,641    INFO scheduling jobs:
2019-10-31 05:10:29,643   DEBUG - qemu
2019-10-31 05:10:29,719   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:10:29,719   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:10:29,735    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:10:31,043    INFO [INIT] Dropping privileges
2019-10-31 05:10:31,043   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:10:31,043   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:10:31,045    INFO [INIT] Marking all workers as offline
2019-10-31 05:10:31,087    INFO [INIT] LAVA master has started.
2019-10-31 05:10:31,088    INFO [INIT] Using protocol version 3
2019-10-31 05:10:31,112   DEBUG lava-logs => PING(20)
2019-10-31 05:10:41,428   DEBUG Dhanu => PING(20)
2019-10-31 05:10:41,429 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:10:51,098    INFO scheduling health checks:
2019-10-31 05:10:51,131    INFO scheduling jobs:
2019-10-31 05:10:51,133   DEBUG - qemu
2019-10-31 05:10:51,205   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:10:51,205   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:10:51,210    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:10:52,278    INFO [INIT] Dropping privileges
2019-10-31 05:10:52,279   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:10:52,279   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:10:52,280    INFO [INIT] Marking all workers as offline
2019-10-31 05:10:52,312    INFO [INIT] LAVA master has started.
2019-10-31 05:10:52,312    INFO [INIT] Using protocol version 3
2019-10-31 05:11:01,448   DEBUG Dhanu => PING(20)
2019-10-31 05:11:01,449 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:11:11,154   DEBUG lava-logs => PING(20)
2019-10-31 05:11:12,314    INFO scheduling health checks:
2019-10-31 05:11:12,333    INFO scheduling jobs:
2019-10-31 05:11:12,335   DEBUG - qemu
2019-10-31 05:11:12,405   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:11:12,405   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:11:12,410    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:11:13,537    INFO [INIT] Dropping privileges
2019-10-31 05:11:13,538   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:11:13,538   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:11:13,539    INFO [INIT] Marking all workers as offline
2019-10-31 05:11:13,592    INFO [INIT] LAVA master has started.
2019-10-31 05:11:13,592    INFO [INIT] Using protocol version 3
2019-10-31 05:11:21,470   DEBUG Dhanu => PING(20)
2019-10-31 05:11:21,470 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:11:31,172   DEBUG lava-logs => PING(20)
2019-10-31 05:11:33,594    INFO scheduling health checks:
2019-10-31 05:11:33,635    INFO scheduling jobs:
2019-10-31 05:11:33,637   DEBUG - qemu
2019-10-31 05:11:33,712   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:11:33,712   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:11:33,717    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:11:34,803    INFO [INIT] Dropping privileges
2019-10-31 05:11:34,803   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:11:34,803   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:11:34,805    INFO [INIT] Marking all workers as offline
2019-10-31 05:11:34,838    INFO [INIT] LAVA master has started.
2019-10-31 05:11:34,838    INFO [INIT] Using protocol version 3
2019-10-31 05:11:41,488   DEBUG Dhanu => PING(20)
2019-10-31 05:11:41,488 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:11:51,189   DEBUG lava-logs => PING(20)
2019-10-31 05:11:54,840    INFO scheduling health checks:
2019-10-31 05:11:54,871    INFO scheduling jobs:
2019-10-31 05:11:54,874   DEBUG - qemu
2019-10-31 05:11:54,953   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:11:54,954   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:11:54,958    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:11:56,109    INFO [INIT] Dropping privileges
2019-10-31 05:11:56,109   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:11:56,109   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:11:56,111    INFO [INIT] Marking all workers as offline
2019-10-31 05:11:56,140    INFO [INIT] LAVA master has started.
2019-10-31 05:11:56,140    INFO [INIT] Using protocol version 3
2019-10-31 05:12:01,504   DEBUG Dhanu => PING(20)
2019-10-31 05:12:01,505 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:12:11,208   DEBUG lava-logs => PING(20)
2019-10-31 05:12:16,145    INFO scheduling health checks:
2019-10-31 05:12:16,184    INFO scheduling jobs:
2019-10-31 05:12:16,187   DEBUG - qemu
2019-10-31 05:12:16,262   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:12:16,262   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:12:16,266    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:12:17,793    INFO [INIT] Dropping privileges
2019-10-31 05:12:17,793   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:12:17,793   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:12:17,795    INFO [INIT] Marking all workers as offline
2019-10-31 05:12:17,820    INFO [INIT] LAVA master has started.
2019-10-31 05:12:17,820    INFO [INIT] Using protocol version 3
2019-10-31 05:12:21,524   DEBUG Dhanu => PING(20)
2019-10-31 05:12:21,525 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:12:31,221   DEBUG lava-logs => PING(20)
2019-10-31 05:12:37,827    INFO scheduling health checks:
2019-10-31 05:12:37,875    INFO scheduling jobs:
2019-10-31 05:12:37,878   DEBUG - qemu
2019-10-31 05:12:37,959   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:12:37,960   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:12:37,964    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:12:39,211    INFO [INIT] Dropping privileges
2019-10-31 05:12:39,211   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:12:39,211   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:12:39,213    INFO [INIT] Marking all workers as offline
2019-10-31 05:12:39,244    INFO [INIT] LAVA master has started.
2019-10-31 05:12:39,244    INFO [INIT] Using protocol version 3
2019-10-31 05:12:41,540   DEBUG Dhanu => PING(20)
2019-10-31 05:12:41,540 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:12:51,232   DEBUG lava-logs => PING(20)
2019-10-31 05:12:59,251    INFO scheduling health checks:
2019-10-31 05:12:59,277    INFO scheduling jobs:
2019-10-31 05:12:59,279   DEBUG - qemu
2019-10-31 05:12:59,365   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:12:59,366   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:12:59,370    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:13:00,564    INFO [INIT] Dropping privileges
2019-10-31 05:13:00,564   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:13:00,564   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:13:00,566    INFO [INIT] Marking all workers as offline
2019-10-31 05:13:00,602    INFO [INIT] LAVA master has started.
2019-10-31 05:13:00,602    INFO [INIT] Using protocol version 3
2019-10-31 05:13:01,554   DEBUG Dhanu => PING(20)
2019-10-31 05:13:01,554 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:13:11,244   DEBUG lava-logs => PING(20)
2019-10-31 05:13:20,612    INFO scheduling health checks:
2019-10-31 05:13:20,657    INFO scheduling jobs:
2019-10-31 05:13:20,660   DEBUG - qemu
2019-10-31 05:13:20,750   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:13:20,750   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:13:20,757    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:13:22,218    INFO [INIT] Dropping privileges
2019-10-31 05:13:22,219   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:13:22,219   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:13:22,221    INFO [INIT] Marking all workers as offline
2019-10-31 05:13:22,249    INFO [INIT] LAVA master has started.
2019-10-31 05:13:22,249    INFO [INIT] Using protocol version 3
2019-10-31 05:13:22,337   DEBUG Dhanu => PING(20)
2019-10-31 05:13:22,338 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:13:31,264   DEBUG lava-logs => PING(20)
2019-10-31 05:13:42,259    INFO scheduling health checks:
2019-10-31 05:13:42,292    INFO scheduling jobs:
2019-10-31 05:13:42,294   DEBUG - qemu
2019-10-31 05:13:42,366   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:13:42,366   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:13:42,370    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:13:43,552    INFO [INIT] Dropping privileges
2019-10-31 05:13:43,553   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:13:43,553   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:13:43,554    INFO [INIT] Marking all workers as offline
2019-10-31 05:13:43,595    INFO [INIT] LAVA master has started.
2019-10-31 05:13:43,596    INFO [INIT] Using protocol version 3
2019-10-31 05:13:51,285   DEBUG lava-logs => PING(20)
2019-10-31 05:14:02,374   DEBUG Dhanu => PING(20)
2019-10-31 05:14:02,374 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:14:03,597    INFO scheduling health checks:
2019-10-31 05:14:03,616    INFO scheduling jobs:
2019-10-31 05:14:03,618   DEBUG - qemu
2019-10-31 05:14:03,687   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:14:03,688   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:14:03,692    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:14:04,785    INFO [INIT] Dropping privileges
2019-10-31 05:14:04,785   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:14:04,785   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:14:04,787    INFO [INIT] Marking all workers as offline
2019-10-31 05:14:04,819    INFO [INIT] LAVA master has started.
2019-10-31 05:14:04,820    INFO [INIT] Using protocol version 3
2019-10-31 05:14:11,304   DEBUG lava-logs => PING(20)
2019-10-31 05:14:22,393   DEBUG Dhanu => PING(20)
2019-10-31 05:14:22,394 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:14:24,822    INFO scheduling health checks:
2019-10-31 05:14:24,852    INFO scheduling jobs:
2019-10-31 05:14:24,853   DEBUG - qemu
2019-10-31 05:14:24,918   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:14:24,918   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:14:24,923    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:14:26,035    INFO [INIT] Dropping privileges
2019-10-31 05:14:26,035   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:14:26,035   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:14:26,037    INFO [INIT] Marking all workers as offline
2019-10-31 05:14:26,076    INFO [INIT] LAVA master has started.
2019-10-31 05:14:26,076    INFO [INIT] Using protocol version 3
2019-10-31 05:14:31,323   DEBUG lava-logs => PING(20)
2019-10-31 05:14:42,414   DEBUG Dhanu => PING(20)
2019-10-31 05:14:42,415 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:14:46,079    INFO scheduling health checks:
2019-10-31 05:14:46,109    INFO scheduling jobs:
2019-10-31 05:14:46,111   DEBUG - qemu
2019-10-31 05:14:46,184   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:14:46,184   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:14:46,189    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:14:47,292    INFO [INIT] Dropping privileges
2019-10-31 05:14:47,292   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:14:47,292   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:14:47,294    INFO [INIT] Marking all workers as offline
2019-10-31 05:14:47,357    INFO [INIT] LAVA master has started.
2019-10-31 05:14:47,357    INFO [INIT] Using protocol version 3
2019-10-31 05:14:51,340   DEBUG lava-logs => PING(20)
2019-10-31 05:15:02,438   DEBUG Dhanu => PING(20)
2019-10-31 05:15:02,439 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:15:07,363    INFO scheduling health checks:
2019-10-31 05:15:07,389    INFO scheduling jobs:
2019-10-31 05:15:07,391   DEBUG - qemu
2019-10-31 05:15:07,464   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:15:07,465   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:15:07,473    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:15:08,617    INFO [INIT] Dropping privileges
2019-10-31 05:15:08,617   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:15:08,617   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:15:08,619    INFO [INIT] Marking all workers as offline
2019-10-31 05:15:08,646    INFO [INIT] LAVA master has started.
2019-10-31 05:15:08,646    INFO [INIT] Using protocol version 3
2019-10-31 05:15:11,355   DEBUG lava-logs => PING(20)
2019-10-31 05:15:22,460   DEBUG Dhanu => PING(20)
2019-10-31 05:15:22,460 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:15:28,651    INFO scheduling health checks:
2019-10-31 05:15:28,691    INFO scheduling jobs:
2019-10-31 05:15:28,694   DEBUG - qemu
2019-10-31 05:15:28,783   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:15:28,783   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:15:28,788    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:15:30,178    INFO [INIT] Dropping privileges
2019-10-31 05:15:30,178   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:15:30,178   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:15:30,180    INFO [INIT] Marking all workers as offline
2019-10-31 05:15:30,204    INFO [INIT] LAVA master has started.
2019-10-31 05:15:30,205    INFO [INIT] Using protocol version 3
2019-10-31 05:15:31,372   DEBUG lava-logs => PING(20)
2019-10-31 05:15:42,479   DEBUG Dhanu => PING(20)
2019-10-31 05:15:42,480 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:15:50,212    INFO scheduling health checks:
2019-10-31 05:15:50,249    INFO scheduling jobs:
2019-10-31 05:15:50,253   DEBUG - qemu
2019-10-31 05:15:50,327   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:15:50,328   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:15:50,332    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:15:51,555    INFO [INIT] Dropping privileges
2019-10-31 05:15:51,555   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:15:51,555   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:15:51,557    INFO [INIT] Marking all workers as offline
2019-10-31 05:15:51,630    INFO [INIT] LAVA master has started.
2019-10-31 05:15:51,630    INFO [INIT] Using protocol version 3
2019-10-31 05:15:51,731   DEBUG lava-logs => PING(20)
2019-10-31 05:16:02,496   DEBUG Dhanu => PING(20)
2019-10-31 05:16:02,497 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:16:11,634    INFO scheduling health checks:
2019-10-31 05:16:11,673    INFO scheduling jobs:
2019-10-31 05:16:11,677   DEBUG - qemu
2019-10-31 05:16:11,752   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:16:11,752   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:16:11,757    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:16:12,840    INFO [INIT] Dropping privileges
2019-10-31 05:16:12,841   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:16:12,841   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:16:12,842    INFO [INIT] Marking all workers as offline
2019-10-31 05:16:12,874    INFO [INIT] LAVA master has started.
2019-10-31 05:16:12,875    INFO [INIT] Using protocol version 3
2019-10-31 05:16:22,520   DEBUG Dhanu => PING(20)
2019-10-31 05:16:22,520 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:16:31,762   DEBUG lava-logs => PING(20)
2019-10-31 05:16:32,877    INFO scheduling health checks:
2019-10-31 05:16:32,897    INFO scheduling jobs:
2019-10-31 05:16:32,899   DEBUG - qemu
2019-10-31 05:16:32,965   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:16:32,965   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:16:32,969    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:16:34,292    INFO [INIT] Dropping privileges
2019-10-31 05:16:34,293   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:16:34,293   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:16:34,294    INFO [INIT] Marking all workers as offline
2019-10-31 05:16:34,321    INFO [INIT] LAVA master has started.
2019-10-31 05:16:34,322    INFO [INIT] Using protocol version 3
2019-10-31 05:16:42,538   DEBUG Dhanu => PING(20)
2019-10-31 05:16:42,538 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:16:51,776   DEBUG lava-logs => PING(20)
2019-10-31 05:16:54,323    INFO scheduling health checks:
2019-10-31 05:16:54,344    INFO scheduling jobs:
2019-10-31 05:16:54,346   DEBUG - qemu
2019-10-31 05:16:54,417   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:16:54,417   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:16:54,422    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:16:55,539    INFO [INIT] Dropping privileges
2019-10-31 05:16:55,539   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:16:55,540   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:16:55,541    INFO [INIT] Marking all workers as offline
2019-10-31 05:16:55,580    INFO [INIT] LAVA master has started.
2019-10-31 05:16:55,580    INFO [INIT] Using protocol version 3
2019-10-31 05:17:02,559   DEBUG Dhanu => PING(20)
2019-10-31 05:17:02,560 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:17:11,795   DEBUG lava-logs => PING(20)
2019-10-31 05:17:15,584    INFO scheduling health checks:
2019-10-31 05:17:15,613    INFO scheduling jobs:
2019-10-31 05:17:15,615   DEBUG - qemu
2019-10-31 05:17:15,687   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:17:15,688   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:17:15,692    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:17:16,781    INFO [INIT] Dropping privileges
2019-10-31 05:17:16,782   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:17:16,782   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:17:16,783    INFO [INIT] Marking all workers as offline
2019-10-31 05:17:16,815    INFO [INIT] LAVA master has started.
2019-10-31 05:17:16,815    INFO [INIT] Using protocol version 3
2019-10-31 05:17:22,580   DEBUG Dhanu => PING(20)
2019-10-31 05:17:22,580 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:17:31,807   DEBUG lava-logs => PING(20)
2019-10-31 05:17:36,821    INFO scheduling health checks:
2019-10-31 05:17:36,871    INFO scheduling jobs:
2019-10-31 05:17:36,874   DEBUG - qemu
2019-10-31 05:17:36,951   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:17:36,952   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:17:36,961    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:17:38,040    INFO [INIT] Dropping privileges
2019-10-31 05:17:38,041   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:17:38,041   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:17:38,042    INFO [INIT] Marking all workers as offline
2019-10-31 05:17:38,073    INFO [INIT] LAVA master has started.
2019-10-31 05:17:38,073    INFO [INIT] Using protocol version 3
2019-10-31 05:17:42,600   DEBUG Dhanu => PING(20)
2019-10-31 05:17:42,601 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:17:51,824   DEBUG lava-logs => PING(20)
2019-10-31 05:17:58,080    INFO scheduling health checks:
2019-10-31 05:17:58,117    INFO scheduling jobs:
2019-10-31 05:17:58,119   DEBUG - qemu
2019-10-31 05:17:58,188   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:17:58,188   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:17:58,198    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:17:59,287    INFO [INIT] Dropping privileges
2019-10-31 05:17:59,287   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:17:59,287   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:17:59,289    INFO [INIT] Marking all workers as offline
2019-10-31 05:17:59,320    INFO [INIT] LAVA master has started.
2019-10-31 05:17:59,320    INFO [INIT] Using protocol version 3
2019-10-31 05:18:02,622   DEBUG Dhanu => PING(20)
2019-10-31 05:18:02,622 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:18:11,839   DEBUG lava-logs => PING(20)
2019-10-31 05:18:19,328    INFO scheduling health checks:
2019-10-31 05:18:19,364    INFO scheduling jobs:
2019-10-31 05:18:19,367   DEBUG - qemu
2019-10-31 05:18:19,442   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:18:19,442   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:18:19,446    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:18:20,533    INFO [INIT] Dropping privileges
2019-10-31 05:18:20,533   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:18:20,533   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:18:20,534    INFO [INIT] Marking all workers as offline
2019-10-31 05:18:20,565    INFO [INIT] LAVA master has started.
2019-10-31 05:18:20,565    INFO [INIT] Using protocol version 3
2019-10-31 05:18:22,644   DEBUG Dhanu => PING(20)
2019-10-31 05:18:22,645 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:18:31,853   DEBUG lava-logs => PING(20)
2019-10-31 05:18:40,574    INFO scheduling health checks:
2019-10-31 05:18:40,610    INFO scheduling jobs:
2019-10-31 05:18:40,612   DEBUG - qemu
2019-10-31 05:18:40,679   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:18:40,679   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:18:40,683    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:18:41,791    INFO [INIT] Dropping privileges
2019-10-31 05:18:41,791   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:18:41,791   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:18:41,793    INFO [INIT] Marking all workers as offline
2019-10-31 05:18:41,835    INFO [INIT] LAVA master has started.
2019-10-31 05:18:41,835    INFO [INIT] Using protocol version 3
2019-10-31 05:18:42,664   DEBUG Dhanu => PING(20)
2019-10-31 05:18:42,665 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:18:51,866   DEBUG lava-logs => PING(20)
2019-10-31 05:19:01,846    INFO scheduling health checks:
2019-10-31 05:19:01,879    INFO scheduling jobs:
2019-10-31 05:19:01,881   DEBUG - qemu
2019-10-31 05:19:01,953   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:19:01,953   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:19:01,958    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:19:03,049    INFO [INIT] Dropping privileges
2019-10-31 05:19:03,050   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:19:03,050   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:19:03,051    INFO [INIT] Marking all workers as offline
2019-10-31 05:19:03,104    INFO [INIT] LAVA master has started.
2019-10-31 05:19:03,104    INFO [INIT] Using protocol version 3
2019-10-31 05:19:03,255   DEBUG Dhanu => PING(20)
2019-10-31 05:19:03,256 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:19:11,885   DEBUG lava-logs => PING(20)
2019-10-31 05:19:23,115    INFO scheduling health checks:
2019-10-31 05:19:23,170    INFO scheduling jobs:
2019-10-31 05:19:23,173   DEBUG - qemu
2019-10-31 05:19:23,248   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:19:23,249   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:19:23,253    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:19:24,551    INFO [INIT] Dropping privileges
2019-10-31 05:19:24,552   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:19:24,552   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:19:24,553    INFO [INIT] Marking all workers as offline
2019-10-31 05:19:24,606    INFO [INIT] LAVA master has started.
2019-10-31 05:19:24,606    INFO [INIT] Using protocol version 3
2019-10-31 05:19:24,666   DEBUG Dhanu => PING(20)
2019-10-31 05:19:24,667 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:19:31,906   DEBUG lava-logs => PING(20)
2019-10-31 05:19:44,619    INFO scheduling health checks:
2019-10-31 05:19:44,638    INFO scheduling jobs:
2019-10-31 05:19:44,640   DEBUG - qemu
2019-10-31 05:19:44,709   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:19:44,709   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:19:44,714    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:19:45,851    INFO [INIT] Dropping privileges
2019-10-31 05:19:45,852   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:19:45,852   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:19:45,853    INFO [INIT] Marking all workers as offline
2019-10-31 05:19:45,898    INFO [INIT] LAVA master has started.
2019-10-31 05:19:45,898    INFO [INIT] Using protocol version 3
2019-10-31 05:19:51,919   DEBUG lava-logs => PING(20)
2019-10-31 05:20:04,700   DEBUG Dhanu => PING(20)
2019-10-31 05:20:04,701 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:20:05,899    INFO scheduling health checks:
2019-10-31 05:20:05,940    INFO scheduling jobs:
2019-10-31 05:20:05,942   DEBUG - qemu
2019-10-31 05:20:06,013   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:20:06,013   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:20:06,018    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:20:07,337    INFO [INIT] Dropping privileges
2019-10-31 05:20:07,337   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:20:07,337   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:20:07,339    INFO [INIT] Marking all workers as offline
2019-10-31 05:20:07,365    INFO [INIT] LAVA master has started.
2019-10-31 05:20:07,365    INFO [INIT] Using protocol version 3
2019-10-31 05:20:11,932   DEBUG lava-logs => PING(20)
2019-10-31 05:20:24,716   DEBUG Dhanu => PING(20)
2019-10-31 05:20:24,717 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:20:27,367    INFO scheduling health checks:
2019-10-31 05:20:27,409    INFO scheduling jobs:
2019-10-31 05:20:27,412   DEBUG - qemu
2019-10-31 05:20:27,490   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:20:27,490   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:20:27,495    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:20:28,855    INFO [INIT] Dropping privileges
2019-10-31 05:20:28,856   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:20:28,856   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:20:28,857    INFO [INIT] Marking all workers as offline
2019-10-31 05:20:28,889    INFO [INIT] LAVA master has started.
2019-10-31 05:20:28,889    INFO [INIT] Using protocol version 3
2019-10-31 05:20:31,948   DEBUG lava-logs => PING(20)
2019-10-31 05:20:44,732   DEBUG Dhanu => PING(20)
2019-10-31 05:20:44,733 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:20:48,891    INFO scheduling health checks:
2019-10-31 05:20:48,933    INFO scheduling jobs:
2019-10-31 05:20:48,937   DEBUG - qemu
2019-10-31 05:20:49,013   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:20:49,013   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:20:49,018    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:20:50,324    INFO [INIT] Dropping privileges
2019-10-31 05:20:50,324   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:20:50,324   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:20:50,326    INFO [INIT] Marking all workers as offline
2019-10-31 05:20:50,358    INFO [INIT] LAVA master has started.
2019-10-31 05:20:50,358    INFO [INIT] Using protocol version 3
2019-10-31 05:20:51,962   DEBUG lava-logs => PING(20)
2019-10-31 05:21:04,748   DEBUG Dhanu => PING(20)
2019-10-31 05:21:04,749 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:21:10,363    INFO scheduling health checks:
2019-10-31 05:21:10,402    INFO scheduling jobs:
2019-10-31 05:21:10,404   DEBUG - qemu
2019-10-31 05:21:10,473   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:21:10,474   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:21:10,478    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:21:11,825    INFO [INIT] Dropping privileges
2019-10-31 05:21:11,825   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:21:11,825   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:21:11,827    INFO [INIT] Marking all workers as offline
2019-10-31 05:21:11,871    INFO [INIT] LAVA master has started.
2019-10-31 05:21:11,872    INFO [INIT] Using protocol version 3
2019-10-31 05:21:11,975   DEBUG lava-logs => PING(20)
2019-10-31 05:21:24,764   DEBUG Dhanu => PING(20)
2019-10-31 05:21:24,765 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:21:31,879    INFO scheduling health checks:
2019-10-31 05:21:31,915    INFO scheduling jobs:
2019-10-31 05:21:31,918   DEBUG - qemu
2019-10-31 05:21:31,993   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:21:31,993   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:21:31,998    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:21:33,384    INFO [INIT] Dropping privileges
2019-10-31 05:21:33,385   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:21:33,385   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:21:33,386    INFO [INIT] Marking all workers as offline
2019-10-31 05:21:33,430    INFO [INIT] LAVA master has started.
2019-10-31 05:21:33,430    INFO [INIT] Using protocol version 3
2019-10-31 05:21:44,777   DEBUG Dhanu => PING(20)
2019-10-31 05:21:44,777 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:21:52,008   DEBUG lava-logs => PING(20)
2019-10-31 05:21:53,431    INFO scheduling health checks:
2019-10-31 05:21:53,473    INFO scheduling jobs:
2019-10-31 05:21:53,476   DEBUG - qemu
2019-10-31 05:21:53,554   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:21:53,554   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:21:53,559    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:21:54,815    INFO [INIT] Dropping privileges
2019-10-31 05:21:54,815   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:21:54,815   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:21:54,817    INFO [INIT] Marking all workers as offline
2019-10-31 05:21:54,853    INFO [INIT] LAVA master has started.
2019-10-31 05:21:54,853    INFO [INIT] Using protocol version 3
2019-10-31 05:22:04,796   DEBUG Dhanu => PING(20)
2019-10-31 05:22:04,797 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:22:12,024   DEBUG lava-logs => PING(20)
2019-10-31 05:22:14,855    INFO scheduling health checks:
2019-10-31 05:22:14,886    INFO scheduling jobs:
2019-10-31 05:22:14,888   DEBUG - qemu
2019-10-31 05:22:14,959   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:22:14,959   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:22:14,964    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:22:16,076    INFO [INIT] Dropping privileges
2019-10-31 05:22:16,076   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:22:16,076   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:22:16,078    INFO [INIT] Marking all workers as offline
2019-10-31 05:22:16,111    INFO [INIT] LAVA master has started.
2019-10-31 05:22:16,111    INFO [INIT] Using protocol version 3
2019-10-31 05:22:24,812   DEBUG Dhanu => PING(20)
2019-10-31 05:22:24,813 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:22:32,040   DEBUG lava-logs => PING(20)
2019-10-31 05:22:36,115    INFO scheduling health checks:
2019-10-31 05:22:36,144    INFO scheduling jobs:
2019-10-31 05:22:36,146   DEBUG - qemu
2019-10-31 05:22:36,223   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:22:36,223   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:22:36,228    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:22:37,596    INFO [INIT] Dropping privileges
2019-10-31 05:22:37,597   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:22:37,597   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:22:37,598    INFO [INIT] Marking all workers as offline
2019-10-31 05:22:37,635    INFO [INIT] LAVA master has started.
2019-10-31 05:22:37,636    INFO [INIT] Using protocol version 3
2019-10-31 05:22:44,828   DEBUG Dhanu => PING(20)
2019-10-31 05:22:44,829 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:22:52,052   DEBUG lava-logs => PING(20)
2019-10-31 05:22:57,639    INFO scheduling health checks:
2019-10-31 05:22:57,679    INFO scheduling jobs:
2019-10-31 05:22:57,681   DEBUG - qemu
2019-10-31 05:22:57,761   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:22:57,761   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:22:57,799    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:22:59,197    INFO [INIT] Dropping privileges
2019-10-31 05:22:59,197   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:22:59,197   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:22:59,200    INFO [INIT] Marking all workers as offline
2019-10-31 05:22:59,256    INFO [INIT] LAVA master has started.
2019-10-31 05:22:59,257    INFO [INIT] Using protocol version 3
2019-10-31 05:23:04,840   DEBUG Dhanu => PING(20)
2019-10-31 05:23:04,841 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:23:12,067   DEBUG lava-logs => PING(20)
2019-10-31 05:23:19,263    INFO scheduling health checks:
2019-10-31 05:23:19,303    INFO scheduling jobs:
2019-10-31 05:23:19,305   DEBUG - qemu
2019-10-31 05:23:19,380   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:23:19,381   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:23:19,390    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:23:20,573    INFO [INIT] Dropping privileges
2019-10-31 05:23:20,574   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:23:20,574   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:23:20,575    INFO [INIT] Marking all workers as offline
2019-10-31 05:23:20,617    INFO [INIT] LAVA master has started.
2019-10-31 05:23:20,617    INFO [INIT] Using protocol version 3
2019-10-31 05:23:24,857   DEBUG Dhanu => PING(20)
2019-10-31 05:23:24,858 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:23:32,080   DEBUG lava-logs => PING(20)
2019-10-31 05:23:40,625    INFO scheduling health checks:
2019-10-31 05:23:40,661    INFO scheduling jobs:
2019-10-31 05:23:40,663   DEBUG - qemu
2019-10-31 05:23:40,740   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:23:40,740   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:23:40,745    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:23:42,072    INFO [INIT] Dropping privileges
2019-10-31 05:23:42,073   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:23:42,073   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:23:42,074    INFO [INIT] Marking all workers as offline
2019-10-31 05:23:42,108    INFO [INIT] LAVA master has started.
2019-10-31 05:23:42,109    INFO [INIT] Using protocol version 3
2019-10-31 05:23:44,872   DEBUG Dhanu => PING(20)
2019-10-31 05:23:44,873 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:23:52,096   DEBUG lava-logs => PING(20)
2019-10-31 05:24:02,119    INFO scheduling health checks:
2019-10-31 05:24:02,163    INFO scheduling jobs:
2019-10-31 05:24:02,166   DEBUG - qemu
2019-10-31 05:24:02,242   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:24:02,242   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:24:02,247    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:24:03,824    INFO [INIT] Dropping privileges
2019-10-31 05:24:03,874   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:24:03,874   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:24:03,881    INFO [INIT] Marking all workers as offline
2019-10-31 05:24:03,962    INFO [INIT] LAVA master has started.
2019-10-31 05:24:03,962    INFO [INIT] Using protocol version 3
2019-10-31 05:24:04,885   DEBUG Dhanu => PING(20)
2019-10-31 05:24:04,886 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:24:12,116   DEBUG lava-logs => PING(20)
2019-10-31 05:24:23,973    INFO scheduling health checks:
2019-10-31 05:24:23,998    INFO scheduling jobs:
2019-10-31 05:24:24,000   DEBUG - qemu
2019-10-31 05:24:24,078   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:24:24,079   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:24:24,126    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:24:25,334    INFO [INIT] Dropping privileges
2019-10-31 05:24:25,335   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:24:25,335   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:24:25,336    INFO [INIT] Marking all workers as offline
2019-10-31 05:24:25,368    INFO [INIT] LAVA master has started.
2019-10-31 05:24:25,368    INFO [INIT] Using protocol version 3
2019-10-31 05:24:25,488   DEBUG Dhanu => PING(20)
2019-10-31 05:24:25,489 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:24:32,132   DEBUG lava-logs => PING(20)
2019-10-31 05:24:45,379    INFO scheduling health checks:
2019-10-31 05:24:45,412    INFO scheduling jobs:
2019-10-31 05:24:45,413   DEBUG - qemu
2019-10-31 05:24:45,481   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:24:45,481   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:24:45,486    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:24:46,830    INFO [INIT] Dropping privileges
2019-10-31 05:24:46,830   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:24:46,830   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:24:46,832    INFO [INIT] Marking all workers as offline
2019-10-31 05:24:46,858    INFO [INIT] LAVA master has started.
2019-10-31 05:24:46,858    INFO [INIT] Using protocol version 3
2019-10-31 05:24:46,878   DEBUG Dhanu => PING(20)
2019-10-31 05:24:46,879 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:24:52,148   DEBUG lava-logs => PING(20)
2019-10-31 05:25:06,871    INFO scheduling health checks:
2019-10-31 05:25:06,914    INFO scheduling jobs:
2019-10-31 05:25:06,916   DEBUG - qemu
2019-10-31 05:25:07,002   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:25:07,003   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:25:07,054    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:25:08,532    INFO [INIT] Dropping privileges
2019-10-31 05:25:08,533   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:25:08,533   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:25:08,535    INFO [INIT] Marking all workers as offline
2019-10-31 05:25:08,591    INFO [INIT] LAVA master has started.
2019-10-31 05:25:08,591    INFO [INIT] Using protocol version 3
2019-10-31 05:25:12,160   DEBUG lava-logs => PING(20)
2019-10-31 05:25:26,929   DEBUG Dhanu => PING(20)
2019-10-31 05:25:26,930 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:25:28,594    INFO scheduling health checks:
2019-10-31 05:25:28,627    INFO scheduling jobs:
2019-10-31 05:25:28,629   DEBUG - qemu
2019-10-31 05:25:28,707   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:25:28,708   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:25:28,756    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:25:30,159    INFO [INIT] Dropping privileges
2019-10-31 05:25:30,160   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:25:30,160   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:25:30,161    INFO [INIT] Marking all workers as offline
2019-10-31 05:25:30,207    INFO [INIT] LAVA master has started.
2019-10-31 05:25:30,208    INFO [INIT] Using protocol version 3
2019-10-31 05:25:32,175   DEBUG lava-logs => PING(20)
2019-10-31 05:25:46,945   DEBUG Dhanu => PING(20)
2019-10-31 05:25:46,945 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:25:50,211    INFO scheduling health checks:
2019-10-31 05:25:50,274    INFO scheduling jobs:
2019-10-31 05:25:50,277   DEBUG - qemu
2019-10-31 05:25:50,355   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:25:50,355   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:25:50,360    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:25:51,593    INFO [INIT] Dropping privileges
2019-10-31 05:25:51,594   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:25:51,594   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:25:51,595    INFO [INIT] Marking all workers as offline
2019-10-31 05:25:51,631    INFO [INIT] LAVA master has started.
2019-10-31 05:25:51,631    INFO [INIT] Using protocol version 3
2019-10-31 05:25:52,184   DEBUG lava-logs => PING(20)
2019-10-31 05:26:06,960   DEBUG Dhanu => PING(20)
2019-10-31 05:26:06,961 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:26:11,635    INFO scheduling health checks:
2019-10-31 05:26:11,664    INFO scheduling jobs:
2019-10-31 05:26:11,666   DEBUG - qemu
2019-10-31 05:26:11,735   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:26:11,735   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:26:11,740    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:26:12,873    INFO [INIT] Dropping privileges
2019-10-31 05:26:12,874   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:26:12,874   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:26:12,876    INFO [INIT] Marking all workers as offline
2019-10-31 05:26:12,899    INFO [INIT] LAVA master has started.
2019-10-31 05:26:12,900    INFO [INIT] Using protocol version 3
2019-10-31 05:26:12,953   DEBUG lava-logs => PING(20)
2019-10-31 05:26:27,024   DEBUG Dhanu => PING(20)
2019-10-31 05:26:27,024 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:26:32,903    INFO scheduling health checks:
2019-10-31 05:26:32,944    INFO scheduling jobs:
2019-10-31 05:26:32,947   DEBUG - qemu
2019-10-31 05:26:33,026   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:26:33,026   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:26:33,107    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:26:34,525    INFO [INIT] Dropping privileges
2019-10-31 05:26:34,543   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:26:34,543   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:26:34,546    INFO [INIT] Marking all workers as offline
2019-10-31 05:26:34,600    INFO [INIT] LAVA master has started.
2019-10-31 05:26:34,600    INFO [INIT] Using protocol version 3
2019-10-31 05:26:47,036   DEBUG Dhanu => PING(20)
2019-10-31 05:26:47,037 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:26:52,988   DEBUG lava-logs => PING(20)
2019-10-31 05:26:54,603    INFO scheduling health checks:
2019-10-31 05:26:54,624    INFO scheduling jobs:
2019-10-31 05:26:54,625   DEBUG - qemu
2019-10-31 05:26:54,694   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:26:54,694   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:26:54,699    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:26:55,837    INFO [INIT] Dropping privileges
2019-10-31 05:26:55,838   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:26:55,838   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:26:55,839    INFO [INIT] Marking all workers as offline
2019-10-31 05:26:55,871    INFO [INIT] LAVA master has started.
2019-10-31 05:26:55,872    INFO [INIT] Using protocol version 3
2019-10-31 05:27:07,048   DEBUG Dhanu => PING(20)
2019-10-31 05:27:07,049 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:27:13,004   DEBUG lava-logs => PING(20)
2019-10-31 05:27:15,875    INFO scheduling health checks:
2019-10-31 05:27:15,904    INFO scheduling jobs:
2019-10-31 05:27:15,907   DEBUG - qemu
2019-10-31 05:27:15,984   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:27:15,984   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:27:15,989    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:27:17,316    INFO [INIT] Dropping privileges
2019-10-31 05:27:17,317   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:27:17,317   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:27:17,318    INFO [INIT] Marking all workers as offline
2019-10-31 05:27:17,397    INFO [INIT] LAVA master has started.
2019-10-31 05:27:17,397    INFO [INIT] Using protocol version 3
2019-10-31 05:27:27,064   DEBUG Dhanu => PING(20)
2019-10-31 05:27:27,065 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:27:33,016   DEBUG lava-logs => PING(20)
2019-10-31 05:27:37,399    INFO scheduling health checks:
2019-10-31 05:27:37,473    INFO scheduling jobs:
2019-10-31 05:27:37,475   DEBUG - qemu
2019-10-31 05:27:37,577   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:27:37,577   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:27:37,614    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:27:39,380    INFO [INIT] Dropping privileges
2019-10-31 05:27:39,394   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:27:39,394   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:27:39,397    INFO [INIT] Marking all workers as offline
2019-10-31 05:27:39,470    INFO [INIT] LAVA master has started.
2019-10-31 05:27:39,470    INFO [INIT] Using protocol version 3
2019-10-31 05:27:47,080   DEBUG Dhanu => PING(20)
2019-10-31 05:27:47,081 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:27:53,028   DEBUG lava-logs => PING(20)
2019-10-31 05:27:59,475    INFO scheduling health checks:
2019-10-31 05:27:59,519    INFO scheduling jobs:
2019-10-31 05:27:59,523   DEBUG - qemu
2019-10-31 05:27:59,606   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:27:59,606   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:27:59,610    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:28:00,835    INFO [INIT] Dropping privileges
2019-10-31 05:28:00,835   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:28:00,835   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:28:00,837    INFO [INIT] Marking all workers as offline
2019-10-31 05:28:00,877    INFO [INIT] LAVA master has started.
2019-10-31 05:28:00,878    INFO [INIT] Using protocol version 3
2019-10-31 05:28:07,093   DEBUG Dhanu => PING(20)
2019-10-31 05:28:07,093 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:28:13,040   DEBUG lava-logs => PING(20)
2019-10-31 05:28:20,883    INFO scheduling health checks:
2019-10-31 05:28:20,921    INFO scheduling jobs:
2019-10-31 05:28:20,924   DEBUG - qemu
2019-10-31 05:28:21,014   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:28:21,014   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:28:21,023    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:28:22,456    INFO [INIT] Dropping privileges
2019-10-31 05:28:22,456   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:28:22,456   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:28:22,458    INFO [INIT] Marking all workers as offline
2019-10-31 05:28:22,490    INFO [INIT] LAVA master has started.
2019-10-31 05:28:22,490    INFO [INIT] Using protocol version 3
2019-10-31 05:28:27,108   DEBUG Dhanu => PING(20)
2019-10-31 05:28:27,110 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:28:33,052   DEBUG lava-logs => PING(20)
2019-10-31 05:28:42,499    INFO scheduling health checks:
2019-10-31 05:28:42,535    INFO scheduling jobs:
2019-10-31 05:28:42,538   DEBUG - qemu
2019-10-31 05:28:42,628   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:28:42,628   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:28:42,664    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:28:43,959    INFO [INIT] Dropping privileges
2019-10-31 05:28:43,960   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:28:43,960   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:28:43,962    INFO [INIT] Marking all workers as offline
2019-10-31 05:28:44,004    INFO [INIT] LAVA master has started.
2019-10-31 05:28:44,004    INFO [INIT] Using protocol version 3
2019-10-31 05:28:47,128   DEBUG Dhanu => PING(20)
2019-10-31 05:28:47,129 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:28:53,072   DEBUG lava-logs => PING(20)
2019-10-31 05:29:04,011    INFO scheduling health checks:
2019-10-31 05:29:04,048    INFO scheduling jobs:
2019-10-31 05:29:04,050   DEBUG - qemu
2019-10-31 05:29:04,125   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:29:04,125   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:29:04,160    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:29:05,624    INFO [INIT] Dropping privileges
2019-10-31 05:29:05,625   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:29:05,626   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:29:05,630    INFO [INIT] Marking all workers as offline
2019-10-31 05:29:05,662    INFO [INIT] LAVA master has started.
2019-10-31 05:29:05,662    INFO [INIT] Using protocol version 3
2019-10-31 05:29:07,142   DEBUG Dhanu => PING(20)
2019-10-31 05:29:07,142 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:29:13,090   DEBUG lava-logs => PING(20)
2019-10-31 05:29:25,671    INFO scheduling health checks:
2019-10-31 05:29:25,705    INFO scheduling jobs:
2019-10-31 05:29:25,707   DEBUG - qemu
2019-10-31 05:29:25,780   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:29:25,780   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:29:25,785    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:29:27,087    INFO [INIT] Dropping privileges
2019-10-31 05:29:27,088   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:29:27,088   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:29:27,089    INFO [INIT] Marking all workers as offline
2019-10-31 05:29:27,130    INFO [INIT] LAVA master has started.
2019-10-31 05:29:27,130    INFO [INIT] Using protocol version 3
2019-10-31 05:29:27,156   DEBUG Dhanu => PING(20)
2019-10-31 05:29:27,157 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:29:33,104   DEBUG lava-logs => PING(20)
2019-10-31 05:29:47,143    INFO scheduling health checks:
2019-10-31 05:29:47,174    INFO scheduling jobs:
2019-10-31 05:29:47,176   DEBUG - qemu
2019-10-31 05:29:47,260   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:29:47,260   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:29:47,268    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:29:48,578    INFO [INIT] Dropping privileges
2019-10-31 05:29:48,578   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:29:48,578   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:29:48,580    INFO [INIT] Marking all workers as offline
2019-10-31 05:29:48,621    INFO [INIT] LAVA master has started.
2019-10-31 05:29:48,622    INFO [INIT] Using protocol version 3
2019-10-31 05:29:53,121   DEBUG lava-logs => PING(20)
2019-10-31 05:30:07,211   DEBUG Dhanu => PING(20)
2019-10-31 05:30:07,212 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:30:08,623    INFO scheduling health checks:
2019-10-31 05:30:08,654    INFO scheduling jobs:
2019-10-31 05:30:08,656   DEBUG - qemu
2019-10-31 05:30:08,729   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:30:08,729   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:30:08,765    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:30:10,260    INFO [INIT] Dropping privileges
2019-10-31 05:30:10,260   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:30:10,260   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:30:10,262    INFO [INIT] Marking all workers as offline
2019-10-31 05:30:10,353    INFO [INIT] LAVA master has started.
2019-10-31 05:30:10,354    INFO [INIT] Using protocol version 3
2019-10-31 05:30:13,135   DEBUG lava-logs => PING(20)
2019-10-31 05:30:27,229   DEBUG Dhanu => PING(20)
2019-10-31 05:30:27,229 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:30:30,355    INFO scheduling health checks:
2019-10-31 05:30:30,389    INFO scheduling jobs:
2019-10-31 05:30:30,391   DEBUG - qemu
2019-10-31 05:30:30,479   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:30:30,479   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:30:30,484    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:30:31,961    INFO [INIT] Dropping privileges
2019-10-31 05:30:31,961   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:30:31,961   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:30:31,963    INFO [INIT] Marking all workers as offline
2019-10-31 05:30:32,015    INFO [INIT] LAVA master has started.
2019-10-31 05:30:32,016    INFO [INIT] Using protocol version 3
2019-10-31 05:30:33,145   DEBUG lava-logs => PING(20)
2019-10-31 05:30:47,244   DEBUG Dhanu => PING(20)
2019-10-31 05:30:47,245 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:30:52,019    INFO scheduling health checks:
2019-10-31 05:30:52,058    INFO scheduling jobs:
2019-10-31 05:30:52,062   DEBUG - qemu
2019-10-31 05:30:52,140   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:30:52,141   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:30:52,145    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:30:53,450    INFO [INIT] Dropping privileges
2019-10-31 05:30:53,450   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:30:53,450   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:30:53,452    INFO [INIT] Marking all workers as offline
2019-10-31 05:30:53,495    INFO [INIT] LAVA master has started.
2019-10-31 05:30:53,496    INFO [INIT] Using protocol version 3
2019-10-31 05:30:53,512   DEBUG lava-logs => PING(20)
2019-10-31 05:31:07,273   DEBUG Dhanu => PING(20)
2019-10-31 05:31:07,282 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:31:13,499    INFO scheduling health checks:
2019-10-31 05:31:13,549    INFO scheduling jobs:
2019-10-31 05:31:13,551   DEBUG - qemu
2019-10-31 05:31:13,620   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:31:13,620   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:31:13,667    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:31:15,393    INFO [INIT] Dropping privileges
2019-10-31 05:31:15,393   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:31:15,393   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:31:15,395    INFO [INIT] Marking all workers as offline
2019-10-31 05:31:15,447    INFO [INIT] LAVA master has started.
2019-10-31 05:31:15,447    INFO [INIT] Using protocol version 3
2019-10-31 05:31:27,296   DEBUG Dhanu => PING(20)
2019-10-31 05:31:27,297 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:31:33,548   DEBUG lava-logs => PING(20)
2019-10-31 05:31:35,450    INFO scheduling health checks:
2019-10-31 05:31:35,485    INFO scheduling jobs:
2019-10-31 05:31:35,486   DEBUG - qemu
2019-10-31 05:31:35,555   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:31:35,555   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:31:35,560    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:31:36,819    INFO [INIT] Dropping privileges
2019-10-31 05:31:36,819   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:31:36,819   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:31:36,838    INFO [INIT] Marking all workers as offline
2019-10-31 05:31:36,876    INFO [INIT] LAVA master has started.
2019-10-31 05:31:36,877    INFO [INIT] Using protocol version 3
2019-10-31 05:31:47,308   DEBUG Dhanu => PING(20)
2019-10-31 05:31:47,309 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:31:53,564   DEBUG lava-logs => PING(20)
2019-10-31 05:31:56,879    INFO scheduling health checks:
2019-10-31 05:31:56,920    INFO scheduling jobs:
2019-10-31 05:31:56,923   DEBUG - qemu
2019-10-31 05:31:57,000   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:31:57,000   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:31:57,005    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:31:58,309    INFO [INIT] Dropping privileges
2019-10-31 05:31:58,310   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:31:58,310   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:31:58,311    INFO [INIT] Marking all workers as offline
2019-10-31 05:31:58,345    INFO [INIT] LAVA master has started.
2019-10-31 05:31:58,345    INFO [INIT] Using protocol version 3
2019-10-31 05:32:07,328   DEBUG Dhanu => PING(20)
2019-10-31 05:32:07,329 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:32:13,576   DEBUG lava-logs => PING(20)
2019-10-31 05:32:18,374    INFO scheduling health checks:
2019-10-31 05:32:18,467    INFO scheduling jobs:
2019-10-31 05:32:18,469   DEBUG - qemu
2019-10-31 05:32:18,558   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:32:18,558   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:32:18,596    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:32:20,320    INFO [INIT] Dropping privileges
2019-10-31 05:32:20,320   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:32:20,320   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:32:20,322    INFO [INIT] Marking all workers as offline
2019-10-31 05:32:20,376    INFO [INIT] LAVA master has started.
2019-10-31 05:32:20,376    INFO [INIT] Using protocol version 3
2019-10-31 05:32:27,358   DEBUG Dhanu => PING(20)
2019-10-31 05:32:27,359 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:32:33,591   DEBUG lava-logs => PING(20)
2019-10-31 05:32:40,379    INFO scheduling health checks:
2019-10-31 05:32:40,402    INFO scheduling jobs:
2019-10-31 05:32:40,403   DEBUG - qemu
2019-10-31 05:32:40,473   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:32:40,473   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:32:40,503    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:32:41,836    INFO [INIT] Dropping privileges
2019-10-31 05:32:41,836   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:32:41,837   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:32:41,838    INFO [INIT] Marking all workers as offline
2019-10-31 05:32:41,872    INFO [INIT] LAVA master has started.
2019-10-31 05:32:41,872    INFO [INIT] Using protocol version 3
2019-10-31 05:32:47,372   DEBUG Dhanu => PING(20)
2019-10-31 05:32:47,373 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:32:53,604   DEBUG lava-logs => PING(20)
2019-10-31 05:33:01,880    INFO scheduling health checks:
2019-10-31 05:33:01,915    INFO scheduling jobs:
2019-10-31 05:33:01,917   DEBUG - qemu
2019-10-31 05:33:01,994   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:33:01,995   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:33:01,999    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:33:03,329    INFO [INIT] Dropping privileges
2019-10-31 05:33:03,329   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:33:03,329   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:33:03,331    INFO [INIT] Marking all workers as offline
2019-10-31 05:33:03,374    INFO [INIT] LAVA master has started.
2019-10-31 05:33:03,374    INFO [INIT] Using protocol version 3
2019-10-31 05:33:07,392   DEBUG Dhanu => PING(20)
2019-10-31 05:33:07,393 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:33:13,616   DEBUG lava-logs => PING(20)
2019-10-31 05:33:23,383    INFO scheduling health checks:
2019-10-31 05:33:23,428    INFO scheduling jobs:
2019-10-31 05:33:23,431   DEBUG - qemu
2019-10-31 05:33:23,517   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:33:23,517   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:33:23,522    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:33:24,918    INFO [INIT] Dropping privileges
2019-10-31 05:33:24,918   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:33:24,918   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:33:24,920    INFO [INIT] Marking all workers as offline
2019-10-31 05:33:24,987    INFO [INIT] LAVA master has started.
2019-10-31 05:33:24,987    INFO [INIT] Using protocol version 3
2019-10-31 05:33:27,419   DEBUG Dhanu => PING(20)
2019-10-31 05:33:27,420 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:33:33,632   DEBUG lava-logs => PING(20)
2019-10-31 05:33:44,996    INFO scheduling health checks:
2019-10-31 05:33:45,030    INFO scheduling jobs:
2019-10-31 05:33:45,032   DEBUG - qemu
2019-10-31 05:33:45,119   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:33:45,119   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:33:45,159    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:33:46,904    INFO [INIT] Dropping privileges
2019-10-31 05:33:46,904   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:33:46,904   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:33:46,919    INFO [INIT] Marking all workers as offline
2019-10-31 05:33:46,973    INFO [INIT] LAVA master has started.
2019-10-31 05:33:46,973    INFO [INIT] Using protocol version 3
2019-10-31 05:33:47,433   DEBUG Dhanu => PING(20)
2019-10-31 05:33:47,434 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:33:53,648   DEBUG lava-logs => PING(20)
2019-10-31 05:34:06,983    INFO scheduling health checks:
2019-10-31 05:34:07,021    INFO scheduling jobs:
2019-10-31 05:34:07,024   DEBUG - qemu
2019-10-31 05:34:07,110   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:34:07,111   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:34:07,116    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:34:08,587    INFO [INIT] Dropping privileges
2019-10-31 05:34:08,588   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:34:08,588   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:34:08,589    INFO [INIT] Marking all workers as offline
2019-10-31 05:34:08,635    INFO [INIT] LAVA master has started.
2019-10-31 05:34:08,636    INFO [INIT] Using protocol version 3
2019-10-31 05:34:08,722   DEBUG Dhanu => PING(20)
2019-10-31 05:34:08,724 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:34:13,660   DEBUG lava-logs => PING(20)
2019-10-31 05:34:28,649    INFO scheduling health checks:
2019-10-31 05:34:28,679    INFO scheduling jobs:
2019-10-31 05:34:28,681   DEBUG - qemu
2019-10-31 05:34:28,768   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:34:28,768   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:34:28,775    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:34:30,144    INFO [INIT] Dropping privileges
2019-10-31 05:34:30,145   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:34:30,145   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:34:30,146    INFO [INIT] Marking all workers as offline
2019-10-31 05:34:30,170    INFO [INIT] LAVA master has started.
2019-10-31 05:34:30,170    INFO [INIT] Using protocol version 3
2019-10-31 05:34:33,672   DEBUG lava-logs => PING(20)
2019-10-31 05:34:48,794   DEBUG Dhanu => PING(20)
2019-10-31 05:34:48,848 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:34:50,171    INFO scheduling health checks:
2019-10-31 05:34:50,204    INFO scheduling jobs:
2019-10-31 05:34:50,206   DEBUG - qemu
2019-10-31 05:34:50,284   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:34:50,284   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:34:50,319    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:34:52,043    INFO [INIT] Dropping privileges
2019-10-31 05:34:52,043   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:34:52,043   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:34:52,058    INFO [INIT] Marking all workers as offline
2019-10-31 05:34:52,134    INFO [INIT] LAVA master has started.
2019-10-31 05:34:52,135    INFO [INIT] Using protocol version 3
2019-10-31 05:34:53,686   DEBUG lava-logs => PING(20)
2019-10-31 05:35:08,864   DEBUG Dhanu => PING(20)
2019-10-31 05:35:08,865 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:35:12,137    INFO scheduling health checks:
2019-10-31 05:35:12,161    INFO scheduling jobs:
2019-10-31 05:35:12,163   DEBUG - qemu
2019-10-31 05:35:12,241   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:35:12,242   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:35:12,247    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:35:13,587    INFO [INIT] Dropping privileges
2019-10-31 05:35:13,588   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:35:13,588   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:35:13,589    INFO [INIT] Marking all workers as offline
2019-10-31 05:35:13,678    INFO [INIT] LAVA master has started.
2019-10-31 05:35:13,678    INFO [INIT] Using protocol version 3
2019-10-31 05:35:13,774   DEBUG lava-logs => PING(20)
2019-10-31 05:35:28,880   DEBUG Dhanu => PING(20)
2019-10-31 05:35:28,881 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:35:33,683    INFO scheduling health checks:
2019-10-31 05:35:33,719    INFO scheduling jobs:
2019-10-31 05:35:33,720   DEBUG - qemu
2019-10-31 05:35:33,790   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:35:33,790   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:35:33,795    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:35:35,081    INFO [INIT] Dropping privileges
2019-10-31 05:35:35,081   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:35:35,081   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:35:35,083    INFO [INIT] Marking all workers as offline
2019-10-31 05:35:35,121    INFO [INIT] LAVA master has started.
2019-10-31 05:35:35,122    INFO [INIT] Using protocol version 3
2019-10-31 05:35:48,896   DEBUG Dhanu => PING(20)
2019-10-31 05:35:48,897 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:35:53,845   DEBUG lava-logs => PING(20)
2019-10-31 05:35:55,123    INFO scheduling health checks:
2019-10-31 05:35:55,176    INFO scheduling jobs:
2019-10-31 05:35:55,179   DEBUG - qemu
2019-10-31 05:35:55,253   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:35:55,253   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:35:55,304    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:35:56,857    INFO [INIT] Dropping privileges
2019-10-31 05:35:56,857   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:35:56,858   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:35:56,859    INFO [INIT] Marking all workers as offline
2019-10-31 05:35:56,942    INFO [INIT] LAVA master has started.
2019-10-31 05:35:56,943    INFO [INIT] Using protocol version 3
2019-10-31 05:36:08,913   DEBUG Dhanu => PING(20)
2019-10-31 05:36:08,915 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:36:13,860   DEBUG lava-logs => PING(20)
2019-10-31 05:36:16,947    INFO scheduling health checks:
2019-10-31 05:36:16,990    INFO scheduling jobs:
2019-10-31 05:36:16,993   DEBUG - qemu
2019-10-31 05:36:17,074   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:36:17,074   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:36:17,119    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:36:18,444    INFO [INIT] Dropping privileges
2019-10-31 05:36:18,444   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:36:18,444   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:36:18,446    INFO [INIT] Marking all workers as offline
2019-10-31 05:36:18,481    INFO [INIT] LAVA master has started.
2019-10-31 05:36:18,481    INFO [INIT] Using protocol version 3
2019-10-31 05:36:28,928   DEBUG Dhanu => PING(20)
2019-10-31 05:36:28,929 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:36:33,876   DEBUG lava-logs => PING(20)
2019-10-31 05:36:38,483    INFO scheduling health checks:
2019-10-31 05:36:38,514    INFO scheduling jobs:
2019-10-31 05:36:38,515   DEBUG - qemu
2019-10-31 05:36:38,591   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:36:38,592   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:36:38,600    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:36:39,850    INFO [INIT] Dropping privileges
2019-10-31 05:36:39,851   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:36:39,851   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:36:39,853    INFO [INIT] Marking all workers as offline
2019-10-31 05:36:39,894    INFO [INIT] LAVA master has started.
2019-10-31 05:36:39,895    INFO [INIT] Using protocol version 3
2019-10-31 05:36:44,181    INFO [POLL] Received a signal, leaving
2019-10-31 05:36:44,181    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:36:45,197    INFO [INIT] Dropping privileges
2019-10-31 05:36:45,197   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:36:45,198   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:36:45,199    INFO [INIT] Marking all workers as offline
2019-10-31 05:36:45,239    INFO [INIT] LAVA master has started.
2019-10-31 05:36:45,240    INFO [INIT] Using protocol version 3
2019-10-31 05:36:48,944   DEBUG Dhanu => PING(20)
2019-10-31 05:36:48,945 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:36:49,571    INFO Dhanu => HELLO
2019-10-31 05:36:49,571 WARNING Dispatcher <Dhanu> has RESTARTED
2019-10-31 05:36:53,888   DEBUG lava-logs => PING(20)
2019-10-31 05:36:54,576   DEBUG Dhanu => PING(20)
2019-10-31 05:37:05,242    INFO scheduling health checks:
2019-10-31 05:37:05,272    INFO scheduling jobs:
2019-10-31 05:37:05,275   DEBUG - qemu
2019-10-31 05:37:05,351   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:37:05,351   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:37:05,356    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:37:06,598    INFO [INIT] Dropping privileges
2019-10-31 05:37:06,598   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:37:06,598   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:37:06,600    INFO [INIT] Marking all workers as offline
2019-10-31 05:37:06,641    INFO [INIT] LAVA master has started.
2019-10-31 05:37:06,641    INFO [INIT] Using protocol version 3
2019-10-31 05:37:14,665   DEBUG Dhanu => PING(20)
2019-10-31 05:37:14,665 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:37:22,811   DEBUG lava-logs => PING(20)
2019-10-31 05:37:22,829   DEBUG lava-logs => PING(20)
2019-10-31 05:37:26,645    INFO scheduling health checks:
2019-10-31 05:37:26,663    INFO scheduling jobs:
2019-10-31 05:37:26,665   DEBUG - qemu
2019-10-31 05:37:26,742   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:37:26,743   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:37:26,776    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:37:28,295    INFO [INIT] Dropping privileges
2019-10-31 05:37:28,296   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:37:28,296   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:37:28,299    INFO [INIT] Marking all workers as offline
2019-10-31 05:37:28,343    INFO [INIT] LAVA master has started.
2019-10-31 05:37:28,343    INFO [INIT] Using protocol version 3
2019-10-31 05:37:34,700   DEBUG Dhanu => PING(20)
2019-10-31 05:37:34,700 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:37:42,844   DEBUG lava-logs => PING(20)
2019-10-31 05:37:48,347    INFO scheduling health checks:
2019-10-31 05:37:48,454    INFO scheduling jobs:
2019-10-31 05:37:48,456   DEBUG - qemu
2019-10-31 05:37:48,549   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:37:48,549   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:37:48,554    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:37:49,871    INFO [INIT] Dropping privileges
2019-10-31 05:37:49,871   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:37:49,871   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:37:49,873    INFO [INIT] Marking all workers as offline
2019-10-31 05:37:49,923    INFO [INIT] LAVA master has started.
2019-10-31 05:37:49,923    INFO [INIT] Using protocol version 3
2019-10-31 05:37:54,716   DEBUG Dhanu => PING(20)
2019-10-31 05:37:54,717 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:38:02,856   DEBUG lava-logs => PING(20)
2019-10-31 05:38:09,927    INFO scheduling health checks:
2019-10-31 05:38:09,967    INFO scheduling jobs:
2019-10-31 05:38:09,970   DEBUG - qemu
2019-10-31 05:38:10,064   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:38:10,064   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:38:10,069    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:38:11,496    INFO [INIT] Dropping privileges
2019-10-31 05:38:11,496   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:38:11,496   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:38:11,500    INFO [INIT] Marking all workers as offline
2019-10-31 05:38:11,539    INFO [INIT] LAVA master has started.
2019-10-31 05:38:11,539    INFO [INIT] Using protocol version 3
2019-10-31 05:38:14,732   DEBUG Dhanu => PING(20)
2019-10-31 05:38:14,732 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:38:22,868   DEBUG lava-logs => PING(20)
2019-10-31 05:38:31,547    INFO scheduling health checks:
2019-10-31 05:38:31,592    INFO scheduling jobs:
2019-10-31 05:38:31,594   DEBUG - qemu
2019-10-31 05:38:31,678   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:38:31,678   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:38:31,685    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:38:33,106    INFO [INIT] Dropping privileges
2019-10-31 05:38:33,106   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:38:33,106   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:38:33,109    INFO [INIT] Marking all workers as offline
2019-10-31 05:38:33,162    INFO [INIT] LAVA master has started.
2019-10-31 05:38:33,162    INFO [INIT] Using protocol version 3
2019-10-31 05:38:34,746   DEBUG Dhanu => PING(20)
2019-10-31 05:38:34,746 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:38:42,884   DEBUG lava-logs => PING(20)
2019-10-31 05:38:53,172    INFO scheduling health checks:
2019-10-31 05:38:53,249    INFO scheduling jobs:
2019-10-31 05:38:53,252   DEBUG - qemu
2019-10-31 05:38:53,331   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:38:53,331   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:38:53,365    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:38:54,652    INFO [INIT] Dropping privileges
2019-10-31 05:38:54,653   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:38:54,653   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:38:54,654    INFO [INIT] Marking all workers as offline
2019-10-31 05:38:54,685    INFO [INIT] LAVA master has started.
2019-10-31 05:38:54,685    INFO [INIT] Using protocol version 3
2019-10-31 05:38:54,849   DEBUG Dhanu => PING(20)
2019-10-31 05:38:54,849 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:39:02,904   DEBUG lava-logs => PING(20)
2019-10-31 05:39:14,695    INFO scheduling health checks:
2019-10-31 05:39:14,729    INFO scheduling jobs:
2019-10-31 05:39:14,732   DEBUG - qemu
2019-10-31 05:39:14,808   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:39:14,808   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:39:14,815    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:39:16,217    INFO [INIT] Dropping privileges
2019-10-31 05:39:16,217   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:39:16,218   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:39:16,219    INFO [INIT] Marking all workers as offline
2019-10-31 05:39:16,243    INFO [INIT] LAVA master has started.
2019-10-31 05:39:16,243    INFO [INIT] Using protocol version 3
2019-10-31 05:39:16,326   DEBUG Dhanu => PING(20)
2019-10-31 05:39:16,327 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:39:22,922   DEBUG lava-logs => PING(20)
2019-10-31 05:39:36,255    INFO scheduling health checks:
2019-10-31 05:39:36,286    INFO scheduling jobs:
2019-10-31 05:39:36,288   DEBUG - qemu
2019-10-31 05:39:36,362   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:39:36,362   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:39:36,367    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:39:37,648    INFO [INIT] Dropping privileges
2019-10-31 05:39:37,649   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:39:37,649   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:39:37,651    INFO [INIT] Marking all workers as offline
2019-10-31 05:39:37,698    INFO [INIT] LAVA master has started.
2019-10-31 05:39:37,699    INFO [INIT] Using protocol version 3
2019-10-31 05:39:42,937   DEBUG lava-logs => PING(20)
2019-10-31 05:39:56,360   DEBUG Dhanu => PING(20)
2019-10-31 05:39:56,361 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:39:57,699    INFO scheduling health checks:
2019-10-31 05:39:57,767    INFO scheduling jobs:
2019-10-31 05:39:57,771   DEBUG - qemu
2019-10-31 05:39:57,850   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:39:57,850   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:39:57,855    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:39:59,105    INFO [INIT] Dropping privileges
2019-10-31 05:39:59,105   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:39:59,105   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:39:59,107    INFO [INIT] Marking all workers as offline
2019-10-31 05:39:59,136    INFO [INIT] LAVA master has started.
2019-10-31 05:39:59,137    INFO [INIT] Using protocol version 3
2019-10-31 05:40:02,954   DEBUG lava-logs => PING(20)
2019-10-31 05:40:16,376   DEBUG Dhanu => PING(20)
2019-10-31 05:40:16,377 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:40:19,139    INFO scheduling health checks:
2019-10-31 05:40:19,180    INFO scheduling jobs:
2019-10-31 05:40:19,182   DEBUG - qemu
2019-10-31 05:40:19,264   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:40:19,265   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:40:19,270    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:40:20,804    INFO [INIT] Dropping privileges
2019-10-31 05:40:20,805   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:40:20,805   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:40:20,806    INFO [INIT] Marking all workers as offline
2019-10-31 05:40:20,837    INFO [INIT] LAVA master has started.
2019-10-31 05:40:20,837    INFO [INIT] Using protocol version 3
2019-10-31 05:40:22,966   DEBUG lava-logs => PING(20)
2019-10-31 05:40:36,392   DEBUG Dhanu => PING(20)
2019-10-31 05:40:36,393 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:40:40,839    INFO scheduling health checks:
2019-10-31 05:40:40,882    INFO scheduling jobs:
2019-10-31 05:40:40,884   DEBUG - qemu
2019-10-31 05:40:40,983   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:40:40,983   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:40:40,990    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:40:42,531    INFO [INIT] Dropping privileges
2019-10-31 05:40:42,531   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:40:42,531   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:40:42,533    INFO [INIT] Marking all workers as offline
2019-10-31 05:40:42,596    INFO [INIT] LAVA master has started.
2019-10-31 05:40:42,596    INFO [INIT] Using protocol version 3
2019-10-31 05:40:42,981   DEBUG lava-logs => PING(20)
2019-10-31 05:40:56,409   DEBUG Dhanu => PING(20)
2019-10-31 05:40:56,410 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:41:02,627    INFO scheduling health checks:
2019-10-31 05:41:02,674    INFO scheduling jobs:
2019-10-31 05:41:02,676   DEBUG - qemu
2019-10-31 05:41:02,767   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:41:02,767   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:41:02,812    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:41:04,279    INFO [INIT] Dropping privileges
2019-10-31 05:41:04,280   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:41:04,280   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:41:04,292    INFO [INIT] Marking all workers as offline
2019-10-31 05:41:04,320    INFO [INIT] LAVA master has started.
2019-10-31 05:41:04,320    INFO [INIT] Using protocol version 3
2019-10-31 05:41:04,390   DEBUG lava-logs => PING(20)
2019-10-31 05:41:16,428   DEBUG Dhanu => PING(20)
2019-10-31 05:41:16,428 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:41:24,334    INFO scheduling health checks:
2019-10-31 05:41:24,419    INFO scheduling jobs:
2019-10-31 05:41:24,423   DEBUG - qemu
2019-10-31 05:41:24,527   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:41:24,527   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:41:24,566    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:41:26,002    INFO [INIT] Dropping privileges
2019-10-31 05:41:26,003   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:41:26,003   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:41:26,005    INFO [INIT] Marking all workers as offline
2019-10-31 05:41:26,043    INFO [INIT] LAVA master has started.
2019-10-31 05:41:26,044    INFO [INIT] Using protocol version 3
2019-10-31 05:41:36,440   DEBUG Dhanu => PING(20)
2019-10-31 05:41:36,441 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:41:44,424   DEBUG lava-logs => PING(20)
2019-10-31 05:41:46,045    INFO scheduling health checks:
2019-10-31 05:41:46,077    INFO scheduling jobs:
2019-10-31 05:41:46,079   DEBUG - qemu
2019-10-31 05:41:46,152   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:41:46,152   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:41:46,161    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:41:47,322    INFO [INIT] Dropping privileges
2019-10-31 05:41:47,322   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:41:47,323   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:41:47,324    INFO [INIT] Marking all workers as offline
2019-10-31 05:41:47,368    INFO [INIT] LAVA master has started.
2019-10-31 05:41:47,369    INFO [INIT] Using protocol version 3
2019-10-31 05:41:56,456   DEBUG Dhanu => PING(20)
2019-10-31 05:41:56,457 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:42:04,442   DEBUG lava-logs => PING(20)
2019-10-31 05:42:07,371    INFO scheduling health checks:
2019-10-31 05:42:07,401    INFO scheduling jobs:
2019-10-31 05:42:07,403   DEBUG - qemu
2019-10-31 05:42:07,486   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:42:07,486   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:42:07,491    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:42:09,039    INFO [INIT] Dropping privileges
2019-10-31 05:42:09,040   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:42:09,040   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:42:09,042    INFO [INIT] Marking all workers as offline
2019-10-31 05:42:09,115    INFO [INIT] LAVA master has started.
2019-10-31 05:42:09,115    INFO [INIT] Using protocol version 3
2019-10-31 05:42:16,468   DEBUG Dhanu => PING(20)
2019-10-31 05:42:16,469 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:42:24,456   DEBUG lava-logs => PING(20)
2019-10-31 05:42:29,119    INFO scheduling health checks:
2019-10-31 05:42:29,159    INFO scheduling jobs:
2019-10-31 05:42:29,161   DEBUG - qemu
2019-10-31 05:42:29,238   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:42:29,238   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:42:29,243    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:42:30,477    INFO [INIT] Dropping privileges
2019-10-31 05:42:30,477   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:42:30,477   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:42:30,479    INFO [INIT] Marking all workers as offline
2019-10-31 05:42:30,516    INFO [INIT] LAVA master has started.
2019-10-31 05:42:30,517    INFO [INIT] Using protocol version 3
2019-10-31 05:42:36,480   DEBUG Dhanu => PING(20)
2019-10-31 05:42:36,481 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:42:44,468   DEBUG lava-logs => PING(20)
2019-10-31 05:42:50,520    INFO scheduling health checks:
2019-10-31 05:42:50,561    INFO scheduling jobs:
2019-10-31 05:42:50,563   DEBUG - qemu
2019-10-31 05:42:50,633   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:42:50,633   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:42:50,638    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:42:51,838    INFO [INIT] Dropping privileges
2019-10-31 05:42:51,838   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:42:51,838   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:42:51,840    INFO [INIT] Marking all workers as offline
2019-10-31 05:42:51,897    INFO [INIT] LAVA master has started.
2019-10-31 05:42:51,898    INFO [INIT] Using protocol version 3
2019-10-31 05:42:56,497   DEBUG Dhanu => PING(20)
2019-10-31 05:42:56,498 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:43:04,480   DEBUG lava-logs => PING(20)
2019-10-31 05:43:11,903    INFO scheduling health checks:
2019-10-31 05:43:11,941    INFO scheduling jobs:
2019-10-31 05:43:11,944   DEBUG - qemu
2019-10-31 05:43:12,028   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:43:12,028   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:43:12,033    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:43:13,495    INFO [INIT] Dropping privileges
2019-10-31 05:43:13,496   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:43:13,496   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:43:13,499    INFO [INIT] Marking all workers as offline
2019-10-31 05:43:13,533    INFO [INIT] LAVA master has started.
2019-10-31 05:43:13,533    INFO [INIT] Using protocol version 3
2019-10-31 05:43:16,514   DEBUG Dhanu => PING(20)
2019-10-31 05:43:16,514 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:43:24,492   DEBUG lava-logs => PING(20)
2019-10-31 05:43:33,557    INFO scheduling health checks:
2019-10-31 05:43:33,632    INFO scheduling jobs:
2019-10-31 05:43:33,636   DEBUG - qemu
2019-10-31 05:43:33,721   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:43:33,721   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:43:33,772    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:43:35,218    INFO [INIT] Dropping privileges
2019-10-31 05:43:35,218   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:43:35,218   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:43:35,220    INFO [INIT] Marking all workers as offline
2019-10-31 05:43:35,245    INFO [INIT] LAVA master has started.
2019-10-31 05:43:35,245    INFO [INIT] Using protocol version 3
2019-10-31 05:43:36,531   DEBUG Dhanu => PING(20)
2019-10-31 05:43:36,532 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:43:44,508   DEBUG lava-logs => PING(20)
2019-10-31 05:43:55,255    INFO scheduling health checks:
2019-10-31 05:43:55,289    INFO scheduling jobs:
2019-10-31 05:43:55,292   DEBUG - qemu
2019-10-31 05:43:55,370   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:43:55,370   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:43:55,376    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:43:56,795    INFO [INIT] Dropping privileges
2019-10-31 05:43:56,796   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:43:56,796   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:43:56,800    INFO [INIT] Marking all workers as offline
2019-10-31 05:43:56,835    INFO [INIT] LAVA master has started.
2019-10-31 05:43:56,836    INFO [INIT] Using protocol version 3
2019-10-31 05:43:56,897   DEBUG Dhanu => PING(20)
2019-10-31 05:43:56,897 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:44:04,529   DEBUG lava-logs => PING(20)
2019-10-31 05:44:16,848    INFO scheduling health checks:
2019-10-31 05:44:16,880    INFO scheduling jobs:
2019-10-31 05:44:16,883   DEBUG - qemu
2019-10-31 05:44:16,976   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:44:16,976   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:44:16,981    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:44:18,419    INFO [INIT] Dropping privileges
2019-10-31 05:44:18,420   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:44:18,420   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:44:18,421    INFO [INIT] Marking all workers as offline
2019-10-31 05:44:18,461    INFO [INIT] LAVA master has started.
2019-10-31 05:44:18,461    INFO [INIT] Using protocol version 3
2019-10-31 05:44:24,544   DEBUG lava-logs => PING(20)
2019-10-31 05:44:36,929   DEBUG Dhanu => PING(20)
2019-10-31 05:44:36,929 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:44:38,463    INFO scheduling health checks:
2019-10-31 05:44:38,482    INFO scheduling jobs:
2019-10-31 05:44:38,483   DEBUG - qemu
2019-10-31 05:44:38,552   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:44:38,553   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:44:38,558    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:44:39,903    INFO [INIT] Dropping privileges
2019-10-31 05:44:39,903   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:44:39,903   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:44:39,905    INFO [INIT] Marking all workers as offline
2019-10-31 05:44:39,950    INFO [INIT] LAVA master has started.
2019-10-31 05:44:39,951    INFO [INIT] Using protocol version 3
2019-10-31 05:44:44,560   DEBUG lava-logs => PING(20)
2019-10-31 05:44:56,944   DEBUG Dhanu => PING(20)
2019-10-31 05:44:56,945 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:44:59,952    INFO scheduling health checks:
2019-10-31 05:44:59,995    INFO scheduling jobs:
2019-10-31 05:44:59,997   DEBUG - qemu
2019-10-31 05:45:00,093   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:45:00,093   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:45:00,100    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:45:01,482    INFO [INIT] Dropping privileges
2019-10-31 05:45:01,482   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:45:01,482   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:45:01,484    INFO [INIT] Marking all workers as offline
2019-10-31 05:45:01,521    INFO [INIT] LAVA master has started.
2019-10-31 05:45:01,521    INFO [INIT] Using protocol version 3
2019-10-31 05:45:04,575   DEBUG lava-logs => PING(20)
2019-10-31 05:45:16,960   DEBUG Dhanu => PING(20)
2019-10-31 05:45:16,961 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:45:21,523    INFO scheduling health checks:
2019-10-31 05:45:21,553    INFO scheduling jobs:
2019-10-31 05:45:21,555   DEBUG - qemu
2019-10-31 05:45:21,629   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:45:21,629   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:45:21,633    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:45:22,822    INFO [INIT] Dropping privileges
2019-10-31 05:45:22,822   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:45:22,822   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:45:22,824    INFO [INIT] Marking all workers as offline
2019-10-31 05:45:22,878    INFO [INIT] LAVA master has started.
2019-10-31 05:45:22,879    INFO [INIT] Using protocol version 3
2019-10-31 05:45:24,586   DEBUG lava-logs => PING(20)
2019-10-31 05:45:36,976   DEBUG Dhanu => PING(20)
2019-10-31 05:45:36,977 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:45:42,883    INFO scheduling health checks:
2019-10-31 05:45:42,922    INFO scheduling jobs:
2019-10-31 05:45:42,924   DEBUG - qemu
2019-10-31 05:45:42,998   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:45:42,998   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:45:43,003    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:45:44,346    INFO [INIT] Dropping privileges
2019-10-31 05:45:44,346   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:45:44,346   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:45:44,348    INFO [INIT] Marking all workers as offline
2019-10-31 05:45:44,380    INFO [INIT] LAVA master has started.
2019-10-31 05:45:44,381    INFO [INIT] Using protocol version 3
2019-10-31 05:45:44,596   DEBUG lava-logs => PING(20)
2019-10-31 05:45:56,989   DEBUG Dhanu => PING(20)
2019-10-31 05:45:56,990 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:46:04,387    INFO scheduling health checks:
2019-10-31 05:46:04,446    INFO scheduling jobs:
2019-10-31 05:46:04,449   DEBUG - qemu
2019-10-31 05:46:04,523   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:46:04,524   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:46:04,528    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:46:05,812    INFO [INIT] Dropping privileges
2019-10-31 05:46:05,812   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:46:05,812   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:46:05,814    INFO [INIT] Marking all workers as offline
2019-10-31 05:46:05,860    INFO [INIT] LAVA master has started.
2019-10-31 05:46:05,861    INFO [INIT] Using protocol version 3
2019-10-31 05:46:06,045   DEBUG lava-logs => PING(20)
2019-10-31 05:46:17,005   DEBUG Dhanu => PING(20)
2019-10-31 05:46:17,006 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:46:25,867    INFO scheduling health checks:
2019-10-31 05:46:25,904    INFO scheduling jobs:
2019-10-31 05:46:25,905   DEBUG - qemu
2019-10-31 05:46:25,980   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:46:25,980   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:46:25,985    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:46:27,325    INFO [INIT] Dropping privileges
2019-10-31 05:46:27,326   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:46:27,326   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:46:27,327    INFO [INIT] Marking all workers as offline
2019-10-31 05:46:27,362    INFO [INIT] LAVA master has started.
2019-10-31 05:46:27,363    INFO [INIT] Using protocol version 3
2019-10-31 05:46:27,507   DEBUG lava-logs => PING(20)
2019-10-31 05:46:37,024   DEBUG Dhanu => PING(20)
2019-10-31 05:46:37,025 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:46:47,372    INFO scheduling health checks:
2019-10-31 05:46:47,395    INFO scheduling jobs:
2019-10-31 05:46:47,397   DEBUG - qemu
2019-10-31 05:46:47,471   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:46:47,471   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:46:47,476    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:46:48,572    INFO [INIT] Dropping privileges
2019-10-31 05:46:48,572   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:46:48,572   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:46:48,574    INFO [INIT] Marking all workers as offline
2019-10-31 05:46:48,608    INFO [INIT] LAVA master has started.
2019-10-31 05:46:48,608    INFO [INIT] Using protocol version 3
2019-10-31 05:46:48,725   DEBUG lava-logs => PING(20)
2019-10-31 05:46:57,040   DEBUG Dhanu => PING(20)
2019-10-31 05:46:57,041 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:47:08,619    INFO scheduling health checks:
2019-10-31 05:47:08,652    INFO scheduling jobs:
2019-10-31 05:47:08,655   DEBUG - qemu
2019-10-31 05:47:08,727   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:47:08,728   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:47:08,736    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:47:10,073    INFO [INIT] Dropping privileges
2019-10-31 05:47:10,073   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:47:10,073   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:47:10,075    INFO [INIT] Marking all workers as offline
2019-10-31 05:47:10,122    INFO [INIT] LAVA master has started.
2019-10-31 05:47:10,122    INFO [INIT] Using protocol version 3
2019-10-31 05:47:10,190   DEBUG lava-logs => PING(20)
2019-10-31 05:47:17,052   DEBUG Dhanu => PING(20)
2019-10-31 05:47:17,053 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:47:30,135    INFO scheduling health checks:
2019-10-31 05:47:30,177    INFO scheduling jobs:
2019-10-31 05:47:30,180   DEBUG - qemu
2019-10-31 05:47:30,260   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:47:30,260   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:47:30,265    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:47:31,578    INFO [INIT] Dropping privileges
2019-10-31 05:47:31,578   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:47:31,578   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:47:31,580    INFO [INIT] Marking all workers as offline
2019-10-31 05:47:31,613    INFO [INIT] LAVA master has started.
2019-10-31 05:47:31,613    INFO [INIT] Using protocol version 3
2019-10-31 05:47:37,064   DEBUG Dhanu => PING(20)
2019-10-31 05:47:37,065 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:47:50,226   DEBUG lava-logs => PING(20)
2019-10-31 05:47:51,615    INFO scheduling health checks:
2019-10-31 05:47:51,634    INFO scheduling jobs:
2019-10-31 05:47:51,636   DEBUG - qemu
2019-10-31 05:47:51,704   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:47:51,705   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:47:51,709    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:47:52,848    INFO [INIT] Dropping privileges
2019-10-31 05:47:52,848   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:47:52,849   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:47:52,850    INFO [INIT] Marking all workers as offline
2019-10-31 05:47:52,892    INFO [INIT] LAVA master has started.
2019-10-31 05:47:52,892    INFO [INIT] Using protocol version 3
2019-10-31 05:47:57,080   DEBUG Dhanu => PING(20)
2019-10-31 05:47:57,080 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:48:10,244   DEBUG lava-logs => PING(20)
2019-10-31 05:48:12,895    INFO scheduling health checks:
2019-10-31 05:48:12,936    INFO scheduling jobs:
2019-10-31 05:48:12,939   DEBUG - qemu
2019-10-31 05:48:13,019   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:48:13,020   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:48:13,024    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:48:14,364    INFO [INIT] Dropping privileges
2019-10-31 05:48:14,365   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:48:14,365   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:48:14,367    INFO [INIT] Marking all workers as offline
2019-10-31 05:48:14,439    INFO [INIT] LAVA master has started.
2019-10-31 05:48:14,440    INFO [INIT] Using protocol version 3
2019-10-31 05:48:17,095   DEBUG Dhanu => PING(20)
2019-10-31 05:48:17,095 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:48:30,256   DEBUG lava-logs => PING(20)
2019-10-31 05:48:34,443    INFO scheduling health checks:
2019-10-31 05:48:34,483    INFO scheduling jobs:
2019-10-31 05:48:34,486   DEBUG - qemu
2019-10-31 05:48:34,562   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:48:34,562   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:48:34,567    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:48:35,828    INFO [INIT] Dropping privileges
2019-10-31 05:48:35,828   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:48:35,828   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:48:35,829    INFO [INIT] Marking all workers as offline
2019-10-31 05:48:35,863    INFO [INIT] LAVA master has started.
2019-10-31 05:48:35,863    INFO [INIT] Using protocol version 3
2019-10-31 05:48:37,110   DEBUG Dhanu => PING(20)
2019-10-31 05:48:37,111 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:48:50,268   DEBUG lava-logs => PING(20)
2019-10-31 05:48:55,867    INFO scheduling health checks:
2019-10-31 05:48:55,907    INFO scheduling jobs:
2019-10-31 05:48:55,910   DEBUG - qemu
2019-10-31 05:48:55,986   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:48:55,987   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:48:55,991    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:48:57,315    INFO [INIT] Dropping privileges
2019-10-31 05:48:57,316   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:48:57,316   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:48:57,317    INFO [INIT] Marking all workers as offline
2019-10-31 05:48:57,354    INFO [INIT] LAVA master has started.
2019-10-31 05:48:57,354    INFO [INIT] Using protocol version 3
2019-10-31 05:48:57,432   DEBUG Dhanu => PING(20)
2019-10-31 05:48:57,432 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:49:10,280   DEBUG lava-logs => PING(20)
2019-10-31 05:49:17,359    INFO scheduling health checks:
2019-10-31 05:49:17,398    INFO scheduling jobs:
2019-10-31 05:49:17,401   DEBUG - qemu
2019-10-31 05:49:17,476   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:49:17,476   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:49:17,484    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:49:18,821    INFO [INIT] Dropping privileges
2019-10-31 05:49:18,821   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:49:18,821   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:49:18,822    INFO [INIT] Marking all workers as offline
2019-10-31 05:49:18,856    INFO [INIT] LAVA master has started.
2019-10-31 05:49:18,856    INFO [INIT] Using protocol version 3
2019-10-31 05:49:30,292   DEBUG lava-logs => PING(20)
2019-10-31 05:49:37,464   DEBUG Dhanu => PING(20)
2019-10-31 05:49:37,465 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:49:38,858    INFO scheduling health checks:
2019-10-31 05:49:38,911    INFO scheduling jobs:
2019-10-31 05:49:38,913   DEBUG - qemu
2019-10-31 05:49:38,989   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:49:38,989   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:49:38,994    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:49:40,308    INFO [INIT] Dropping privileges
2019-10-31 05:49:40,309   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:49:40,309   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:49:40,310    INFO [INIT] Marking all workers as offline
2019-10-31 05:49:40,358    INFO [INIT] LAVA master has started.
2019-10-31 05:49:40,359    INFO [INIT] Using protocol version 3
2019-10-31 05:49:50,312   DEBUG lava-logs => PING(20)
2019-10-31 05:49:57,480   DEBUG Dhanu => PING(20)
2019-10-31 05:49:57,481 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:50:00,361    INFO scheduling health checks:
2019-10-31 05:50:00,391    INFO scheduling jobs:
2019-10-31 05:50:00,393   DEBUG - qemu
2019-10-31 05:50:00,469   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:50:00,469   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:50:00,474    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:50:01,840    INFO [INIT] Dropping privileges
2019-10-31 05:50:01,840   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:50:01,840   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:50:01,842    INFO [INIT] Marking all workers as offline
2019-10-31 05:50:01,894    INFO [INIT] LAVA master has started.
2019-10-31 05:50:01,895    INFO [INIT] Using protocol version 3
2019-10-31 05:50:10,332   DEBUG lava-logs => PING(20)
2019-10-31 05:50:17,496   DEBUG Dhanu => PING(20)
2019-10-31 05:50:17,497 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:50:21,899    INFO scheduling health checks:
2019-10-31 05:50:21,960    INFO scheduling jobs:
2019-10-31 05:50:21,962   DEBUG - qemu
2019-10-31 05:50:22,034   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:50:22,034   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:50:22,039    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:50:23,312    INFO [INIT] Dropping privileges
2019-10-31 05:50:23,313   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:50:23,313   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:50:23,314    INFO [INIT] Marking all workers as offline
2019-10-31 05:50:23,351    INFO [INIT] LAVA master has started.
2019-10-31 05:50:23,351    INFO [INIT] Using protocol version 3
2019-10-31 05:50:30,350   DEBUG lava-logs => PING(20)
2019-10-31 05:50:37,512   DEBUG Dhanu => PING(20)
2019-10-31 05:50:37,513 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:50:43,355    INFO scheduling health checks:
2019-10-31 05:50:43,406    INFO scheduling jobs:
2019-10-31 05:50:43,410   DEBUG - qemu
2019-10-31 05:50:43,487   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:50:43,487   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:50:43,492    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:50:44,823    INFO [INIT] Dropping privileges
2019-10-31 05:50:44,823   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:50:44,823   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:50:44,825    INFO [INIT] Marking all workers as offline
2019-10-31 05:50:44,864    INFO [INIT] LAVA master has started.
2019-10-31 05:50:44,865    INFO [INIT] Using protocol version 3
2019-10-31 05:50:50,364   DEBUG lava-logs => PING(20)
2019-10-31 05:50:57,528   DEBUG Dhanu => PING(20)
2019-10-31 05:50:57,529 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:51:04,871    INFO scheduling health checks:
2019-10-31 05:51:04,920    INFO scheduling jobs:
2019-10-31 05:51:04,923   DEBUG - qemu
2019-10-31 05:51:05,006   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:51:05,007   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:51:05,011    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:51:06,331    INFO [INIT] Dropping privileges
2019-10-31 05:51:06,331   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:51:06,331   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:51:06,333    INFO [INIT] Marking all workers as offline
2019-10-31 05:51:06,402    INFO [INIT] LAVA master has started.
2019-10-31 05:51:06,403    INFO [INIT] Using protocol version 3
2019-10-31 05:51:10,380   DEBUG lava-logs => PING(20)
2019-10-31 05:51:17,540   DEBUG Dhanu => PING(20)
2019-10-31 05:51:17,541 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:51:26,411    INFO scheduling health checks:
2019-10-31 05:51:26,466    INFO scheduling jobs:
2019-10-31 05:51:26,469   DEBUG - qemu
2019-10-31 05:51:26,546   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:51:26,546   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:51:26,550    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:51:27,845    INFO [INIT] Dropping privileges
2019-10-31 05:51:27,845   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:51:27,845   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:51:27,847    INFO [INIT] Marking all workers as offline
2019-10-31 05:51:27,879    INFO [INIT] LAVA master has started.
2019-10-31 05:51:27,879    INFO [INIT] Using protocol version 3
2019-10-31 05:51:30,392   DEBUG lava-logs => PING(20)
2019-10-31 05:51:37,556   DEBUG Dhanu => PING(20)
2019-10-31 05:51:37,557 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:51:47,888    INFO scheduling health checks:
2019-10-31 05:51:47,923    INFO scheduling jobs:
2019-10-31 05:51:47,925   DEBUG - qemu
2019-10-31 05:51:48,001   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:51:48,001   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:51:48,006    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:51:49,336    INFO [INIT] Dropping privileges
2019-10-31 05:51:49,336   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:51:49,336   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:51:49,338    INFO [INIT] Marking all workers as offline
2019-10-31 05:51:49,393    INFO [INIT] LAVA master has started.
2019-10-31 05:51:49,394    INFO [INIT] Using protocol version 3
2019-10-31 05:51:50,406   DEBUG lava-logs => PING(20)
2019-10-31 05:51:57,572   DEBUG Dhanu => PING(20)
2019-10-31 05:51:57,573 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:52:09,403    INFO scheduling health checks:
2019-10-31 05:52:09,459    INFO scheduling jobs:
2019-10-31 05:52:09,462   DEBUG - qemu
2019-10-31 05:52:09,539   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:52:09,539   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:52:09,543    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:52:10,826    INFO [INIT] Dropping privileges
2019-10-31 05:52:10,827   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:52:10,827   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:52:10,828    INFO [INIT] Marking all workers as offline
2019-10-31 05:52:10,872    INFO [INIT] LAVA master has started.
2019-10-31 05:52:10,873    INFO [INIT] Using protocol version 3
2019-10-31 05:52:10,958   DEBUG lava-logs => PING(20)
2019-10-31 05:52:17,584   DEBUG Dhanu => PING(20)
2019-10-31 05:52:17,585 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:52:30,883    INFO scheduling health checks:
2019-10-31 05:52:30,939    INFO scheduling jobs:
2019-10-31 05:52:30,942   DEBUG - qemu
2019-10-31 05:52:31,015   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:52:31,015   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:52:31,020    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:52:32,369    INFO [INIT] Dropping privileges
2019-10-31 05:52:32,369   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:52:32,369   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:52:32,371    INFO [INIT] Marking all workers as offline
2019-10-31 05:52:32,419    INFO [INIT] LAVA master has started.
2019-10-31 05:52:32,419    INFO [INIT] Using protocol version 3
2019-10-31 05:52:37,596   DEBUG Dhanu => PING(20)
2019-10-31 05:52:37,597 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:52:50,992   DEBUG lava-logs => PING(20)
2019-10-31 05:52:52,421    INFO scheduling health checks:
2019-10-31 05:52:52,452    INFO scheduling jobs:
2019-10-31 05:52:52,454   DEBUG - qemu
2019-10-31 05:52:52,528   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:52:52,528   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:52:52,533    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:52:53,844    INFO [INIT] Dropping privileges
2019-10-31 05:52:53,844   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:52:53,844   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:52:53,846    INFO [INIT] Marking all workers as offline
2019-10-31 05:52:53,876    INFO [INIT] LAVA master has started.
2019-10-31 05:52:53,877    INFO [INIT] Using protocol version 3
2019-10-31 05:52:57,613   DEBUG Dhanu => PING(20)
2019-10-31 05:52:57,613 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:53:11,008   DEBUG lava-logs => PING(20)
2019-10-31 05:53:13,879    INFO scheduling health checks:
2019-10-31 05:53:13,909    INFO scheduling jobs:
2019-10-31 05:53:13,911   DEBUG - qemu
2019-10-31 05:53:13,984   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:53:13,984   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:53:13,989    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:53:15,357    INFO [INIT] Dropping privileges
2019-10-31 05:53:15,357   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:53:15,357   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:53:15,359    INFO [INIT] Marking all workers as offline
2019-10-31 05:53:15,401    INFO [INIT] LAVA master has started.
2019-10-31 05:53:15,402    INFO [INIT] Using protocol version 3
2019-10-31 05:53:17,627   DEBUG Dhanu => PING(20)
2019-10-31 05:53:17,627 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:53:31,024   DEBUG lava-logs => PING(20)
2019-10-31 05:53:35,403    INFO scheduling health checks:
2019-10-31 05:53:35,434    INFO scheduling jobs:
2019-10-31 05:53:35,436   DEBUG - qemu
2019-10-31 05:53:35,510   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:53:35,510   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:53:35,518    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:53:36,848    INFO [INIT] Dropping privileges
2019-10-31 05:53:36,848   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:53:36,848   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:53:36,850    INFO [INIT] Marking all workers as offline
2019-10-31 05:53:36,892    INFO [INIT] LAVA master has started.
2019-10-31 05:53:36,893    INFO [INIT] Using protocol version 3
2019-10-31 05:53:37,641   DEBUG Dhanu => PING(20)
2019-10-31 05:53:37,642 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:53:51,036   DEBUG lava-logs => PING(20)
2019-10-31 05:53:56,895    INFO scheduling health checks:
2019-10-31 05:53:56,947    INFO scheduling jobs:
2019-10-31 05:53:56,950   DEBUG - qemu
2019-10-31 05:53:57,024   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:53:57,024   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:53:57,029    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:53:58,334    INFO [INIT] Dropping privileges
2019-10-31 05:53:58,334   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:53:58,334   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:53:58,336    INFO [INIT] Marking all workers as offline
2019-10-31 05:53:58,372    INFO [INIT] LAVA master has started.
2019-10-31 05:53:58,372    INFO [INIT] Using protocol version 3
2019-10-31 05:53:58,489   DEBUG Dhanu => PING(20)
2019-10-31 05:53:58,489 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:54:11,048   DEBUG lava-logs => PING(20)
2019-10-31 05:54:18,379    INFO scheduling health checks:
2019-10-31 05:54:18,405    INFO scheduling jobs:
2019-10-31 05:54:18,407   DEBUG - qemu
2019-10-31 05:54:18,483   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:54:18,483   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:54:18,488    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:54:19,838    INFO [INIT] Dropping privileges
2019-10-31 05:54:19,838   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:54:19,838   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:54:19,840    INFO [INIT] Marking all workers as offline
2019-10-31 05:54:19,873    INFO [INIT] LAVA master has started.
2019-10-31 05:54:19,874    INFO [INIT] Using protocol version 3
2019-10-31 05:54:20,010   DEBUG Dhanu => PING(20)
2019-10-31 05:54:20,010 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:54:31,060   DEBUG lava-logs => PING(20)
2019-10-31 05:54:39,879    INFO scheduling health checks:
2019-10-31 05:54:39,929    INFO scheduling jobs:
2019-10-31 05:54:39,931   DEBUG - qemu
2019-10-31 05:54:40,004   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:54:40,005   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:54:40,014    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:54:41,333    INFO [INIT] Dropping privileges
2019-10-31 05:54:41,333   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:54:41,333   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:54:41,335    INFO [INIT] Marking all workers as offline
2019-10-31 05:54:41,387    INFO [INIT] LAVA master has started.
2019-10-31 05:54:41,388    INFO [INIT] Using protocol version 3
2019-10-31 05:54:41,516   DEBUG Dhanu => PING(20)
2019-10-31 05:54:41,516 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:54:51,100   DEBUG lava-logs => PING(20)
2019-10-31 05:55:01,395    INFO scheduling health checks:
2019-10-31 05:55:01,431    INFO scheduling jobs:
2019-10-31 05:55:01,433   DEBUG - qemu
2019-10-31 05:55:01,503   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:55:01,503   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:55:01,511    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:55:02,835    INFO [INIT] Dropping privileges
2019-10-31 05:55:02,835   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:55:02,835   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:55:02,837    INFO [INIT] Marking all workers as offline
2019-10-31 05:55:02,878    INFO [INIT] LAVA master has started.
2019-10-31 05:55:02,878    INFO [INIT] Using protocol version 3
2019-10-31 05:55:02,991   DEBUG Dhanu => PING(20)
2019-10-31 05:55:02,992 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:55:11,120   DEBUG lava-logs => PING(20)
2019-10-31 05:55:22,887    INFO scheduling health checks:
2019-10-31 05:55:22,911    INFO scheduling jobs:
2019-10-31 05:55:22,913   DEBUG - qemu
2019-10-31 05:55:22,987   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:55:22,988   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:55:22,996    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:55:24,327    INFO [INIT] Dropping privileges
2019-10-31 05:55:24,327   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:55:24,327   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:55:24,329    INFO [INIT] Marking all workers as offline
2019-10-31 05:55:24,369    INFO [INIT] LAVA master has started.
2019-10-31 05:55:24,369    INFO [INIT] Using protocol version 3
2019-10-31 05:55:24,387   DEBUG Dhanu => PING(20)
2019-10-31 05:55:24,387 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:55:31,136   DEBUG lava-logs => PING(20)
2019-10-31 05:55:44,379    INFO scheduling health checks:
2019-10-31 05:55:44,413    INFO scheduling jobs:
2019-10-31 05:55:44,414   DEBUG - qemu
2019-10-31 05:55:44,485   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:55:44,485   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:55:44,490    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:55:45,826    INFO [INIT] Dropping privileges
2019-10-31 05:55:45,826   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:55:45,826   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:55:45,828    INFO [INIT] Marking all workers as offline
2019-10-31 05:55:45,871    INFO [INIT] LAVA master has started.
2019-10-31 05:55:45,872    INFO [INIT] Using protocol version 3
2019-10-31 05:55:51,152   DEBUG lava-logs => PING(20)
2019-10-31 05:56:04,421   DEBUG Dhanu => PING(20)
2019-10-31 05:56:04,421 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:56:05,874    INFO scheduling health checks:
2019-10-31 05:56:05,904    INFO scheduling jobs:
2019-10-31 05:56:05,906   DEBUG - qemu
2019-10-31 05:56:05,987   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:56:05,987   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:56:05,992    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:56:07,345    INFO [INIT] Dropping privileges
2019-10-31 05:56:07,345   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:56:07,345   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:56:07,347    INFO [INIT] Marking all workers as offline
2019-10-31 05:56:07,384    INFO [INIT] LAVA master has started.
2019-10-31 05:56:07,385    INFO [INIT] Using protocol version 3
2019-10-31 05:56:11,168   DEBUG lava-logs => PING(20)
2019-10-31 05:56:24,436   DEBUG Dhanu => PING(20)
2019-10-31 05:56:24,437 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:56:27,387    INFO scheduling health checks:
2019-10-31 05:56:27,417    INFO scheduling jobs:
2019-10-31 05:56:27,419   DEBUG - qemu
2019-10-31 05:56:27,498   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:56:27,498   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:56:27,503    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:56:28,851    INFO [INIT] Dropping privileges
2019-10-31 05:56:28,851   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:56:28,851   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:56:28,853    INFO [INIT] Marking all workers as offline
2019-10-31 05:56:28,897    INFO [INIT] LAVA master has started.
2019-10-31 05:56:28,897    INFO [INIT] Using protocol version 3
2019-10-31 05:56:31,182   DEBUG lava-logs => PING(20)
2019-10-31 05:56:44,452   DEBUG Dhanu => PING(20)
2019-10-31 05:56:44,453 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:56:48,899    INFO scheduling health checks:
2019-10-31 05:56:48,919    INFO scheduling jobs:
2019-10-31 05:56:48,920   DEBUG - qemu
2019-10-31 05:56:48,989   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:56:48,989   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:56:48,994    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:56:50,345    INFO [INIT] Dropping privileges
2019-10-31 05:56:50,345   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:56:50,346   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:56:50,347    INFO [INIT] Marking all workers as offline
2019-10-31 05:56:50,388    INFO [INIT] LAVA master has started.
2019-10-31 05:56:50,388    INFO [INIT] Using protocol version 3
2019-10-31 05:56:51,193   DEBUG lava-logs => PING(20)
2019-10-31 05:57:04,469   DEBUG Dhanu => PING(20)
2019-10-31 05:57:04,469 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:57:10,391    INFO scheduling health checks:
2019-10-31 05:57:10,432    INFO scheduling jobs:
2019-10-31 05:57:10,435   DEBUG - qemu
2019-10-31 05:57:10,518   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:57:10,518   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:57:10,523    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:57:11,845    INFO [INIT] Dropping privileges
2019-10-31 05:57:11,845   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:57:11,845   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:57:11,847    INFO [INIT] Marking all workers as offline
2019-10-31 05:57:11,901    INFO [INIT] LAVA master has started.
2019-10-31 05:57:11,902    INFO [INIT] Using protocol version 3
2019-10-31 05:57:11,966   DEBUG lava-logs => PING(20)
2019-10-31 05:57:24,488   DEBUG Dhanu => PING(20)
2019-10-31 05:57:24,489 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:57:31,909    INFO scheduling health checks:
2019-10-31 05:57:31,947    INFO scheduling jobs:
2019-10-31 05:57:31,949   DEBUG - qemu
2019-10-31 05:57:32,040   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:57:32,040   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:57:32,045    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:57:33,390    INFO [INIT] Dropping privileges
2019-10-31 05:57:33,390   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:57:33,390   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:57:33,392    INFO [INIT] Marking all workers as offline
2019-10-31 05:57:33,425    INFO [INIT] LAVA master has started.
2019-10-31 05:57:33,427    INFO [INIT] Using protocol version 3
2019-10-31 05:57:44,500   DEBUG Dhanu => PING(20)
2019-10-31 05:57:44,500 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:57:52,003   DEBUG lava-logs => PING(20)
2019-10-31 05:57:53,428    INFO scheduling health checks:
2019-10-31 05:57:53,459    INFO scheduling jobs:
2019-10-31 05:57:53,461   DEBUG - qemu
2019-10-31 05:57:53,553   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:57:53,553   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:57:53,559    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:57:54,982    INFO [INIT] Dropping privileges
2019-10-31 05:57:54,983   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:57:54,983   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:57:54,984    INFO [INIT] Marking all workers as offline
2019-10-31 05:57:55,016    INFO [INIT] LAVA master has started.
2019-10-31 05:57:55,016    INFO [INIT] Using protocol version 3
2019-10-31 05:58:04,519   DEBUG Dhanu => PING(20)
2019-10-31 05:58:04,519 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:58:12,023   DEBUG lava-logs => PING(20)
2019-10-31 05:58:15,020    INFO scheduling health checks:
2019-10-31 05:58:15,061    INFO scheduling jobs:
2019-10-31 05:58:15,063   DEBUG - qemu
2019-10-31 05:58:15,138   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:58:15,139   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:58:15,143    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:58:16,289    INFO [INIT] Dropping privileges
2019-10-31 05:58:16,290   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:58:16,290   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:58:16,291    INFO [INIT] Marking all workers as offline
2019-10-31 05:58:16,329    INFO [INIT] LAVA master has started.
2019-10-31 05:58:16,330    INFO [INIT] Using protocol version 3
2019-10-31 05:58:24,541   DEBUG Dhanu => PING(20)
2019-10-31 05:58:24,542 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:58:32,032   DEBUG lava-logs => PING(20)
2019-10-31 05:58:36,334    INFO scheduling health checks:
2019-10-31 05:58:36,374    INFO scheduling jobs:
2019-10-31 05:58:36,377   DEBUG - qemu
2019-10-31 05:58:36,450   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:58:36,451   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:58:36,455    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:58:37,558    INFO [INIT] Dropping privileges
2019-10-31 05:58:37,558   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:58:37,558   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:58:37,560    INFO [INIT] Marking all workers as offline
2019-10-31 05:58:37,621    INFO [INIT] LAVA master has started.
2019-10-31 05:58:37,621    INFO [INIT] Using protocol version 3
2019-10-31 05:58:44,560   DEBUG Dhanu => PING(20)
2019-10-31 05:58:44,561 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:58:52,048   DEBUG lava-logs => PING(20)
2019-10-31 05:58:57,627    INFO scheduling health checks:
2019-10-31 05:58:57,665    INFO scheduling jobs:
2019-10-31 05:58:57,667   DEBUG - qemu
2019-10-31 05:58:57,736   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:58:57,736   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:58:57,741    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:58:59,034    INFO [INIT] Dropping privileges
2019-10-31 05:58:59,035   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:58:59,035   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:58:59,036    INFO [INIT] Marking all workers as offline
2019-10-31 05:58:59,079    INFO [INIT] LAVA master has started.
2019-10-31 05:58:59,079    INFO [INIT] Using protocol version 3
2019-10-31 05:59:04,579   DEBUG Dhanu => PING(20)
2019-10-31 05:59:04,579 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:59:12,060   DEBUG lava-logs => PING(20)
2019-10-31 05:59:19,087    INFO scheduling health checks:
2019-10-31 05:59:19,134    INFO scheduling jobs:
2019-10-31 05:59:19,137   DEBUG - qemu
2019-10-31 05:59:19,211   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:59:19,211   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:59:19,216    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:59:20,296    INFO [INIT] Dropping privileges
2019-10-31 05:59:20,296   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:59:20,296   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:59:20,298    INFO [INIT] Marking all workers as offline
2019-10-31 05:59:20,336    INFO [INIT] LAVA master has started.
2019-10-31 05:59:20,336    INFO [INIT] Using protocol version 3
2019-10-31 05:59:24,600   DEBUG Dhanu => PING(20)
2019-10-31 05:59:24,601 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:59:32,070   DEBUG lava-logs => PING(20)
2019-10-31 05:59:40,345    INFO scheduling health checks:
2019-10-31 05:59:40,380    INFO scheduling jobs:
2019-10-31 05:59:40,384   DEBUG - qemu
2019-10-31 05:59:40,456   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 05:59:40,456   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 05:59:40,461    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 05:59:41,524    INFO [INIT] Dropping privileges
2019-10-31 05:59:41,524   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 05:59:41,525   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 05:59:41,526    INFO [INIT] Marking all workers as offline
2019-10-31 05:59:41,560    INFO [INIT] LAVA master has started.
2019-10-31 05:59:41,560    INFO [INIT] Using protocol version 3
2019-10-31 05:59:44,623   DEBUG Dhanu => PING(20)
2019-10-31 05:59:44,624 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 05:59:52,084   DEBUG lava-logs => PING(20)
2019-10-31 06:00:01,569    INFO scheduling health checks:
2019-10-31 06:00:01,604    INFO scheduling jobs:
2019-10-31 06:00:01,607   DEBUG - qemu
2019-10-31 06:00:01,677   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:00:01,677   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:00:01,682    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:00:02,783    INFO [INIT] Dropping privileges
2019-10-31 06:00:02,783   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:00:02,783   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:00:02,785    INFO [INIT] Marking all workers as offline
2019-10-31 06:00:02,841    INFO [INIT] LAVA master has started.
2019-10-31 06:00:02,841    INFO [INIT] Using protocol version 3
2019-10-31 06:00:04,644   DEBUG Dhanu => PING(20)
2019-10-31 06:00:04,645 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:00:12,102   DEBUG lava-logs => PING(20)
2019-10-31 06:00:22,852    INFO scheduling health checks:
2019-10-31 06:00:22,884    INFO scheduling jobs:
2019-10-31 06:00:22,887   DEBUG - qemu
2019-10-31 06:00:22,961   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:00:22,962   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:00:22,972    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:00:24,030    INFO [INIT] Dropping privileges
2019-10-31 06:00:24,030   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:00:24,031   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:00:24,032    INFO [INIT] Marking all workers as offline
2019-10-31 06:00:24,098    INFO [INIT] LAVA master has started.
2019-10-31 06:00:24,098    INFO [INIT] Using protocol version 3
2019-10-31 06:00:24,664   DEBUG Dhanu => PING(20)
2019-10-31 06:00:24,665 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:00:32,121   DEBUG lava-logs => PING(20)
2019-10-31 06:00:44,110    INFO scheduling health checks:
2019-10-31 06:00:44,142    INFO scheduling jobs:
2019-10-31 06:00:44,143   DEBUG - qemu
2019-10-31 06:00:44,209   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:00:44,210   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:00:44,214    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:00:45,275    INFO [INIT] Dropping privileges
2019-10-31 06:00:45,276   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:00:45,276   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:00:45,277    INFO [INIT] Marking all workers as offline
2019-10-31 06:00:45,345    INFO [INIT] LAVA master has started.
2019-10-31 06:00:45,345    INFO [INIT] Using protocol version 3
2019-10-31 06:00:45,364   DEBUG Dhanu => PING(20)
2019-10-31 06:00:45,364 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:00:52,140   DEBUG lava-logs => PING(20)
2019-10-31 06:01:05,359    INFO scheduling health checks:
2019-10-31 06:01:05,399    INFO scheduling jobs:
2019-10-31 06:01:05,401   DEBUG - qemu
2019-10-31 06:01:05,472   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:01:05,472   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:01:05,477    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:01:06,538    INFO [INIT] Dropping privileges
2019-10-31 06:01:06,538   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:01:06,539   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:01:06,541    INFO [INIT] Marking all workers as offline
2019-10-31 06:01:06,579    INFO [INIT] LAVA master has started.
2019-10-31 06:01:06,580    INFO [INIT] Using protocol version 3
2019-10-31 06:01:12,158   DEBUG lava-logs => PING(20)
2019-10-31 06:01:25,406   DEBUG Dhanu => PING(20)
2019-10-31 06:01:25,407 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:01:26,581    INFO scheduling health checks:
2019-10-31 06:01:26,601    INFO scheduling jobs:
2019-10-31 06:01:26,603   DEBUG - qemu
2019-10-31 06:01:26,673   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:01:26,674   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:01:26,678    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:01:27,780    INFO [INIT] Dropping privileges
2019-10-31 06:01:27,780   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:01:27,780   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:01:27,782    INFO [INIT] Marking all workers as offline
2019-10-31 06:01:27,815    INFO [INIT] LAVA master has started.
2019-10-31 06:01:27,815    INFO [INIT] Using protocol version 3
2019-10-31 06:01:32,172   DEBUG lava-logs => PING(20)
2019-10-31 06:01:45,427   DEBUG Dhanu => PING(20)
2019-10-31 06:01:45,428 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:01:47,818    INFO scheduling health checks:
2019-10-31 06:01:47,837    INFO scheduling jobs:
2019-10-31 06:01:47,838   DEBUG - qemu
2019-10-31 06:01:47,901   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:01:47,901   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:01:47,906    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:01:49,043    INFO [INIT] Dropping privileges
2019-10-31 06:01:49,044   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:01:49,044   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:01:49,046    INFO [INIT] Marking all workers as offline
2019-10-31 06:01:49,106    INFO [INIT] LAVA master has started.
2019-10-31 06:01:49,107    INFO [INIT] Using protocol version 3
2019-10-31 06:01:52,187   DEBUG lava-logs => PING(20)
2019-10-31 06:02:05,448   DEBUG Dhanu => PING(20)
2019-10-31 06:02:05,449 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:02:09,111    INFO scheduling health checks:
2019-10-31 06:02:09,150    INFO scheduling jobs:
2019-10-31 06:02:09,154   DEBUG - qemu
2019-10-31 06:02:09,228   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:02:09,228   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:02:09,233    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:02:10,343    INFO [INIT] Dropping privileges
2019-10-31 06:02:10,343   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:02:10,343   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:02:10,344    INFO [INIT] Marking all workers as offline
2019-10-31 06:02:10,385    INFO [INIT] LAVA master has started.
2019-10-31 06:02:10,386    INFO [INIT] Using protocol version 3
2019-10-31 06:02:12,202   DEBUG lava-logs => PING(20)
2019-10-31 06:02:25,466   DEBUG Dhanu => PING(20)
2019-10-31 06:02:25,466 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:02:30,391    INFO scheduling health checks:
2019-10-31 06:02:30,430    INFO scheduling jobs:
2019-10-31 06:02:30,432   DEBUG - qemu
2019-10-31 06:02:30,505   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:02:30,505   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:02:30,510    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:02:31,789    INFO [INIT] Dropping privileges
2019-10-31 06:02:31,789   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:02:31,790   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:02:31,791    INFO [INIT] Marking all workers as offline
2019-10-31 06:02:31,833    INFO [INIT] LAVA master has started.
2019-10-31 06:02:31,833    INFO [INIT] Using protocol version 3
2019-10-31 06:02:32,216   DEBUG lava-logs => PING(20)
2019-10-31 06:02:45,488   DEBUG Dhanu => PING(20)
2019-10-31 06:02:45,488 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:02:51,839    INFO scheduling health checks:
2019-10-31 06:02:51,876    INFO scheduling jobs:
2019-10-31 06:02:51,879   DEBUG - qemu
2019-10-31 06:02:51,951   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:02:51,951   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:02:51,961    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:02:53,035    INFO [INIT] Dropping privileges
2019-10-31 06:02:53,035   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:02:53,035   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:02:53,037    INFO [INIT] Marking all workers as offline
2019-10-31 06:02:53,068    INFO [INIT] LAVA master has started.
2019-10-31 06:02:53,069    INFO [INIT] Using protocol version 3
2019-10-31 06:02:53,172   DEBUG lava-logs => PING(20)
2019-10-31 06:03:05,506   DEBUG Dhanu => PING(20)
2019-10-31 06:03:05,506 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:03:13,077    INFO scheduling health checks:
2019-10-31 06:03:13,123    INFO scheduling jobs:
2019-10-31 06:03:13,126   DEBUG - qemu
2019-10-31 06:03:13,205   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:03:13,205   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:03:13,209    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:03:14,281    INFO [INIT] Dropping privileges
2019-10-31 06:03:14,282   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:03:14,282   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:03:14,283    INFO [INIT] Marking all workers as offline
2019-10-31 06:03:14,314    INFO [INIT] LAVA master has started.
2019-10-31 06:03:14,314    INFO [INIT] Using protocol version 3
2019-10-31 06:03:25,527   DEBUG Dhanu => PING(20)
2019-10-31 06:03:25,527 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:03:33,200   DEBUG lava-logs => PING(20)
2019-10-31 06:03:34,315    INFO scheduling health checks:
2019-10-31 06:03:34,336    INFO scheduling jobs:
2019-10-31 06:03:34,338   DEBUG - qemu
2019-10-31 06:03:34,409   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:03:34,410   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:03:34,414    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:03:35,528    INFO [INIT] Dropping privileges
2019-10-31 06:03:35,528   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:03:35,528   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:03:35,530    INFO [INIT] Marking all workers as offline
2019-10-31 06:03:35,572    INFO [INIT] LAVA master has started.
2019-10-31 06:03:35,572    INFO [INIT] Using protocol version 3
2019-10-31 06:03:45,544   DEBUG Dhanu => PING(20)
2019-10-31 06:03:45,545 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:03:53,212   DEBUG lava-logs => PING(20)
2019-10-31 06:03:55,575    INFO scheduling health checks:
2019-10-31 06:03:55,605    INFO scheduling jobs:
2019-10-31 06:03:55,607   DEBUG - qemu
2019-10-31 06:03:55,677   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:03:55,677   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:03:55,682    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:03:56,799    INFO [INIT] Dropping privileges
2019-10-31 06:03:56,799   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:03:56,799   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:03:56,801    INFO [INIT] Marking all workers as offline
2019-10-31 06:03:56,841    INFO [INIT] LAVA master has started.
2019-10-31 06:03:56,841    INFO [INIT] Using protocol version 3
2019-10-31 06:04:05,567   DEBUG Dhanu => PING(20)
2019-10-31 06:04:05,568 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:04:13,232   DEBUG lava-logs => PING(20)
2019-10-31 06:04:16,843    INFO scheduling health checks:
2019-10-31 06:04:16,907    INFO scheduling jobs:
2019-10-31 06:04:16,910   DEBUG - qemu
2019-10-31 06:04:16,982   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:04:16,983   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:04:16,994    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:04:18,288    INFO [INIT] Dropping privileges
2019-10-31 06:04:18,288   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:04:18,289   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:04:18,290    INFO [INIT] Marking all workers as offline
2019-10-31 06:04:18,354    INFO [INIT] LAVA master has started.
2019-10-31 06:04:18,355    INFO [INIT] Using protocol version 3
2019-10-31 06:04:25,588   DEBUG Dhanu => PING(20)
2019-10-31 06:04:25,589 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:04:33,250   DEBUG lava-logs => PING(20)
2019-10-31 06:04:38,360    INFO scheduling health checks:
2019-10-31 06:04:38,387    INFO scheduling jobs:
2019-10-31 06:04:38,389   DEBUG - qemu
2019-10-31 06:04:38,461   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:04:38,461   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:04:38,465    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:04:39,533    INFO [INIT] Dropping privileges
2019-10-31 06:04:39,533   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:04:39,533   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:04:39,535    INFO [INIT] Marking all workers as offline
2019-10-31 06:04:39,578    INFO [INIT] LAVA master has started.
2019-10-31 06:04:39,579    INFO [INIT] Using protocol version 3
2019-10-31 06:04:45,608   DEBUG Dhanu => PING(20)
2019-10-31 06:04:45,608 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:04:53,264   DEBUG lava-logs => PING(20)
2019-10-31 06:04:59,586    INFO scheduling health checks:
2019-10-31 06:04:59,611    INFO scheduling jobs:
2019-10-31 06:04:59,612   DEBUG - qemu
2019-10-31 06:04:59,684   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:04:59,684   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:04:59,689    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:05:00,779    INFO [INIT] Dropping privileges
2019-10-31 06:05:00,780   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:05:00,780   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:05:00,781    INFO [INIT] Marking all workers as offline
2019-10-31 06:05:00,813    INFO [INIT] LAVA master has started.
2019-10-31 06:05:00,813    INFO [INIT] Using protocol version 3
2019-10-31 06:05:05,629   DEBUG Dhanu => PING(20)
2019-10-31 06:05:05,630 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:05:13,278   DEBUG lava-logs => PING(20)
2019-10-31 06:05:20,821    INFO scheduling health checks:
2019-10-31 06:05:20,880    INFO scheduling jobs:
2019-10-31 06:05:20,883   DEBUG - qemu
2019-10-31 06:05:20,957   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:05:20,958   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:05:20,962    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:05:22,064    INFO [INIT] Dropping privileges
2019-10-31 06:05:22,064   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:05:22,064   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:05:22,065    INFO [INIT] Marking all workers as offline
2019-10-31 06:05:22,127    INFO [INIT] LAVA master has started.
2019-10-31 06:05:22,127    INFO [INIT] Using protocol version 3
2019-10-31 06:05:25,652   DEBUG Dhanu => PING(20)
2019-10-31 06:05:25,653 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:05:33,284   DEBUG lava-logs => PING(20)
2019-10-31 06:05:42,136    INFO scheduling health checks:
2019-10-31 06:05:42,159    INFO scheduling jobs:
2019-10-31 06:05:42,161   DEBUG - qemu
2019-10-31 06:05:42,225   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:05:42,225   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:05:42,229    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:05:43,321    INFO [INIT] Dropping privileges
2019-10-31 06:05:43,321   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:05:43,321   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:05:43,323    INFO [INIT] Marking all workers as offline
2019-10-31 06:05:43,418    INFO [INIT] LAVA master has started.
2019-10-31 06:05:43,418    INFO [INIT] Using protocol version 3
2019-10-31 06:05:45,673   DEBUG Dhanu => PING(20)
2019-10-31 06:05:45,674 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:05:53,306   DEBUG lava-logs => PING(20)
2019-10-31 06:06:03,427    INFO scheduling health checks:
2019-10-31 06:06:03,462    INFO scheduling jobs:
2019-10-31 06:06:03,464   DEBUG - qemu
2019-10-31 06:06:03,535   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:06:03,535   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:06:03,539    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:06:04,789    INFO [INIT] Dropping privileges
2019-10-31 06:06:04,789   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:06:04,789   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:06:04,791    INFO [INIT] Marking all workers as offline
2019-10-31 06:06:04,842    INFO [INIT] LAVA master has started.
2019-10-31 06:06:04,842    INFO [INIT] Using protocol version 3
2019-10-31 06:06:05,694   DEBUG Dhanu => PING(20)
2019-10-31 06:06:05,694 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:06:13,328   DEBUG lava-logs => PING(20)
2019-10-31 06:06:24,854    INFO scheduling health checks:
2019-10-31 06:06:24,897    INFO scheduling jobs:
2019-10-31 06:06:24,899   DEBUG - qemu
2019-10-31 06:06:24,972   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:06:24,972   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:06:24,976    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:06:26,035    INFO [INIT] Dropping privileges
2019-10-31 06:06:26,036   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:06:26,036   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:06:26,037    INFO [INIT] Marking all workers as offline
2019-10-31 06:06:26,077    INFO [INIT] LAVA master has started.
2019-10-31 06:06:26,077    INFO [INIT] Using protocol version 3
2019-10-31 06:06:26,092   DEBUG Dhanu => PING(20)
2019-10-31 06:06:26,092 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:06:33,349   DEBUG lava-logs => PING(20)
2019-10-31 06:06:46,083    INFO scheduling health checks:
2019-10-31 06:06:46,110    INFO scheduling jobs:
2019-10-31 06:06:46,112   DEBUG - qemu
2019-10-31 06:06:46,187   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:06:46,187   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:06:46,191    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:06:47,293    INFO [INIT] Dropping privileges
2019-10-31 06:06:47,293   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:06:47,294   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:06:47,295    INFO [INIT] Marking all workers as offline
2019-10-31 06:06:47,335    INFO [INIT] LAVA master has started.
2019-10-31 06:06:47,336    INFO [INIT] Using protocol version 3
2019-10-31 06:06:53,359   DEBUG lava-logs => PING(20)
2019-10-31 06:07:06,132   DEBUG Dhanu => PING(20)
2019-10-31 06:07:06,133 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:07:07,337    INFO scheduling health checks:
2019-10-31 06:07:07,357    INFO scheduling jobs:
2019-10-31 06:07:07,358   DEBUG - qemu
2019-10-31 06:07:07,428   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:07:07,428   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:07:07,433    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:07:08,538    INFO [INIT] Dropping privileges
2019-10-31 06:07:08,538   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:07:08,539   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:07:08,540    INFO [INIT] Marking all workers as offline
2019-10-31 06:07:08,582    INFO [INIT] LAVA master has started.
2019-10-31 06:07:08,582    INFO [INIT] Using protocol version 3
2019-10-31 06:07:13,377   DEBUG lava-logs => PING(20)
2019-10-31 06:07:26,152   DEBUG Dhanu => PING(20)
2019-10-31 06:07:26,153 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:07:28,585    INFO scheduling health checks:
2019-10-31 06:07:28,614    INFO scheduling jobs:
2019-10-31 06:07:28,616   DEBUG - qemu
2019-10-31 06:07:28,691   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:07:28,691   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:07:28,695    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:07:29,819    INFO [INIT] Dropping privileges
2019-10-31 06:07:29,820   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:07:29,820   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:07:29,821    INFO [INIT] Marking all workers as offline
2019-10-31 06:07:29,884    INFO [INIT] LAVA master has started.
2019-10-31 06:07:29,885    INFO [INIT] Using protocol version 3
2019-10-31 06:07:33,393   DEBUG lava-logs => PING(20)
2019-10-31 06:07:46,170   DEBUG Dhanu => PING(20)
2019-10-31 06:07:46,170 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:07:49,888    INFO scheduling health checks:
2019-10-31 06:07:49,928    INFO scheduling jobs:
2019-10-31 06:07:49,931   DEBUG - qemu
2019-10-31 06:07:50,006   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:07:50,006   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:07:50,011    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:07:51,284    INFO [INIT] Dropping privileges
2019-10-31 06:07:51,284   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:07:51,284   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:07:51,286    INFO [INIT] Marking all workers as offline
2019-10-31 06:07:51,319    INFO [INIT] LAVA master has started.
2019-10-31 06:07:51,319    INFO [INIT] Using protocol version 3
2019-10-31 06:07:53,408   DEBUG lava-logs => PING(20)
2019-10-31 06:08:06,192   DEBUG Dhanu => PING(20)
2019-10-31 06:08:06,193 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:08:11,325    INFO scheduling health checks:
2019-10-31 06:08:11,363    INFO scheduling jobs:
2019-10-31 06:08:11,366   DEBUG - qemu
2019-10-31 06:08:11,436   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:08:11,436   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:08:11,441    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:08:12,547    INFO [INIT] Dropping privileges
2019-10-31 06:08:12,547   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:08:12,548   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:08:12,549    INFO [INIT] Marking all workers as offline
2019-10-31 06:08:12,599    INFO [INIT] LAVA master has started.
2019-10-31 06:08:12,599    INFO [INIT] Using protocol version 3
2019-10-31 06:08:13,422   DEBUG lava-logs => PING(20)
2019-10-31 06:08:26,211   DEBUG Dhanu => PING(20)
2019-10-31 06:08:26,212 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:08:32,606    INFO scheduling health checks:
2019-10-31 06:08:32,632    INFO scheduling jobs:
2019-10-31 06:08:32,633   DEBUG - qemu
2019-10-31 06:08:32,705   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:08:32,705   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:08:32,710    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:08:33,779    INFO [INIT] Dropping privileges
2019-10-31 06:08:33,779   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:08:33,779   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:08:33,781    INFO [INIT] Marking all workers as offline
2019-10-31 06:08:33,823    INFO [INIT] LAVA master has started.
2019-10-31 06:08:33,824    INFO [INIT] Using protocol version 3
2019-10-31 06:08:33,950   DEBUG lava-logs => PING(20)
2019-10-31 06:08:46,233   DEBUG Dhanu => PING(20)
2019-10-31 06:08:46,233 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:08:53,832    INFO scheduling health checks:
2019-10-31 06:08:53,867    INFO scheduling jobs:
2019-10-31 06:08:53,869   DEBUG - qemu
2019-10-31 06:08:53,941   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:08:53,941   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:08:53,946    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:08:55,036    INFO [INIT] Dropping privileges
2019-10-31 06:08:55,036   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:08:55,036   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:08:55,038    INFO [INIT] Marking all workers as offline
2019-10-31 06:08:55,081    INFO [INIT] LAVA master has started.
2019-10-31 06:08:55,081    INFO [INIT] Using protocol version 3
2019-10-31 06:08:55,195   DEBUG lava-logs => PING(20)
2019-10-31 06:09:06,251   DEBUG Dhanu => PING(20)
2019-10-31 06:09:06,252 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:09:15,090    INFO scheduling health checks:
2019-10-31 06:09:15,125    INFO scheduling jobs:
2019-10-31 06:09:15,127   DEBUG - qemu
2019-10-31 06:09:15,200   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:09:15,200   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:09:15,205    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:09:16,307    INFO [INIT] Dropping privileges
2019-10-31 06:09:16,307   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:09:16,307   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:09:16,309    INFO [INIT] Marking all workers as offline
2019-10-31 06:09:16,372    INFO [INIT] LAVA master has started.
2019-10-31 06:09:16,372    INFO [INIT] Using protocol version 3
2019-10-31 06:09:16,383   DEBUG lava-logs => PING(20)
2019-10-31 06:09:26,275   DEBUG Dhanu => PING(20)
2019-10-31 06:09:26,275 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:09:36,379    INFO scheduling health checks:
2019-10-31 06:09:36,404    INFO scheduling jobs:
2019-10-31 06:09:36,406   DEBUG - qemu
2019-10-31 06:09:36,472   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:09:36,472   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:09:36,477    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:09:37,527    INFO [INIT] Dropping privileges
2019-10-31 06:09:37,528   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:09:37,528   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:09:37,529    INFO [INIT] Marking all workers as offline
2019-10-31 06:09:37,562    INFO [INIT] LAVA master has started.
2019-10-31 06:09:37,563    INFO [INIT] Using protocol version 3
2019-10-31 06:09:46,296   DEBUG Dhanu => PING(20)
2019-10-31 06:09:46,297 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:09:56,416   DEBUG lava-logs => PING(20)
2019-10-31 06:09:57,564    INFO scheduling health checks:
2019-10-31 06:09:57,584    INFO scheduling jobs:
2019-10-31 06:09:57,586   DEBUG - qemu
2019-10-31 06:09:57,654   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:09:57,654   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:09:57,658    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:09:58,831    INFO [INIT] Dropping privileges
2019-10-31 06:09:58,831   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:09:58,831   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:09:58,833    INFO [INIT] Marking all workers as offline
2019-10-31 06:09:58,865    INFO [INIT] LAVA master has started.
2019-10-31 06:09:58,865    INFO [INIT] Using protocol version 3
2019-10-31 06:10:06,318   DEBUG Dhanu => PING(20)
2019-10-31 06:10:06,318 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:10:16,436   DEBUG lava-logs => PING(20)
2019-10-31 06:10:18,867    INFO scheduling health checks:
2019-10-31 06:10:18,886    INFO scheduling jobs:
2019-10-31 06:10:18,887   DEBUG - qemu
2019-10-31 06:10:18,953   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:10:18,953   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:10:18,958    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:10:20,030    INFO [INIT] Dropping privileges
2019-10-31 06:10:20,030   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:10:20,030   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:10:20,032    INFO [INIT] Marking all workers as offline
2019-10-31 06:10:20,066    INFO [INIT] LAVA master has started.
2019-10-31 06:10:20,066    INFO [INIT] Using protocol version 3
2019-10-31 06:10:26,339   DEBUG Dhanu => PING(20)
2019-10-31 06:10:26,339 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:10:36,456   DEBUG lava-logs => PING(20)
2019-10-31 06:10:40,071    INFO scheduling health checks:
2019-10-31 06:10:40,099    INFO scheduling jobs:
2019-10-31 06:10:40,101   DEBUG - qemu
2019-10-31 06:10:40,167   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:10:40,168   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:10:40,177    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:10:41,308    INFO [INIT] Dropping privileges
2019-10-31 06:10:41,308   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:10:41,308   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:10:41,310    INFO [INIT] Marking all workers as offline
2019-10-31 06:10:41,390    INFO [INIT] LAVA master has started.
2019-10-31 06:10:41,390    INFO [INIT] Using protocol version 3
2019-10-31 06:10:46,362   DEBUG Dhanu => PING(20)
2019-10-31 06:10:46,362 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:10:56,474   DEBUG lava-logs => PING(20)
2019-10-31 06:11:01,395    INFO scheduling health checks:
2019-10-31 06:11:01,424    INFO scheduling jobs:
2019-10-31 06:11:01,426   DEBUG - qemu
2019-10-31 06:11:01,499   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:11:01,499   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:11:01,511    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:11:02,795    INFO [INIT] Dropping privileges
2019-10-31 06:11:02,795   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:11:02,795   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:11:02,797    INFO [INIT] Marking all workers as offline
2019-10-31 06:11:02,838    INFO [INIT] LAVA master has started.
2019-10-31 06:11:02,838    INFO [INIT] Using protocol version 3
2019-10-31 06:11:06,384   DEBUG Dhanu => PING(20)
2019-10-31 06:11:06,385 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:11:16,490   DEBUG lava-logs => PING(20)
2019-10-31 06:11:22,845    INFO scheduling health checks:
2019-10-31 06:11:22,882    INFO scheduling jobs:
2019-10-31 06:11:22,885   DEBUG - qemu
2019-10-31 06:11:22,960   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:11:22,961   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:11:22,975    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:11:24,025    INFO [INIT] Dropping privileges
2019-10-31 06:11:24,025   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:11:24,025   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:11:24,027    INFO [INIT] Marking all workers as offline
2019-10-31 06:11:24,062    INFO [INIT] LAVA master has started.
2019-10-31 06:11:24,062    INFO [INIT] Using protocol version 3
2019-10-31 06:11:26,403   DEBUG Dhanu => PING(20)
2019-10-31 06:11:26,404 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:11:36,506   DEBUG lava-logs => PING(20)
2019-10-31 06:11:44,070    INFO scheduling health checks:
2019-10-31 06:11:44,117    INFO scheduling jobs:
2019-10-31 06:11:44,119   DEBUG - qemu
2019-10-31 06:11:44,187   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:11:44,188   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:11:44,192    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:11:45,274    INFO [INIT] Dropping privileges
2019-10-31 06:11:45,275   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:11:45,275   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:11:45,276    INFO [INIT] Marking all workers as offline
2019-10-31 06:11:45,331    INFO [INIT] LAVA master has started.
2019-10-31 06:11:45,331    INFO [INIT] Using protocol version 3
2019-10-31 06:11:46,421   DEBUG Dhanu => PING(20)
2019-10-31 06:11:46,422 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:11:56,516   DEBUG lava-logs => PING(20)
2019-10-31 06:12:05,339    INFO scheduling health checks:
2019-10-31 06:12:05,375    INFO scheduling jobs:
2019-10-31 06:12:05,377   DEBUG - qemu
2019-10-31 06:12:05,453   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:12:05,453   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:12:05,458    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:12:06,533    INFO [INIT] Dropping privileges
2019-10-31 06:12:06,533   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:12:06,533   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:12:06,535    INFO [INIT] Marking all workers as offline
2019-10-31 06:12:06,566    INFO [INIT] LAVA master has started.
2019-10-31 06:12:06,566    INFO [INIT] Using protocol version 3
2019-10-31 06:12:06,665   DEBUG Dhanu => PING(20)
2019-10-31 06:12:06,665 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:12:16,539   DEBUG lava-logs => PING(20)
2019-10-31 06:12:26,577    INFO scheduling health checks:
2019-10-31 06:12:26,621    INFO scheduling jobs:
2019-10-31 06:12:26,623   DEBUG - qemu
2019-10-31 06:12:26,695   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:12:26,695   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:12:26,700    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:12:27,890    INFO [INIT] Dropping privileges
2019-10-31 06:12:27,890   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:12:27,890   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:12:27,892    INFO [INIT] Marking all workers as offline
2019-10-31 06:12:27,923    INFO [INIT] LAVA master has started.
2019-10-31 06:12:27,923    INFO [INIT] Using protocol version 3
2019-10-31 06:12:36,560   DEBUG lava-logs => PING(20)
2019-10-31 06:12:46,709   DEBUG Dhanu => PING(20)
2019-10-31 06:12:46,710 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:12:47,925    INFO scheduling health checks:
2019-10-31 06:12:47,956    INFO scheduling jobs:
2019-10-31 06:12:47,958   DEBUG - qemu
2019-10-31 06:12:48,037   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:12:48,037   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:12:48,042    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:12:49,399    INFO [INIT] Dropping privileges
2019-10-31 06:12:49,400   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:12:49,400   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:12:49,401    INFO [INIT] Marking all workers as offline
2019-10-31 06:12:49,458    INFO [INIT] LAVA master has started.
2019-10-31 06:12:49,458    INFO [INIT] Using protocol version 3
2019-10-31 06:12:56,574   DEBUG lava-logs => PING(20)
2019-10-31 06:13:06,727   DEBUG Dhanu => PING(20)
2019-10-31 06:13:06,728 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:13:09,459    INFO scheduling health checks:
2019-10-31 06:13:09,503    INFO scheduling jobs:
2019-10-31 06:13:09,506   DEBUG - qemu
2019-10-31 06:13:09,593   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:13:09,594   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:13:09,599    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:13:11,147    INFO [INIT] Dropping privileges
2019-10-31 06:13:11,147   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:13:11,147   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:13:11,151    INFO [INIT] Marking all workers as offline
2019-10-31 06:13:11,194    INFO [INIT] LAVA master has started.
2019-10-31 06:13:11,195    INFO [INIT] Using protocol version 3
2019-10-31 06:13:16,590   DEBUG lava-logs => PING(20)
2019-10-31 06:13:26,744   DEBUG Dhanu => PING(20)
2019-10-31 06:13:26,745 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:13:31,199    INFO scheduling health checks:
2019-10-31 06:13:31,261    INFO scheduling jobs:
2019-10-31 06:13:31,265   DEBUG - qemu
2019-10-31 06:13:31,346   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:13:31,346   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:13:31,351    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:13:32,567    INFO [INIT] Dropping privileges
2019-10-31 06:13:32,568   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:13:32,568   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:13:32,569    INFO [INIT] Marking all workers as offline
2019-10-31 06:13:32,619    INFO [INIT] LAVA master has started.
2019-10-31 06:13:32,619    INFO [INIT] Using protocol version 3
2019-10-31 06:13:36,606   DEBUG lava-logs => PING(20)
2019-10-31 06:13:46,760   DEBUG Dhanu => PING(20)
2019-10-31 06:13:46,761 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:13:52,626    INFO scheduling health checks:
2019-10-31 06:13:52,663    INFO scheduling jobs:
2019-10-31 06:13:52,665   DEBUG - qemu
2019-10-31 06:13:52,738   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:13:52,738   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:13:52,742    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:13:54,056    INFO [INIT] Dropping privileges
2019-10-31 06:13:54,057   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:13:54,057   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:13:54,058    INFO [INIT] Marking all workers as offline
2019-10-31 06:13:54,121    INFO [INIT] LAVA master has started.
2019-10-31 06:13:54,121    INFO [INIT] Using protocol version 3
2019-10-31 06:13:56,619   DEBUG lava-logs => PING(20)
2019-10-31 06:14:06,782   DEBUG Dhanu => PING(20)
2019-10-31 06:14:06,782 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:14:14,129    INFO scheduling health checks:
2019-10-31 06:14:14,165    INFO scheduling jobs:
2019-10-31 06:14:14,168   DEBUG - qemu
2019-10-31 06:14:14,238   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:14:14,238   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:14:14,242    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:14:15,346    INFO [INIT] Dropping privileges
2019-10-31 06:14:15,347   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:14:15,347   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:14:15,348    INFO [INIT] Marking all workers as offline
2019-10-31 06:14:15,377    INFO [INIT] LAVA master has started.
2019-10-31 06:14:15,377    INFO [INIT] Using protocol version 3
2019-10-31 06:14:16,634   DEBUG lava-logs => PING(20)
2019-10-31 06:14:26,802   DEBUG Dhanu => PING(20)
2019-10-31 06:14:26,802 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:14:35,386    INFO scheduling health checks:
2019-10-31 06:14:35,422    INFO scheduling jobs:
2019-10-31 06:14:35,424   DEBUG - qemu
2019-10-31 06:14:35,496   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:14:35,496   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:14:35,501    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:14:36,794    INFO [INIT] Dropping privileges
2019-10-31 06:14:36,794   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:14:36,794   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:14:36,796    INFO [INIT] Marking all workers as offline
2019-10-31 06:14:36,847    INFO [INIT] LAVA master has started.
2019-10-31 06:14:36,847    INFO [INIT] Using protocol version 3
2019-10-31 06:14:36,979   DEBUG lava-logs => PING(20)
2019-10-31 06:14:46,824   DEBUG Dhanu => PING(20)
2019-10-31 06:14:46,825 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:14:56,855    INFO scheduling health checks:
2019-10-31 06:14:56,902    INFO scheduling jobs:
2019-10-31 06:14:56,905   DEBUG - qemu
2019-10-31 06:14:56,986   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:14:56,986   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:14:56,992    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:14:58,386    INFO [INIT] Dropping privileges
2019-10-31 06:14:58,386   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:14:58,386   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:14:58,388    INFO [INIT] Marking all workers as offline
2019-10-31 06:14:58,429    INFO [INIT] LAVA master has started.
2019-10-31 06:14:58,429    INFO [INIT] Using protocol version 3
2019-10-31 06:14:58,503   DEBUG lava-logs => PING(20)
2019-10-31 06:15:06,839   DEBUG Dhanu => PING(20)
2019-10-31 06:15:06,840 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:15:18,439    INFO scheduling health checks:
2019-10-31 06:15:18,460    INFO scheduling jobs:
2019-10-31 06:15:18,461   DEBUG - qemu
2019-10-31 06:15:18,535   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:15:18,535   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:15:18,540    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:15:19,813    INFO [INIT] Dropping privileges
2019-10-31 06:15:19,814   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:15:19,838   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:15:19,840    INFO [INIT] Marking all workers as offline
2019-10-31 06:15:19,919    INFO [INIT] LAVA master has started.
2019-10-31 06:15:19,920    INFO [INIT] Using protocol version 3
2019-10-31 06:15:26,858   DEBUG Dhanu => PING(20)
2019-10-31 06:15:26,858 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:15:38,545   DEBUG lava-logs => PING(20)
2019-10-31 06:15:39,921    INFO scheduling health checks:
2019-10-31 06:15:39,951    INFO scheduling jobs:
2019-10-31 06:15:39,953   DEBUG - qemu
2019-10-31 06:15:40,027   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:15:40,027   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:15:40,031    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:15:41,288    INFO [INIT] Dropping privileges
2019-10-31 06:15:41,289   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:15:41,289   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:15:41,290    INFO [INIT] Marking all workers as offline
2019-10-31 06:15:41,332    INFO [INIT] LAVA master has started.
2019-10-31 06:15:41,332    INFO [INIT] Using protocol version 3
2019-10-31 06:15:46,874   DEBUG Dhanu => PING(20)
2019-10-31 06:15:46,875 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:15:58,560   DEBUG lava-logs => PING(20)
2019-10-31 06:16:01,335    INFO scheduling health checks:
2019-10-31 06:16:01,375    INFO scheduling jobs:
2019-10-31 06:16:01,377   DEBUG - qemu
2019-10-31 06:16:01,446   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:16:01,446   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:16:01,450    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:16:02,532    INFO [INIT] Dropping privileges
2019-10-31 06:16:02,532   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:16:02,532   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:16:02,534    INFO [INIT] Marking all workers as offline
2019-10-31 06:16:02,566    INFO [INIT] LAVA master has started.
2019-10-31 06:16:02,567    INFO [INIT] Using protocol version 3
2019-10-31 06:16:06,893   DEBUG Dhanu => PING(20)
2019-10-31 06:16:06,894 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:16:18,577   DEBUG lava-logs => PING(20)
2019-10-31 06:16:22,571    INFO scheduling health checks:
2019-10-31 06:16:22,599    INFO scheduling jobs:
2019-10-31 06:16:22,601   DEBUG - qemu
2019-10-31 06:16:22,666   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:16:22,667   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:16:22,671    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:16:23,804    INFO [INIT] Dropping privileges
2019-10-31 06:16:23,805   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:16:23,805   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:16:23,806    INFO [INIT] Marking all workers as offline
2019-10-31 06:16:23,845    INFO [INIT] LAVA master has started.
2019-10-31 06:16:23,846    INFO [INIT] Using protocol version 3
2019-10-31 06:16:26,915   DEBUG Dhanu => PING(20)
2019-10-31 06:16:26,915 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:16:38,594   DEBUG lava-logs => PING(20)
2019-10-31 06:16:43,851    INFO scheduling health checks:
2019-10-31 06:16:43,902    INFO scheduling jobs:
2019-10-31 06:16:43,905   DEBUG - qemu
2019-10-31 06:16:43,981   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:16:43,981   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:16:43,992    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:16:45,281    INFO [INIT] Dropping privileges
2019-10-31 06:16:45,281   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:16:45,281   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:16:45,283    INFO [INIT] Marking all workers as offline
2019-10-31 06:16:45,315    INFO [INIT] LAVA master has started.
2019-10-31 06:16:45,315    INFO [INIT] Using protocol version 3
2019-10-31 06:16:46,932   DEBUG Dhanu => PING(20)
2019-10-31 06:16:46,932 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:16:58,608   DEBUG lava-logs => PING(20)
2019-10-31 06:17:05,323    INFO scheduling health checks:
2019-10-31 06:17:05,359    INFO scheduling jobs:
2019-10-31 06:17:05,363   DEBUG - qemu
2019-10-31 06:17:05,437   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:17:05,437   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:17:05,442    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:17:06,527    INFO [INIT] Dropping privileges
2019-10-31 06:17:06,528   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:17:06,528   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:17:06,529    INFO [INIT] Marking all workers as offline
2019-10-31 06:17:06,562    INFO [INIT] LAVA master has started.
2019-10-31 06:17:06,562    INFO [INIT] Using protocol version 3
2019-10-31 06:17:06,952   DEBUG Dhanu => PING(20)
2019-10-31 06:17:06,952 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:17:18,623   DEBUG lava-logs => PING(20)
2019-10-31 06:17:26,570    INFO scheduling health checks:
2019-10-31 06:17:26,606    INFO scheduling jobs:
2019-10-31 06:17:26,608   DEBUG - qemu
2019-10-31 06:17:26,684   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:17:26,684   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:17:26,688    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:17:27,774    INFO [INIT] Dropping privileges
2019-10-31 06:17:27,774   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:17:27,774   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:17:27,776    INFO [INIT] Marking all workers as offline
2019-10-31 06:17:27,809    INFO [INIT] LAVA master has started.
2019-10-31 06:17:27,809    INFO [INIT] Using protocol version 3
2019-10-31 06:17:27,842   DEBUG Dhanu => PING(20)
2019-10-31 06:17:27,842 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:17:38,637   DEBUG lava-logs => PING(20)
2019-10-31 06:17:47,819    INFO scheduling health checks:
2019-10-31 06:17:47,852    INFO scheduling jobs:
2019-10-31 06:17:47,855   DEBUG - qemu
2019-10-31 06:17:47,930   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:17:47,930   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:17:47,935    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:17:49,036    INFO [INIT] Dropping privileges
2019-10-31 06:17:49,037   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:17:49,037   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:17:49,038    INFO [INIT] Marking all workers as offline
2019-10-31 06:17:49,076    INFO [INIT] LAVA master has started.
2019-10-31 06:17:49,076    INFO [INIT] Using protocol version 3
2019-10-31 06:17:58,660   DEBUG lava-logs => PING(20)
2019-10-31 06:18:07,884   DEBUG Dhanu => PING(20)
2019-10-31 06:18:07,885 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:18:09,077    INFO scheduling health checks:
2019-10-31 06:18:09,099    INFO scheduling jobs:
2019-10-31 06:18:09,100   DEBUG - qemu
2019-10-31 06:18:09,165   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:18:09,165   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:18:09,169    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:18:10,285    INFO [INIT] Dropping privileges
2019-10-31 06:18:10,285   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:18:10,285   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:18:10,287    INFO [INIT] Marking all workers as offline
2019-10-31 06:18:10,323    INFO [INIT] LAVA master has started.
2019-10-31 06:18:10,324    INFO [INIT] Using protocol version 3
2019-10-31 06:18:18,681   DEBUG lava-logs => PING(20)
2019-10-31 06:18:27,900   DEBUG Dhanu => PING(20)
2019-10-31 06:18:27,901 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:18:30,326    INFO scheduling health checks:
2019-10-31 06:18:30,345    INFO scheduling jobs:
2019-10-31 06:18:30,346   DEBUG - qemu
2019-10-31 06:18:30,416   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:18:30,417   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:18:30,424    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:18:31,537    INFO [INIT] Dropping privileges
2019-10-31 06:18:31,538   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:18:31,538   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:18:31,539    INFO [INIT] Marking all workers as offline
2019-10-31 06:18:31,569    INFO [INIT] LAVA master has started.
2019-10-31 06:18:31,569    INFO [INIT] Using protocol version 3
2019-10-31 06:18:38,701   DEBUG lava-logs => PING(20)
2019-10-31 06:18:47,921   DEBUG Dhanu => PING(20)
2019-10-31 06:18:47,921 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:18:51,574    INFO scheduling health checks:
2019-10-31 06:18:51,614    INFO scheduling jobs:
2019-10-31 06:18:51,616   DEBUG - qemu
2019-10-31 06:18:51,690   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:18:51,690   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:18:51,695    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:18:52,784    INFO [INIT] Dropping privileges
2019-10-31 06:18:52,785   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:18:52,785   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:18:52,787    INFO [INIT] Marking all workers as offline
2019-10-31 06:18:52,844    INFO [INIT] LAVA master has started.
2019-10-31 06:18:52,844    INFO [INIT] Using protocol version 3
2019-10-31 06:18:58,719   DEBUG lava-logs => PING(20)
2019-10-31 06:19:07,936   DEBUG Dhanu => PING(20)
2019-10-31 06:19:07,937 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:19:12,847    INFO scheduling health checks:
2019-10-31 06:19:12,883    INFO scheduling jobs:
2019-10-31 06:19:12,886   DEBUG - qemu
2019-10-31 06:19:12,961   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:19:12,961   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:19:12,965    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:19:14,030    INFO [INIT] Dropping privileges
2019-10-31 06:19:14,031   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:19:14,031   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:19:14,032    INFO [INIT] Marking all workers as offline
2019-10-31 06:19:14,062    INFO [INIT] LAVA master has started.
2019-10-31 06:19:14,062    INFO [INIT] Using protocol version 3
2019-10-31 06:19:18,737   DEBUG lava-logs => PING(20)
2019-10-31 06:19:27,956   DEBUG Dhanu => PING(20)
2019-10-31 06:19:27,956 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:19:34,069    INFO scheduling health checks:
2019-10-31 06:19:34,107    INFO scheduling jobs:
2019-10-31 06:19:34,111   DEBUG - qemu
2019-10-31 06:19:34,185   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:19:34,185   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:19:34,190    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:19:35,285    INFO [INIT] Dropping privileges
2019-10-31 06:19:35,285   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:19:35,285   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:19:35,287    INFO [INIT] Marking all workers as offline
2019-10-31 06:19:35,320    INFO [INIT] LAVA master has started.
2019-10-31 06:19:35,321    INFO [INIT] Using protocol version 3
2019-10-31 06:19:38,754   DEBUG lava-logs => PING(20)
2019-10-31 06:19:47,977   DEBUG Dhanu => PING(20)
2019-10-31 06:19:47,978 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:19:55,329    INFO scheduling health checks:
2019-10-31 06:19:55,387    INFO scheduling jobs:
2019-10-31 06:19:55,390   DEBUG - qemu
2019-10-31 06:19:55,464   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:19:55,464   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:19:55,469    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:19:56,533    INFO [INIT] Dropping privileges
2019-10-31 06:19:56,533   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:19:56,533   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:19:56,534    INFO [INIT] Marking all workers as offline
2019-10-31 06:19:56,590    INFO [INIT] LAVA master has started.
2019-10-31 06:19:56,590    INFO [INIT] Using protocol version 3
2019-10-31 06:19:58,767   DEBUG lava-logs => PING(20)
2019-10-31 06:20:07,998   DEBUG Dhanu => PING(20)
2019-10-31 06:20:07,999 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:20:16,599    INFO scheduling health checks:
2019-10-31 06:20:16,633    INFO scheduling jobs:
2019-10-31 06:20:16,635   DEBUG - qemu
2019-10-31 06:20:16,701   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:20:16,702   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:20:16,706    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:20:17,778    INFO [INIT] Dropping privileges
2019-10-31 06:20:17,778   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:20:17,778   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:20:17,780    INFO [INIT] Marking all workers as offline
2019-10-31 06:20:17,813    INFO [INIT] LAVA master has started.
2019-10-31 06:20:17,813    INFO [INIT] Using protocol version 3
2019-10-31 06:20:18,781   DEBUG lava-logs => PING(20)
2019-10-31 06:20:28,018   DEBUG Dhanu => PING(20)
2019-10-31 06:20:28,019 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:20:37,823    INFO scheduling health checks:
2019-10-31 06:20:37,846    INFO scheduling jobs:
2019-10-31 06:20:37,848   DEBUG - qemu
2019-10-31 06:20:37,914   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:20:37,914   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:20:37,918    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:20:39,081    INFO [INIT] Dropping privileges
2019-10-31 06:20:39,082   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:20:39,082   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:20:39,083    INFO [INIT] Marking all workers as offline
2019-10-31 06:20:39,161    INFO [INIT] LAVA master has started.
2019-10-31 06:20:39,161    INFO [INIT] Using protocol version 3
2019-10-31 06:20:39,166   DEBUG lava-logs => PING(20)
2019-10-31 06:20:48,038   DEBUG Dhanu => PING(20)
2019-10-31 06:20:48,038 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:20:59,173    INFO scheduling health checks:
2019-10-31 06:20:59,193    INFO scheduling jobs:
2019-10-31 06:20:59,194   DEBUG - qemu
2019-10-31 06:20:59,265   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:20:59,265   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:20:59,270    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:21:00,337    INFO [INIT] Dropping privileges
2019-10-31 06:21:00,338   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:21:00,338   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:21:00,339    INFO [INIT] Marking all workers as offline
2019-10-31 06:21:00,373    INFO [INIT] LAVA master has started.
2019-10-31 06:21:00,373    INFO [INIT] Using protocol version 3
2019-10-31 06:21:08,059   DEBUG Dhanu => PING(20)
2019-10-31 06:21:08,059 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:21:19,208   DEBUG lava-logs => PING(20)
2019-10-31 06:21:20,375    INFO scheduling health checks:
2019-10-31 06:21:20,406    INFO scheduling jobs:
2019-10-31 06:21:20,408   DEBUG - qemu
2019-10-31 06:21:20,474   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:21:20,474   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:21:20,478    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:21:21,773    INFO [INIT] Dropping privileges
2019-10-31 06:21:21,773   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:21:21,774   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:21:21,775    INFO [INIT] Marking all workers as offline
2019-10-31 06:21:21,809    INFO [INIT] LAVA master has started.
2019-10-31 06:21:21,809    INFO [INIT] Using protocol version 3
2019-10-31 06:21:28,076   DEBUG Dhanu => PING(20)
2019-10-31 06:21:28,077 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:21:39,216   DEBUG lava-logs => PING(20)
2019-10-31 06:21:41,811    INFO scheduling health checks:
2019-10-31 06:21:41,842    INFO scheduling jobs:
2019-10-31 06:21:41,844   DEBUG - qemu
2019-10-31 06:21:41,915   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:21:41,916   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:21:41,920    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:21:43,045    INFO [INIT] Dropping privileges
2019-10-31 06:21:43,045   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:21:43,045   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:21:43,047    INFO [INIT] Marking all workers as offline
2019-10-31 06:21:43,133    INFO [INIT] LAVA master has started.
2019-10-31 06:21:43,134    INFO [INIT] Using protocol version 3
2019-10-31 06:21:48,098   DEBUG Dhanu => PING(20)
2019-10-31 06:21:48,098 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:21:59,235   DEBUG lava-logs => PING(20)
2019-10-31 06:22:03,135    INFO scheduling health checks:
2019-10-31 06:22:03,166    INFO scheduling jobs:
2019-10-31 06:22:03,170   DEBUG - qemu
2019-10-31 06:22:03,270   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:22:03,270   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:22:03,277    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:22:04,628    INFO [INIT] Dropping privileges
2019-10-31 06:22:04,629   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:22:04,629   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:22:04,632    INFO [INIT] Marking all workers as offline
2019-10-31 06:22:04,656    INFO [INIT] LAVA master has started.
2019-10-31 06:22:04,656    INFO [INIT] Using protocol version 3
2019-10-31 06:22:08,120   DEBUG Dhanu => PING(20)
2019-10-31 06:22:08,120 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:22:19,248   DEBUG lava-logs => PING(20)
2019-10-31 06:22:24,658    INFO scheduling health checks:
2019-10-31 06:22:24,701    INFO scheduling jobs:
2019-10-31 06:22:24,704   DEBUG - qemu
2019-10-31 06:22:24,781   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:22:24,781   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:22:24,786    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:22:26,050    INFO [INIT] Dropping privileges
2019-10-31 06:22:26,051   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:22:26,051   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:22:26,052    INFO [INIT] Marking all workers as offline
2019-10-31 06:22:26,092    INFO [INIT] LAVA master has started.
2019-10-31 06:22:26,092    INFO [INIT] Using protocol version 3
2019-10-31 06:22:28,132   DEBUG Dhanu => PING(20)
2019-10-31 06:22:28,133 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:22:39,260   DEBUG lava-logs => PING(20)
2019-10-31 06:22:46,099    INFO scheduling health checks:
2019-10-31 06:22:46,137    INFO scheduling jobs:
2019-10-31 06:22:46,140   DEBUG - qemu
2019-10-31 06:22:46,208   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:22:46,208   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:22:46,213    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:22:47,296    INFO [INIT] Dropping privileges
2019-10-31 06:22:47,296   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:22:47,296   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:22:47,298    INFO [INIT] Marking all workers as offline
2019-10-31 06:22:47,327    INFO [INIT] LAVA master has started.
2019-10-31 06:22:47,328    INFO [INIT] Using protocol version 3
2019-10-31 06:22:48,149   DEBUG Dhanu => PING(20)
2019-10-31 06:22:48,150 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:22:59,275   DEBUG lava-logs => PING(20)
2019-10-31 06:23:07,334    INFO scheduling health checks:
2019-10-31 06:23:07,372    INFO scheduling jobs:
2019-10-31 06:23:07,374   DEBUG - qemu
2019-10-31 06:23:07,446   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:23:07,446   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:23:07,451    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:23:08,546    INFO [INIT] Dropping privileges
2019-10-31 06:23:08,546   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:23:08,546   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:23:08,548    INFO [INIT] Marking all workers as offline
2019-10-31 06:23:08,585    INFO [INIT] LAVA master has started.
2019-10-31 06:23:08,585    INFO [INIT] Using protocol version 3
2019-10-31 06:23:08,588   DEBUG Dhanu => PING(20)
2019-10-31 06:23:08,588 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:23:19,287   DEBUG lava-logs => PING(20)
2019-10-31 06:23:28,591    INFO scheduling health checks:
2019-10-31 06:23:28,630    INFO scheduling jobs:
2019-10-31 06:23:28,632   DEBUG - qemu
2019-10-31 06:23:28,705   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:23:28,705   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:23:28,709    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:23:29,777    INFO [INIT] Dropping privileges
2019-10-31 06:23:29,778   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:23:29,778   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:23:29,779    INFO [INIT] Marking all workers as offline
2019-10-31 06:23:29,822    INFO [INIT] LAVA master has started.
2019-10-31 06:23:29,822    INFO [INIT] Using protocol version 3
2019-10-31 06:23:39,306   DEBUG lava-logs => PING(20)
2019-10-31 06:23:48,626   DEBUG Dhanu => PING(20)
2019-10-31 06:23:48,627 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:23:49,823    INFO scheduling health checks:
2019-10-31 06:23:49,843    INFO scheduling jobs:
2019-10-31 06:23:49,844   DEBUG - qemu
2019-10-31 06:23:49,912   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:23:49,913   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:23:49,917    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:23:51,036    INFO [INIT] Dropping privileges
2019-10-31 06:23:51,036   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:23:51,036   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:23:51,038    INFO [INIT] Marking all workers as offline
2019-10-31 06:23:51,068    INFO [INIT] LAVA master has started.
2019-10-31 06:23:51,068    INFO [INIT] Using protocol version 3
2019-10-31 06:23:59,328   DEBUG lava-logs => PING(20)
2019-10-31 06:24:08,647   DEBUG Dhanu => PING(20)
2019-10-31 06:24:08,648 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:24:11,071    INFO scheduling health checks:
2019-10-31 06:24:11,123    INFO scheduling jobs:
2019-10-31 06:24:11,126   DEBUG - qemu
2019-10-31 06:24:11,202   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:24:11,202   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:24:11,207    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:24:12,295    INFO [INIT] Dropping privileges
2019-10-31 06:24:12,295   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:24:12,295   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:24:12,296    INFO [INIT] Marking all workers as offline
2019-10-31 06:24:12,326    INFO [INIT] LAVA master has started.
2019-10-31 06:24:12,326    INFO [INIT] Using protocol version 3
2019-10-31 06:24:19,348   DEBUG lava-logs => PING(20)
2019-10-31 06:24:28,664   DEBUG Dhanu => PING(20)
2019-10-31 06:24:28,665 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:24:32,330    INFO scheduling health checks:
2019-10-31 06:24:32,381    INFO scheduling jobs:
2019-10-31 06:24:32,383   DEBUG - qemu
2019-10-31 06:24:32,457   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:24:32,457   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:24:32,461    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:24:33,548    INFO [INIT] Dropping privileges
2019-10-31 06:24:33,548   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:24:33,548   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:24:33,550    INFO [INIT] Marking all workers as offline
2019-10-31 06:24:33,582    INFO [INIT] LAVA master has started.
2019-10-31 06:24:33,582    INFO [INIT] Using protocol version 3
2019-10-31 06:24:39,368   DEBUG lava-logs => PING(20)
2019-10-31 06:24:48,680   DEBUG Dhanu => PING(20)
2019-10-31 06:24:48,681 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:24:51,790    INFO [POLL] Received a signal, leaving
2019-10-31 06:24:51,790    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:24:52,756    INFO [INIT] Dropping privileges
2019-10-31 06:24:52,756   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:24:52,757   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:24:52,758    INFO [INIT] Marking all workers as offline
2019-10-31 06:24:52,785    INFO [INIT] LAVA master has started.
2019-10-31 06:24:52,785    INFO [INIT] Using protocol version 3
2019-10-31 06:24:57,633    INFO Dhanu => HELLO
2019-10-31 06:24:57,633 WARNING New dispatcher <Dhanu>
2019-10-31 06:24:59,388   DEBUG lava-logs => PING(20)
2019-10-31 06:25:02,640   DEBUG Dhanu => PING(20)
2019-10-31 06:25:12,795    INFO scheduling health checks:
2019-10-31 06:25:12,929    INFO scheduling jobs:
2019-10-31 06:25:12,932   DEBUG - qemu
2019-10-31 06:25:13,037   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 06:25:13,037   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 06:25:13,043    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 06:25:14,464    INFO [INIT] Dropping privileges
2019-10-31 06:25:14,464   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 06:25:14,464   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 06:25:14,467    INFO [INIT] Marking all workers as offline
2019-10-31 06:25:14,543    INFO [INIT] LAVA master has started.
2019-10-31 06:25:14,543    INFO [INIT] Using protocol version 3
2019-10-31 06:25:14,828   DEBUG lava-logs => PING(20)
2019-10-31 06:25:14,879   DEBUG lava-logs => PING(20)
2019-10-31 06:25:22,656   DEBUG Dhanu => PING(20)
2019-10-31 06:25:22,657 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 06:25:33,386    INFO [POLL] Received a signal, leaving
2019-10-31 06:25:33,386    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 11:59:41,532    INFO [INIT] Dropping privileges
2019-10-31 11:59:41,608   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 11:59:41,609   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 11:59:41,623    INFO [INIT] Marking all workers as offline
2019-10-31 11:59:41,692    INFO [INIT] LAVA master has started.
2019-10-31 11:59:41,692    INFO [INIT] Using protocol version 3
2019-10-31 11:59:41,717    INFO Dhanu => HELLO
2019-10-31 11:59:41,718 WARNING New dispatcher <Dhanu>
2019-10-31 11:59:41,801    INFO Dhanu => HELLO_RETRY
2019-10-31 11:59:41,801 WARNING Dispatcher <Dhanu> was not confirmed
2019-10-31 11:59:41,834    INFO Dhanu => HELLO_RETRY
2019-10-31 11:59:41,835 WARNING Dispatcher <Dhanu> was not confirmed
2019-10-31 11:59:41,867   DEBUG lava-logs => PING(20)
2019-10-31 11:59:41,901    INFO Dhanu => HELLO_RETRY
2019-10-31 11:59:41,901 WARNING Dispatcher <Dhanu> was not confirmed
2019-10-31 11:59:41,934   DEBUG lava-logs => PING(20)
2019-10-31 11:59:41,967    INFO Dhanu => HELLO_RETRY
2019-10-31 11:59:41,968 WARNING Dispatcher <Dhanu> was not confirmed
2019-10-31 11:59:46,974   DEBUG Dhanu => PING(20)
2019-10-31 12:00:01,705    INFO scheduling health checks:
2019-10-31 12:00:02,047    INFO scheduling jobs:
2019-10-31 12:00:02,050   DEBUG - qemu
2019-10-31 12:00:02,443   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:00:02,443   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:00:02,505    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:00:03,889    INFO [INIT] Dropping privileges
2019-10-31 12:00:03,889   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:00:03,889   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:00:03,891    INFO [INIT] Marking all workers as offline
2019-10-31 12:00:03,950    INFO [INIT] LAVA master has started.
2019-10-31 12:00:03,951    INFO [INIT] Using protocol version 3
2019-10-31 12:00:06,995   DEBUG Dhanu => PING(20)
2019-10-31 12:00:06,995 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:00:21,976   DEBUG lava-logs => PING(20)
2019-10-31 12:00:23,953    INFO scheduling health checks:
2019-10-31 12:00:24,005    INFO scheduling jobs:
2019-10-31 12:00:24,007   DEBUG - qemu
2019-10-31 12:00:24,081   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:00:24,081   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:00:24,085    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:00:25,364    INFO [INIT] Dropping privileges
2019-10-31 12:00:25,364   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:00:25,364   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:00:25,366    INFO [INIT] Marking all workers as offline
2019-10-31 12:00:25,430    INFO [INIT] LAVA master has started.
2019-10-31 12:00:25,430    INFO [INIT] Using protocol version 3
2019-10-31 12:00:27,015   DEBUG Dhanu => PING(20)
2019-10-31 12:00:27,015 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:00:41,992   DEBUG lava-logs => PING(20)
2019-10-31 12:00:45,435    INFO scheduling health checks:
2019-10-31 12:00:45,496    INFO scheduling jobs:
2019-10-31 12:00:45,499   DEBUG - qemu
2019-10-31 12:00:45,566   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:00:45,566   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:00:45,570    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:00:46,901    INFO [INIT] Dropping privileges
2019-10-31 12:00:46,901   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:00:46,901   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:00:46,903    INFO [INIT] Marking all workers as offline
2019-10-31 12:00:46,964    INFO [INIT] LAVA master has started.
2019-10-31 12:00:46,965    INFO [INIT] Using protocol version 3
2019-10-31 12:00:47,030   DEBUG Dhanu => PING(20)
2019-10-31 12:00:47,031 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:01:02,010   DEBUG lava-logs => PING(20)
2019-10-31 12:01:06,970    INFO scheduling health checks:
2019-10-31 12:01:07,009    INFO scheduling jobs:
2019-10-31 12:01:07,010   DEBUG - qemu
2019-10-31 12:01:07,083   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:01:07,083   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:01:07,087    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:01:08,278    INFO [INIT] Dropping privileges
2019-10-31 12:01:08,278   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:01:08,278   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:01:08,279    INFO [INIT] Marking all workers as offline
2019-10-31 12:01:08,345    INFO [INIT] LAVA master has started.
2019-10-31 12:01:08,345    INFO [INIT] Using protocol version 3
2019-10-31 12:01:22,026   DEBUG lava-logs => PING(20)
2019-10-31 12:01:27,069   DEBUG Dhanu => PING(20)
2019-10-31 12:01:27,070 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:01:28,347    INFO scheduling health checks:
2019-10-31 12:01:28,389    INFO scheduling jobs:
2019-10-31 12:01:28,392   DEBUG - qemu
2019-10-31 12:01:28,461   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:01:28,461   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:01:28,465    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:01:29,729    INFO [INIT] Dropping privileges
2019-10-31 12:01:29,729   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:01:29,729   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:01:29,731    INFO [INIT] Marking all workers as offline
2019-10-31 12:01:29,768    INFO [INIT] LAVA master has started.
2019-10-31 12:01:29,768    INFO [INIT] Using protocol version 3
2019-10-31 12:01:42,038   DEBUG lava-logs => PING(20)
2019-10-31 12:01:47,086   DEBUG Dhanu => PING(20)
2019-10-31 12:01:47,086 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:01:49,769    INFO scheduling health checks:
2019-10-31 12:01:49,869    INFO scheduling jobs:
2019-10-31 12:01:49,871   DEBUG - qemu
2019-10-31 12:01:49,953   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:01:49,953   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:01:49,958    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:01:51,240    INFO [INIT] Dropping privileges
2019-10-31 12:01:51,240   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:01:51,240   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:01:51,242    INFO [INIT] Marking all workers as offline
2019-10-31 12:01:51,304    INFO [INIT] LAVA master has started.
2019-10-31 12:01:51,304    INFO [INIT] Using protocol version 3
2019-10-31 12:02:02,050   DEBUG lava-logs => PING(20)
2019-10-31 12:02:07,102   DEBUG Dhanu => PING(20)
2019-10-31 12:02:07,102 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:02:11,305    INFO scheduling health checks:
2019-10-31 12:02:11,360    INFO scheduling jobs:
2019-10-31 12:02:11,364   DEBUG - qemu
2019-10-31 12:02:11,440   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:02:11,440   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:02:11,445    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:02:12,839    INFO [INIT] Dropping privileges
2019-10-31 12:02:12,839   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:02:12,840   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:02:12,841    INFO [INIT] Marking all workers as offline
2019-10-31 12:02:12,896    INFO [INIT] LAVA master has started.
2019-10-31 12:02:12,896    INFO [INIT] Using protocol version 3
2019-10-31 12:02:22,067   DEBUG lava-logs => PING(20)
2019-10-31 12:02:27,118   DEBUG Dhanu => PING(20)
2019-10-31 12:02:27,119 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:02:32,901    INFO scheduling health checks:
2019-10-31 12:02:32,962    INFO scheduling jobs:
2019-10-31 12:02:32,965   DEBUG - qemu
2019-10-31 12:02:33,039   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:02:33,039   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:02:33,043    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:02:34,380    INFO [INIT] Dropping privileges
2019-10-31 12:02:34,381   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:02:34,381   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:02:34,382    INFO [INIT] Marking all workers as offline
2019-10-31 12:02:34,432    INFO [INIT] LAVA master has started.
2019-10-31 12:02:34,432    INFO [INIT] Using protocol version 3
2019-10-31 12:02:42,086   DEBUG lava-logs => PING(20)
2019-10-31 12:02:47,138   DEBUG Dhanu => PING(20)
2019-10-31 12:02:47,138 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:02:54,440    INFO scheduling health checks:
2019-10-31 12:02:54,502    INFO scheduling jobs:
2019-10-31 12:02:54,506   DEBUG - qemu
2019-10-31 12:02:54,581   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:02:54,581   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:02:54,586    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:02:55,796    INFO [INIT] Dropping privileges
2019-10-31 12:02:55,797   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:02:55,797   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:02:55,798    INFO [INIT] Marking all workers as offline
2019-10-31 12:02:55,856    INFO [INIT] LAVA master has started.
2019-10-31 12:02:55,856    INFO [INIT] Using protocol version 3
2019-10-31 12:03:02,105   DEBUG lava-logs => PING(20)
2019-10-31 12:03:07,152   DEBUG Dhanu => PING(20)
2019-10-31 12:03:07,152 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:03:15,865    INFO scheduling health checks:
2019-10-31 12:03:15,922    INFO scheduling jobs:
2019-10-31 12:03:15,924   DEBUG - qemu
2019-10-31 12:03:15,994   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:03:15,994   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:03:15,999    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:03:17,148    INFO [INIT] Dropping privileges
2019-10-31 12:03:17,148   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:03:17,148   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:03:17,149    INFO [INIT] Marking all workers as offline
2019-10-31 12:03:17,214    INFO [INIT] LAVA master has started.
2019-10-31 12:03:17,214    INFO [INIT] Using protocol version 3
2019-10-31 12:03:22,121   DEBUG lava-logs => PING(20)
2019-10-31 12:03:27,170   DEBUG Dhanu => PING(20)
2019-10-31 12:03:27,171 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:03:37,221    INFO scheduling health checks:
2019-10-31 12:03:37,280    INFO scheduling jobs:
2019-10-31 12:03:37,282   DEBUG - qemu
2019-10-31 12:03:37,353   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:03:37,353   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:03:37,358    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:03:38,629    INFO [INIT] Dropping privileges
2019-10-31 12:03:38,630   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:03:38,630   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:03:38,631    INFO [INIT] Marking all workers as offline
2019-10-31 12:03:38,693    INFO [INIT] LAVA master has started.
2019-10-31 12:03:38,694    INFO [INIT] Using protocol version 3
2019-10-31 12:03:42,134   DEBUG lava-logs => PING(20)
2019-10-31 12:03:47,192   DEBUG Dhanu => PING(20)
2019-10-31 12:03:47,192 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:03:58,705    INFO scheduling health checks:
2019-10-31 12:03:58,760    INFO scheduling jobs:
2019-10-31 12:03:58,763   DEBUG - qemu
2019-10-31 12:03:58,838   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:03:58,838   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:03:58,854    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:04:00,098    INFO [INIT] Dropping privileges
2019-10-31 12:04:00,098   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:04:00,098   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:04:00,100    INFO [INIT] Marking all workers as offline
2019-10-31 12:04:00,162    INFO [INIT] LAVA master has started.
2019-10-31 12:04:00,163    INFO [INIT] Using protocol version 3
2019-10-31 12:04:02,149   DEBUG lava-logs => PING(20)
2019-10-31 12:04:07,211   DEBUG Dhanu => PING(20)
2019-10-31 12:04:07,211 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:04:20,173    INFO scheduling health checks:
2019-10-31 12:04:20,206    INFO scheduling jobs:
2019-10-31 12:04:20,209   DEBUG - qemu
2019-10-31 12:04:20,280   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:04:20,280   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:04:20,285    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:04:21,340    INFO [INIT] Dropping privileges
2019-10-31 12:04:21,340   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:04:21,341   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:04:21,342    INFO [INIT] Marking all workers as offline
2019-10-31 12:04:21,375    INFO [INIT] LAVA master has started.
2019-10-31 12:04:21,376    INFO [INIT] Using protocol version 3
2019-10-31 12:04:22,162   DEBUG lava-logs => PING(20)
2019-10-31 12:04:27,231   DEBUG Dhanu => PING(20)
2019-10-31 12:04:27,231 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:04:28,617    INFO [POLL] Received a signal, leaving
2019-10-31 12:04:28,617    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:04:29,589    INFO [INIT] Dropping privileges
2019-10-31 12:04:29,589   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:04:29,589   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:04:29,591    INFO [INIT] Marking all workers as offline
2019-10-31 12:04:29,620    INFO [INIT] LAVA master has started.
2019-10-31 12:04:29,621    INFO [INIT] Using protocol version 3
2019-10-31 12:04:47,245   DEBUG Dhanu => PING(20)
2019-10-31 12:04:47,246 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:04:47,286   DEBUG lava-logs => PING(20)
2019-10-31 12:04:47,298   DEBUG lava-logs => PING(20)
2019-10-31 12:04:49,623    INFO scheduling health checks:
2019-10-31 12:04:49,653    INFO scheduling jobs:
2019-10-31 12:04:49,655   DEBUG - qemu
2019-10-31 12:04:49,728   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:04:49,728   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:04:49,732    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:04:50,842    INFO [INIT] Dropping privileges
2019-10-31 12:04:50,842   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:04:50,842   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:04:50,844    INFO [INIT] Marking all workers as offline
2019-10-31 12:04:50,878    INFO [INIT] LAVA master has started.
2019-10-31 12:04:50,879    INFO [INIT] Using protocol version 3
2019-10-31 12:05:07,264   DEBUG Dhanu => PING(20)
2019-10-31 12:05:07,265 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:05:07,322   DEBUG lava-logs => PING(20)
2019-10-31 12:05:10,883    INFO scheduling health checks:
2019-10-31 12:05:10,934    INFO scheduling jobs:
2019-10-31 12:05:10,937   DEBUG - qemu
2019-10-31 12:05:11,014   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:05:11,014   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:05:11,019    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:05:12,108    INFO [INIT] Dropping privileges
2019-10-31 12:05:12,109   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:05:12,109   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:05:12,111    INFO [INIT] Marking all workers as offline
2019-10-31 12:05:12,147    INFO [INIT] LAVA master has started.
2019-10-31 12:05:12,147    INFO [INIT] Using protocol version 3
2019-10-31 12:05:23,701    INFO Dhanu => HELLO
2019-10-31 12:05:23,702 WARNING New dispatcher <Dhanu>
2019-10-31 12:05:27,338   DEBUG lava-logs => PING(20)
2019-10-31 12:05:28,708   DEBUG Dhanu => PING(20)
2019-10-31 12:05:32,149    INFO scheduling health checks:
2019-10-31 12:05:32,180    INFO scheduling jobs:
2019-10-31 12:05:32,182   DEBUG - qemu
2019-10-31 12:05:32,255   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:05:32,255   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:05:32,260    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:05:33,356    INFO [INIT] Dropping privileges
2019-10-31 12:05:33,356   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:05:33,356   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:05:33,358    INFO [INIT] Marking all workers as offline
2019-10-31 12:05:33,416    INFO [INIT] LAVA master has started.
2019-10-31 12:05:33,417    INFO [INIT] Using protocol version 3
2019-10-31 12:05:47,354   DEBUG lava-logs => PING(20)
2019-10-31 12:05:48,726   DEBUG Dhanu => PING(20)
2019-10-31 12:05:48,727 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:05:53,418    INFO scheduling health checks:
2019-10-31 12:05:53,437    INFO scheduling jobs:
2019-10-31 12:05:53,439   DEBUG - qemu
2019-10-31 12:05:53,508   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:05:53,508   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:05:53,512    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:05:54,773    INFO [INIT] Dropping privileges
2019-10-31 12:05:54,774   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:05:54,774   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:05:54,775    INFO [INIT] Marking all workers as offline
2019-10-31 12:05:54,805    INFO [INIT] LAVA master has started.
2019-10-31 12:05:54,806    INFO [INIT] Using protocol version 3
2019-10-31 12:06:07,366   DEBUG lava-logs => PING(20)
2019-10-31 12:06:08,742   DEBUG Dhanu => PING(20)
2019-10-31 12:06:08,743 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:06:14,812    INFO scheduling health checks:
2019-10-31 12:06:14,896    INFO scheduling jobs:
2019-10-31 12:06:14,899   DEBUG - qemu
2019-10-31 12:06:14,975   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:06:14,976   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:06:14,980    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:06:16,097    INFO [INIT] Dropping privileges
2019-10-31 12:06:16,097   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:06:16,097   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:06:16,098    INFO [INIT] Marking all workers as offline
2019-10-31 12:06:16,131    INFO [INIT] LAVA master has started.
2019-10-31 12:06:16,131    INFO [INIT] Using protocol version 3
2019-10-31 12:06:27,377   DEBUG lava-logs => PING(20)
2019-10-31 12:06:28,763   DEBUG Dhanu => PING(20)
2019-10-31 12:06:28,763 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:06:36,137    INFO scheduling health checks:
2019-10-31 12:06:36,164    INFO scheduling jobs:
2019-10-31 12:06:36,166   DEBUG - qemu
2019-10-31 12:06:36,258   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:06:36,259   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:06:36,263    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:06:37,534    INFO [INIT] Dropping privileges
2019-10-31 12:06:37,534   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:06:37,534   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:06:37,536    INFO [INIT] Marking all workers as offline
2019-10-31 12:06:37,566    INFO [INIT] LAVA master has started.
2019-10-31 12:06:37,566    INFO [INIT] Using protocol version 3
2019-10-31 12:06:47,394   DEBUG lava-logs => PING(20)
2019-10-31 12:06:48,779   DEBUG Dhanu => PING(20)
2019-10-31 12:06:48,780 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:06:57,575    INFO scheduling health checks:
2019-10-31 12:06:57,633    INFO scheduling jobs:
2019-10-31 12:06:57,634   DEBUG - qemu
2019-10-31 12:06:57,700   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:06:57,701   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:06:57,705    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:06:58,846    INFO [INIT] Dropping privileges
2019-10-31 12:06:58,846   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:06:58,846   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:06:58,848    INFO [INIT] Marking all workers as offline
2019-10-31 12:06:58,879    INFO [INIT] LAVA master has started.
2019-10-31 12:06:58,880    INFO [INIT] Using protocol version 3
2019-10-31 12:07:07,414   DEBUG lava-logs => PING(20)
2019-10-31 12:07:08,803   DEBUG Dhanu => PING(20)
2019-10-31 12:07:08,804 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:07:18,889    INFO scheduling health checks:
2019-10-31 12:07:18,935    INFO scheduling jobs:
2019-10-31 12:07:18,938   DEBUG - qemu
2019-10-31 12:07:19,013   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:07:19,013   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:07:19,017    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:07:20,107    INFO [INIT] Dropping privileges
2019-10-31 12:07:20,108   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:07:20,108   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:07:20,109    INFO [INIT] Marking all workers as offline
2019-10-31 12:07:20,171    INFO [INIT] LAVA master has started.
2019-10-31 12:07:20,172    INFO [INIT] Using protocol version 3
2019-10-31 12:07:27,430   DEBUG lava-logs => PING(20)
2019-10-31 12:07:28,826   DEBUG Dhanu => PING(20)
2019-10-31 12:07:28,827 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:07:40,183    INFO scheduling health checks:
2019-10-31 12:07:40,226    INFO scheduling jobs:
2019-10-31 12:07:40,228   DEBUG - qemu
2019-10-31 12:07:40,303   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:07:40,303   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:07:40,308    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:07:41,583    INFO [INIT] Dropping privileges
2019-10-31 12:07:41,584   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:07:41,584   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:07:41,585    INFO [INIT] Marking all workers as offline
2019-10-31 12:07:41,617    INFO [INIT] LAVA master has started.
2019-10-31 12:07:41,618    INFO [INIT] Using protocol version 3
2019-10-31 12:07:47,446   DEBUG lava-logs => PING(20)
2019-10-31 12:07:48,847   DEBUG Dhanu => PING(20)
2019-10-31 12:07:48,848 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:08:01,631    INFO scheduling health checks:
2019-10-31 12:08:01,673    INFO scheduling jobs:
2019-10-31 12:08:01,676   DEBUG - qemu
2019-10-31 12:08:01,750   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:08:01,750   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:08:01,755    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:08:02,865    INFO [INIT] Dropping privileges
2019-10-31 12:08:02,865   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:08:02,865   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:08:02,867    INFO [INIT] Marking all workers as offline
2019-10-31 12:08:02,898    INFO [INIT] LAVA master has started.
2019-10-31 12:08:02,898    INFO [INIT] Using protocol version 3
2019-10-31 12:08:07,462   DEBUG lava-logs => PING(20)
2019-10-31 12:08:08,867   DEBUG Dhanu => PING(20)
2019-10-31 12:08:08,867 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:08:22,912    INFO scheduling health checks:
2019-10-31 12:08:22,952    INFO scheduling jobs:
2019-10-31 12:08:22,955   DEBUG - qemu
2019-10-31 12:08:23,029   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:08:23,029   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:08:23,033    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:08:24,127    INFO [INIT] Dropping privileges
2019-10-31 12:08:24,128   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:08:24,128   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:08:24,129    INFO [INIT] Marking all workers as offline
2019-10-31 12:08:24,189    INFO [INIT] LAVA master has started.
2019-10-31 12:08:24,189    INFO [INIT] Using protocol version 3
2019-10-31 12:08:27,478   DEBUG lava-logs => PING(20)
2019-10-31 12:08:28,890   DEBUG Dhanu => PING(20)
2019-10-31 12:08:28,891 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:08:44,205    INFO scheduling health checks:
2019-10-31 12:08:44,243    INFO scheduling jobs:
2019-10-31 12:08:44,246   DEBUG - qemu
2019-10-31 12:08:44,319   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:08:44,319   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:08:44,326    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:08:45,601    INFO [INIT] Dropping privileges
2019-10-31 12:08:45,601   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:08:45,601   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:08:45,603    INFO [INIT] Marking all workers as offline
2019-10-31 12:08:45,634    INFO [INIT] LAVA master has started.
2019-10-31 12:08:45,634    INFO [INIT] Using protocol version 3
2019-10-31 12:08:47,494   DEBUG lava-logs => PING(20)
2019-10-31 12:08:48,910   DEBUG Dhanu => PING(20)
2019-10-31 12:08:48,911 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:09:05,651    INFO scheduling health checks:
2019-10-31 12:09:05,690    INFO scheduling jobs:
2019-10-31 12:09:05,694   DEBUG - qemu
2019-10-31 12:09:05,768   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:09:05,768   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:09:05,778    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:09:06,837    INFO [INIT] Dropping privileges
2019-10-31 12:09:06,837   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:09:06,837   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:09:06,838    INFO [INIT] Marking all workers as offline
2019-10-31 12:09:06,869    INFO [INIT] LAVA master has started.
2019-10-31 12:09:06,869    INFO [INIT] Using protocol version 3
2019-10-31 12:09:07,507   DEBUG lava-logs => PING(20)
2019-10-31 12:09:08,930   DEBUG Dhanu => PING(20)
2019-10-31 12:09:08,931 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:09:26,885    INFO scheduling health checks:
2019-10-31 12:09:26,925    INFO scheduling jobs:
2019-10-31 12:09:26,928   DEBUG - qemu
2019-10-31 12:09:27,002   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:09:27,002   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:09:27,006    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:09:28,095    INFO [INIT] Dropping privileges
2019-10-31 12:09:28,095   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:09:28,095   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:09:28,096    INFO [INIT] Marking all workers as offline
2019-10-31 12:09:28,127    INFO [INIT] LAVA master has started.
2019-10-31 12:09:28,127    INFO [INIT] Using protocol version 3
2019-10-31 12:09:28,176   DEBUG lava-logs => PING(20)
2019-10-31 12:09:28,951   DEBUG Dhanu => PING(20)
2019-10-31 12:09:28,951 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:09:48,147    INFO scheduling health checks:
2019-10-31 12:09:48,183    INFO scheduling jobs:
2019-10-31 12:09:48,186   DEBUG - qemu
2019-10-31 12:09:48,254   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:09:48,254   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:09:48,264    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:09:49,341    INFO [INIT] Dropping privileges
2019-10-31 12:09:49,342   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:09:49,342   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:09:49,343    INFO [INIT] Marking all workers as offline
2019-10-31 12:09:49,374    INFO [INIT] LAVA master has started.
2019-10-31 12:09:49,374    INFO [INIT] Using protocol version 3
2019-10-31 12:09:49,494   DEBUG Dhanu => PING(20)
2019-10-31 12:09:49,495 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:10:08,219   DEBUG lava-logs => PING(20)
2019-10-31 12:10:09,376    INFO scheduling health checks:
2019-10-31 12:10:09,407    INFO scheduling jobs:
2019-10-31 12:10:09,409   DEBUG - qemu
2019-10-31 12:10:09,483   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:10:09,484   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:10:09,488    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:10:10,597    INFO [INIT] Dropping privileges
2019-10-31 12:10:10,597   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:10:10,597   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:10:10,599    INFO [INIT] Marking all workers as offline
2019-10-31 12:10:10,666    INFO [INIT] LAVA master has started.
2019-10-31 12:10:10,666    INFO [INIT] Using protocol version 3
2019-10-31 12:10:10,778   DEBUG Dhanu => PING(20)
2019-10-31 12:10:10,779 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:10:28,230   DEBUG lava-logs => PING(20)
2019-10-31 12:10:30,668    INFO scheduling health checks:
2019-10-31 12:10:30,698    INFO scheduling jobs:
2019-10-31 12:10:30,700   DEBUG - qemu
2019-10-31 12:10:30,766   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:10:30,766   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:10:30,776    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:10:31,849    INFO [INIT] Dropping privileges
2019-10-31 12:10:31,849   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:10:31,849   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:10:31,851    INFO [INIT] Marking all workers as offline
2019-10-31 12:10:31,890    INFO [INIT] LAVA master has started.
2019-10-31 12:10:31,891    INFO [INIT] Using protocol version 3
2019-10-31 12:10:31,951   DEBUG Dhanu => PING(20)
2019-10-31 12:10:31,951 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:10:48,246   DEBUG lava-logs => PING(20)
2019-10-31 12:10:51,895    INFO scheduling health checks:
2019-10-31 12:10:51,923    INFO scheduling jobs:
2019-10-31 12:10:51,925   DEBUG - qemu
2019-10-31 12:10:51,999   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:10:51,999   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:10:52,008    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:10:53,089    INFO [INIT] Dropping privileges
2019-10-31 12:10:53,090   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:10:53,090   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:10:53,091    INFO [INIT] Marking all workers as offline
2019-10-31 12:10:53,125    INFO [INIT] LAVA master has started.
2019-10-31 12:10:53,126    INFO [INIT] Using protocol version 3
2019-10-31 12:11:08,265   DEBUG lava-logs => PING(20)
2019-10-31 12:11:11,991   DEBUG Dhanu => PING(20)
2019-10-31 12:11:11,991 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:11:13,128    INFO scheduling health checks:
2019-10-31 12:11:13,147    INFO scheduling jobs:
2019-10-31 12:11:13,148   DEBUG - qemu
2019-10-31 12:11:13,218   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:11:13,218   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:11:13,231    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:11:14,340    INFO [INIT] Dropping privileges
2019-10-31 12:11:14,341   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:11:14,341   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:11:14,342    INFO [INIT] Marking all workers as offline
2019-10-31 12:11:14,372    INFO [INIT] LAVA master has started.
2019-10-31 12:11:14,372    INFO [INIT] Using protocol version 3
2019-10-31 12:11:28,281   DEBUG lava-logs => PING(20)
2019-10-31 12:11:32,013   DEBUG Dhanu => PING(20)
2019-10-31 12:11:32,013 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:11:34,374    INFO scheduling health checks:
2019-10-31 12:11:34,416    INFO scheduling jobs:
2019-10-31 12:11:34,419   DEBUG - qemu
2019-10-31 12:11:34,489   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:11:34,489   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:11:34,493    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:11:35,596    INFO [INIT] Dropping privileges
2019-10-31 12:11:35,596   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:11:35,597   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:11:35,598    INFO [INIT] Marking all workers as offline
2019-10-31 12:11:35,629    INFO [INIT] LAVA master has started.
2019-10-31 12:11:35,629    INFO [INIT] Using protocol version 3
2019-10-31 12:11:48,297   DEBUG lava-logs => PING(20)
2019-10-31 12:11:52,034   DEBUG Dhanu => PING(20)
2019-10-31 12:11:52,034 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:11:55,633    INFO scheduling health checks:
2019-10-31 12:11:55,662    INFO scheduling jobs:
2019-10-31 12:11:55,664   DEBUG - qemu
2019-10-31 12:11:55,736   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:11:55,736   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:11:55,741    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:11:56,841    INFO [INIT] Dropping privileges
2019-10-31 12:11:56,841   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:11:56,841   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:11:56,843    INFO [INIT] Marking all workers as offline
2019-10-31 12:11:56,875    INFO [INIT] LAVA master has started.
2019-10-31 12:11:56,876    INFO [INIT] Using protocol version 3
2019-10-31 12:12:08,312   DEBUG lava-logs => PING(20)
2019-10-31 12:12:12,050   DEBUG Dhanu => PING(20)
2019-10-31 12:12:12,050 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:12:16,877    INFO scheduling health checks:
2019-10-31 12:12:16,898    INFO scheduling jobs:
2019-10-31 12:12:16,899   DEBUG - qemu
2019-10-31 12:12:16,971   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:12:16,971   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:12:16,975    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:12:18,102    INFO [INIT] Dropping privileges
2019-10-31 12:12:18,102   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:12:18,102   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:12:18,104    INFO [INIT] Marking all workers as offline
2019-10-31 12:12:18,133    INFO [INIT] LAVA master has started.
2019-10-31 12:12:18,133    INFO [INIT] Using protocol version 3
2019-10-31 12:12:28,322   DEBUG lava-logs => PING(20)
2019-10-31 12:12:32,068   DEBUG Dhanu => PING(20)
2019-10-31 12:12:32,068 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:12:38,139    INFO scheduling health checks:
2019-10-31 12:12:38,178    INFO scheduling jobs:
2019-10-31 12:12:38,181   DEBUG - qemu
2019-10-31 12:12:38,255   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:12:38,255   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:12:38,259    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:12:39,344    INFO [INIT] Dropping privileges
2019-10-31 12:12:39,344   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:12:39,344   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:12:39,346    INFO [INIT] Marking all workers as offline
2019-10-31 12:12:39,380    INFO [INIT] LAVA master has started.
2019-10-31 12:12:39,381    INFO [INIT] Using protocol version 3
2019-10-31 12:12:48,343   DEBUG lava-logs => PING(20)
2019-10-31 12:12:52,089   DEBUG Dhanu => PING(20)
2019-10-31 12:12:52,089 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:12:59,388    INFO scheduling health checks:
2019-10-31 12:12:59,413    INFO scheduling jobs:
2019-10-31 12:12:59,415   DEBUG - qemu
2019-10-31 12:12:59,487   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:12:59,487   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:12:59,491    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:13:00,592    INFO [INIT] Dropping privileges
2019-10-31 12:13:00,592   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:13:00,592   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:13:00,594    INFO [INIT] Marking all workers as offline
2019-10-31 12:13:00,627    INFO [INIT] LAVA master has started.
2019-10-31 12:13:00,628    INFO [INIT] Using protocol version 3
2019-10-31 12:13:08,362   DEBUG lava-logs => PING(20)
2019-10-31 12:13:12,109   DEBUG Dhanu => PING(20)
2019-10-31 12:13:12,109 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:13:20,637    INFO scheduling health checks:
2019-10-31 12:13:20,660    INFO scheduling jobs:
2019-10-31 12:13:20,661   DEBUG - qemu
2019-10-31 12:13:20,732   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:13:20,732   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:13:20,737    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:13:21,851    INFO [INIT] Dropping privileges
2019-10-31 12:13:21,851   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:13:21,851   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:13:21,853    INFO [INIT] Marking all workers as offline
2019-10-31 12:13:21,884    INFO [INIT] LAVA master has started.
2019-10-31 12:13:21,884    INFO [INIT] Using protocol version 3
2019-10-31 12:13:28,381   DEBUG lava-logs => PING(20)
2019-10-31 12:13:32,128   DEBUG Dhanu => PING(20)
2019-10-31 12:13:32,129 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:13:41,894    INFO scheduling health checks:
2019-10-31 12:13:41,917    INFO scheduling jobs:
2019-10-31 12:13:41,919   DEBUG - qemu
2019-10-31 12:13:41,989   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:13:41,989   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:13:41,994    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:13:43,107    INFO [INIT] Dropping privileges
2019-10-31 12:13:43,107   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:13:43,107   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:13:43,109    INFO [INIT] Marking all workers as offline
2019-10-31 12:13:43,142    INFO [INIT] LAVA master has started.
2019-10-31 12:13:43,142    INFO [INIT] Using protocol version 3
2019-10-31 12:13:48,399   DEBUG lava-logs => PING(20)
2019-10-31 12:13:52,148   DEBUG Dhanu => PING(20)
2019-10-31 12:13:52,149 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:14:03,153    INFO scheduling health checks:
2019-10-31 12:14:03,175    INFO scheduling jobs:
2019-10-31 12:14:03,176   DEBUG - qemu
2019-10-31 12:14:03,248   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:14:03,248   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:14:03,253    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:14:04,378    INFO [INIT] Dropping privileges
2019-10-31 12:14:04,378   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:14:04,378   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:14:04,380    INFO [INIT] Marking all workers as offline
2019-10-31 12:14:04,455    INFO [INIT] LAVA master has started.
2019-10-31 12:14:04,456    INFO [INIT] Using protocol version 3
2019-10-31 12:14:08,410   DEBUG lava-logs => PING(20)
2019-10-31 12:14:12,170   DEBUG Dhanu => PING(20)
2019-10-31 12:14:12,171 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:14:24,468    INFO scheduling health checks:
2019-10-31 12:14:24,488    INFO scheduling jobs:
2019-10-31 12:14:24,489   DEBUG - qemu
2019-10-31 12:14:24,559   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:14:24,559   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:14:24,564    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:14:25,743    INFO [INIT] Dropping privileges
2019-10-31 12:14:25,743   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:14:25,744   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:14:25,745    INFO [INIT] Marking all workers as offline
2019-10-31 12:14:25,824    INFO [INIT] LAVA master has started.
2019-10-31 12:14:25,825    INFO [INIT] Using protocol version 3
2019-10-31 12:14:28,426   DEBUG lava-logs => PING(20)
2019-10-31 12:14:32,192   DEBUG Dhanu => PING(20)
2019-10-31 12:14:32,192 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:14:45,839    INFO scheduling health checks:
2019-10-31 12:14:45,879    INFO scheduling jobs:
2019-10-31 12:14:45,883   DEBUG - qemu
2019-10-31 12:14:45,955   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:14:45,955   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:14:45,959    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:14:47,089    INFO [INIT] Dropping privileges
2019-10-31 12:14:47,089   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:14:47,089   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:14:47,091    INFO [INIT] Marking all workers as offline
2019-10-31 12:14:47,126    INFO [INIT] LAVA master has started.
2019-10-31 12:14:47,127    INFO [INIT] Using protocol version 3
2019-10-31 12:14:48,440   DEBUG lava-logs => PING(20)
2019-10-31 12:14:52,212   DEBUG Dhanu => PING(20)
2019-10-31 12:14:52,212 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:15:07,142    INFO scheduling health checks:
2019-10-31 12:15:07,195    INFO scheduling jobs:
2019-10-31 12:15:07,198   DEBUG - qemu
2019-10-31 12:15:07,273   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:15:07,273   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:15:07,277    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:15:08,355    INFO [INIT] Dropping privileges
2019-10-31 12:15:08,355   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:15:08,355   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:15:08,357    INFO [INIT] Marking all workers as offline
2019-10-31 12:15:08,430    INFO [INIT] LAVA master has started.
2019-10-31 12:15:08,431    INFO [INIT] Using protocol version 3
2019-10-31 12:15:08,617   DEBUG lava-logs => PING(20)
2019-10-31 12:15:12,234   DEBUG Dhanu => PING(20)
2019-10-31 12:15:12,235 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:15:28,447    INFO scheduling health checks:
2019-10-31 12:15:28,486    INFO scheduling jobs:
2019-10-31 12:15:28,489   DEBUG - qemu
2019-10-31 12:15:28,563   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:15:28,563   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:15:28,568    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:15:29,845    INFO [INIT] Dropping privileges
2019-10-31 12:15:29,845   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:15:29,845   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:15:29,847    INFO [INIT] Marking all workers as offline
2019-10-31 12:15:29,888    INFO [INIT] LAVA master has started.
2019-10-31 12:15:29,888    INFO [INIT] Using protocol version 3
2019-10-31 12:15:29,918   DEBUG lava-logs => PING(20)
2019-10-31 12:15:32,255   DEBUG Dhanu => PING(20)
2019-10-31 12:15:32,256 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:15:49,906    INFO scheduling health checks:
2019-10-31 12:15:49,943    INFO scheduling jobs:
2019-10-31 12:15:49,945   DEBUG - qemu
2019-10-31 12:15:50,014   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:15:50,015   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:15:50,019    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:15:51,090    INFO [INIT] Dropping privileges
2019-10-31 12:15:51,090   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:15:51,090   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:15:51,092    INFO [INIT] Marking all workers as offline
2019-10-31 12:15:51,123    INFO [INIT] LAVA master has started.
2019-10-31 12:15:51,123    INFO [INIT] Using protocol version 3
2019-10-31 12:15:52,275   DEBUG Dhanu => PING(20)
2019-10-31 12:15:52,275 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:16:09,953   DEBUG lava-logs => PING(20)
2019-10-31 12:16:11,125    INFO scheduling health checks:
2019-10-31 12:16:11,145    INFO scheduling jobs:
2019-10-31 12:16:11,146   DEBUG - qemu
2019-10-31 12:16:11,219   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:16:11,219   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:16:11,223    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:16:12,335    INFO [INIT] Dropping privileges
2019-10-31 12:16:12,335   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:16:12,335   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:16:12,337    INFO [INIT] Marking all workers as offline
2019-10-31 12:16:12,369    INFO [INIT] LAVA master has started.
2019-10-31 12:16:12,369    INFO [INIT] Using protocol version 3
2019-10-31 12:16:12,394   DEBUG Dhanu => PING(20)
2019-10-31 12:16:12,394 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:16:29,973   DEBUG lava-logs => PING(20)
2019-10-31 12:16:32,371    INFO scheduling health checks:
2019-10-31 12:16:32,392    INFO scheduling jobs:
2019-10-31 12:16:32,393   DEBUG - qemu
2019-10-31 12:16:32,461   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:16:32,462   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:16:32,466    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:16:33,616    INFO [INIT] Dropping privileges
2019-10-31 12:16:33,617   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:16:33,617   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:16:33,618    INFO [INIT] Marking all workers as offline
2019-10-31 12:16:33,661    INFO [INIT] LAVA master has started.
2019-10-31 12:16:33,662    INFO [INIT] Using protocol version 3
2019-10-31 12:16:49,992   DEBUG lava-logs => PING(20)
2019-10-31 12:16:52,435   DEBUG Dhanu => PING(20)
2019-10-31 12:16:52,436 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:16:53,663    INFO scheduling health checks:
2019-10-31 12:16:53,682    INFO scheduling jobs:
2019-10-31 12:16:53,684   DEBUG - qemu
2019-10-31 12:16:53,748   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:16:53,748   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:16:53,752    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:16:54,825    INFO [INIT] Dropping privileges
2019-10-31 12:16:54,825   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:16:54,825   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:16:54,827    INFO [INIT] Marking all workers as offline
2019-10-31 12:16:54,863    INFO [INIT] LAVA master has started.
2019-10-31 12:16:54,863    INFO [INIT] Using protocol version 3
2019-10-31 12:17:10,010   DEBUG lava-logs => PING(20)
2019-10-31 12:17:12,453   DEBUG Dhanu => PING(20)
2019-10-31 12:17:12,454 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:17:14,865    INFO scheduling health checks:
2019-10-31 12:17:14,884    INFO scheduling jobs:
2019-10-31 12:17:14,886   DEBUG - qemu
2019-10-31 12:17:14,953   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:17:14,954   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:17:14,962    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:17:16,110    INFO [INIT] Dropping privileges
2019-10-31 12:17:16,110   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:17:16,110   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:17:16,112    INFO [INIT] Marking all workers as offline
2019-10-31 12:17:16,152    INFO [INIT] LAVA master has started.
2019-10-31 12:17:16,153    INFO [INIT] Using protocol version 3
2019-10-31 12:17:30,022   DEBUG lava-logs => PING(20)
2019-10-31 12:17:32,470   DEBUG Dhanu => PING(20)
2019-10-31 12:17:32,471 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:17:36,153    INFO scheduling health checks:
2019-10-31 12:17:36,187    INFO scheduling jobs:
2019-10-31 12:17:36,190   DEBUG - qemu
2019-10-31 12:17:36,265   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:17:36,266   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:17:36,270    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:17:37,379    INFO [INIT] Dropping privileges
2019-10-31 12:17:37,380   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:17:37,380   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:17:37,381    INFO [INIT] Marking all workers as offline
2019-10-31 12:17:37,411    INFO [INIT] LAVA master has started.
2019-10-31 12:17:37,411    INFO [INIT] Using protocol version 3
2019-10-31 12:17:50,038   DEBUG lava-logs => PING(20)
2019-10-31 12:17:52,490   DEBUG Dhanu => PING(20)
2019-10-31 12:17:52,490 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:17:57,416    INFO scheduling health checks:
2019-10-31 12:17:57,456    INFO scheduling jobs:
2019-10-31 12:17:57,459   DEBUG - qemu
2019-10-31 12:17:57,532   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:17:57,533   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:17:57,542    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:17:58,847    INFO [INIT] Dropping privileges
2019-10-31 12:17:58,847   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:17:58,847   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:17:58,849    INFO [INIT] Marking all workers as offline
2019-10-31 12:17:58,880    INFO [INIT] LAVA master has started.
2019-10-31 12:17:58,881    INFO [INIT] Using protocol version 3
2019-10-31 12:18:10,051   DEBUG lava-logs => PING(20)
2019-10-31 12:18:12,510   DEBUG Dhanu => PING(20)
2019-10-31 12:18:12,511 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:18:18,888    INFO scheduling health checks:
2019-10-31 12:18:18,924    INFO scheduling jobs:
2019-10-31 12:18:18,927   DEBUG - qemu
2019-10-31 12:18:19,001   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:18:19,001   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:18:19,010    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:18:20,095    INFO [INIT] Dropping privileges
2019-10-31 12:18:20,095   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:18:20,095   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:18:20,097    INFO [INIT] Marking all workers as offline
2019-10-31 12:18:20,126    INFO [INIT] LAVA master has started.
2019-10-31 12:18:20,126    INFO [INIT] Using protocol version 3
2019-10-31 12:18:30,074   DEBUG lava-logs => PING(20)
2019-10-31 12:18:32,532   DEBUG Dhanu => PING(20)
2019-10-31 12:18:32,533 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:18:40,134    INFO scheduling health checks:
2019-10-31 12:18:40,171    INFO scheduling jobs:
2019-10-31 12:18:40,173   DEBUG - qemu
2019-10-31 12:18:40,247   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:18:40,247   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:18:40,252    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:18:41,345    INFO [INIT] Dropping privileges
2019-10-31 12:18:41,345   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:18:41,346   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:18:41,347    INFO [INIT] Marking all workers as offline
2019-10-31 12:18:41,385    INFO [INIT] LAVA master has started.
2019-10-31 12:18:41,385    INFO [INIT] Using protocol version 3
2019-10-31 12:18:50,096   DEBUG lava-logs => PING(20)
2019-10-31 12:18:52,553   DEBUG Dhanu => PING(20)
2019-10-31 12:18:52,554 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:19:01,395    INFO scheduling health checks:
2019-10-31 12:19:01,440    INFO scheduling jobs:
2019-10-31 12:19:01,443   DEBUG - qemu
2019-10-31 12:19:01,517   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:19:01,517   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:19:01,533    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:19:02,622    INFO [INIT] Dropping privileges
2019-10-31 12:19:02,623   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:19:02,623   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:19:02,624    INFO [INIT] Marking all workers as offline
2019-10-31 12:19:02,698    INFO [INIT] LAVA master has started.
2019-10-31 12:19:02,698    INFO [INIT] Using protocol version 3
2019-10-31 12:19:10,116   DEBUG lava-logs => PING(20)
2019-10-31 12:19:12,573   DEBUG Dhanu => PING(20)
2019-10-31 12:19:12,574 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:19:22,709    INFO scheduling health checks:
2019-10-31 12:19:22,742    INFO scheduling jobs:
2019-10-31 12:19:22,744   DEBUG - qemu
2019-10-31 12:19:22,815   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:19:22,816   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:19:22,820    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:19:24,089    INFO [INIT] Dropping privileges
2019-10-31 12:19:24,089   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:19:24,089   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:19:24,091    INFO [INIT] Marking all workers as offline
2019-10-31 12:19:24,133    INFO [INIT] LAVA master has started.
2019-10-31 12:19:24,134    INFO [INIT] Using protocol version 3
2019-10-31 12:19:30,136   DEBUG lava-logs => PING(20)
2019-10-31 12:19:32,596   DEBUG Dhanu => PING(20)
2019-10-31 12:19:32,596 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:19:44,146    INFO scheduling health checks:
2019-10-31 12:19:44,177    INFO scheduling jobs:
2019-10-31 12:19:44,179   DEBUG - qemu
2019-10-31 12:19:44,253   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:19:44,253   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:19:44,258    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:19:45,346    INFO [INIT] Dropping privileges
2019-10-31 12:19:45,346   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:19:45,347   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:19:45,348    INFO [INIT] Marking all workers as offline
2019-10-31 12:19:45,380    INFO [INIT] LAVA master has started.
2019-10-31 12:19:45,380    INFO [INIT] Using protocol version 3
2019-10-31 12:19:50,154   DEBUG lava-logs => PING(20)
2019-10-31 12:19:52,617   DEBUG Dhanu => PING(20)
2019-10-31 12:19:52,618 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:20:05,393    INFO scheduling health checks:
2019-10-31 12:20:05,424    INFO scheduling jobs:
2019-10-31 12:20:05,426   DEBUG - qemu
2019-10-31 12:20:05,499   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:20:05,500   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:20:05,511    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:20:06,592    INFO [INIT] Dropping privileges
2019-10-31 12:20:06,592   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:20:06,592   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:20:06,594    INFO [INIT] Marking all workers as offline
2019-10-31 12:20:06,626    INFO [INIT] LAVA master has started.
2019-10-31 12:20:06,626    INFO [INIT] Using protocol version 3
2019-10-31 12:20:10,166   DEBUG lava-logs => PING(20)
2019-10-31 12:20:12,637   DEBUG Dhanu => PING(20)
2019-10-31 12:20:12,638 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:20:26,641    INFO scheduling health checks:
2019-10-31 12:20:26,681    INFO scheduling jobs:
2019-10-31 12:20:26,683   DEBUG - qemu
2019-10-31 12:20:26,756   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:20:26,757   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:20:26,761    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:20:27,840    INFO [INIT] Dropping privileges
2019-10-31 12:20:27,840   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:20:27,840   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:20:27,842    INFO [INIT] Marking all workers as offline
2019-10-31 12:20:27,884    INFO [INIT] LAVA master has started.
2019-10-31 12:20:27,884    INFO [INIT] Using protocol version 3
2019-10-31 12:20:30,173   DEBUG lava-logs => PING(20)
2019-10-31 12:20:32,660   DEBUG Dhanu => PING(20)
2019-10-31 12:20:32,660 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:20:47,899    INFO scheduling health checks:
2019-10-31 12:20:47,972    INFO scheduling jobs:
2019-10-31 12:20:47,976   DEBUG - qemu
2019-10-31 12:20:48,050   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:20:48,050   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:20:48,059    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:20:49,377    INFO [INIT] Dropping privileges
2019-10-31 12:20:49,377   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:20:49,378   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:20:49,379    INFO [INIT] Marking all workers as offline
2019-10-31 12:20:49,453    INFO [INIT] LAVA master has started.
2019-10-31 12:20:49,453    INFO [INIT] Using protocol version 3
2019-10-31 12:20:50,179   DEBUG lava-logs => PING(20)
2019-10-31 12:20:52,680   DEBUG Dhanu => PING(20)
2019-10-31 12:20:52,681 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:21:09,467    INFO scheduling health checks:
2019-10-31 12:21:09,497    INFO scheduling jobs:
2019-10-31 12:21:09,499   DEBUG - qemu
2019-10-31 12:21:09,570   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:21:09,571   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:21:09,575    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:21:10,755    INFO [INIT] Dropping privileges
2019-10-31 12:21:10,755   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:21:10,755   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:21:10,757    INFO [INIT] Marking all workers as offline
2019-10-31 12:21:10,799    INFO [INIT] LAVA master has started.
2019-10-31 12:21:10,799    INFO [INIT] Using protocol version 3
2019-10-31 12:21:10,922   DEBUG lava-logs => PING(20)
2019-10-31 12:21:12,702   DEBUG Dhanu => PING(20)
2019-10-31 12:21:12,702 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:21:30,818    INFO scheduling health checks:
2019-10-31 12:21:30,843    INFO scheduling jobs:
2019-10-31 12:21:30,845   DEBUG - qemu
2019-10-31 12:21:30,919   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:21:30,919   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:21:30,924    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:21:32,088    INFO [INIT] Dropping privileges
2019-10-31 12:21:32,088   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:21:32,088   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:21:32,090    INFO [INIT] Marking all workers as offline
2019-10-31 12:21:32,123    INFO [INIT] LAVA master has started.
2019-10-31 12:21:32,124    INFO [INIT] Using protocol version 3
2019-10-31 12:21:32,200   DEBUG lava-logs => PING(20)
2019-10-31 12:21:32,721   DEBUG Dhanu => PING(20)
2019-10-31 12:21:32,721 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:21:52,144    INFO scheduling health checks:
2019-10-31 12:21:52,168    INFO scheduling jobs:
2019-10-31 12:21:52,169   DEBUG - qemu
2019-10-31 12:21:52,242   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:21:52,242   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:21:52,247    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:21:53,360    INFO [INIT] Dropping privileges
2019-10-31 12:21:53,361   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:21:53,361   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:21:53,362    INFO [INIT] Marking all workers as offline
2019-10-31 12:21:53,403    INFO [INIT] LAVA master has started.
2019-10-31 12:21:53,403    INFO [INIT] Using protocol version 3
2019-10-31 12:21:53,443   DEBUG Dhanu => PING(20)
2019-10-31 12:21:53,443 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:22:12,242   DEBUG lava-logs => PING(20)
2019-10-31 12:22:13,405    INFO scheduling health checks:
2019-10-31 12:22:13,425    INFO scheduling jobs:
2019-10-31 12:22:13,426   DEBUG - qemu
2019-10-31 12:22:13,498   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:22:13,498   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:22:13,502    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:22:14,595    INFO [INIT] Dropping privileges
2019-10-31 12:22:14,595   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:22:14,595   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:22:14,597    INFO [INIT] Marking all workers as offline
2019-10-31 12:22:14,628    INFO [INIT] LAVA master has started.
2019-10-31 12:22:14,628    INFO [INIT] Using protocol version 3
2019-10-31 12:22:32,263   DEBUG lava-logs => PING(20)
2019-10-31 12:22:33,488   DEBUG Dhanu => PING(20)
2019-10-31 12:22:33,488 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:22:34,629    INFO scheduling health checks:
2019-10-31 12:22:34,649    INFO scheduling jobs:
2019-10-31 12:22:34,650   DEBUG - qemu
2019-10-31 12:22:34,719   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:22:34,719   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:22:34,724    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:22:35,853    INFO [INIT] Dropping privileges
2019-10-31 12:22:35,854   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:22:35,854   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:22:35,855    INFO [INIT] Marking all workers as offline
2019-10-31 12:22:35,885    INFO [INIT] LAVA master has started.
2019-10-31 12:22:35,885    INFO [INIT] Using protocol version 3
2019-10-31 12:22:52,276   DEBUG lava-logs => PING(20)
2019-10-31 12:22:53,510   DEBUG Dhanu => PING(20)
2019-10-31 12:22:53,511 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:22:55,888    INFO scheduling health checks:
2019-10-31 12:22:55,907    INFO scheduling jobs:
2019-10-31 12:22:55,908   DEBUG - qemu
2019-10-31 12:22:55,978   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:22:55,978   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:22:55,983    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:22:57,086    INFO [INIT] Dropping privileges
2019-10-31 12:22:57,087   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:22:57,087   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:22:57,088    INFO [INIT] Marking all workers as offline
2019-10-31 12:22:57,121    INFO [INIT] LAVA master has started.
2019-10-31 12:22:57,121    INFO [INIT] Using protocol version 3
2019-10-31 12:23:12,294   DEBUG lava-logs => PING(20)
2019-10-31 12:23:13,530   DEBUG Dhanu => PING(20)
2019-10-31 12:23:13,531 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:23:17,125    INFO scheduling health checks:
2019-10-31 12:23:17,176    INFO scheduling jobs:
2019-10-31 12:23:17,180   DEBUG - qemu
2019-10-31 12:23:17,252   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:23:17,252   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:23:17,257    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:23:18,335    INFO [INIT] Dropping privileges
2019-10-31 12:23:18,335   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:23:18,335   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:23:18,337    INFO [INIT] Marking all workers as offline
2019-10-31 12:23:18,366    INFO [INIT] LAVA master has started.
2019-10-31 12:23:18,366    INFO [INIT] Using protocol version 3
2019-10-31 12:23:32,311   DEBUG lava-logs => PING(20)
2019-10-31 12:23:33,550   DEBUG Dhanu => PING(20)
2019-10-31 12:23:33,551 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:23:38,371    INFO scheduling health checks:
2019-10-31 12:23:38,400    INFO scheduling jobs:
2019-10-31 12:23:38,402   DEBUG - qemu
2019-10-31 12:23:38,475   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:23:38,475   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:23:38,480    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:23:39,619    INFO [INIT] Dropping privileges
2019-10-31 12:23:39,619   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:23:39,619   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:23:39,621    INFO [INIT] Marking all workers as offline
2019-10-31 12:23:39,658    INFO [INIT] LAVA master has started.
2019-10-31 12:23:39,659    INFO [INIT] Using protocol version 3
2019-10-31 12:23:52,326   DEBUG lava-logs => PING(20)
2019-10-31 12:23:53,573   DEBUG Dhanu => PING(20)
2019-10-31 12:23:53,573 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:23:59,665    INFO scheduling health checks:
2019-10-31 12:23:59,702    INFO scheduling jobs:
2019-10-31 12:23:59,704   DEBUG - qemu
2019-10-31 12:23:59,779   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:23:59,779   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:23:59,784    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:24:00,848    INFO [INIT] Dropping privileges
2019-10-31 12:24:00,848   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:24:00,848   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:24:00,850    INFO [INIT] Marking all workers as offline
2019-10-31 12:24:00,882    INFO [INIT] LAVA master has started.
2019-10-31 12:24:00,883    INFO [INIT] Using protocol version 3
2019-10-31 12:24:12,340   DEBUG lava-logs => PING(20)
2019-10-31 12:24:13,593   DEBUG Dhanu => PING(20)
2019-10-31 12:24:13,594 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:24:20,891    INFO scheduling health checks:
2019-10-31 12:24:20,938    INFO scheduling jobs:
2019-10-31 12:24:20,940   DEBUG - qemu
2019-10-31 12:24:21,008   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:24:21,008   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:24:21,012    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:24:22,096    INFO [INIT] Dropping privileges
2019-10-31 12:24:22,097   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:24:22,097   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:24:22,098    INFO [INIT] Marking all workers as offline
2019-10-31 12:24:22,129    INFO [INIT] LAVA master has started.
2019-10-31 12:24:22,130    INFO [INIT] Using protocol version 3
2019-10-31 12:24:32,350   DEBUG lava-logs => PING(20)
2019-10-31 12:24:33,614   DEBUG Dhanu => PING(20)
2019-10-31 12:24:33,615 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:24:42,138    INFO scheduling health checks:
2019-10-31 12:24:42,173    INFO scheduling jobs:
2019-10-31 12:24:42,175   DEBUG - qemu
2019-10-31 12:24:42,241   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:24:42,242   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:24:42,246    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:24:43,367    INFO [INIT] Dropping privileges
2019-10-31 12:24:43,368   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:24:43,368   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:24:43,369    INFO [INIT] Marking all workers as offline
2019-10-31 12:24:43,443    INFO [INIT] LAVA master has started.
2019-10-31 12:24:43,443    INFO [INIT] Using protocol version 3
2019-10-31 12:24:52,372   DEBUG lava-logs => PING(20)
2019-10-31 12:24:53,633   DEBUG Dhanu => PING(20)
2019-10-31 12:24:53,634 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:25:03,453    INFO scheduling health checks:
2019-10-31 12:25:03,498    INFO scheduling jobs:
2019-10-31 12:25:03,501   DEBUG - qemu
2019-10-31 12:25:03,575   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:25:03,575   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:25:03,580    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:25:04,848    INFO [INIT] Dropping privileges
2019-10-31 12:25:04,848   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:25:04,848   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:25:04,849    INFO [INIT] Marking all workers as offline
2019-10-31 12:25:04,877    INFO [INIT] LAVA master has started.
2019-10-31 12:25:04,878    INFO [INIT] Using protocol version 3
2019-10-31 12:25:12,391   DEBUG lava-logs => PING(20)
2019-10-31 12:25:13,645   DEBUG Dhanu => PING(20)
2019-10-31 12:25:13,646 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:25:24,881    INFO scheduling health checks:
2019-10-31 12:25:24,967    INFO scheduling jobs:
2019-10-31 12:25:24,970   DEBUG - qemu
2019-10-31 12:25:25,047   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:25:25,048   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:25:25,052    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:25:26,474    INFO [INIT] Dropping privileges
2019-10-31 12:25:26,474   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:25:26,474   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:25:26,475    INFO [INIT] Marking all workers as offline
2019-10-31 12:25:26,514    INFO [INIT] LAVA master has started.
2019-10-31 12:25:26,514    INFO [INIT] Using protocol version 3
2019-10-31 12:25:32,406   DEBUG lava-logs => PING(20)
2019-10-31 12:25:33,664   DEBUG Dhanu => PING(20)
2019-10-31 12:25:33,664 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:25:46,528    INFO scheduling health checks:
2019-10-31 12:25:46,568    INFO scheduling jobs:
2019-10-31 12:25:46,571   DEBUG - qemu
2019-10-31 12:25:46,644   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:25:46,644   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:25:46,649    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:25:47,863    INFO [INIT] Dropping privileges
2019-10-31 12:25:47,863   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:25:47,863   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:25:47,864    INFO [INIT] Marking all workers as offline
2019-10-31 12:25:47,903    INFO [INIT] LAVA master has started.
2019-10-31 12:25:47,904    INFO [INIT] Using protocol version 3
2019-10-31 12:25:52,423   DEBUG lava-logs => PING(20)
2019-10-31 12:25:53,678   DEBUG Dhanu => PING(20)
2019-10-31 12:25:53,679 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:26:07,917    INFO scheduling health checks:
2019-10-31 12:26:07,948    INFO scheduling jobs:
2019-10-31 12:26:07,950   DEBUG - qemu
2019-10-31 12:26:08,020   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:26:08,020   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:26:08,025    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:26:09,583    INFO [INIT] Dropping privileges
2019-10-31 12:26:09,583   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:26:09,583   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:26:09,585    INFO [INIT] Marking all workers as offline
2019-10-31 12:26:09,628    INFO [INIT] LAVA master has started.
2019-10-31 12:26:09,628    INFO [INIT] Using protocol version 3
2019-10-31 12:26:12,437   DEBUG lava-logs => PING(20)
2019-10-31 12:26:13,698   DEBUG Dhanu => PING(20)
2019-10-31 12:26:13,699 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:26:29,642    INFO scheduling health checks:
2019-10-31 12:26:29,661    INFO scheduling jobs:
2019-10-31 12:26:29,663   DEBUG - qemu
2019-10-31 12:26:29,736   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:26:29,736   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:26:29,741    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:26:31,180    INFO [INIT] Dropping privileges
2019-10-31 12:26:31,180   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:26:31,181   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:26:31,182    INFO [INIT] Marking all workers as offline
2019-10-31 12:26:31,220    INFO [INIT] LAVA master has started.
2019-10-31 12:26:31,221    INFO [INIT] Using protocol version 3
2019-10-31 12:26:32,448   DEBUG lava-logs => PING(20)
2019-10-31 12:26:33,713   DEBUG Dhanu => PING(20)
2019-10-31 12:26:33,714 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:26:51,239    INFO scheduling health checks:
2019-10-31 12:26:51,275    INFO scheduling jobs:
2019-10-31 12:26:51,277   DEBUG - qemu
2019-10-31 12:26:51,346   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:26:51,347   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:26:51,351    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:26:52,628    INFO [INIT] Dropping privileges
2019-10-31 12:26:52,628   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:26:52,628   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:26:52,630    INFO [INIT] Marking all workers as offline
2019-10-31 12:26:52,700    INFO [INIT] LAVA master has started.
2019-10-31 12:26:52,701    INFO [INIT] Using protocol version 3
2019-10-31 12:26:52,822   DEBUG lava-logs => PING(20)
2019-10-31 12:26:53,726   DEBUG Dhanu => PING(20)
2019-10-31 12:26:53,727 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:27:12,717    INFO scheduling health checks:
2019-10-31 12:27:12,766    INFO scheduling jobs:
2019-10-31 12:27:12,769   DEBUG - qemu
2019-10-31 12:27:12,847   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:27:12,848   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:27:12,855    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:27:14,265    INFO [INIT] Dropping privileges
2019-10-31 12:27:14,265   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:27:14,266   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:27:14,267    INFO [INIT] Marking all workers as offline
2019-10-31 12:27:14,313    INFO [INIT] LAVA master has started.
2019-10-31 12:27:14,313    INFO [INIT] Using protocol version 3
2019-10-31 12:27:14,327   DEBUG Dhanu => PING(20)
2019-10-31 12:27:14,328 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:27:32,859   DEBUG lava-logs => PING(20)
2019-10-31 12:27:34,315    INFO scheduling health checks:
2019-10-31 12:27:34,345    INFO scheduling jobs:
2019-10-31 12:27:34,347   DEBUG - qemu
2019-10-31 12:27:34,458   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:27:34,458   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:27:34,467    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:27:35,956    INFO [INIT] Dropping privileges
2019-10-31 12:27:35,956   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:27:35,956   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:27:35,957    INFO [INIT] Marking all workers as offline
2019-10-31 12:27:35,994    INFO [INIT] LAVA master has started.
2019-10-31 12:27:35,994    INFO [INIT] Using protocol version 3
2019-10-31 12:27:52,878   DEBUG lava-logs => PING(20)
2019-10-31 12:27:54,362   DEBUG Dhanu => PING(20)
2019-10-31 12:27:54,363 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:27:55,997    INFO scheduling health checks:
2019-10-31 12:27:56,092    INFO scheduling jobs:
2019-10-31 12:27:56,094   DEBUG - qemu
2019-10-31 12:27:56,162   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:27:56,162   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:27:56,167    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:27:57,513    INFO [INIT] Dropping privileges
2019-10-31 12:27:57,513   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:27:57,513   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:27:57,514    INFO [INIT] Marking all workers as offline
2019-10-31 12:27:57,550    INFO [INIT] LAVA master has started.
2019-10-31 12:27:57,550    INFO [INIT] Using protocol version 3
2019-10-31 12:28:12,893   DEBUG lava-logs => PING(20)
2019-10-31 12:28:14,378   DEBUG Dhanu => PING(20)
2019-10-31 12:28:14,378 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:28:17,553    INFO scheduling health checks:
2019-10-31 12:28:17,583    INFO scheduling jobs:
2019-10-31 12:28:17,586   DEBUG - qemu
2019-10-31 12:28:17,665   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:28:17,666   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:28:17,675    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:28:18,992    INFO [INIT] Dropping privileges
2019-10-31 12:28:18,992   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:28:18,992   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:28:18,994    INFO [INIT] Marking all workers as offline
2019-10-31 12:28:19,030    INFO [INIT] LAVA master has started.
2019-10-31 12:28:19,030    INFO [INIT] Using protocol version 3
2019-10-31 12:28:32,906   DEBUG lava-logs => PING(20)
2019-10-31 12:28:34,394   DEBUG Dhanu => PING(20)
2019-10-31 12:28:34,395 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:28:39,033    INFO scheduling health checks:
2019-10-31 12:28:39,063    INFO scheduling jobs:
2019-10-31 12:28:39,065   DEBUG - qemu
2019-10-31 12:28:39,148   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:28:39,149   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:28:39,155    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:28:40,382    INFO [INIT] Dropping privileges
2019-10-31 12:28:40,382   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:28:40,382   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:28:40,384    INFO [INIT] Marking all workers as offline
2019-10-31 12:28:40,421    INFO [INIT] LAVA master has started.
2019-10-31 12:28:40,422    INFO [INIT] Using protocol version 3
2019-10-31 12:28:52,922   DEBUG lava-logs => PING(20)
2019-10-31 12:28:54,413   DEBUG Dhanu => PING(20)
2019-10-31 12:28:54,414 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:29:00,428    INFO scheduling health checks:
2019-10-31 12:29:00,477    INFO scheduling jobs:
2019-10-31 12:29:00,478   DEBUG - qemu
2019-10-31 12:29:00,546   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:29:00,546   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:29:00,550    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:29:01,831    INFO [INIT] Dropping privileges
2019-10-31 12:29:01,831   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:29:01,831   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:29:01,833    INFO [INIT] Marking all workers as offline
2019-10-31 12:29:01,867    INFO [INIT] LAVA master has started.
2019-10-31 12:29:01,868    INFO [INIT] Using protocol version 3
2019-10-31 12:29:12,935   DEBUG lava-logs => PING(20)
2019-10-31 12:29:14,434   DEBUG Dhanu => PING(20)
2019-10-31 12:29:14,435 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:29:21,875    INFO scheduling health checks:
2019-10-31 12:29:21,912    INFO scheduling jobs:
2019-10-31 12:29:21,915   DEBUG - qemu
2019-10-31 12:29:21,988   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:29:21,988   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:29:21,993    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:29:23,091    INFO [INIT] Dropping privileges
2019-10-31 12:29:23,091   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:29:23,091   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:29:23,093    INFO [INIT] Marking all workers as offline
2019-10-31 12:29:23,160    INFO [INIT] LAVA master has started.
2019-10-31 12:29:23,160    INFO [INIT] Using protocol version 3
2019-10-31 12:29:32,946   DEBUG lava-logs => PING(20)
2019-10-31 12:29:34,452   DEBUG Dhanu => PING(20)
2019-10-31 12:29:34,452 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:29:43,169    INFO scheduling health checks:
2019-10-31 12:29:43,203    INFO scheduling jobs:
2019-10-31 12:29:43,204   DEBUG - qemu
2019-10-31 12:29:43,298   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:29:43,298   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:29:43,303    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:29:44,733    INFO [INIT] Dropping privileges
2019-10-31 12:29:44,733   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:29:44,733   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:29:44,735    INFO [INIT] Marking all workers as offline
2019-10-31 12:29:44,794    INFO [INIT] LAVA master has started.
2019-10-31 12:29:44,794    INFO [INIT] Using protocol version 3
2019-10-31 12:29:52,962   DEBUG lava-logs => PING(20)
2019-10-31 12:29:54,470   DEBUG Dhanu => PING(20)
2019-10-31 12:29:54,470 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:30:04,805    INFO scheduling health checks:
2019-10-31 12:30:04,850    INFO scheduling jobs:
2019-10-31 12:30:04,852   DEBUG - qemu
2019-10-31 12:30:04,926   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:30:04,927   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:30:04,942    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:30:06,120    INFO [INIT] Dropping privileges
2019-10-31 12:30:06,120   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:30:06,120   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:30:06,122    INFO [INIT] Marking all workers as offline
2019-10-31 12:30:06,186    INFO [INIT] LAVA master has started.
2019-10-31 12:30:06,187    INFO [INIT] Using protocol version 3
2019-10-31 12:30:12,977   DEBUG lava-logs => PING(20)
2019-10-31 12:30:14,492   DEBUG Dhanu => PING(20)
2019-10-31 12:30:14,492 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:30:26,199    INFO scheduling health checks:
2019-10-31 12:30:26,241    INFO scheduling jobs:
2019-10-31 12:30:26,243   DEBUG - qemu
2019-10-31 12:30:26,316   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:30:26,317   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:30:26,321    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:30:27,614    INFO [INIT] Dropping privileges
2019-10-31 12:30:27,614   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:30:27,614   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:30:27,616    INFO [INIT] Marking all workers as offline
2019-10-31 12:30:27,653    INFO [INIT] LAVA master has started.
2019-10-31 12:30:27,653    INFO [INIT] Using protocol version 3
2019-10-31 12:30:32,990   DEBUG lava-logs => PING(20)
2019-10-31 12:30:34,513   DEBUG Dhanu => PING(20)
2019-10-31 12:30:34,514 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:30:47,667    INFO scheduling health checks:
2019-10-31 12:30:47,698    INFO scheduling jobs:
2019-10-31 12:30:47,700   DEBUG - qemu
2019-10-31 12:30:47,770   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:30:47,770   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:30:47,774    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:30:48,856    INFO [INIT] Dropping privileges
2019-10-31 12:30:48,856   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:30:48,857   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:30:48,858    INFO [INIT] Marking all workers as offline
2019-10-31 12:30:48,890    INFO [INIT] LAVA master has started.
2019-10-31 12:30:48,891    INFO [INIT] Using protocol version 3
2019-10-31 12:30:53,006   DEBUG lava-logs => PING(20)
2019-10-31 12:30:54,534   DEBUG Dhanu => PING(20)
2019-10-31 12:30:54,534 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:31:08,905    INFO scheduling health checks:
2019-10-31 12:31:08,945    INFO scheduling jobs:
2019-10-31 12:31:08,947   DEBUG - qemu
2019-10-31 12:31:09,013   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:31:09,013   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:31:09,028    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:31:10,091    INFO [INIT] Dropping privileges
2019-10-31 12:31:10,091   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:31:10,091   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:31:10,093    INFO [INIT] Marking all workers as offline
2019-10-31 12:31:10,124    INFO [INIT] LAVA master has started.
2019-10-31 12:31:10,124    INFO [INIT] Using protocol version 3
2019-10-31 12:31:13,022   DEBUG lava-logs => PING(20)
2019-10-31 12:31:14,555   DEBUG Dhanu => PING(20)
2019-10-31 12:31:14,556 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:31:30,140    INFO scheduling health checks:
2019-10-31 12:31:30,192    INFO scheduling jobs:
2019-10-31 12:31:30,195   DEBUG - qemu
2019-10-31 12:31:30,266   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:31:30,267   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:31:30,271    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:31:31,339    INFO [INIT] Dropping privileges
2019-10-31 12:31:31,339   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:31:31,339   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:31:31,341    INFO [INIT] Marking all workers as offline
2019-10-31 12:31:31,382    INFO [INIT] LAVA master has started.
2019-10-31 12:31:31,382    INFO [INIT] Using protocol version 3
2019-10-31 12:31:33,037   DEBUG lava-logs => PING(20)
2019-10-31 12:31:34,574   DEBUG Dhanu => PING(20)
2019-10-31 12:31:34,574 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:31:51,387    INFO scheduling health checks:
2019-10-31 12:31:51,416    INFO scheduling jobs:
2019-10-31 12:31:51,418   DEBUG - qemu
2019-10-31 12:31:51,489   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:31:51,489   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:31:51,494    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:31:52,632    INFO [INIT] Dropping privileges
2019-10-31 12:31:52,632   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:31:52,632   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:31:52,634    INFO [INIT] Marking all workers as offline
2019-10-31 12:31:52,708    INFO [INIT] LAVA master has started.
2019-10-31 12:31:52,708    INFO [INIT] Using protocol version 3
2019-10-31 12:31:53,050   DEBUG lava-logs => PING(20)
2019-10-31 12:31:54,592   DEBUG Dhanu => PING(20)
2019-10-31 12:31:54,593 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:32:12,726    INFO scheduling health checks:
2019-10-31 12:32:12,751    INFO scheduling jobs:
2019-10-31 12:32:12,753   DEBUG - qemu
2019-10-31 12:32:12,822   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:32:12,823   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:32:12,827    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:32:14,086    INFO [INIT] Dropping privileges
2019-10-31 12:32:14,086   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:32:14,086   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:32:14,088    INFO [INIT] Marking all workers as offline
2019-10-31 12:32:14,119    INFO [INIT] LAVA master has started.
2019-10-31 12:32:14,120    INFO [INIT] Using protocol version 3
2019-10-31 12:32:14,144   DEBUG lava-logs => PING(20)
2019-10-31 12:32:14,610   DEBUG Dhanu => PING(20)
2019-10-31 12:32:14,611 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:32:34,140    INFO scheduling health checks:
2019-10-31 12:32:34,165    INFO scheduling jobs:
2019-10-31 12:32:34,166   DEBUG - qemu
2019-10-31 12:32:34,240   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:32:34,241   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:32:34,245    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:32:35,348    INFO [INIT] Dropping privileges
2019-10-31 12:32:35,349   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:32:35,349   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:32:35,350    INFO [INIT] Marking all workers as offline
2019-10-31 12:32:35,389    INFO [INIT] LAVA master has started.
2019-10-31 12:32:35,389    INFO [INIT] Using protocol version 3
2019-10-31 12:32:35,476   DEBUG Dhanu => PING(20)
2019-10-31 12:32:35,477 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:32:54,186   DEBUG lava-logs => PING(20)
2019-10-31 12:32:55,391    INFO scheduling health checks:
2019-10-31 12:32:55,411    INFO scheduling jobs:
2019-10-31 12:32:55,412   DEBUG - qemu
2019-10-31 12:32:55,483   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:32:55,483   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:32:55,487    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:32:56,605    INFO [INIT] Dropping privileges
2019-10-31 12:32:56,606   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:32:56,606   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:32:56,607    INFO [INIT] Marking all workers as offline
2019-10-31 12:32:56,646    INFO [INIT] LAVA master has started.
2019-10-31 12:32:56,647    INFO [INIT] Using protocol version 3
2019-10-31 12:32:56,706   DEBUG Dhanu => PING(20)
2019-10-31 12:32:56,707 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:33:14,206   DEBUG lava-logs => PING(20)
2019-10-31 12:33:16,650    INFO scheduling health checks:
2019-10-31 12:33:16,680    INFO scheduling jobs:
2019-10-31 12:33:16,682   DEBUG - qemu
2019-10-31 12:33:16,755   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:33:16,756   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:33:16,760    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:33:17,848    INFO [INIT] Dropping privileges
2019-10-31 12:33:17,848   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:33:17,848   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:33:17,850    INFO [INIT] Marking all workers as offline
2019-10-31 12:33:17,883    INFO [INIT] LAVA master has started.
2019-10-31 12:33:17,883    INFO [INIT] Using protocol version 3
2019-10-31 12:33:34,225   DEBUG lava-logs => PING(20)
2019-10-31 12:33:36,748   DEBUG Dhanu => PING(20)
2019-10-31 12:33:36,748 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:33:37,885    INFO scheduling health checks:
2019-10-31 12:33:37,915    INFO scheduling jobs:
2019-10-31 12:33:37,917   DEBUG - qemu
2019-10-31 12:33:37,990   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:33:37,990   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:33:37,994    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:33:39,096    INFO [INIT] Dropping privileges
2019-10-31 12:33:39,097   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:33:39,097   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:33:39,098    INFO [INIT] Marking all workers as offline
2019-10-31 12:33:39,139    INFO [INIT] LAVA master has started.
2019-10-31 12:33:39,139    INFO [INIT] Using protocol version 3
2019-10-31 12:33:54,241   DEBUG lava-logs => PING(20)
2019-10-31 12:33:56,770   DEBUG Dhanu => PING(20)
2019-10-31 12:33:56,771 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:33:59,141    INFO scheduling health checks:
2019-10-31 12:33:59,173    INFO scheduling jobs:
2019-10-31 12:33:59,175   DEBUG - qemu
2019-10-31 12:33:59,246   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:33:59,246   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:33:59,251    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:34:00,355    INFO [INIT] Dropping privileges
2019-10-31 12:34:00,355   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:34:00,356   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:34:00,357    INFO [INIT] Marking all workers as offline
2019-10-31 12:34:00,397    INFO [INIT] LAVA master has started.
2019-10-31 12:34:00,397    INFO [INIT] Using protocol version 3
2019-10-31 12:34:14,258   DEBUG lava-logs => PING(20)
2019-10-31 12:34:16,791   DEBUG Dhanu => PING(20)
2019-10-31 12:34:16,791 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:34:20,401    INFO scheduling health checks:
2019-10-31 12:34:20,431    INFO scheduling jobs:
2019-10-31 12:34:20,433   DEBUG - qemu
2019-10-31 12:34:20,505   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:34:20,506   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:34:20,510    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:34:21,587    INFO [INIT] Dropping privileges
2019-10-31 12:34:21,588   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:34:21,588   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:34:21,589    INFO [INIT] Marking all workers as offline
2019-10-31 12:34:21,621    INFO [INIT] LAVA master has started.
2019-10-31 12:34:21,621    INFO [INIT] Using protocol version 3
2019-10-31 12:34:34,271   DEBUG lava-logs => PING(20)
2019-10-31 12:34:36,808   DEBUG Dhanu => PING(20)
2019-10-31 12:34:36,809 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:34:41,627    INFO scheduling health checks:
2019-10-31 12:34:41,666    INFO scheduling jobs:
2019-10-31 12:34:41,669   DEBUG - qemu
2019-10-31 12:34:41,744   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:34:41,744   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:34:41,749    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:34:42,835    INFO [INIT] Dropping privileges
2019-10-31 12:34:42,835   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:34:42,835   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:34:42,837    INFO [INIT] Marking all workers as offline
2019-10-31 12:34:42,880    INFO [INIT] LAVA master has started.
2019-10-31 12:34:42,880    INFO [INIT] Using protocol version 3
2019-10-31 12:34:54,286   DEBUG lava-logs => PING(20)
2019-10-31 12:34:56,830   DEBUG Dhanu => PING(20)
2019-10-31 12:34:56,831 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:35:02,885    INFO scheduling health checks:
2019-10-31 12:35:02,924    INFO scheduling jobs:
2019-10-31 12:35:02,927   DEBUG - qemu
2019-10-31 12:35:03,000   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:35:03,000   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:35:03,005    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:35:04,111    INFO [INIT] Dropping privileges
2019-10-31 12:35:04,111   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:35:04,111   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:35:04,113    INFO [INIT] Marking all workers as offline
2019-10-31 12:35:04,171    INFO [INIT] LAVA master has started.
2019-10-31 12:35:04,172    INFO [INIT] Using protocol version 3
2019-10-31 12:35:14,299   DEBUG lava-logs => PING(20)
2019-10-31 12:35:16,850   DEBUG Dhanu => PING(20)
2019-10-31 12:35:16,851 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:35:24,180    INFO scheduling health checks:
2019-10-31 12:35:24,215    INFO scheduling jobs:
2019-10-31 12:35:24,217   DEBUG - qemu
2019-10-31 12:35:24,294   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:35:24,295   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:35:24,299    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:35:25,624    INFO [INIT] Dropping privileges
2019-10-31 12:35:25,624   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:35:25,624   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:35:25,626    INFO [INIT] Marking all workers as offline
2019-10-31 12:35:25,662    INFO [INIT] LAVA master has started.
2019-10-31 12:35:25,662    INFO [INIT] Using protocol version 3
2019-10-31 12:35:34,318   DEBUG lava-logs => PING(20)
2019-10-31 12:35:36,870   DEBUG Dhanu => PING(20)
2019-10-31 12:35:36,871 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:35:45,671    INFO scheduling health checks:
2019-10-31 12:35:45,717    INFO scheduling jobs:
2019-10-31 12:35:45,719   DEBUG - qemu
2019-10-31 12:35:45,793   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:35:45,793   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:35:45,798    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:35:47,096    INFO [INIT] Dropping privileges
2019-10-31 12:35:47,097   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:35:47,097   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:35:47,098    INFO [INIT] Marking all workers as offline
2019-10-31 12:35:47,130    INFO [INIT] LAVA master has started.
2019-10-31 12:35:47,130    INFO [INIT] Using protocol version 3
2019-10-31 12:35:54,338   DEBUG lava-logs => PING(20)
2019-10-31 12:35:56,890   DEBUG Dhanu => PING(20)
2019-10-31 12:35:56,890 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:36:07,137    INFO scheduling health checks:
2019-10-31 12:36:07,174    INFO scheduling jobs:
2019-10-31 12:36:07,177   DEBUG - qemu
2019-10-31 12:36:07,263   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:36:07,263   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:36:07,268    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:36:08,537    INFO [INIT] Dropping privileges
2019-10-31 12:36:08,537   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:36:08,537   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:36:08,539    INFO [INIT] Marking all workers as offline
2019-10-31 12:36:08,565    INFO [INIT] LAVA master has started.
2019-10-31 12:36:08,565    INFO [INIT] Using protocol version 3
2019-10-31 12:36:14,353   DEBUG lava-logs => PING(20)
2019-10-31 12:36:16,912   DEBUG Dhanu => PING(20)
2019-10-31 12:36:16,912 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:36:28,577    INFO scheduling health checks:
2019-10-31 12:36:28,610    INFO scheduling jobs:
2019-10-31 12:36:28,614   DEBUG - qemu
2019-10-31 12:36:28,690   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:36:28,690   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:36:28,699    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:36:29,892    INFO [INIT] Dropping privileges
2019-10-31 12:36:29,893   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:36:29,893   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:36:29,894    INFO [INIT] Marking all workers as offline
2019-10-31 12:36:29,924    INFO [INIT] LAVA master has started.
2019-10-31 12:36:29,924    INFO [INIT] Using protocol version 3
2019-10-31 12:36:34,368   DEBUG lava-logs => PING(20)
2019-10-31 12:36:36,931   DEBUG Dhanu => PING(20)
2019-10-31 12:36:36,931 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:36:49,934    INFO scheduling health checks:
2019-10-31 12:36:49,968    INFO scheduling jobs:
2019-10-31 12:36:49,970   DEBUG - qemu
2019-10-31 12:36:50,049   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:36:50,049   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:36:50,054    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:36:51,493    INFO [INIT] Dropping privileges
2019-10-31 12:36:51,494   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:36:51,494   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:36:51,495    INFO [INIT] Marking all workers as offline
2019-10-31 12:36:51,560    INFO [INIT] LAVA master has started.
2019-10-31 12:36:51,560    INFO [INIT] Using protocol version 3
2019-10-31 12:36:54,381   DEBUG lava-logs => PING(20)
2019-10-31 12:36:56,946   DEBUG Dhanu => PING(20)
2019-10-31 12:36:56,947 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:37:11,573    INFO scheduling health checks:
2019-10-31 12:37:11,603    INFO scheduling jobs:
2019-10-31 12:37:11,605   DEBUG - qemu
2019-10-31 12:37:11,685   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:37:11,685   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:37:11,689    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:37:12,920    INFO [INIT] Dropping privileges
2019-10-31 12:37:12,920   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:37:12,920   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:37:12,922    INFO [INIT] Marking all workers as offline
2019-10-31 12:37:12,961    INFO [INIT] LAVA master has started.
2019-10-31 12:37:12,961    INFO [INIT] Using protocol version 3
2019-10-31 12:37:14,393   DEBUG lava-logs => PING(20)
2019-10-31 12:37:16,968   DEBUG Dhanu => PING(20)
2019-10-31 12:37:16,968 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:37:32,977    INFO scheduling health checks:
2019-10-31 12:37:33,027    INFO scheduling jobs:
2019-10-31 12:37:33,031   DEBUG - qemu
2019-10-31 12:37:33,113   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:37:33,114   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:37:33,122    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:37:34,498    INFO [INIT] Dropping privileges
2019-10-31 12:37:34,498   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:37:34,498   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:37:34,500    INFO [INIT] Marking all workers as offline
2019-10-31 12:37:34,529    INFO [INIT] LAVA master has started.
2019-10-31 12:37:34,529    INFO [INIT] Using protocol version 3
2019-10-31 12:37:34,575   DEBUG lava-logs => PING(20)
2019-10-31 12:37:36,985   DEBUG Dhanu => PING(20)
2019-10-31 12:37:36,986 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:37:54,547    INFO scheduling health checks:
2019-10-31 12:37:54,585    INFO scheduling jobs:
2019-10-31 12:37:54,587   DEBUG - qemu
2019-10-31 12:37:54,669   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:37:54,669   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:37:54,673    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:37:55,889    INFO [INIT] Dropping privileges
2019-10-31 12:37:55,890   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:37:55,890   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:37:55,891    INFO [INIT] Marking all workers as offline
2019-10-31 12:37:55,931    INFO [INIT] LAVA master has started.
2019-10-31 12:37:55,931    INFO [INIT] Using protocol version 3
2019-10-31 12:37:56,999   DEBUG Dhanu => PING(20)
2019-10-31 12:37:56,999 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:38:14,614   DEBUG lava-logs => PING(20)
2019-10-31 12:38:15,933    INFO scheduling health checks:
2019-10-31 12:38:15,954    INFO scheduling jobs:
2019-10-31 12:38:15,955   DEBUG - qemu
2019-10-31 12:38:16,050   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:38:16,050   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:38:16,058    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:38:17,543    INFO [INIT] Dropping privileges
2019-10-31 12:38:17,544   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:38:17,544   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:38:17,545    INFO [INIT] Marking all workers as offline
2019-10-31 12:38:17,578    INFO [INIT] LAVA master has started.
2019-10-31 12:38:17,578    INFO [INIT] Using protocol version 3
2019-10-31 12:38:17,704   DEBUG Dhanu => PING(20)
2019-10-31 12:38:17,704 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:38:34,630   DEBUG lava-logs => PING(20)
2019-10-31 12:38:37,581    INFO scheduling health checks:
2019-10-31 12:38:37,611    INFO scheduling jobs:
2019-10-31 12:38:37,613   DEBUG - qemu
2019-10-31 12:38:37,693   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:38:37,694   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:38:37,699    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:38:39,122    INFO [INIT] Dropping privileges
2019-10-31 12:38:39,123   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:38:39,123   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:38:39,124    INFO [INIT] Marking all workers as offline
2019-10-31 12:38:39,205    INFO [INIT] LAVA master has started.
2019-10-31 12:38:39,206    INFO [INIT] Using protocol version 3
2019-10-31 12:38:39,272   DEBUG Dhanu => PING(20)
2019-10-31 12:38:39,272 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:38:54,642   DEBUG lava-logs => PING(20)
2019-10-31 12:38:59,209    INFO scheduling health checks:
2019-10-31 12:38:59,263    INFO scheduling jobs:
2019-10-31 12:38:59,266   DEBUG - qemu
2019-10-31 12:38:59,343   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:38:59,343   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:38:59,350    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:39:00,734    INFO [INIT] Dropping privileges
2019-10-31 12:39:00,734   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:39:00,734   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:39:00,736    INFO [INIT] Marking all workers as offline
2019-10-31 12:39:00,794    INFO [INIT] LAVA master has started.
2019-10-31 12:39:00,795    INFO [INIT] Using protocol version 3
2019-10-31 12:39:14,656   DEBUG lava-logs => PING(20)
2019-10-31 12:39:19,306   DEBUG Dhanu => PING(20)
2019-10-31 12:39:19,307 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:39:20,796    INFO scheduling health checks:
2019-10-31 12:39:20,827    INFO scheduling jobs:
2019-10-31 12:39:20,829   DEBUG - qemu
2019-10-31 12:39:20,904   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:39:20,904   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:39:20,909    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:39:22,123    INFO [INIT] Dropping privileges
2019-10-31 12:39:22,123   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:39:22,123   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:39:22,125    INFO [INIT] Marking all workers as offline
2019-10-31 12:39:22,183    INFO [INIT] LAVA master has started.
2019-10-31 12:39:22,183    INFO [INIT] Using protocol version 3
2019-10-31 12:39:34,670   DEBUG lava-logs => PING(20)
2019-10-31 12:39:39,326   DEBUG Dhanu => PING(20)
2019-10-31 12:39:39,327 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:39:42,185    INFO scheduling health checks:
2019-10-31 12:39:42,207    INFO scheduling jobs:
2019-10-31 12:39:42,208   DEBUG - qemu
2019-10-31 12:39:42,280   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:39:42,280   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:39:42,285    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:39:43,662    INFO [INIT] Dropping privileges
2019-10-31 12:39:43,663   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:39:43,663   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:39:43,664    INFO [INIT] Marking all workers as offline
2019-10-31 12:39:43,698    INFO [INIT] LAVA master has started.
2019-10-31 12:39:43,698    INFO [INIT] Using protocol version 3
2019-10-31 12:39:54,684   DEBUG lava-logs => PING(20)
2019-10-31 12:39:59,344   DEBUG Dhanu => PING(20)
2019-10-31 12:39:59,344 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:40:03,703    INFO scheduling health checks:
2019-10-31 12:40:03,742    INFO scheduling jobs:
2019-10-31 12:40:03,745   DEBUG - qemu
2019-10-31 12:40:03,833   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:40:03,833   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:40:03,838    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:40:05,186    INFO [INIT] Dropping privileges
2019-10-31 12:40:05,186   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:40:05,186   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:40:05,188    INFO [INIT] Marking all workers as offline
2019-10-31 12:40:05,223    INFO [INIT] LAVA master has started.
2019-10-31 12:40:05,223    INFO [INIT] Using protocol version 3
2019-10-31 12:40:14,702   DEBUG lava-logs => PING(20)
2019-10-31 12:40:19,362   DEBUG Dhanu => PING(20)
2019-10-31 12:40:19,363 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:40:25,229    INFO scheduling health checks:
2019-10-31 12:40:25,255    INFO scheduling jobs:
2019-10-31 12:40:25,257   DEBUG - qemu
2019-10-31 12:40:25,333   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:40:25,333   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:40:25,338    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:40:26,705    INFO [INIT] Dropping privileges
2019-10-31 12:40:26,706   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:40:26,706   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:40:26,707    INFO [INIT] Marking all workers as offline
2019-10-31 12:40:26,748    INFO [INIT] LAVA master has started.
2019-10-31 12:40:26,748    INFO [INIT] Using protocol version 3
2019-10-31 12:40:34,723   DEBUG lava-logs => PING(20)
2019-10-31 12:40:39,378   DEBUG Dhanu => PING(20)
2019-10-31 12:40:39,378 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:40:46,753    INFO scheduling health checks:
2019-10-31 12:40:46,791    INFO scheduling jobs:
2019-10-31 12:40:46,794   DEBUG - qemu
2019-10-31 12:40:46,870   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:40:46,870   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:40:46,875    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:40:48,358    INFO [INIT] Dropping privileges
2019-10-31 12:40:48,358   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:40:48,359   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:40:48,361    INFO [INIT] Marking all workers as offline
2019-10-31 12:40:48,438    INFO [INIT] LAVA master has started.
2019-10-31 12:40:48,438    INFO [INIT] Using protocol version 3
2019-10-31 12:40:54,738   DEBUG lava-logs => PING(20)
2019-10-31 12:40:59,400   DEBUG Dhanu => PING(20)
2019-10-31 12:40:59,400 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:41:08,445    INFO scheduling health checks:
2019-10-31 12:41:08,482    INFO scheduling jobs:
2019-10-31 12:41:08,484   DEBUG - qemu
2019-10-31 12:41:08,565   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:41:08,565   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:41:08,570    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:41:09,973    INFO [INIT] Dropping privileges
2019-10-31 12:41:09,973   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:41:09,973   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:41:09,975    INFO [INIT] Marking all workers as offline
2019-10-31 12:41:10,007    INFO [INIT] LAVA master has started.
2019-10-31 12:41:10,007    INFO [INIT] Using protocol version 3
2019-10-31 12:41:14,750   DEBUG lava-logs => PING(20)
2019-10-31 12:41:19,421   DEBUG Dhanu => PING(20)
2019-10-31 12:41:19,421 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:41:30,018    INFO scheduling health checks:
2019-10-31 12:41:30,051    INFO scheduling jobs:
2019-10-31 12:41:30,052   DEBUG - qemu
2019-10-31 12:41:30,119   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:41:30,119   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:41:30,124    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:41:31,354    INFO [INIT] Dropping privileges
2019-10-31 12:41:31,355   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:41:31,355   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:41:31,356    INFO [INIT] Marking all workers as offline
2019-10-31 12:41:31,397    INFO [INIT] LAVA master has started.
2019-10-31 12:41:31,397    INFO [INIT] Using protocol version 3
2019-10-31 12:41:34,762   DEBUG lava-logs => PING(20)
2019-10-31 12:41:39,440   DEBUG Dhanu => PING(20)
2019-10-31 12:41:39,440 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:41:51,405    INFO scheduling health checks:
2019-10-31 12:41:51,441    INFO scheduling jobs:
2019-10-31 12:41:51,444   DEBUG - qemu
2019-10-31 12:41:51,532   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:41:51,532   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:41:51,538    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:41:53,061    INFO [INIT] Dropping privileges
2019-10-31 12:41:53,062   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:41:53,062   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:41:53,063    INFO [INIT] Marking all workers as offline
2019-10-31 12:41:53,100    INFO [INIT] LAVA master has started.
2019-10-31 12:41:53,100    INFO [INIT] Using protocol version 3
2019-10-31 12:41:54,776   DEBUG lava-logs => PING(20)
2019-10-31 12:41:59,460   DEBUG Dhanu => PING(20)
2019-10-31 12:41:59,461 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:42:13,113    INFO scheduling health checks:
2019-10-31 12:42:13,156    INFO scheduling jobs:
2019-10-31 12:42:13,159   DEBUG - qemu
2019-10-31 12:42:13,250   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:42:13,252   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:42:13,257    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:42:14,541    INFO [INIT] Dropping privileges
2019-10-31 12:42:14,541   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:42:14,542   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:42:14,543    INFO [INIT] Marking all workers as offline
2019-10-31 12:42:14,578    INFO [INIT] LAVA master has started.
2019-10-31 12:42:14,578    INFO [INIT] Using protocol version 3
2019-10-31 12:42:14,791   DEBUG lava-logs => PING(20)
2019-10-31 12:42:19,478   DEBUG Dhanu => PING(20)
2019-10-31 12:42:19,479 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:42:34,593    INFO scheduling health checks:
2019-10-31 12:42:34,624    INFO scheduling jobs:
2019-10-31 12:42:34,628   DEBUG - qemu
2019-10-31 12:42:34,716   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:42:34,717   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:42:34,726    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:42:36,151    INFO [INIT] Dropping privileges
2019-10-31 12:42:36,152   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:42:36,152   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:42:36,156    INFO [INIT] Marking all workers as offline
2019-10-31 12:42:36,238    INFO [INIT] LAVA master has started.
2019-10-31 12:42:36,238    INFO [INIT] Using protocol version 3
2019-10-31 12:42:36,397   DEBUG lava-logs => PING(20)
2019-10-31 12:42:39,493   DEBUG Dhanu => PING(20)
2019-10-31 12:42:39,493 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:42:56,253    INFO scheduling health checks:
2019-10-31 12:42:56,281    INFO scheduling jobs:
2019-10-31 12:42:56,285   DEBUG - qemu
2019-10-31 12:42:56,359   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:42:56,360   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:42:56,364    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:42:57,675    INFO [INIT] Dropping privileges
2019-10-31 12:42:57,675   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:42:57,676   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:42:57,677    INFO [INIT] Marking all workers as offline
2019-10-31 12:42:57,718    INFO [INIT] LAVA master has started.
2019-10-31 12:42:57,718    INFO [INIT] Using protocol version 3
2019-10-31 12:42:57,776   DEBUG lava-logs => PING(20)
2019-10-31 12:42:59,508   DEBUG Dhanu => PING(20)
2019-10-31 12:42:59,509 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:43:17,734    INFO scheduling health checks:
2019-10-31 12:43:17,761    INFO scheduling jobs:
2019-10-31 12:43:17,763   DEBUG - qemu
2019-10-31 12:43:17,840   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:43:17,840   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:43:17,845    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:43:19,119    INFO [INIT] Dropping privileges
2019-10-31 12:43:19,120   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:43:19,120   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:43:19,121    INFO [INIT] Marking all workers as offline
2019-10-31 12:43:19,164    INFO [INIT] LAVA master has started.
2019-10-31 12:43:19,165    INFO [INIT] Using protocol version 3
2019-10-31 12:43:19,526   DEBUG Dhanu => PING(20)
2019-10-31 12:43:19,527 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:43:37,813   DEBUG lava-logs => PING(20)
2019-10-31 12:43:39,166    INFO scheduling health checks:
2019-10-31 12:43:39,275    INFO scheduling jobs:
2019-10-31 12:43:39,277   DEBUG - qemu
2019-10-31 12:43:39,400   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:43:39,400   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:43:39,407    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:43:40,904    INFO [INIT] Dropping privileges
2019-10-31 12:43:40,904   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:43:40,904   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:43:40,906    INFO [INIT] Marking all workers as offline
2019-10-31 12:43:40,982    INFO [INIT] LAVA master has started.
2019-10-31 12:43:40,982    INFO [INIT] Using protocol version 3
2019-10-31 12:43:41,129   DEBUG Dhanu => PING(20)
2019-10-31 12:43:41,129 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:43:57,831   DEBUG lava-logs => PING(20)
2019-10-31 12:44:00,986    INFO scheduling health checks:
2019-10-31 12:44:01,044    INFO scheduling jobs:
2019-10-31 12:44:01,047   DEBUG - qemu
2019-10-31 12:44:01,120   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:44:01,120   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:44:01,124    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:44:02,345    INFO [INIT] Dropping privileges
2019-10-31 12:44:02,345   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:44:02,345   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:44:02,347    INFO [INIT] Marking all workers as offline
2019-10-31 12:44:02,378    INFO [INIT] LAVA master has started.
2019-10-31 12:44:02,379    INFO [INIT] Using protocol version 3
2019-10-31 12:44:02,573   DEBUG Dhanu => PING(20)
2019-10-31 12:44:02,574 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:44:17,841   DEBUG lava-logs => PING(20)
2019-10-31 12:44:22,381    INFO scheduling health checks:
2019-10-31 12:44:22,412    INFO scheduling jobs:
2019-10-31 12:44:22,414   DEBUG - qemu
2019-10-31 12:44:22,483   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:44:22,483   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:44:22,488    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:44:23,700    INFO [INIT] Dropping privileges
2019-10-31 12:44:23,701   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:44:23,701   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:44:23,702    INFO [INIT] Marking all workers as offline
2019-10-31 12:44:23,763    INFO [INIT] LAVA master has started.
2019-10-31 12:44:23,763    INFO [INIT] Using protocol version 3
2019-10-31 12:44:23,875   DEBUG Dhanu => PING(20)
2019-10-31 12:44:23,875 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:44:37,853   DEBUG lava-logs => PING(20)
2019-10-31 12:44:43,769    INFO scheduling health checks:
2019-10-31 12:44:43,803    INFO scheduling jobs:
2019-10-31 12:44:43,804   DEBUG - qemu
2019-10-31 12:44:43,871   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:44:43,871   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:44:43,876    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:44:45,159    INFO [INIT] Dropping privileges
2019-10-31 12:44:45,159   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:44:45,160   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:44:45,161    INFO [INIT] Marking all workers as offline
2019-10-31 12:44:45,204    INFO [INIT] LAVA master has started.
2019-10-31 12:44:45,204    INFO [INIT] Using protocol version 3
2019-10-31 12:44:45,263   DEBUG Dhanu => PING(20)
2019-10-31 12:44:45,264 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:44:57,865   DEBUG lava-logs => PING(20)
2019-10-31 12:45:05,209    INFO scheduling health checks:
2019-10-31 12:45:05,238    INFO scheduling jobs:
2019-10-31 12:45:05,240   DEBUG - qemu
2019-10-31 12:45:05,308   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:45:05,309   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:45:05,314    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:45:06,678    INFO [INIT] Dropping privileges
2019-10-31 12:45:06,678   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:45:06,678   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:45:06,686    INFO [INIT] Marking all workers as offline
2019-10-31 12:45:06,995    INFO [INIT] LAVA master has started.
2019-10-31 12:45:06,996    INFO [INIT] Using protocol version 3
2019-10-31 12:45:17,878   DEBUG lava-logs => PING(20)
2019-10-31 12:45:25,299   DEBUG Dhanu => PING(20)
2019-10-31 12:45:25,299 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:45:26,997    INFO scheduling health checks:
2019-10-31 12:45:27,030    INFO scheduling jobs:
2019-10-31 12:45:27,031   DEBUG - qemu
2019-10-31 12:45:27,100   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:45:27,100   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:45:27,105    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:45:28,307    INFO [INIT] Dropping privileges
2019-10-31 12:45:28,307   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:45:28,307   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:45:28,309    INFO [INIT] Marking all workers as offline
2019-10-31 12:45:28,366    INFO [INIT] LAVA master has started.
2019-10-31 12:45:28,367    INFO [INIT] Using protocol version 3
2019-10-31 12:45:37,900   DEBUG lava-logs => PING(20)
2019-10-31 12:45:45,314   DEBUG Dhanu => PING(20)
2019-10-31 12:45:45,315 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:45:48,369    INFO scheduling health checks:
2019-10-31 12:45:48,421    INFO scheduling jobs:
2019-10-31 12:45:48,424   DEBUG - qemu
2019-10-31 12:45:48,503   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:45:48,503   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:45:48,507    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:45:49,699    INFO [INIT] Dropping privileges
2019-10-31 12:45:49,699   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:45:49,699   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:45:49,701    INFO [INIT] Marking all workers as offline
2019-10-31 12:45:49,733    INFO [INIT] LAVA master has started.
2019-10-31 12:45:49,733    INFO [INIT] Using protocol version 3
2019-10-31 12:45:57,951   DEBUG lava-logs => PING(20)
2019-10-31 12:46:05,329   DEBUG Dhanu => PING(20)
2019-10-31 12:46:05,330 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:46:09,738    INFO scheduling health checks:
2019-10-31 12:46:09,789    INFO scheduling jobs:
2019-10-31 12:46:09,791   DEBUG - qemu
2019-10-31 12:46:09,912   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:46:09,912   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:46:09,920    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:46:11,180    INFO [INIT] Dropping privileges
2019-10-31 12:46:11,180   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:46:11,180   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:46:11,182    INFO [INIT] Marking all workers as offline
2019-10-31 12:46:11,213    INFO [INIT] LAVA master has started.
2019-10-31 12:46:11,213    INFO [INIT] Using protocol version 3
2019-10-31 12:46:17,969   DEBUG lava-logs => PING(20)
2019-10-31 12:46:25,348   DEBUG Dhanu => PING(20)
2019-10-31 12:46:25,348 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:46:31,218    INFO scheduling health checks:
2019-10-31 12:46:31,258    INFO scheduling jobs:
2019-10-31 12:46:31,262   DEBUG - qemu
2019-10-31 12:46:31,359   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:46:31,359   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:46:31,365    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:46:32,835    INFO [INIT] Dropping privileges
2019-10-31 12:46:32,835   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:46:32,835   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:46:32,836    INFO [INIT] Marking all workers as offline
2019-10-31 12:46:32,872    INFO [INIT] LAVA master has started.
2019-10-31 12:46:32,874    INFO [INIT] Using protocol version 3
2019-10-31 12:46:37,984   DEBUG lava-logs => PING(20)
2019-10-31 12:46:45,368   DEBUG Dhanu => PING(20)
2019-10-31 12:46:45,368 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:46:52,882    INFO scheduling health checks:
2019-10-31 12:46:52,927    INFO scheduling jobs:
2019-10-31 12:46:52,930   DEBUG - qemu
2019-10-31 12:46:53,006   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:46:53,006   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:46:53,011    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:46:54,113    INFO [INIT] Dropping privileges
2019-10-31 12:46:54,113   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:46:54,113   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:46:54,115    INFO [INIT] Marking all workers as offline
2019-10-31 12:46:54,154    INFO [INIT] LAVA master has started.
2019-10-31 12:46:54,154    INFO [INIT] Using protocol version 3
2019-10-31 12:46:57,999   DEBUG lava-logs => PING(20)
2019-10-31 12:47:05,385   DEBUG Dhanu => PING(20)
2019-10-31 12:47:05,385 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:47:14,162    INFO scheduling health checks:
2019-10-31 12:47:14,196    INFO scheduling jobs:
2019-10-31 12:47:14,198   DEBUG - qemu
2019-10-31 12:47:14,296   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:47:14,296   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:47:14,304    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:47:15,719    INFO [INIT] Dropping privileges
2019-10-31 12:47:15,719   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:47:15,719   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:47:15,720    INFO [INIT] Marking all workers as offline
2019-10-31 12:47:15,753    INFO [INIT] LAVA master has started.
2019-10-31 12:47:15,754    INFO [INIT] Using protocol version 3
2019-10-31 12:47:18,012   DEBUG lava-logs => PING(20)
2019-10-31 12:47:25,402   DEBUG Dhanu => PING(20)
2019-10-31 12:47:25,403 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:47:35,761    INFO scheduling health checks:
2019-10-31 12:47:35,798    INFO scheduling jobs:
2019-10-31 12:47:35,803   DEBUG - qemu
2019-10-31 12:47:35,879   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:47:35,880   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:47:35,884    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:47:37,180    INFO [INIT] Dropping privileges
2019-10-31 12:47:37,180   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:47:37,180   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:47:37,182    INFO [INIT] Marking all workers as offline
2019-10-31 12:47:37,257    INFO [INIT] LAVA master has started.
2019-10-31 12:47:37,257    INFO [INIT] Using protocol version 3
2019-10-31 12:47:38,023   DEBUG lava-logs => PING(20)
2019-10-31 12:47:45,422   DEBUG Dhanu => PING(20)
2019-10-31 12:47:45,422 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:47:57,269    INFO scheduling health checks:
2019-10-31 12:47:57,300    INFO scheduling jobs:
2019-10-31 12:47:57,303   DEBUG - qemu
2019-10-31 12:47:57,377   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:47:57,378   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:47:57,382    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:47:58,651    INFO [INIT] Dropping privileges
2019-10-31 12:47:58,651   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:47:58,651   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:47:58,652    INFO [INIT] Marking all workers as offline
2019-10-31 12:47:58,692    INFO [INIT] LAVA master has started.
2019-10-31 12:47:58,692    INFO [INIT] Using protocol version 3
2019-10-31 12:47:58,758   DEBUG lava-logs => PING(20)
2019-10-31 12:48:05,442   DEBUG Dhanu => PING(20)
2019-10-31 12:48:05,443 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:48:18,706    INFO scheduling health checks:
2019-10-31 12:48:18,747    INFO scheduling jobs:
2019-10-31 12:48:18,750   DEBUG - qemu
2019-10-31 12:48:18,823   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:48:18,823   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:48:18,831    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:48:20,110    INFO [INIT] Dropping privileges
2019-10-31 12:48:20,110   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:48:20,110   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:48:20,112    INFO [INIT] Marking all workers as offline
2019-10-31 12:48:20,139    INFO [INIT] LAVA master has started.
2019-10-31 12:48:20,139    INFO [INIT] Using protocol version 3
2019-10-31 12:48:25,458   DEBUG Dhanu => PING(20)
2019-10-31 12:48:25,459 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:48:38,797   DEBUG lava-logs => PING(20)
2019-10-31 12:48:40,140    INFO scheduling health checks:
2019-10-31 12:48:40,194    INFO scheduling jobs:
2019-10-31 12:48:40,197   DEBUG - qemu
2019-10-31 12:48:40,275   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:48:40,275   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:48:40,280    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:48:41,340    INFO [INIT] Dropping privileges
2019-10-31 12:48:41,340   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:48:41,340   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:48:41,342    INFO [INIT] Marking all workers as offline
2019-10-31 12:48:41,385    INFO [INIT] LAVA master has started.
2019-10-31 12:48:41,385    INFO [INIT] Using protocol version 3
2019-10-31 12:48:45,477   DEBUG Dhanu => PING(20)
2019-10-31 12:48:45,477 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:48:58,816   DEBUG lava-logs => PING(20)
2019-10-31 12:49:01,388    INFO scheduling health checks:
2019-10-31 12:49:01,429    INFO scheduling jobs:
2019-10-31 12:49:01,432   DEBUG - qemu
2019-10-31 12:49:01,505   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:49:01,506   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:49:01,514    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:49:02,712    INFO [INIT] Dropping privileges
2019-10-31 12:49:02,712   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:49:02,712   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:49:02,714    INFO [INIT] Marking all workers as offline
2019-10-31 12:49:02,741    INFO [INIT] LAVA master has started.
2019-10-31 12:49:02,742    INFO [INIT] Using protocol version 3
2019-10-31 12:49:05,498   DEBUG Dhanu => PING(20)
2019-10-31 12:49:05,499 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:49:18,835   DEBUG lava-logs => PING(20)
2019-10-31 12:49:22,746    INFO scheduling health checks:
2019-10-31 12:49:22,775    INFO scheduling jobs:
2019-10-31 12:49:22,777   DEBUG - qemu
2019-10-31 12:49:22,850   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:49:22,850   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:49:22,858    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:49:24,109    INFO [INIT] Dropping privileges
2019-10-31 12:49:24,109   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:49:24,109   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:49:24,111    INFO [INIT] Marking all workers as offline
2019-10-31 12:49:24,155    INFO [INIT] LAVA master has started.
2019-10-31 12:49:24,156    INFO [INIT] Using protocol version 3
2019-10-31 12:49:25,514   DEBUG Dhanu => PING(20)
2019-10-31 12:49:25,514 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:49:38,850   DEBUG lava-logs => PING(20)
2019-10-31 12:49:44,161    INFO scheduling health checks:
2019-10-31 12:49:44,200    INFO scheduling jobs:
2019-10-31 12:49:44,203   DEBUG - qemu
2019-10-31 12:49:44,276   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:49:44,277   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:49:44,281    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:49:45,643    INFO [INIT] Dropping privileges
2019-10-31 12:49:45,643   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:49:45,643   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:49:45,645    INFO [INIT] Marking all workers as offline
2019-10-31 12:49:45,669    INFO [INIT] LAVA master has started.
2019-10-31 12:49:45,669    INFO [INIT] Using protocol version 3
2019-10-31 12:49:45,722   DEBUG Dhanu => PING(20)
2019-10-31 12:49:45,723 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:49:58,861   DEBUG lava-logs => PING(20)
2019-10-31 12:50:05,676    INFO scheduling health checks:
2019-10-31 12:50:05,702    INFO scheduling jobs:
2019-10-31 12:50:05,704   DEBUG - qemu
2019-10-31 12:50:05,775   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:50:05,775   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:50:05,780    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:50:07,096    INFO [INIT] Dropping privileges
2019-10-31 12:50:07,097   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:50:07,097   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:50:07,099    INFO [INIT] Marking all workers as offline
2019-10-31 12:50:07,136    INFO [INIT] LAVA master has started.
2019-10-31 12:50:07,136    INFO [INIT] Using protocol version 3
2019-10-31 12:50:18,874   DEBUG lava-logs => PING(20)
2019-10-31 12:50:25,758   DEBUG Dhanu => PING(20)
2019-10-31 12:50:25,760 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:50:27,137    INFO scheduling health checks:
2019-10-31 12:50:27,193    INFO scheduling jobs:
2019-10-31 12:50:27,194   DEBUG - qemu
2019-10-31 12:50:27,264   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:50:27,264   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:50:27,273    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:50:28,424    INFO [INIT] Dropping privileges
2019-10-31 12:50:28,425   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:50:28,425   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:50:28,427    INFO [INIT] Marking all workers as offline
2019-10-31 12:50:28,474    INFO [INIT] LAVA master has started.
2019-10-31 12:50:28,474    INFO [INIT] Using protocol version 3
2019-10-31 12:50:38,887   DEBUG lava-logs => PING(20)
2019-10-31 12:50:45,780   DEBUG Dhanu => PING(20)
2019-10-31 12:50:45,780 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:50:48,477    INFO scheduling health checks:
2019-10-31 12:50:48,517    INFO scheduling jobs:
2019-10-31 12:50:48,519   DEBUG - qemu
2019-10-31 12:50:48,607   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:50:48,608   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:50:48,613    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:50:49,943    INFO [INIT] Dropping privileges
2019-10-31 12:50:49,944   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:50:49,944   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:50:49,946    INFO [INIT] Marking all workers as offline
2019-10-31 12:50:49,975    INFO [INIT] LAVA master has started.
2019-10-31 12:50:49,976    INFO [INIT] Using protocol version 3
2019-10-31 12:50:58,906   DEBUG lava-logs => PING(20)
2019-10-31 12:51:05,798   DEBUG Dhanu => PING(20)
2019-10-31 12:51:05,800 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:51:09,981    INFO scheduling health checks:
2019-10-31 12:51:10,019    INFO scheduling jobs:
2019-10-31 12:51:10,022   DEBUG - qemu
2019-10-31 12:51:10,096   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:51:10,097   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:51:10,101    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:51:11,369    INFO [INIT] Dropping privileges
2019-10-31 12:51:11,370   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:51:11,370   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:51:11,371    INFO [INIT] Marking all workers as offline
2019-10-31 12:51:11,411    INFO [INIT] LAVA master has started.
2019-10-31 12:51:11,412    INFO [INIT] Using protocol version 3
2019-10-31 12:51:18,918   DEBUG lava-logs => PING(20)
2019-10-31 12:51:25,818   DEBUG Dhanu => PING(20)
2019-10-31 12:51:25,818 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:51:31,417    INFO scheduling health checks:
2019-10-31 12:51:31,477    INFO scheduling jobs:
2019-10-31 12:51:31,479   DEBUG - qemu
2019-10-31 12:51:31,558   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:51:31,558   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:51:31,562    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:51:32,915    INFO [INIT] Dropping privileges
2019-10-31 12:51:32,915   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:51:32,915   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:51:32,917    INFO [INIT] Marking all workers as offline
2019-10-31 12:51:32,945    INFO [INIT] LAVA master has started.
2019-10-31 12:51:32,946    INFO [INIT] Using protocol version 3
2019-10-31 12:51:38,937   DEBUG lava-logs => PING(20)
2019-10-31 12:51:45,833   DEBUG Dhanu => PING(20)
2019-10-31 12:51:45,833 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:51:52,953    INFO scheduling health checks:
2019-10-31 12:51:52,990    INFO scheduling jobs:
2019-10-31 12:51:52,993   DEBUG - qemu
2019-10-31 12:51:53,065   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:51:53,065   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:51:53,070    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:51:54,349    INFO [INIT] Dropping privileges
2019-10-31 12:51:54,350   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:51:54,350   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:51:54,351    INFO [INIT] Marking all workers as offline
2019-10-31 12:51:54,437    INFO [INIT] LAVA master has started.
2019-10-31 12:51:54,438    INFO [INIT] Using protocol version 3
2019-10-31 12:51:58,954   DEBUG lava-logs => PING(20)
2019-10-31 12:52:05,851   DEBUG Dhanu => PING(20)
2019-10-31 12:52:05,852 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:52:14,447    INFO scheduling health checks:
2019-10-31 12:52:14,481    INFO scheduling jobs:
2019-10-31 12:52:14,483   DEBUG - qemu
2019-10-31 12:52:14,555   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:52:14,555   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:52:14,559    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:52:15,750    INFO [INIT] Dropping privileges
2019-10-31 12:52:15,750   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:52:15,750   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:52:15,752    INFO [INIT] Marking all workers as offline
2019-10-31 12:52:15,793    INFO [INIT] LAVA master has started.
2019-10-31 12:52:15,794    INFO [INIT] Using protocol version 3
2019-10-31 12:52:18,971   DEBUG lava-logs => PING(20)
2019-10-31 12:52:25,871   DEBUG Dhanu => PING(20)
2019-10-31 12:52:25,872 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:52:35,803    INFO scheduling health checks:
2019-10-31 12:52:35,839    INFO scheduling jobs:
2019-10-31 12:52:35,842   DEBUG - qemu
2019-10-31 12:52:35,914   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:52:35,915   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:52:35,919    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:52:37,095    INFO [INIT] Dropping privileges
2019-10-31 12:52:37,095   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:52:37,095   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:52:37,097    INFO [INIT] Marking all workers as offline
2019-10-31 12:52:37,130    INFO [INIT] LAVA master has started.
2019-10-31 12:52:37,130    INFO [INIT] Using protocol version 3
2019-10-31 12:52:38,985   DEBUG lava-logs => PING(20)
2019-10-31 12:52:45,894   DEBUG Dhanu => PING(20)
2019-10-31 12:52:45,895 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:52:57,141    INFO scheduling health checks:
2019-10-31 12:52:57,174    INFO scheduling jobs:
2019-10-31 12:52:57,177   DEBUG - qemu
2019-10-31 12:52:57,250   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:52:57,250   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:52:57,254    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:52:58,341    INFO [INIT] Dropping privileges
2019-10-31 12:52:58,341   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:52:58,341   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:52:58,343    INFO [INIT] Marking all workers as offline
2019-10-31 12:52:58,376    INFO [INIT] LAVA master has started.
2019-10-31 12:52:58,376    INFO [INIT] Using protocol version 3
2019-10-31 12:52:59,000   DEBUG lava-logs => PING(20)
2019-10-31 12:53:05,913   DEBUG Dhanu => PING(20)
2019-10-31 12:53:05,913 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:53:18,389    INFO scheduling health checks:
2019-10-31 12:53:18,421    INFO scheduling jobs:
2019-10-31 12:53:18,423   DEBUG - qemu
2019-10-31 12:53:18,496   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:53:18,496   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:53:18,501    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:53:19,587    INFO [INIT] Dropping privileges
2019-10-31 12:53:19,587   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:53:19,587   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:53:19,589    INFO [INIT] Marking all workers as offline
2019-10-31 12:53:19,634    INFO [INIT] LAVA master has started.
2019-10-31 12:53:19,634    INFO [INIT] Using protocol version 3
2019-10-31 12:53:19,688   DEBUG lava-logs => PING(20)
2019-10-31 12:53:25,931   DEBUG Dhanu => PING(20)
2019-10-31 12:53:25,932 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:53:39,648    INFO scheduling health checks:
2019-10-31 12:53:39,678    INFO scheduling jobs:
2019-10-31 12:53:39,680   DEBUG - qemu
2019-10-31 12:53:39,757   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:53:39,757   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:53:39,761    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:53:40,834    INFO [INIT] Dropping privileges
2019-10-31 12:53:40,834   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:53:40,834   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:53:40,836    INFO [INIT] Marking all workers as offline
2019-10-31 12:53:40,904    INFO [INIT] LAVA master has started.
2019-10-31 12:53:40,904    INFO [INIT] Using protocol version 3
2019-10-31 12:53:45,953   DEBUG Dhanu => PING(20)
2019-10-31 12:53:45,954 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:53:59,731   DEBUG lava-logs => PING(20)
2019-10-31 12:54:00,905    INFO scheduling health checks:
2019-10-31 12:54:00,925    INFO scheduling jobs:
2019-10-31 12:54:00,926   DEBUG - qemu
2019-10-31 12:54:00,991   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:54:00,991   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:54:01,001    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:54:02,095    INFO [INIT] Dropping privileges
2019-10-31 12:54:02,096   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:54:02,096   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:54:02,098    INFO [INIT] Marking all workers as offline
2019-10-31 12:54:02,162    INFO [INIT] LAVA master has started.
2019-10-31 12:54:02,163    INFO [INIT] Using protocol version 3
2019-10-31 12:54:05,974   DEBUG Dhanu => PING(20)
2019-10-31 12:54:05,974 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:54:19,748   DEBUG lava-logs => PING(20)
2019-10-31 12:54:22,166    INFO scheduling health checks:
2019-10-31 12:54:22,194    INFO scheduling jobs:
2019-10-31 12:54:22,195   DEBUG - qemu
2019-10-31 12:54:22,262   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:54:22,262   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:54:22,277    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:54:23,345    INFO [INIT] Dropping privileges
2019-10-31 12:54:23,345   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:54:23,346   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:54:23,347    INFO [INIT] Marking all workers as offline
2019-10-31 12:54:23,384    INFO [INIT] LAVA master has started.
2019-10-31 12:54:23,385    INFO [INIT] Using protocol version 3
2019-10-31 12:54:25,994   DEBUG Dhanu => PING(20)
2019-10-31 12:54:25,995 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:54:39,766   DEBUG lava-logs => PING(20)
2019-10-31 12:54:43,388    INFO scheduling health checks:
2019-10-31 12:54:43,418    INFO scheduling jobs:
2019-10-31 12:54:43,420   DEBUG - qemu
2019-10-31 12:54:43,493   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:54:43,493   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:54:43,502    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:54:44,588    INFO [INIT] Dropping privileges
2019-10-31 12:54:44,588   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:54:44,588   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:54:44,590    INFO [INIT] Marking all workers as offline
2019-10-31 12:54:44,620    INFO [INIT] LAVA master has started.
2019-10-31 12:54:44,621    INFO [INIT] Using protocol version 3
2019-10-31 12:54:46,015   DEBUG Dhanu => PING(20)
2019-10-31 12:54:46,015 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:54:59,783   DEBUG lava-logs => PING(20)
2019-10-31 12:55:04,626    INFO scheduling health checks:
2019-10-31 12:55:04,654    INFO scheduling jobs:
2019-10-31 12:55:04,656   DEBUG - qemu
2019-10-31 12:55:04,729   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:55:04,729   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:55:04,734    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:55:05,850    INFO [INIT] Dropping privileges
2019-10-31 12:55:05,850   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:55:05,850   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:55:05,852    INFO [INIT] Marking all workers as offline
2019-10-31 12:55:05,888    INFO [INIT] LAVA master has started.
2019-10-31 12:55:05,888    INFO [INIT] Using protocol version 3
2019-10-31 12:55:06,031   DEBUG Dhanu => PING(20)
2019-10-31 12:55:06,031 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:55:19,800   DEBUG lava-logs => PING(20)
2019-10-31 12:55:25,895    INFO scheduling health checks:
2019-10-31 12:55:25,934    INFO scheduling jobs:
2019-10-31 12:55:25,936   DEBUG - qemu
2019-10-31 12:55:26,008   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:55:26,008   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:55:26,013    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:55:27,093    INFO [INIT] Dropping privileges
2019-10-31 12:55:27,093   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:55:27,093   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:55:27,095    INFO [INIT] Marking all workers as offline
2019-10-31 12:55:27,124    INFO [INIT] LAVA master has started.
2019-10-31 12:55:27,124    INFO [INIT] Using protocol version 3
2019-10-31 12:55:27,208   DEBUG Dhanu => PING(20)
2019-10-31 12:55:27,209 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:55:39,816   DEBUG lava-logs => PING(20)
2019-10-31 12:55:47,129    INFO scheduling health checks:
2019-10-31 12:55:47,169    INFO scheduling jobs:
2019-10-31 12:55:47,171   DEBUG - qemu
2019-10-31 12:55:47,238   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:55:47,238   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:55:47,243    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:55:48,350    INFO [INIT] Dropping privileges
2019-10-31 12:55:48,350   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:55:48,350   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:55:48,352    INFO [INIT] Marking all workers as offline
2019-10-31 12:55:48,382    INFO [INIT] LAVA master has started.
2019-10-31 12:55:48,382    INFO [INIT] Using protocol version 3
2019-10-31 12:55:59,830   DEBUG lava-logs => PING(20)
2019-10-31 12:56:07,251   DEBUG Dhanu => PING(20)
2019-10-31 12:56:07,252 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:56:08,383    INFO scheduling health checks:
2019-10-31 12:56:08,404    INFO scheduling jobs:
2019-10-31 12:56:08,406   DEBUG - qemu
2019-10-31 12:56:08,475   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:56:08,476   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:56:08,480    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:56:09,596    INFO [INIT] Dropping privileges
2019-10-31 12:56:09,596   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:56:09,596   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:56:09,597    INFO [INIT] Marking all workers as offline
2019-10-31 12:56:09,640    INFO [INIT] LAVA master has started.
2019-10-31 12:56:09,641    INFO [INIT] Using protocol version 3
2019-10-31 12:56:19,843   DEBUG lava-logs => PING(20)
2019-10-31 12:56:27,273   DEBUG Dhanu => PING(20)
2019-10-31 12:56:27,274 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:56:29,643    INFO scheduling health checks:
2019-10-31 12:56:29,662    INFO scheduling jobs:
2019-10-31 12:56:29,663   DEBUG - qemu
2019-10-31 12:56:29,734   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:56:29,734   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:56:29,739    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:56:30,976    INFO [INIT] Dropping privileges
2019-10-31 12:56:30,976   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:56:30,976   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:56:30,978    INFO [INIT] Marking all workers as offline
2019-10-31 12:56:31,010    INFO [INIT] LAVA master has started.
2019-10-31 12:56:31,010    INFO [INIT] Using protocol version 3
2019-10-31 12:56:39,864   DEBUG lava-logs => PING(20)
2019-10-31 12:56:47,294   DEBUG Dhanu => PING(20)
2019-10-31 12:56:47,294 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:56:51,013    INFO scheduling health checks:
2019-10-31 12:56:51,042    INFO scheduling jobs:
2019-10-31 12:56:51,044   DEBUG - qemu
2019-10-31 12:56:51,118   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:56:51,118   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:56:51,126    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:56:52,334    INFO [INIT] Dropping privileges
2019-10-31 12:56:52,335   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:56:52,335   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:56:52,337    INFO [INIT] Marking all workers as offline
2019-10-31 12:56:52,389    INFO [INIT] LAVA master has started.
2019-10-31 12:56:52,390    INFO [INIT] Using protocol version 3
2019-10-31 12:56:59,885   DEBUG lava-logs => PING(20)
2019-10-31 12:57:07,315   DEBUG Dhanu => PING(20)
2019-10-31 12:57:07,316 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:57:12,395    INFO scheduling health checks:
2019-10-31 12:57:12,433    INFO scheduling jobs:
2019-10-31 12:57:12,435   DEBUG - qemu
2019-10-31 12:57:12,510   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:57:12,510   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:57:12,518    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:57:13,588    INFO [INIT] Dropping privileges
2019-10-31 12:57:13,588   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:57:13,588   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:57:13,590    INFO [INIT] Marking all workers as offline
2019-10-31 12:57:13,635    INFO [INIT] LAVA master has started.
2019-10-31 12:57:13,636    INFO [INIT] Using protocol version 3
2019-10-31 12:57:19,902   DEBUG lava-logs => PING(20)
2019-10-31 12:57:27,339   DEBUG Dhanu => PING(20)
2019-10-31 12:57:27,339 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:57:33,642    INFO scheduling health checks:
2019-10-31 12:57:33,680    INFO scheduling jobs:
2019-10-31 12:57:33,683   DEBUG - qemu
2019-10-31 12:57:33,757   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:57:33,757   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:57:33,766    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:57:34,850    INFO [INIT] Dropping privileges
2019-10-31 12:57:34,850   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:57:34,850   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:57:34,852    INFO [INIT] Marking all workers as offline
2019-10-31 12:57:34,881    INFO [INIT] LAVA master has started.
2019-10-31 12:57:34,881    INFO [INIT] Using protocol version 3
2019-10-31 12:57:39,918   DEBUG lava-logs => PING(20)
2019-10-31 12:57:47,360   DEBUG Dhanu => PING(20)
2019-10-31 12:57:47,361 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:57:54,889    INFO scheduling health checks:
2019-10-31 12:57:54,926    INFO scheduling jobs:
2019-10-31 12:57:54,928   DEBUG - qemu
2019-10-31 12:57:54,994   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:57:54,994   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:57:54,999    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:57:56,080    INFO [INIT] Dropping privileges
2019-10-31 12:57:56,080   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:57:56,080   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:57:56,082    INFO [INIT] Marking all workers as offline
2019-10-31 12:57:56,106    INFO [INIT] LAVA master has started.
2019-10-31 12:57:56,106    INFO [INIT] Using protocol version 3
2019-10-31 12:57:59,934   DEBUG lava-logs => PING(20)
2019-10-31 12:58:07,381   DEBUG Dhanu => PING(20)
2019-10-31 12:58:07,381 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:58:16,115    INFO scheduling health checks:
2019-10-31 12:58:16,139    INFO scheduling jobs:
2019-10-31 12:58:16,142   DEBUG - qemu
2019-10-31 12:58:16,215   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:58:16,215   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:58:16,219    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:58:17,343    INFO [INIT] Dropping privileges
2019-10-31 12:58:17,343   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:58:17,343   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:58:17,344    INFO [INIT] Marking all workers as offline
2019-10-31 12:58:17,375    INFO [INIT] LAVA master has started.
2019-10-31 12:58:17,376    INFO [INIT] Using protocol version 3
2019-10-31 12:58:19,950   DEBUG lava-logs => PING(20)
2019-10-31 12:58:27,397   DEBUG Dhanu => PING(20)
2019-10-31 12:58:27,397 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:58:37,386    INFO scheduling health checks:
2019-10-31 12:58:37,408    INFO scheduling jobs:
2019-10-31 12:58:37,410   DEBUG - qemu
2019-10-31 12:58:37,479   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:58:37,479   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:58:37,484    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:58:38,586    INFO [INIT] Dropping privileges
2019-10-31 12:58:38,587   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:58:38,587   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:58:38,589    INFO [INIT] Marking all workers as offline
2019-10-31 12:58:38,645    INFO [INIT] LAVA master has started.
2019-10-31 12:58:38,646    INFO [INIT] Using protocol version 3
2019-10-31 12:58:39,956   DEBUG lava-logs => PING(20)
2019-10-31 12:58:47,416   DEBUG Dhanu => PING(20)
2019-10-31 12:58:47,416 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:58:58,657    INFO scheduling health checks:
2019-10-31 12:58:58,688    INFO scheduling jobs:
2019-10-31 12:58:58,690   DEBUG - qemu
2019-10-31 12:58:58,760   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:58:58,760   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:58:58,764    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:58:59,846    INFO [INIT] Dropping privileges
2019-10-31 12:58:59,846   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:58:59,846   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:58:59,848    INFO [INIT] Marking all workers as offline
2019-10-31 12:58:59,891    INFO [INIT] LAVA master has started.
2019-10-31 12:58:59,891    INFO [INIT] Using protocol version 3
2019-10-31 12:58:59,970   DEBUG lava-logs => PING(20)
2019-10-31 12:59:07,434   DEBUG Dhanu => PING(20)
2019-10-31 12:59:07,435 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:59:19,901    INFO scheduling health checks:
2019-10-31 12:59:19,934    INFO scheduling jobs:
2019-10-31 12:59:19,936   DEBUG - qemu
2019-10-31 12:59:20,010   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:59:20,010   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:59:20,015    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:59:21,089    INFO [INIT] Dropping privileges
2019-10-31 12:59:21,089   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:59:21,089   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:59:21,091    INFO [INIT] Marking all workers as offline
2019-10-31 12:59:21,115    INFO [INIT] LAVA master has started.
2019-10-31 12:59:21,115    INFO [INIT] Using protocol version 3
2019-10-31 12:59:27,446   DEBUG Dhanu => PING(20)
2019-10-31 12:59:27,447 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 12:59:40,010   DEBUG lava-logs => PING(20)
2019-10-31 12:59:41,117    INFO scheduling health checks:
2019-10-31 12:59:41,136    INFO scheduling jobs:
2019-10-31 12:59:41,138   DEBUG - qemu
2019-10-31 12:59:41,207   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 12:59:41,207   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 12:59:41,211    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:59:42,365    INFO [INIT] Dropping privileges
2019-10-31 12:59:42,365   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:59:42,365   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:59:42,366    INFO [INIT] Marking all workers as offline
2019-10-31 12:59:42,395    INFO [INIT] LAVA master has started.
2019-10-31 12:59:42,395    INFO [INIT] Using protocol version 3
2019-10-31 12:59:47,460   DEBUG Dhanu => PING(20)
2019-10-31 12:59:47,460 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 13:00:00,031   DEBUG lava-logs => PING(20)
2019-10-31 13:00:02,398    INFO scheduling health checks:
2019-10-31 13:00:02,428    INFO scheduling jobs:
2019-10-31 13:00:02,430   DEBUG - qemu
2019-10-31 13:00:02,503   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 13:00:02,503   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 13:00:02,508    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 13:00:03,582    INFO [INIT] Dropping privileges
2019-10-31 13:00:03,583   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 13:00:03,583   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 13:00:03,584    INFO [INIT] Marking all workers as offline
2019-10-31 13:00:03,630    INFO [INIT] LAVA master has started.
2019-10-31 13:00:03,630    INFO [INIT] Using protocol version 3
2019-10-31 13:00:07,482   DEBUG Dhanu => PING(20)
2019-10-31 13:00:07,483 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 13:00:20,049   DEBUG lava-logs => PING(20)
2019-10-31 13:00:23,634    INFO scheduling health checks:
2019-10-31 13:00:23,686    INFO scheduling jobs:
2019-10-31 13:00:23,689   DEBUG - qemu
2019-10-31 13:00:23,762   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 13:00:23,762   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 13:00:23,767    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 13:00:24,840    INFO [INIT] Dropping privileges
2019-10-31 13:00:24,840   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 13:00:24,840   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 13:00:24,842    INFO [INIT] Marking all workers as offline
2019-10-31 13:00:24,888    INFO [INIT] LAVA master has started.
2019-10-31 13:00:24,888    INFO [INIT] Using protocol version 3
2019-10-31 13:00:27,504   DEBUG Dhanu => PING(20)
2019-10-31 13:00:27,504 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 13:00:40,067   DEBUG lava-logs => PING(20)
2019-10-31 13:00:44,893    INFO scheduling health checks:
2019-10-31 13:00:44,921    INFO scheduling jobs:
2019-10-31 13:00:44,922   DEBUG - qemu
2019-10-31 13:00:44,994   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 13:00:44,994   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 13:00:44,999    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 13:00:46,084    INFO [INIT] Dropping privileges
2019-10-31 13:00:46,085   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 13:00:46,085   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 13:00:46,086    INFO [INIT] Marking all workers as offline
2019-10-31 13:00:46,134    INFO [INIT] LAVA master has started.
2019-10-31 13:00:46,135    INFO [INIT] Using protocol version 3
2019-10-31 13:00:47,523   DEBUG Dhanu => PING(20)
2019-10-31 13:00:47,524 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 13:01:00,084   DEBUG lava-logs => PING(20)
2019-10-31 13:01:06,141    INFO scheduling health checks:
2019-10-31 13:01:06,178    INFO scheduling jobs:
2019-10-31 13:01:06,182   DEBUG - qemu
2019-10-31 13:01:06,255   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 13:01:06,255   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 13:01:06,259    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 13:01:07,349    INFO [INIT] Dropping privileges
2019-10-31 13:01:07,349   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 13:01:07,349   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 13:01:07,351    INFO [INIT] Marking all workers as offline
2019-10-31 13:01:07,380    INFO [INIT] LAVA master has started.
2019-10-31 13:01:07,380    INFO [INIT] Using protocol version 3
2019-10-31 13:01:07,542   DEBUG Dhanu => PING(20)
2019-10-31 13:01:07,543 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 13:01:20,100   DEBUG lava-logs => PING(20)
2019-10-31 13:01:27,388    INFO scheduling health checks:
2019-10-31 13:01:27,425    INFO scheduling jobs:
2019-10-31 13:01:27,428   DEBUG - qemu
2019-10-31 13:01:27,503   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 13:01:27,503   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 13:01:27,508    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 13:01:28,606    INFO [INIT] Dropping privileges
2019-10-31 13:01:28,606   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 13:01:28,606   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 13:01:28,608    INFO [INIT] Marking all workers as offline
2019-10-31 13:01:28,638    INFO [INIT] LAVA master has started.
2019-10-31 13:01:28,638    INFO [INIT] Using protocol version 3
2019-10-31 13:01:28,716   DEBUG Dhanu => PING(20)
2019-10-31 13:01:28,717 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 13:01:40,114   DEBUG lava-logs => PING(20)
2019-10-31 13:01:48,645    INFO scheduling health checks:
2019-10-31 13:01:48,671    INFO scheduling jobs:
2019-10-31 13:01:48,673   DEBUG - qemu
2019-10-31 13:01:48,737   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 13:01:48,738   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 13:01:48,742    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 13:01:49,840    INFO [INIT] Dropping privileges
2019-10-31 13:01:49,840   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 13:01:49,840   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 13:01:49,842    INFO [INIT] Marking all workers as offline
2019-10-31 13:01:49,874    INFO [INIT] LAVA master has started.
2019-10-31 13:01:49,874    INFO [INIT] Using protocol version 3
2019-10-31 13:02:00,127   DEBUG lava-logs => PING(20)
2019-10-31 13:02:08,762   DEBUG Dhanu => PING(20)
2019-10-31 13:02:08,762 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 13:02:09,875    INFO scheduling health checks:
2019-10-31 13:02:09,907    INFO scheduling jobs:
2019-10-31 13:02:09,909   DEBUG - qemu
2019-10-31 13:02:09,984   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 13:02:09,984   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 13:02:09,988    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 13:02:11,100    INFO [INIT] Dropping privileges
2019-10-31 13:02:11,100   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 13:02:11,100   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 13:02:11,102    INFO [INIT] Marking all workers as offline
2019-10-31 13:02:11,132    INFO [INIT] LAVA master has started.
2019-10-31 13:02:11,132    INFO [INIT] Using protocol version 3
2019-10-31 13:02:20,148   DEBUG lava-logs => PING(20)
2019-10-31 13:02:28,783   DEBUG Dhanu => PING(20)
2019-10-31 13:02:28,784 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 13:02:31,135    INFO scheduling health checks:
2019-10-31 13:02:31,176    INFO scheduling jobs:
2019-10-31 13:02:31,179   DEBUG - qemu
2019-10-31 13:02:31,249   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 13:02:31,249   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 13:02:31,259    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 13:02:32,342    INFO [INIT] Dropping privileges
2019-10-31 13:02:32,342   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 13:02:32,342   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 13:02:32,344    INFO [INIT] Marking all workers as offline
2019-10-31 13:02:32,377    INFO [INIT] LAVA master has started.
2019-10-31 13:02:32,378    INFO [INIT] Using protocol version 3
2019-10-31 13:02:40,169   DEBUG lava-logs => PING(20)
2019-10-31 13:02:48,802   DEBUG Dhanu => PING(20)
2019-10-31 13:02:48,803 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 13:02:52,381    INFO scheduling health checks:
2019-10-31 13:02:52,433    INFO scheduling jobs:
2019-10-31 13:02:52,435   DEBUG - qemu
2019-10-31 13:02:52,509   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 13:02:52,510   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 13:02:52,517    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 13:02:53,590    INFO [INIT] Dropping privileges
2019-10-31 13:02:53,590   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 13:02:53,590   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 13:02:53,592    INFO [INIT] Marking all workers as offline
2019-10-31 13:02:53,625    INFO [INIT] LAVA master has started.
2019-10-31 13:02:53,625    INFO [INIT] Using protocol version 3
2019-10-31 13:03:00,188   DEBUG lava-logs => PING(20)
2019-10-31 13:03:08,822   DEBUG Dhanu => PING(20)
2019-10-31 13:03:08,822 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 13:03:13,631    INFO scheduling health checks:
2019-10-31 13:03:13,658    INFO scheduling jobs:
2019-10-31 13:03:13,660   DEBUG - qemu
2019-10-31 13:03:13,732   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 13:03:13,733   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 13:03:13,744    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 13:03:14,863    INFO [INIT] Dropping privileges
2019-10-31 13:03:14,863   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 13:03:14,863   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 13:03:14,865    INFO [INIT] Marking all workers as offline
2019-10-31 13:03:14,893    INFO [INIT] LAVA master has started.
2019-10-31 13:03:14,894    INFO [INIT] Using protocol version 3
2019-10-31 13:03:20,204   DEBUG lava-logs => PING(20)
2019-10-31 13:03:28,844   DEBUG Dhanu => PING(20)
2019-10-31 13:03:28,845 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 13:03:34,900    INFO scheduling health checks:
2019-10-31 13:03:34,938    INFO scheduling jobs:
2019-10-31 13:03:34,941   DEBUG - qemu
2019-10-31 13:03:35,014   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 13:03:35,014   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 13:03:35,018    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 13:03:36,097    INFO [INIT] Dropping privileges
2019-10-31 13:03:36,097   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 13:03:36,097   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 13:03:36,099    INFO [INIT] Marking all workers as offline
2019-10-31 13:03:36,163    INFO [INIT] LAVA master has started.
2019-10-31 13:03:36,163    INFO [INIT] Using protocol version 3
2019-10-31 13:03:40,221   DEBUG lava-logs => PING(20)
2019-10-31 13:03:48,861   DEBUG Dhanu => PING(20)
2019-10-31 13:03:48,862 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 13:03:56,169    INFO scheduling health checks:
2019-10-31 13:03:56,206    INFO scheduling jobs:
2019-10-31 13:03:56,208   DEBUG - qemu
2019-10-31 13:03:56,276   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 13:03:56,276   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 13:03:56,281    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 13:03:57,342    INFO [INIT] Dropping privileges
2019-10-31 13:03:57,343   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 13:03:57,343   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 13:03:57,344    INFO [INIT] Marking all workers as offline
2019-10-31 13:03:57,387    INFO [INIT] LAVA master has started.
2019-10-31 13:03:57,387    INFO [INIT] Using protocol version 3
2019-10-31 13:04:00,234   DEBUG lava-logs => PING(20)
2019-10-31 13:04:08,879   DEBUG Dhanu => PING(20)
2019-10-31 13:04:08,880 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 13:04:17,396    INFO scheduling health checks:
2019-10-31 13:04:17,431    INFO scheduling jobs:
2019-10-31 13:04:17,433   DEBUG - qemu
2019-10-31 13:04:17,507   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 13:04:17,507   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 13:04:17,511    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 13:04:18,600    INFO [INIT] Dropping privileges
2019-10-31 13:04:18,600   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 13:04:18,600   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 13:04:18,602    INFO [INIT] Marking all workers as offline
2019-10-31 13:04:18,667    INFO [INIT] LAVA master has started.
2019-10-31 13:04:18,667    INFO [INIT] Using protocol version 3
2019-10-31 13:04:20,249   DEBUG lava-logs => PING(20)
2019-10-31 13:04:28,899   DEBUG Dhanu => PING(20)
2019-10-31 13:04:28,899 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 13:04:38,677    INFO scheduling health checks:
2019-10-31 13:04:38,711    INFO scheduling jobs:
2019-10-31 13:04:38,713   DEBUG - qemu
2019-10-31 13:04:38,787   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 13:04:38,788   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 13:04:38,792    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 13:04:40,090    INFO [INIT] Dropping privileges
2019-10-31 13:04:40,090   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 13:04:40,090   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 13:04:40,092    INFO [INIT] Marking all workers as offline
2019-10-31 13:04:40,124    INFO [INIT] LAVA master has started.
2019-10-31 13:04:40,125    INFO [INIT] Using protocol version 3
2019-10-31 13:04:40,262   DEBUG lava-logs => PING(20)
2019-10-31 13:04:48,920   DEBUG Dhanu => PING(20)
2019-10-31 13:04:48,920 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 13:05:00,136    INFO scheduling health checks:
2019-10-31 13:05:00,168    INFO scheduling jobs:
2019-10-31 13:05:00,170   DEBUG - qemu
2019-10-31 13:05:00,242   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 13:05:00,242   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 13:05:00,252    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 13:05:01,351    INFO [INIT] Dropping privileges
2019-10-31 13:05:01,351   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 13:05:01,351   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 13:05:01,353    INFO [INIT] Marking all workers as offline
2019-10-31 13:05:01,381    INFO [INIT] LAVA master has started.
2019-10-31 13:05:01,381    INFO [INIT] Using protocol version 3
2019-10-31 13:05:01,467   DEBUG lava-logs => PING(20)
2019-10-31 13:05:08,941   DEBUG Dhanu => PING(20)
2019-10-31 13:05:08,942 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 13:05:21,394    INFO scheduling health checks:
2019-10-31 13:05:21,426    INFO scheduling jobs:
2019-10-31 13:05:21,428   DEBUG - qemu
2019-10-31 13:05:21,502   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 13:05:21,502   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 13:05:21,507    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 13:05:22,593    INFO [INIT] Dropping privileges
2019-10-31 13:05:22,593   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 13:05:22,593   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 13:05:22,595    INFO [INIT] Marking all workers as offline
2019-10-31 13:05:22,629    INFO [INIT] LAVA master has started.
2019-10-31 13:05:22,629    INFO [INIT] Using protocol version 3
2019-10-31 13:05:28,961   DEBUG Dhanu => PING(20)
2019-10-31 13:05:28,962 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 13:05:41,510   DEBUG lava-logs => PING(20)
2019-10-31 13:05:42,631    INFO scheduling health checks:
2019-10-31 13:05:42,650    INFO scheduling jobs:
2019-10-31 13:05:42,651   DEBUG - qemu
2019-10-31 13:05:42,722   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 13:05:42,722   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 13:05:42,726    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 13:05:43,853    INFO [INIT] Dropping privileges
2019-10-31 13:05:43,853   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 13:05:43,853   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 13:05:43,855    INFO [INIT] Marking all workers as offline
2019-10-31 13:05:43,886    INFO [INIT] LAVA master has started.
2019-10-31 13:05:43,886    INFO [INIT] Using protocol version 3
2019-10-31 13:05:48,985   DEBUG Dhanu => PING(20)
2019-10-31 13:05:48,986 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 13:06:01,531   DEBUG lava-logs => PING(20)
2019-10-31 13:06:03,889    INFO scheduling health checks:
2019-10-31 13:06:03,952    INFO scheduling jobs:
2019-10-31 13:06:03,956   DEBUG - qemu
2019-10-31 13:06:04,030   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 13:06:04,031   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 13:06:04,035    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 13:06:05,113    INFO [INIT] Dropping privileges
2019-10-31 13:06:05,114   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 13:06:05,114   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 13:06:05,115    INFO [INIT] Marking all workers as offline
2019-10-31 13:06:05,143    INFO [INIT] LAVA master has started.
2019-10-31 13:06:05,143    INFO [INIT] Using protocol version 3
2019-10-31 13:06:09,002   DEBUG Dhanu => PING(20)
2019-10-31 13:06:09,002 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 13:06:21,551   DEBUG lava-logs => PING(20)
2019-10-31 13:06:25,147    INFO scheduling health checks:
2019-10-31 13:06:25,177    INFO scheduling jobs:
2019-10-31 13:06:25,178   DEBUG - qemu
2019-10-31 13:06:25,248   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 13:06:25,248   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 13:06:25,252    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 13:06:26,331    INFO [INIT] Dropping privileges
2019-10-31 13:06:26,331   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 13:06:26,331   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 13:06:26,332    INFO [INIT] Marking all workers as offline
2019-10-31 13:06:26,368    INFO [INIT] LAVA master has started.
2019-10-31 13:06:26,368    INFO [INIT] Using protocol version 3
2019-10-31 13:06:29,017   DEBUG Dhanu => PING(20)
2019-10-31 13:06:29,018 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 13:06:41,568   DEBUG lava-logs => PING(20)
2019-10-31 13:06:46,373    INFO scheduling health checks:
2019-10-31 13:06:46,401    INFO scheduling jobs:
2019-10-31 13:06:46,403   DEBUG - qemu
2019-10-31 13:06:46,475   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 13:06:46,476   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 13:06:46,480    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 13:06:47,588    INFO [INIT] Dropping privileges
2019-10-31 13:06:47,589   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 13:06:47,589   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 13:06:47,591    INFO [INIT] Marking all workers as offline
2019-10-31 13:06:47,626    INFO [INIT] LAVA master has started.
2019-10-31 13:06:47,626    INFO [INIT] Using protocol version 3
2019-10-31 13:06:49,035   DEBUG Dhanu => PING(20)
2019-10-31 13:06:49,036 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 13:07:01,585   DEBUG lava-logs => PING(20)
2019-10-31 13:07:07,632    INFO scheduling health checks:
2019-10-31 13:07:07,658    INFO scheduling jobs:
2019-10-31 13:07:07,660   DEBUG - qemu
2019-10-31 13:07:07,732   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 13:07:07,732   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 13:07:07,737    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 13:07:08,835    INFO [INIT] Dropping privileges
2019-10-31 13:07:08,835   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 13:07:08,835   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 13:07:08,837    INFO [INIT] Marking all workers as offline
2019-10-31 13:07:08,871    INFO [INIT] LAVA master has started.
2019-10-31 13:07:08,871    INFO [INIT] Using protocol version 3
2019-10-31 13:07:09,064   DEBUG Dhanu => PING(20)
2019-10-31 13:07:09,065 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 13:07:21,598   DEBUG lava-logs => PING(20)
2019-10-31 13:07:28,879    INFO scheduling health checks:
2019-10-31 13:07:28,905    INFO scheduling jobs:
2019-10-31 13:07:28,907   DEBUG - qemu
2019-10-31 13:07:28,979   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 13:07:28,979   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 13:07:28,983    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 13:07:30,080    INFO [INIT] Dropping privileges
2019-10-31 13:07:30,080   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 13:07:30,080   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 13:07:30,082    INFO [INIT] Marking all workers as offline
2019-10-31 13:07:30,107    INFO [INIT] LAVA master has started.
2019-10-31 13:07:30,107    INFO [INIT] Using protocol version 3
2019-10-31 13:07:30,124   DEBUG Dhanu => PING(20)
2019-10-31 13:07:30,124 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 13:07:41,612   DEBUG lava-logs => PING(20)
2019-10-31 13:07:50,116    INFO scheduling health checks:
2019-10-31 13:07:50,140    INFO scheduling jobs:
2019-10-31 13:07:50,142   DEBUG - qemu
2019-10-31 13:07:50,211   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 13:07:50,212   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 13:07:50,216    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 13:07:51,333    INFO [INIT] Dropping privileges
2019-10-31 13:07:51,333   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 13:07:51,333   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 13:07:51,335    INFO [INIT] Marking all workers as offline
2019-10-31 13:07:51,365    INFO [INIT] LAVA master has started.
2019-10-31 13:07:51,365    INFO [INIT] Using protocol version 3
2019-10-31 13:08:01,625   DEBUG lava-logs => PING(20)
2019-10-31 13:08:10,169   DEBUG Dhanu => PING(20)
2019-10-31 13:08:10,170 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 13:08:11,366    INFO scheduling health checks:
2019-10-31 13:08:11,398    INFO scheduling jobs:
2019-10-31 13:08:11,399   DEBUG - qemu
2019-10-31 13:08:11,469   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 13:08:11,469   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 13:08:11,474    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 13:08:12,602    INFO [INIT] Dropping privileges
2019-10-31 13:08:12,603   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 13:08:12,603   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 13:08:12,604    INFO [INIT] Marking all workers as offline
2019-10-31 13:08:12,668    INFO [INIT] LAVA master has started.
2019-10-31 13:08:12,668    INFO [INIT] Using protocol version 3
2019-10-31 13:08:21,644   DEBUG lava-logs => PING(20)
2019-10-31 13:08:30,191   DEBUG Dhanu => PING(20)
2019-10-31 13:08:30,191 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 13:08:32,669    INFO scheduling health checks:
2019-10-31 13:08:32,700    INFO scheduling jobs:
2019-10-31 13:08:32,702   DEBUG - qemu
2019-10-31 13:08:32,775   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 13:08:32,775   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 13:08:32,779    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 13:08:33,848    INFO [INIT] Dropping privileges
2019-10-31 13:08:33,848   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 13:08:33,848   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 13:08:33,850    INFO [INIT] Marking all workers as offline
2019-10-31 13:08:33,880    INFO [INIT] LAVA master has started.
2019-10-31 13:08:33,880    INFO [INIT] Using protocol version 3
2019-10-31 13:08:41,665   DEBUG lava-logs => PING(20)
2019-10-31 13:08:50,212   DEBUG Dhanu => PING(20)
2019-10-31 13:08:50,212 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 13:08:53,884    INFO scheduling health checks:
2019-10-31 13:08:53,936    INFO scheduling jobs:
2019-10-31 13:08:53,939   DEBUG - qemu
2019-10-31 13:08:54,006   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 13:08:54,006   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 13:08:54,011    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 13:08:55,094    INFO [INIT] Dropping privileges
2019-10-31 13:08:55,094   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 13:08:55,094   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 13:08:55,096    INFO [INIT] Marking all workers as offline
2019-10-31 13:08:55,127    INFO [INIT] LAVA master has started.
2019-10-31 13:08:55,127    INFO [INIT] Using protocol version 3
2019-10-31 13:09:01,684   DEBUG lava-logs => PING(20)
2019-10-31 13:09:10,235   DEBUG Dhanu => PING(20)
2019-10-31 13:09:10,236 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 13:09:15,131    INFO scheduling health checks:
2019-10-31 13:09:15,160    INFO scheduling jobs:
2019-10-31 13:09:15,162   DEBUG - qemu
2019-10-31 13:09:15,233   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 13:09:15,234   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 13:09:15,238    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 13:09:16,337    INFO [INIT] Dropping privileges
2019-10-31 13:09:16,337   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 13:09:16,337   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 13:09:16,339    INFO [INIT] Marking all workers as offline
2019-10-31 13:09:16,374    INFO [INIT] LAVA master has started.
2019-10-31 13:09:16,374    INFO [INIT] Using protocol version 3
2019-10-31 13:09:21,702   DEBUG lava-logs => PING(20)
2019-10-31 13:09:30,258   DEBUG Dhanu => PING(20)
2019-10-31 13:09:30,258 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 13:09:36,380    INFO scheduling health checks:
2019-10-31 13:09:36,418    INFO scheduling jobs:
2019-10-31 13:09:36,420   DEBUG - qemu
2019-10-31 13:09:36,490   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 13:09:36,490   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 13:09:36,494    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 13:09:37,596    INFO [INIT] Dropping privileges
2019-10-31 13:09:37,597   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 13:09:37,597   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 13:09:37,598    INFO [INIT] Marking all workers as offline
2019-10-31 13:09:37,631    INFO [INIT] LAVA master has started.
2019-10-31 13:09:37,631    INFO [INIT] Using protocol version 3
2019-10-31 13:09:41,718   DEBUG lava-logs => PING(20)
2019-10-31 13:09:50,277   DEBUG Dhanu => PING(20)
2019-10-31 13:09:50,277 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 13:09:57,638    INFO scheduling health checks:
2019-10-31 13:09:57,676    INFO scheduling jobs:
2019-10-31 13:09:57,679   DEBUG - qemu
2019-10-31 13:09:57,754   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 13:09:57,754   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 13:09:57,758    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 13:09:58,879    INFO [INIT] Dropping privileges
2019-10-31 13:09:58,880   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 13:09:58,880   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 13:09:58,881    INFO [INIT] Marking all workers as offline
2019-10-31 13:09:58,945    INFO [INIT] LAVA master has started.
2019-10-31 13:09:58,945    INFO [INIT] Using protocol version 3
2019-10-31 13:10:01,733   DEBUG lava-logs => PING(20)
2019-10-31 13:10:10,297   DEBUG Dhanu => PING(20)
2019-10-31 13:10:10,298 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 13:10:18,954    INFO scheduling health checks:
2019-10-31 13:10:18,989    INFO scheduling jobs:
2019-10-31 13:10:18,991   DEBUG - qemu
2019-10-31 13:10:19,063   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 13:10:19,063   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 13:10:19,067    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 13:10:20,333    INFO [INIT] Dropping privileges
2019-10-31 13:10:20,333   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 13:10:20,333   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 13:10:20,335    INFO [INIT] Marking all workers as offline
2019-10-31 13:10:20,402    INFO [INIT] LAVA master has started.
2019-10-31 13:10:20,402    INFO [INIT] Using protocol version 3
2019-10-31 13:10:21,746   DEBUG lava-logs => PING(20)
2019-10-31 13:10:30,322   DEBUG Dhanu => PING(20)
2019-10-31 13:10:30,322 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 13:10:40,413    INFO scheduling health checks:
2019-10-31 13:10:40,446    INFO scheduling jobs:
2019-10-31 13:10:40,448   DEBUG - qemu
2019-10-31 13:10:40,520   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 13:10:40,520   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 13:10:40,525    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 13:10:41,607    INFO [INIT] Dropping privileges
2019-10-31 13:10:41,607   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 13:10:41,607   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 13:10:41,609    INFO [INIT] Marking all workers as offline
2019-10-31 13:10:41,671    INFO [INIT] LAVA master has started.
2019-10-31 13:10:41,671    INFO [INIT] Using protocol version 3
2019-10-31 13:10:41,759   DEBUG lava-logs => PING(20)
2019-10-31 13:10:50,340   DEBUG Dhanu => PING(20)
2019-10-31 13:10:50,340 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 13:11:01,683    INFO scheduling health checks:
2019-10-31 13:11:01,715    INFO scheduling jobs:
2019-10-31 13:11:01,717   DEBUG - qemu
2019-10-31 13:11:01,784   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 13:11:01,784   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 13:11:01,795    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 13:11:03,097    INFO [INIT] Dropping privileges
2019-10-31 13:11:03,097   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 13:11:03,097   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 13:11:03,099    INFO [INIT] Marking all workers as offline
2019-10-31 13:11:03,128    INFO [INIT] LAVA master has started.
2019-10-31 13:11:03,128    INFO [INIT] Using protocol version 3
2019-10-31 13:11:10,361   DEBUG Dhanu => PING(20)
2019-10-31 13:11:10,362 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 13:11:21,794   DEBUG lava-logs => PING(20)
2019-10-31 13:11:23,130    INFO scheduling health checks:
2019-10-31 13:11:23,150    INFO scheduling jobs:
2019-10-31 13:11:23,151   DEBUG - qemu
2019-10-31 13:11:23,216   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 13:11:23,216   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 13:11:23,221    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 13:11:24,341    INFO [INIT] Dropping privileges
2019-10-31 13:11:24,341   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 13:11:24,341   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 13:11:24,343    INFO [INIT] Marking all workers as offline
2019-10-31 13:11:24,376    INFO [INIT] LAVA master has started.
2019-10-31 13:11:24,376    INFO [INIT] Using protocol version 3
2019-10-31 13:11:30,381   DEBUG Dhanu => PING(20)
2019-10-31 13:11:30,382 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 14:00:08,991   DEBUG Dhanu => PING(20)
2019-10-31 14:00:09,036 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 14:00:15,416   DEBUG lava-logs => PING(20)
2019-10-31 14:00:29,008   DEBUG Dhanu => PING(20)
2019-10-31 14:00:29,042    INFO scheduling health checks:
2019-10-31 14:00:29,071    INFO scheduling jobs:
2019-10-31 14:00:29,073   DEBUG - qemu
2019-10-31 14:00:29,171   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 14:00:29,171   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 14:00:29,177    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 14:00:30,610    INFO [INIT] Dropping privileges
2019-10-31 14:00:30,610   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 14:00:30,610   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 14:00:30,612    INFO [INIT] Marking all workers as offline
2019-10-31 14:00:30,642    INFO [INIT] LAVA master has started.
2019-10-31 14:00:30,643    INFO [INIT] Using protocol version 3
2019-10-31 14:00:35,433   DEBUG lava-logs => PING(20)
2019-10-31 14:00:49,026   DEBUG Dhanu => PING(20)
2019-10-31 14:00:49,026 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 14:00:50,645    INFO scheduling health checks:
2019-10-31 14:00:50,740    INFO scheduling jobs:
2019-10-31 14:00:50,743   DEBUG - qemu
2019-10-31 14:00:50,821   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 14:00:50,821   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 14:00:50,825    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 14:00:52,077    INFO [INIT] Dropping privileges
2019-10-31 14:00:52,078   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 14:00:52,078   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 14:00:52,080    INFO [INIT] Marking all workers as offline
2019-10-31 14:00:52,108    INFO [INIT] LAVA master has started.
2019-10-31 14:00:52,109    INFO [INIT] Using protocol version 3
2019-10-31 14:00:55,448   DEBUG lava-logs => PING(20)
2019-10-31 14:01:09,042   DEBUG Dhanu => PING(20)
2019-10-31 14:01:09,042 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 14:01:12,111    INFO scheduling health checks:
2019-10-31 14:01:12,143    INFO scheduling jobs:
2019-10-31 14:01:12,146   DEBUG - qemu
2019-10-31 14:01:12,241   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 14:01:12,241   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 14:01:12,250    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 14:01:13,659    INFO [INIT] Dropping privileges
2019-10-31 14:01:13,659   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 14:01:13,660   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 14:01:13,661    INFO [INIT] Marking all workers as offline
2019-10-31 14:01:13,722    INFO [INIT] LAVA master has started.
2019-10-31 14:01:13,722    INFO [INIT] Using protocol version 3
2019-10-31 14:01:15,463   DEBUG lava-logs => PING(20)
2019-10-31 14:01:29,056   DEBUG Dhanu => PING(20)
2019-10-31 14:01:29,056 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 14:01:33,723    INFO scheduling health checks:
2019-10-31 14:01:33,766    INFO scheduling jobs:
2019-10-31 14:01:33,769   DEBUG - qemu
2019-10-31 14:01:33,842   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 14:01:33,842   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 14:01:33,847    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 14:01:35,324    INFO [INIT] Dropping privileges
2019-10-31 14:01:35,324   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 14:01:35,325   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 14:01:35,326    INFO [INIT] Marking all workers as offline
2019-10-31 14:01:35,380    INFO [INIT] LAVA master has started.
2019-10-31 14:01:35,380    INFO [INIT] Using protocol version 3
2019-10-31 14:01:35,472   DEBUG lava-logs => PING(20)
2019-10-31 14:01:49,072   DEBUG Dhanu => PING(20)
2019-10-31 14:01:49,072 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 14:01:55,387    INFO scheduling health checks:
2019-10-31 14:01:55,423    INFO scheduling jobs:
2019-10-31 14:01:55,426   DEBUG - qemu
2019-10-31 14:01:55,504   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 14:01:55,504   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 14:01:55,511    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 14:01:57,034    INFO [INIT] Dropping privileges
2019-10-31 14:01:57,035   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 14:01:57,035   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 14:01:57,037    INFO [INIT] Marking all workers as offline
2019-10-31 14:01:57,071    INFO [INIT] LAVA master has started.
2019-10-31 14:01:57,071    INFO [INIT] Using protocol version 3
2019-10-31 14:02:09,090   DEBUG Dhanu => PING(20)
2019-10-31 14:02:09,090 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 14:02:15,508   DEBUG lava-logs => PING(20)
2019-10-31 14:02:17,073    INFO scheduling health checks:
2019-10-31 14:02:17,092    INFO scheduling jobs:
2019-10-31 14:02:17,095   DEBUG - qemu
2019-10-31 14:02:17,175   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 14:02:17,175   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 14:02:17,184    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 14:02:18,746    INFO [INIT] Dropping privileges
2019-10-31 14:02:18,746   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 14:02:18,746   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 14:02:18,748    INFO [INIT] Marking all workers as offline
2019-10-31 14:02:18,784    INFO [INIT] LAVA master has started.
2019-10-31 14:02:18,784    INFO [INIT] Using protocol version 3
2019-10-31 14:02:29,104   DEBUG Dhanu => PING(20)
2019-10-31 14:02:29,104 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 14:02:35,524   DEBUG lava-logs => PING(20)
2019-10-31 14:02:38,787    INFO scheduling health checks:
2019-10-31 14:02:38,816    INFO scheduling jobs:
2019-10-31 14:02:38,818   DEBUG - qemu
2019-10-31 14:02:38,903   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 14:02:38,903   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 777, in main_loop
    schedule(self.logger)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 14:02:38,908    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 14:02:40,444    INFO [INIT] Dropping privileges
2019-10-31 14:02:40,444   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 14:02:40,448   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 14:02:40,450    INFO [INIT] Marking all workers as offline
2019-10-31 14:02:40,564    INFO [INIT] LAVA master has started.
2019-10-31 14:02:40,564    INFO [INIT] Using protocol version 3
2019-10-31 14:02:49,122   DEBUG Dhanu => PING(20)
2019-10-31 14:02:49,123 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 14:02:55,540   DEBUG lava-logs => PING(20)
2019-10-31 14:03:00,571    INFO scheduling health checks:
2019-10-31 14:03:00,577    INFO scheduling jobs:
2019-10-31 14:03:09,144   DEBUG Dhanu => PING(20)
2019-10-31 14:03:15,560   DEBUG lava-logs => PING(20)
2019-10-31 14:03:20,592    INFO scheduling health checks:
2019-10-31 14:03:20,596    INFO scheduling jobs:
2019-10-31 14:03:29,160   DEBUG Dhanu => PING(20)
2019-10-31 14:03:35,583   DEBUG lava-logs => PING(20)
2019-10-31 14:03:40,611    INFO scheduling health checks:
2019-10-31 14:03:40,613    INFO scheduling jobs:
2019-10-31 14:03:49,180   DEBUG Dhanu => PING(20)
2019-10-31 14:03:55,600   DEBUG lava-logs => PING(20)
2019-10-31 14:04:00,629    INFO scheduling health checks:
2019-10-31 14:04:00,633    INFO scheduling jobs:
2019-10-31 14:04:09,199   DEBUG Dhanu => PING(20)
2019-10-31 14:04:15,620   DEBUG lava-logs => PING(20)
2019-10-31 14:04:20,650    INFO scheduling health checks:
2019-10-31 14:04:20,654    INFO scheduling jobs:
2019-10-31 14:04:29,224   DEBUG Dhanu => PING(20)
2019-10-31 14:04:35,643   DEBUG lava-logs => PING(20)
2019-10-31 14:04:40,668    INFO scheduling health checks:
2019-10-31 14:04:40,672    INFO scheduling jobs:
2019-10-31 14:04:49,248   DEBUG Dhanu => PING(20)
2019-10-31 14:04:55,666   DEBUG lava-logs => PING(20)
2019-10-31 14:05:00,684    INFO scheduling health checks:
2019-10-31 14:05:00,688    INFO scheduling jobs:
2019-10-31 14:05:09,273   DEBUG Dhanu => PING(20)
2019-10-31 14:05:15,684   DEBUG lava-logs => PING(20)
2019-10-31 14:05:20,705    INFO scheduling health checks:
2019-10-31 14:05:20,709    INFO scheduling jobs:
2019-10-31 14:05:29,297   DEBUG Dhanu => PING(20)
2019-10-31 14:05:35,707   DEBUG lava-logs => PING(20)
2019-10-31 14:05:40,725    INFO scheduling health checks:
2019-10-31 14:05:40,729    INFO scheduling jobs:
2019-10-31 14:05:49,322   DEBUG Dhanu => PING(20)
2019-10-31 14:05:55,730   DEBUG lava-logs => PING(20)
2019-10-31 14:06:00,743    INFO scheduling health checks:
2019-10-31 14:06:00,747    INFO scheduling jobs:
2019-10-31 14:06:09,346   DEBUG Dhanu => PING(20)
2019-10-31 14:06:15,753   DEBUG lava-logs => PING(20)
2019-10-31 14:06:20,762    INFO scheduling health checks:
2019-10-31 14:06:20,766    INFO scheduling jobs:
2019-10-31 14:06:29,370   DEBUG Dhanu => PING(20)
2019-10-31 14:06:35,776   DEBUG lava-logs => PING(20)
2019-10-31 14:06:40,781    INFO scheduling health checks:
2019-10-31 14:06:40,785    INFO scheduling jobs:
2019-10-31 14:06:49,391   DEBUG Dhanu => PING(20)
2019-10-31 14:06:55,799   DEBUG lava-logs => PING(20)
2019-10-31 14:07:00,798    INFO scheduling health checks:
2019-10-31 14:07:00,803    INFO scheduling jobs:
2019-10-31 14:07:09,412   DEBUG Dhanu => PING(20)
2019-10-31 14:07:15,822   DEBUG lava-logs => PING(20)
2019-10-31 14:07:20,818    INFO scheduling health checks:
2019-10-31 14:07:20,822    INFO scheduling jobs:
2019-10-31 14:07:29,437   DEBUG Dhanu => PING(20)
2019-10-31 14:07:35,845   DEBUG lava-logs => PING(20)
2019-10-31 14:07:40,836    INFO scheduling health checks:
2019-10-31 14:07:40,841    INFO scheduling jobs:
2019-10-31 14:07:49,466   DEBUG Dhanu => PING(20)
2019-10-31 14:07:55,867   DEBUG lava-logs => PING(20)
2019-10-31 14:08:00,855    INFO scheduling health checks:
2019-10-31 14:08:00,859    INFO scheduling jobs:
2019-10-31 14:08:09,486   DEBUG Dhanu => PING(20)
2019-10-31 14:08:15,890   DEBUG lava-logs => PING(20)
2019-10-31 14:08:20,876    INFO scheduling health checks:
2019-10-31 14:08:20,880    INFO scheduling jobs:
2019-10-31 14:08:29,510   DEBUG Dhanu => PING(20)
2019-10-31 14:08:35,913   DEBUG lava-logs => PING(20)
2019-10-31 14:08:40,898    INFO scheduling health checks:
2019-10-31 14:08:40,902    INFO scheduling jobs:
2019-10-31 14:08:49,535   DEBUG Dhanu => PING(20)
2019-10-31 14:08:55,936   DEBUG lava-logs => PING(20)
2019-10-31 14:09:00,916    INFO scheduling health checks:
2019-10-31 14:09:00,920    INFO scheduling jobs:
2019-10-31 14:09:09,552   DEBUG Dhanu => PING(20)
2019-10-31 14:09:15,959   DEBUG lava-logs => PING(20)
2019-10-31 14:09:20,935    INFO scheduling health checks:
2019-10-31 14:09:20,939    INFO scheduling jobs:
2019-10-31 14:09:29,575   DEBUG Dhanu => PING(20)
2019-10-31 14:09:35,980   DEBUG lava-logs => PING(20)
2019-10-31 14:09:40,953    INFO scheduling health checks:
2019-10-31 14:09:40,957    INFO scheduling jobs:
2019-10-31 14:09:49,599   DEBUG Dhanu => PING(20)
2019-10-31 14:09:56,003   DEBUG lava-logs => PING(20)
2019-10-31 14:10:00,973    INFO scheduling health checks:
2019-10-31 14:10:00,977    INFO scheduling jobs:
2019-10-31 14:10:09,624   DEBUG Dhanu => PING(20)
2019-10-31 14:10:16,026   DEBUG lava-logs => PING(20)
2019-10-31 14:10:20,996    INFO scheduling health checks:
2019-10-31 14:10:20,999    INFO scheduling jobs:
2019-10-31 14:10:29,644   DEBUG Dhanu => PING(20)
2019-10-31 14:10:36,049   DEBUG lava-logs => PING(20)
2019-10-31 14:10:41,012    INFO scheduling health checks:
2019-10-31 14:10:41,016    INFO scheduling jobs:
2019-10-31 14:10:49,668   DEBUG Dhanu => PING(20)
2019-10-31 14:10:56,068   DEBUG lava-logs => PING(20)
2019-10-31 14:11:01,029    INFO scheduling health checks:
2019-10-31 14:11:01,031    INFO scheduling jobs:
2019-10-31 14:11:09,693   DEBUG Dhanu => PING(20)
2019-10-31 14:11:16,088   DEBUG lava-logs => PING(20)
2019-10-31 14:11:21,049    INFO scheduling health checks:
2019-10-31 14:11:21,054    INFO scheduling jobs:
2019-10-31 14:11:29,712   DEBUG Dhanu => PING(20)
2019-10-31 14:11:36,107   DEBUG lava-logs => PING(20)
2019-10-31 14:11:41,071    INFO scheduling health checks:
2019-10-31 14:11:41,076    INFO scheduling jobs:
2019-10-31 14:11:49,735   DEBUG Dhanu => PING(20)
2019-10-31 14:11:56,130   DEBUG lava-logs => PING(20)
2019-10-31 14:12:01,092    INFO scheduling health checks:
2019-10-31 14:12:01,095    INFO scheduling jobs:
2019-10-31 14:12:09,756   DEBUG Dhanu => PING(20)
2019-10-31 14:12:16,151   DEBUG lava-logs => PING(20)
2019-10-31 14:12:21,110    INFO scheduling health checks:
2019-10-31 14:12:21,114    INFO scheduling jobs:
2019-10-31 14:12:29,777   DEBUG Dhanu => PING(20)
2019-10-31 14:12:36,170   DEBUG lava-logs => PING(20)
2019-10-31 14:12:41,131    INFO scheduling health checks:
2019-10-31 14:12:41,135    INFO scheduling jobs:
2019-10-31 14:12:49,798   DEBUG Dhanu => PING(20)
2019-10-31 14:12:56,190   DEBUG lava-logs => PING(20)
2019-10-31 14:13:01,149    INFO scheduling health checks:
2019-10-31 14:13:01,151    INFO scheduling jobs:
2019-10-31 14:13:09,816   DEBUG Dhanu => PING(20)
2019-10-31 14:13:16,208   DEBUG lava-logs => PING(20)
2019-10-31 14:13:21,165    INFO scheduling health checks:
2019-10-31 14:13:21,170    INFO scheduling jobs:
2019-10-31 14:13:29,832   DEBUG Dhanu => PING(20)
2019-10-31 14:13:36,228   DEBUG lava-logs => PING(20)
2019-10-31 14:13:41,182    INFO scheduling health checks:
2019-10-31 14:13:41,184    INFO scheduling jobs:
2019-10-31 14:13:49,852   DEBUG Dhanu => PING(20)
2019-10-31 14:13:56,251   DEBUG lava-logs => PING(20)
2019-10-31 14:14:01,204    INFO scheduling health checks:
2019-10-31 14:14:01,208    INFO scheduling jobs:
2019-10-31 14:14:09,867   DEBUG Dhanu => PING(20)
2019-10-31 14:14:16,268   DEBUG lava-logs => PING(20)
2019-10-31 14:14:21,227    INFO scheduling health checks:
2019-10-31 14:14:21,229    INFO scheduling jobs:
2019-10-31 14:14:29,886   DEBUG Dhanu => PING(20)
2019-10-31 14:14:36,288   DEBUG lava-logs => PING(20)
2019-10-31 14:14:41,239    INFO scheduling health checks:
2019-10-31 14:14:41,242    INFO scheduling jobs:
2019-10-31 14:14:49,905   DEBUG Dhanu => PING(20)
2019-10-31 14:14:56,307   DEBUG lava-logs => PING(20)
2019-10-31 14:15:01,256    INFO scheduling health checks:
2019-10-31 14:15:01,260    INFO scheduling jobs:
2019-10-31 14:15:09,924   DEBUG Dhanu => PING(20)
2019-10-31 14:15:16,326   DEBUG lava-logs => PING(20)
2019-10-31 14:15:21,274    INFO scheduling health checks:
2019-10-31 14:15:21,278    INFO scheduling jobs:
2019-10-31 14:15:29,946   DEBUG Dhanu => PING(20)
2019-10-31 14:15:36,347   DEBUG lava-logs => PING(20)
2019-10-31 14:15:41,294    INFO scheduling health checks:
2019-10-31 14:15:41,297    INFO scheduling jobs:
2019-10-31 14:15:49,966   DEBUG Dhanu => PING(20)
2019-10-31 14:15:56,364   DEBUG lava-logs => PING(20)
2019-10-31 14:16:01,313    INFO scheduling health checks:
2019-10-31 14:16:01,316    INFO scheduling jobs:
2019-10-31 14:16:09,986   DEBUG Dhanu => PING(20)
2019-10-31 14:16:16,380   DEBUG lava-logs => PING(20)
2019-10-31 14:16:21,328    INFO scheduling health checks:
2019-10-31 14:16:21,332    INFO scheduling jobs:
2019-10-31 14:16:30,004   DEBUG Dhanu => PING(20)
2019-10-31 14:16:36,401   DEBUG lava-logs => PING(20)
2019-10-31 14:16:41,346    INFO scheduling health checks:
2019-10-31 14:16:41,350    INFO scheduling jobs:
2019-10-31 14:16:50,027   DEBUG Dhanu => PING(20)
2019-10-31 14:16:56,424   DEBUG lava-logs => PING(20)
2019-10-31 14:17:01,364    INFO scheduling health checks:
2019-10-31 14:17:01,368    INFO scheduling jobs:
2019-10-31 14:17:10,046   DEBUG Dhanu => PING(20)
2019-10-31 14:17:16,447   DEBUG lava-logs => PING(20)
2019-10-31 14:17:21,385    INFO scheduling health checks:
2019-10-31 14:17:21,389    INFO scheduling jobs:
2019-10-31 14:17:30,070   DEBUG Dhanu => PING(20)
2019-10-31 14:17:36,460   DEBUG lava-logs => PING(20)
2019-10-31 14:17:41,403    INFO scheduling health checks:
2019-10-31 14:17:41,407    INFO scheduling jobs:
2019-10-31 14:17:50,094   DEBUG Dhanu => PING(20)
2019-10-31 14:17:56,483   DEBUG lava-logs => PING(20)
2019-10-31 14:18:01,421    INFO scheduling health checks:
2019-10-31 14:18:01,425    INFO scheduling jobs:
2019-10-31 14:18:10,112   DEBUG Dhanu => PING(20)
2019-10-31 14:18:16,506   DEBUG lava-logs => PING(20)
2019-10-31 14:18:21,442    INFO scheduling health checks:
2019-10-31 14:18:21,446    INFO scheduling jobs:
2019-10-31 14:18:30,135   DEBUG Dhanu => PING(20)
2019-10-31 14:18:36,529   DEBUG lava-logs => PING(20)
2019-10-31 14:18:41,461    INFO scheduling health checks:
2019-10-31 14:18:41,465    INFO scheduling jobs:
2019-10-31 14:18:50,160   DEBUG Dhanu => PING(20)
2019-10-31 14:18:56,552   DEBUG lava-logs => PING(20)
2019-10-31 14:19:01,481    INFO scheduling health checks:
2019-10-31 14:19:01,485    INFO scheduling jobs:
2019-10-31 14:19:10,184   DEBUG Dhanu => PING(20)
2019-10-31 14:19:16,575   DEBUG lava-logs => PING(20)
2019-10-31 14:19:21,500    INFO scheduling health checks:
2019-10-31 14:19:21,504    INFO scheduling jobs:
2019-10-31 14:19:30,209   DEBUG Dhanu => PING(20)
2019-10-31 14:19:36,594   DEBUG lava-logs => PING(20)
2019-10-31 14:19:41,516    INFO scheduling health checks:
2019-10-31 14:19:41,520    INFO scheduling jobs:
2019-10-31 14:19:50,233   DEBUG Dhanu => PING(20)
2019-10-31 14:19:56,617   DEBUG lava-logs => PING(20)
2019-10-31 14:20:01,536    INFO scheduling health checks:
2019-10-31 14:20:01,540    INFO scheduling jobs:
2019-10-31 14:20:10,254   DEBUG Dhanu => PING(20)
2019-10-31 14:20:16,640   DEBUG lava-logs => PING(20)
2019-10-31 14:20:21,553    INFO scheduling health checks:
2019-10-31 14:20:21,557    INFO scheduling jobs:
2019-10-31 14:20:30,278   DEBUG Dhanu => PING(20)
2019-10-31 14:20:36,663   DEBUG lava-logs => PING(20)
2019-10-31 14:20:41,571    INFO scheduling health checks:
2019-10-31 14:20:41,575    INFO scheduling jobs:
2019-10-31 14:20:50,303   DEBUG Dhanu => PING(20)
2019-10-31 14:20:56,684   DEBUG lava-logs => PING(20)
2019-10-31 14:21:01,589    INFO scheduling health checks:
2019-10-31 14:21:01,593    INFO scheduling jobs:
2019-10-31 14:21:10,327   DEBUG Dhanu => PING(20)
2019-10-31 14:21:16,707   DEBUG lava-logs => PING(20)
2019-10-31 14:21:21,608    INFO scheduling health checks:
2019-10-31 14:21:21,612    INFO scheduling jobs:
2019-10-31 14:21:30,350   DEBUG Dhanu => PING(20)
2019-10-31 14:21:36,724   DEBUG lava-logs => PING(20)
2019-10-31 14:21:41,626    INFO scheduling health checks:
2019-10-31 14:21:41,630    INFO scheduling jobs:
2019-10-31 14:21:50,370   DEBUG Dhanu => PING(20)
2019-10-31 14:21:56,744   DEBUG lava-logs => PING(20)
2019-10-31 14:22:01,646    INFO scheduling health checks:
2019-10-31 14:22:01,650    INFO scheduling jobs:
2019-10-31 14:22:10,394   DEBUG Dhanu => PING(20)
2019-10-31 14:22:16,767   DEBUG lava-logs => PING(20)
2019-10-31 14:22:21,664    INFO scheduling health checks:
2019-10-31 14:22:21,668    INFO scheduling jobs:
2019-10-31 14:22:30,415   DEBUG Dhanu => PING(20)
2019-10-31 14:22:36,780   DEBUG lava-logs => PING(20)
2019-10-31 14:22:41,686    INFO scheduling health checks:
2019-10-31 14:22:41,690    INFO scheduling jobs:
2019-10-31 14:22:50,440   DEBUG Dhanu => PING(20)
2019-10-31 14:22:56,800   DEBUG lava-logs => PING(20)
2019-10-31 14:23:01,706    INFO scheduling health checks:
2019-10-31 14:23:01,710    INFO scheduling jobs:
2019-10-31 14:23:10,462   DEBUG Dhanu => PING(20)
2019-10-31 14:23:16,823   DEBUG lava-logs => PING(20)
2019-10-31 14:23:21,724    INFO scheduling health checks:
2019-10-31 14:23:21,728    INFO scheduling jobs:
2019-10-31 14:23:30,486   DEBUG Dhanu => PING(20)
2019-10-31 14:23:36,846   DEBUG lava-logs => PING(20)
2019-10-31 14:23:41,743    INFO scheduling health checks:
2019-10-31 14:23:41,747    INFO scheduling jobs:
2019-10-31 14:23:50,510   DEBUG Dhanu => PING(20)
2019-10-31 14:23:56,869   DEBUG lava-logs => PING(20)
2019-10-31 14:24:01,762    INFO scheduling health checks:
2019-10-31 14:24:01,766    INFO scheduling jobs:
2019-10-31 14:24:10,528   DEBUG Dhanu => PING(20)
2019-10-31 14:24:16,888   DEBUG lava-logs => PING(20)
2019-10-31 14:24:21,780    INFO scheduling health checks:
2019-10-31 14:24:21,784    INFO scheduling jobs:
2019-10-31 14:24:30,544   DEBUG Dhanu => PING(20)
2019-10-31 14:24:36,905   DEBUG lava-logs => PING(20)
2019-10-31 14:24:41,801    INFO scheduling health checks:
2019-10-31 14:24:41,805    INFO scheduling jobs:
2019-10-31 14:24:50,560   DEBUG Dhanu => PING(20)
2019-10-31 14:24:56,928   DEBUG lava-logs => PING(20)
2019-10-31 14:25:01,819    INFO scheduling health checks:
2019-10-31 14:25:01,823    INFO scheduling jobs:
2019-10-31 14:25:10,576   DEBUG Dhanu => PING(20)
2019-10-31 14:25:16,951   DEBUG lava-logs => PING(20)
2019-10-31 14:25:21,838    INFO scheduling health checks:
2019-10-31 14:25:21,842    INFO scheduling jobs:
2019-10-31 14:25:30,600   DEBUG Dhanu => PING(20)
2019-10-31 14:25:36,974   DEBUG lava-logs => PING(20)
2019-10-31 14:25:41,858    INFO scheduling health checks:
2019-10-31 14:25:41,862    INFO scheduling jobs:
2019-10-31 14:25:50,625   DEBUG Dhanu => PING(20)
2019-10-31 14:25:56,994   DEBUG lava-logs => PING(20)
2019-10-31 14:26:01,877    INFO scheduling health checks:
2019-10-31 14:26:01,881    INFO scheduling jobs:
2019-10-31 14:26:10,649   DEBUG Dhanu => PING(20)
2019-10-31 14:26:17,014   DEBUG lava-logs => PING(20)
2019-10-31 14:26:21,900    INFO scheduling health checks:
2019-10-31 14:26:21,904    INFO scheduling jobs:
2019-10-31 14:26:30,672   DEBUG Dhanu => PING(20)
2019-10-31 14:26:37,036   DEBUG lava-logs => PING(20)
2019-10-31 14:26:41,921    INFO scheduling health checks:
2019-10-31 14:26:41,925    INFO scheduling jobs:
2019-10-31 14:26:50,694   DEBUG Dhanu => PING(20)
2019-10-31 14:26:57,056   DEBUG lava-logs => PING(20)
2019-10-31 14:27:01,940    INFO scheduling health checks:
2019-10-31 14:27:01,944    INFO scheduling jobs:
2019-10-31 14:27:10,718   DEBUG Dhanu => PING(20)
2019-10-31 14:27:17,079   DEBUG lava-logs => PING(20)
2019-10-31 14:27:21,962    INFO scheduling health checks:
2019-10-31 14:27:21,966    INFO scheduling jobs:
2019-10-31 14:27:30,741   DEBUG Dhanu => PING(20)
2019-10-31 14:27:37,102   DEBUG lava-logs => PING(20)
2019-10-31 14:27:41,981    INFO scheduling health checks:
2019-10-31 14:27:41,985    INFO scheduling jobs:
2019-10-31 14:27:50,765   DEBUG Dhanu => PING(20)
2019-10-31 14:27:57,125   DEBUG lava-logs => PING(20)
2019-10-31 14:28:01,997    INFO scheduling health checks:
2019-10-31 14:28:02,000    INFO scheduling jobs:
2019-10-31 14:28:10,789   DEBUG Dhanu => PING(20)
2019-10-31 14:28:17,148   DEBUG lava-logs => PING(20)
2019-10-31 14:28:22,017    INFO scheduling health checks:
2019-10-31 14:28:22,021    INFO scheduling jobs:
2019-10-31 14:28:30,814   DEBUG Dhanu => PING(20)
2019-10-31 14:28:37,163   DEBUG lava-logs => PING(20)
2019-10-31 14:28:42,035    INFO scheduling health checks:
2019-10-31 14:28:42,039    INFO scheduling jobs:
2019-10-31 14:28:50,838   DEBUG Dhanu => PING(20)
2019-10-31 14:28:57,186   DEBUG lava-logs => PING(20)
2019-10-31 14:29:02,057    INFO scheduling health checks:
2019-10-31 14:29:02,061    INFO scheduling jobs:
2019-10-31 14:29:10,862   DEBUG Dhanu => PING(20)
2019-10-31 14:29:17,209   DEBUG lava-logs => PING(20)
2019-10-31 14:29:22,077    INFO scheduling health checks:
2019-10-31 14:29:22,081    INFO scheduling jobs:
2019-10-31 14:29:30,883   DEBUG Dhanu => PING(20)
2019-10-31 14:29:37,228   DEBUG lava-logs => PING(20)
2019-10-31 14:29:42,099    INFO scheduling health checks:
2019-10-31 14:29:42,102    INFO scheduling jobs:
2019-10-31 14:29:50,906   DEBUG Dhanu => PING(20)
2019-10-31 14:29:57,251   DEBUG lava-logs => PING(20)
2019-10-31 14:30:02,118    INFO scheduling health checks:
2019-10-31 14:30:02,121    INFO scheduling jobs:
2019-10-31 14:30:10,930   DEBUG Dhanu => PING(20)
2019-10-31 14:30:17,274   DEBUG lava-logs => PING(20)
2019-10-31 14:30:22,135    INFO scheduling health checks:
2019-10-31 14:30:22,138    INFO scheduling jobs:
2019-10-31 14:30:30,954   DEBUG Dhanu => PING(20)
2019-10-31 14:30:37,297   DEBUG lava-logs => PING(20)
2019-10-31 14:30:42,155    INFO scheduling health checks:
2019-10-31 14:30:42,159    INFO scheduling jobs:
2019-10-31 14:30:50,979   DEBUG Dhanu => PING(20)
2019-10-31 14:30:57,320   DEBUG lava-logs => PING(20)
2019-10-31 14:31:02,176    INFO scheduling health checks:
2019-10-31 14:31:02,180    INFO scheduling jobs:
2019-10-31 14:31:11,003   DEBUG Dhanu => PING(20)
2019-10-31 14:31:17,343   DEBUG lava-logs => PING(20)
2019-10-31 14:31:22,195    INFO scheduling health checks:
2019-10-31 14:31:22,199    INFO scheduling jobs:
2019-10-31 14:31:31,028   DEBUG Dhanu => PING(20)
2019-10-31 14:31:37,360   DEBUG lava-logs => PING(20)
2019-10-31 14:31:42,214    INFO scheduling health checks:
2019-10-31 14:31:42,218    INFO scheduling jobs:
2019-10-31 14:31:51,052   DEBUG Dhanu => PING(20)
2019-10-31 14:31:57,383   DEBUG lava-logs => PING(20)
2019-10-31 14:32:02,234    INFO scheduling health checks:
2019-10-31 14:32:02,238    INFO scheduling jobs:
2019-10-31 14:32:11,077   DEBUG Dhanu => PING(20)
2019-10-31 14:32:17,406   DEBUG lava-logs => PING(20)
2019-10-31 14:32:22,253    INFO scheduling health checks:
2019-10-31 14:32:22,257    INFO scheduling jobs:
2019-10-31 14:32:31,101   DEBUG Dhanu => PING(20)
2019-10-31 14:32:37,424   DEBUG lava-logs => PING(20)
2019-10-31 14:32:42,274    INFO scheduling health checks:
2019-10-31 14:32:42,278    INFO scheduling jobs:
2019-10-31 14:32:51,122   DEBUG Dhanu => PING(20)
2019-10-31 14:32:57,447   DEBUG lava-logs => PING(20)
2019-10-31 14:33:02,293    INFO scheduling health checks:
2019-10-31 14:33:02,297    INFO scheduling jobs:
2019-10-31 14:33:11,146   DEBUG Dhanu => PING(20)
2019-10-31 14:33:17,464   DEBUG lava-logs => PING(20)
2019-10-31 14:33:22,314    INFO scheduling health checks:
2019-10-31 14:33:22,317    INFO scheduling jobs:
2019-10-31 14:33:31,171   DEBUG Dhanu => PING(20)
2019-10-31 14:33:37,486   DEBUG lava-logs => PING(20)
2019-10-31 14:33:42,335    INFO scheduling health checks:
2019-10-31 14:33:42,338    INFO scheduling jobs:
2019-10-31 14:33:51,195   DEBUG Dhanu => PING(20)
2019-10-31 14:33:57,509   DEBUG lava-logs => PING(20)
2019-10-31 14:34:02,351    INFO scheduling health checks:
2019-10-31 14:34:02,354    INFO scheduling jobs:
2019-10-31 14:34:11,220   DEBUG Dhanu => PING(20)
2019-10-31 14:34:17,532   DEBUG lava-logs => PING(20)
2019-10-31 14:34:22,368    INFO scheduling health checks:
2019-10-31 14:34:22,372    INFO scheduling jobs:
2019-10-31 14:34:31,240   DEBUG Dhanu => PING(20)
2019-10-31 14:34:37,555   DEBUG lava-logs => PING(20)
2019-10-31 14:34:42,389    INFO scheduling health checks:
2019-10-31 14:34:42,393    INFO scheduling jobs:
2019-10-31 14:34:51,264   DEBUG Dhanu => PING(20)
2019-10-31 14:34:57,578   DEBUG lava-logs => PING(20)
2019-10-31 14:35:02,408    INFO scheduling health checks:
2019-10-31 14:35:02,412    INFO scheduling jobs:
2019-10-31 14:35:11,289   DEBUG Dhanu => PING(20)
2019-10-31 14:35:17,601   DEBUG lava-logs => PING(20)
2019-10-31 14:35:22,431    INFO scheduling health checks:
2019-10-31 14:35:22,435    INFO scheduling jobs:
2019-10-31 14:35:31,313   DEBUG Dhanu => PING(20)
2019-10-31 14:35:37,624   DEBUG lava-logs => PING(20)
2019-10-31 14:35:42,454    INFO scheduling health checks:
2019-10-31 14:35:42,458    INFO scheduling jobs:
2019-10-31 14:35:51,337   DEBUG Dhanu => PING(20)
2019-10-31 14:35:57,644   DEBUG lava-logs => PING(20)
2019-10-31 14:36:02,472    INFO scheduling health checks:
2019-10-31 14:36:02,476    INFO scheduling jobs:
2019-10-31 14:36:11,362   DEBUG Dhanu => PING(20)
2019-10-31 14:36:17,667   DEBUG lava-logs => PING(20)
2019-10-31 14:36:22,490    INFO scheduling health checks:
2019-10-31 14:36:22,494    INFO scheduling jobs:
2019-10-31 14:36:31,386   DEBUG Dhanu => PING(20)
2019-10-31 14:36:37,690   DEBUG lava-logs => PING(20)
2019-10-31 14:36:42,507    INFO scheduling health checks:
2019-10-31 14:36:42,511    INFO scheduling jobs:
2019-10-31 14:36:51,410   DEBUG Dhanu => PING(20)
2019-10-31 14:36:57,710   DEBUG lava-logs => PING(20)
2019-10-31 14:37:02,526    INFO scheduling health checks:
2019-10-31 14:37:02,530    INFO scheduling jobs:
2019-10-31 14:37:11,433   DEBUG Dhanu => PING(20)
2019-10-31 14:37:17,733   DEBUG lava-logs => PING(20)
2019-10-31 14:37:22,545    INFO scheduling health checks:
2019-10-31 14:37:22,548    INFO scheduling jobs:
2019-10-31 14:37:31,457   DEBUG Dhanu => PING(20)
2019-10-31 14:37:37,756   DEBUG lava-logs => PING(20)
2019-10-31 14:37:42,562    INFO scheduling health checks:
2019-10-31 14:37:42,566    INFO scheduling jobs:
2019-10-31 14:37:51,482   DEBUG Dhanu => PING(20)
2019-10-31 14:37:57,779   DEBUG lava-logs => PING(20)
2019-10-31 14:38:02,582    INFO scheduling health checks:
2019-10-31 14:38:02,586    INFO scheduling jobs:
2019-10-31 14:38:11,504   DEBUG Dhanu => PING(20)
2019-10-31 14:38:17,802   DEBUG lava-logs => PING(20)
2019-10-31 14:38:22,603    INFO scheduling health checks:
2019-10-31 14:38:22,607    INFO scheduling jobs:
2019-10-31 14:38:31,528   DEBUG Dhanu => PING(20)
2019-10-31 14:38:37,825   DEBUG lava-logs => PING(20)
2019-10-31 14:38:42,624    INFO scheduling health checks:
2019-10-31 14:38:42,628    INFO scheduling jobs:
2019-10-31 14:38:51,550   DEBUG Dhanu => PING(20)
2019-10-31 14:38:57,839   DEBUG lava-logs => PING(20)
2019-10-31 14:39:02,643    INFO scheduling health checks:
2019-10-31 14:39:02,647    INFO scheduling jobs:
2019-10-31 14:39:11,574   DEBUG Dhanu => PING(20)
2019-10-31 14:39:17,862   DEBUG lava-logs => PING(20)
2019-10-31 14:39:22,659    INFO scheduling health checks:
2019-10-31 14:39:22,663    INFO scheduling jobs:
2019-10-31 14:39:31,595   DEBUG Dhanu => PING(20)
2019-10-31 14:39:37,885   DEBUG lava-logs => PING(20)
2019-10-31 14:39:42,678    INFO scheduling health checks:
2019-10-31 14:39:42,680    INFO scheduling jobs:
2019-10-31 14:39:51,619   DEBUG Dhanu => PING(20)
2019-10-31 14:39:57,903   DEBUG lava-logs => PING(20)
2019-10-31 14:40:02,696    INFO scheduling health checks:
2019-10-31 14:40:02,700    INFO scheduling jobs:
2019-10-31 14:40:11,642   DEBUG Dhanu => PING(20)
2019-10-31 14:40:17,920   DEBUG lava-logs => PING(20)
2019-10-31 14:40:22,714    INFO scheduling health checks:
2019-10-31 14:40:22,720    INFO scheduling jobs:
2019-10-31 14:40:31,660   DEBUG Dhanu => PING(20)
2019-10-31 14:40:37,942   DEBUG lava-logs => PING(20)
2019-10-31 14:40:42,735    INFO scheduling health checks:
2019-10-31 14:40:42,740    INFO scheduling jobs:
2019-10-31 14:40:51,680   DEBUG Dhanu => PING(20)
2019-10-31 14:40:57,962   DEBUG lava-logs => PING(20)
2019-10-31 14:41:02,757    INFO scheduling health checks:
2019-10-31 14:41:02,761    INFO scheduling jobs:
2019-10-31 14:41:11,698   DEBUG Dhanu => PING(20)
2019-10-31 14:41:17,983   DEBUG lava-logs => PING(20)
2019-10-31 14:41:22,774    INFO scheduling health checks:
2019-10-31 14:41:22,778    INFO scheduling jobs:
2019-10-31 14:41:31,722   DEBUG Dhanu => PING(20)
2019-10-31 14:41:38,006   DEBUG lava-logs => PING(20)
2019-10-31 14:41:42,793    INFO scheduling health checks:
2019-10-31 14:41:42,797    INFO scheduling jobs:
2019-10-31 14:41:51,747   DEBUG Dhanu => PING(20)
2019-10-31 14:41:58,028   DEBUG lava-logs => PING(20)
2019-10-31 14:42:02,813    INFO scheduling health checks:
2019-10-31 14:42:02,817    INFO scheduling jobs:
2019-10-31 14:42:11,771   DEBUG Dhanu => PING(20)
2019-10-31 14:42:18,046   DEBUG lava-logs => PING(20)
2019-10-31 14:42:22,834    INFO scheduling health checks:
2019-10-31 14:42:22,838    INFO scheduling jobs:
2019-10-31 14:42:31,796   DEBUG Dhanu => PING(20)
2019-10-31 14:42:38,068   DEBUG lava-logs => PING(20)
2019-10-31 14:42:42,859    INFO scheduling health checks:
2019-10-31 14:42:42,863    INFO scheduling jobs:
2019-10-31 14:42:51,814   DEBUG Dhanu => PING(20)
2019-10-31 14:42:58,091   DEBUG lava-logs => PING(20)
2019-10-31 14:43:02,878    INFO scheduling health checks:
2019-10-31 14:43:02,882    INFO scheduling jobs:
2019-10-31 14:43:11,832   DEBUG Dhanu => PING(20)
2019-10-31 14:43:18,114   DEBUG lava-logs => PING(20)
2019-10-31 14:43:22,897    INFO scheduling health checks:
2019-10-31 14:43:22,901    INFO scheduling jobs:
2019-10-31 14:43:31,852   DEBUG Dhanu => PING(20)
2019-10-31 14:43:33,768   DEBUG lava-logs => PING(20)
2019-10-31 14:43:33,794   DEBUG lava-logs => PING(20)
2019-10-31 14:43:42,915    INFO scheduling health checks:
2019-10-31 14:43:42,921    INFO scheduling jobs:
2019-10-31 14:43:51,870   DEBUG Dhanu => PING(20)
2019-10-31 14:43:53,812   DEBUG lava-logs => PING(20)
2019-10-31 14:44:02,934    INFO scheduling health checks:
2019-10-31 14:44:02,936    INFO scheduling jobs:
2019-10-31 14:44:12,320   DEBUG Dhanu => PING(20)
2019-10-31 14:44:13,872   DEBUG lava-logs => PING(20)
2019-10-31 14:44:22,951    INFO scheduling health checks:
2019-10-31 14:44:22,955    INFO scheduling jobs:
2019-10-31 14:44:32,344   DEBUG Dhanu => PING(20)
2019-10-31 14:44:33,896   DEBUG lava-logs => PING(20)
2019-10-31 14:44:43,019    INFO scheduling health checks:
2019-10-31 14:44:43,024    INFO scheduling jobs:
2019-10-31 14:44:52,368   DEBUG Dhanu => PING(20)
2019-10-31 14:44:53,918   DEBUG lava-logs => PING(20)
2019-10-31 14:45:03,039    INFO scheduling health checks:
2019-10-31 14:45:03,043    INFO scheduling jobs:
2019-10-31 14:45:12,392   DEBUG Dhanu => PING(20)
2019-10-31 14:45:13,939   DEBUG lava-logs => PING(20)
2019-10-31 14:45:23,057    INFO scheduling health checks:
2019-10-31 14:45:23,061    INFO scheduling jobs:
2019-10-31 14:45:32,411   DEBUG Dhanu => PING(20)
2019-10-31 14:45:33,952   DEBUG lava-logs => PING(20)
2019-10-31 14:45:43,077    INFO scheduling health checks:
2019-10-31 14:45:43,081    INFO scheduling jobs:
2019-10-31 14:45:52,436   DEBUG Dhanu => PING(20)
2019-10-31 14:45:53,975   DEBUG lava-logs => PING(20)
2019-10-31 14:46:03,099    INFO scheduling health checks:
2019-10-31 14:46:03,101    INFO scheduling jobs:
2019-10-31 14:46:12,459   DEBUG Dhanu => PING(20)
2019-10-31 14:46:14,025   DEBUG lava-logs => PING(20)
2019-10-31 14:46:23,111    INFO scheduling health checks:
2019-10-31 14:46:23,113    INFO scheduling jobs:
2019-10-31 14:46:32,478   DEBUG Dhanu => PING(20)
2019-10-31 14:46:34,047   DEBUG lava-logs => PING(20)
2019-10-31 14:46:43,122    INFO scheduling health checks:
2019-10-31 14:46:43,126    INFO scheduling jobs:
2019-10-31 14:46:52,500   DEBUG Dhanu => PING(20)
2019-10-31 14:46:54,070   DEBUG lava-logs => PING(20)
2019-10-31 14:47:03,146    INFO scheduling health checks:
2019-10-31 14:47:03,149    INFO scheduling jobs:
2019-10-31 14:47:12,519   DEBUG Dhanu => PING(20)
2019-10-31 14:47:14,093   DEBUG lava-logs => PING(20)
2019-10-31 14:47:23,167    INFO scheduling health checks:
2019-10-31 14:47:23,170    INFO scheduling jobs:
2019-10-31 14:47:32,539   DEBUG Dhanu => PING(20)
2019-10-31 14:47:34,115   DEBUG lava-logs => PING(20)
2019-10-31 14:47:43,188    INFO scheduling health checks:
2019-10-31 14:47:43,192    INFO scheduling jobs:
2019-10-31 14:47:52,560   DEBUG Dhanu => PING(20)
2019-10-31 14:47:54,138   DEBUG lava-logs => PING(20)
2019-10-31 14:48:03,210    INFO scheduling health checks:
2019-10-31 14:48:03,213    INFO scheduling jobs:
2019-10-31 14:48:12,578   DEBUG Dhanu => PING(20)
2019-10-31 14:48:14,159   DEBUG lava-logs => PING(20)
2019-10-31 14:48:23,228    INFO scheduling health checks:
2019-10-31 14:48:23,232    INFO scheduling jobs:
2019-10-31 14:48:32,600   DEBUG Dhanu => PING(20)
2019-10-31 14:48:34,180   DEBUG lava-logs => PING(20)
2019-10-31 14:48:43,250    INFO scheduling health checks:
2019-10-31 14:48:43,254    INFO scheduling jobs:
2019-10-31 14:48:52,618   DEBUG Dhanu => PING(20)
2019-10-31 14:48:54,201   DEBUG lava-logs => PING(20)
2019-10-31 14:49:03,272    INFO scheduling health checks:
2019-10-31 14:49:03,276    INFO scheduling jobs:
2019-10-31 14:49:12,641   DEBUG Dhanu => PING(20)
2019-10-31 14:49:14,224   DEBUG lava-logs => PING(20)
2019-10-31 14:49:23,294    INFO scheduling health checks:
2019-10-31 14:49:23,298    INFO scheduling jobs:
2019-10-31 14:49:32,664   DEBUG Dhanu => PING(20)
2019-10-31 14:49:34,243   DEBUG lava-logs => PING(20)
2019-10-31 14:49:43,314    INFO scheduling health checks:
2019-10-31 14:49:43,317    INFO scheduling jobs:
2019-10-31 14:49:52,764   DEBUG Dhanu => PING(20)
2019-10-31 14:49:54,266   DEBUG lava-logs => PING(20)
2019-10-31 14:50:03,335    INFO scheduling health checks:
2019-10-31 14:50:03,338    INFO scheduling jobs:
2019-10-31 14:50:12,882   DEBUG Dhanu => PING(20)
2019-10-31 14:50:13,760    INFO [POLL] Received a signal, leaving
2019-10-31 14:50:13,761    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 14:50:30,127    INFO [INIT] Dropping privileges
2019-10-31 14:50:30,127   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 14:50:30,128   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 14:50:30,129    INFO [INIT] Marking all workers as offline
2019-10-31 14:50:30,169    INFO [INIT] LAVA master has started.
2019-10-31 14:50:30,169    INFO [INIT] Using protocol version 3
2019-10-31 14:50:30,219   DEBUG lava-logs => PING(20)
2019-10-31 14:50:32,597    INFO Dhanu => HELLO
2019-10-31 14:50:32,598 WARNING New dispatcher <Dhanu>
2019-10-31 14:50:37,604   DEBUG Dhanu => PING(20)
2019-10-31 14:50:40,228   DEBUG lava-logs => PING(20)
2019-10-31 14:50:50,171    INFO scheduling health checks:
2019-10-31 14:50:50,178    INFO scheduling jobs:
2019-10-31 14:50:57,635   DEBUG Dhanu => PING(20)
2019-10-31 14:51:05,588   DEBUG lava-logs => PING(20)
2019-10-31 14:51:05,615   DEBUG lava-logs => PING(20)
2019-10-31 14:51:10,193    INFO scheduling health checks:
2019-10-31 14:51:10,196    INFO scheduling jobs:
2019-10-31 14:51:17,652   DEBUG Dhanu => PING(20)
2019-10-31 14:51:25,638   DEBUG lava-logs => PING(20)
2019-10-31 14:51:30,214    INFO scheduling health checks:
2019-10-31 14:51:30,220    INFO scheduling jobs:
2019-10-31 14:51:37,668   DEBUG Dhanu => PING(20)
2019-10-31 14:51:45,655   DEBUG lava-logs => PING(20)
2019-10-31 14:51:50,237    INFO scheduling health checks:
2019-10-31 14:51:50,240    INFO scheduling jobs:
2019-10-31 14:51:57,684   DEBUG Dhanu => PING(20)
2019-10-31 14:52:05,678   DEBUG lava-logs => PING(20)
2019-10-31 14:52:10,255    INFO scheduling health checks:
2019-10-31 14:52:10,260    INFO scheduling jobs:
2019-10-31 14:52:17,701   DEBUG Dhanu => PING(20)
2019-10-31 14:52:25,692   DEBUG lava-logs => PING(20)
2019-10-31 14:52:30,275    INFO scheduling health checks:
2019-10-31 14:52:30,279    INFO scheduling jobs:
2019-10-31 14:52:37,721   DEBUG Dhanu => PING(20)
2019-10-31 14:52:45,715   DEBUG lava-logs => PING(20)
2019-10-31 14:52:50,296    INFO scheduling health checks:
2019-10-31 14:52:50,298    INFO scheduling jobs:
2019-10-31 14:52:57,743   DEBUG Dhanu => PING(20)
2019-10-31 14:53:05,732   DEBUG lava-logs => PING(20)
2019-10-31 14:53:10,306    INFO scheduling health checks:
2019-10-31 14:53:10,310    INFO scheduling jobs:
2019-10-31 14:53:17,759   DEBUG Dhanu => PING(20)
2019-10-31 14:53:25,768   DEBUG lava-logs => PING(20)
2019-10-31 14:53:30,330    INFO scheduling health checks:
2019-10-31 14:53:30,344    INFO scheduling jobs:
2019-10-31 14:53:37,776   DEBUG Dhanu => PING(20)
2019-10-31 14:53:45,790   DEBUG lava-logs => PING(20)
2019-10-31 14:53:50,361    INFO scheduling health checks:
2019-10-31 14:53:50,370    INFO scheduling jobs:
2019-10-31 14:53:57,800   DEBUG Dhanu => PING(20)
2019-10-31 14:54:05,810   DEBUG lava-logs => PING(20)
2019-10-31 14:54:10,383    INFO scheduling health checks:
2019-10-31 14:54:10,394    INFO scheduling jobs:
2019-10-31 14:54:17,820   DEBUG Dhanu => PING(20)
2019-10-31 14:54:25,831   DEBUG lava-logs => PING(20)
2019-10-31 14:54:30,407    INFO scheduling health checks:
2019-10-31 14:54:30,420    INFO scheduling jobs:
2019-10-31 14:54:37,839   DEBUG Dhanu => PING(20)
2019-10-31 14:54:45,854   DEBUG lava-logs => PING(20)
2019-10-31 14:54:50,433    INFO scheduling health checks:
2019-10-31 14:54:50,444    INFO scheduling jobs:
2019-10-31 14:54:57,860   DEBUG Dhanu => PING(20)
2019-10-31 14:55:05,874   DEBUG lava-logs => PING(20)
2019-10-31 14:55:10,461    INFO scheduling health checks:
2019-10-31 14:55:10,471    INFO scheduling jobs:
2019-10-31 14:55:17,878   DEBUG Dhanu => PING(20)
2019-10-31 14:55:25,892   DEBUG lava-logs => PING(20)
2019-10-31 14:55:30,485    INFO scheduling health checks:
2019-10-31 14:55:30,493    INFO scheduling jobs:
2019-10-31 14:55:37,899   DEBUG Dhanu => PING(20)
2019-10-31 14:55:45,905   DEBUG lava-logs => PING(20)
2019-10-31 14:55:50,509    INFO scheduling health checks:
2019-10-31 14:55:50,513    INFO scheduling jobs:
2019-10-31 14:55:57,920   DEBUG Dhanu => PING(20)
2019-10-31 14:56:06,025   DEBUG lava-logs => PING(20)
2019-10-31 14:56:10,533    INFO scheduling health checks:
2019-10-31 14:56:10,537    INFO scheduling jobs:
2019-10-31 14:56:17,956   DEBUG Dhanu => PING(20)
2019-10-31 14:56:26,046   DEBUG lava-logs => PING(20)
2019-10-31 14:56:30,553    INFO scheduling health checks:
2019-10-31 14:56:30,563    INFO scheduling jobs:
2019-10-31 14:56:37,972   DEBUG Dhanu => PING(20)
2019-10-31 14:56:46,070   DEBUG lava-logs => PING(20)
2019-10-31 14:56:50,574    INFO scheduling health checks:
2019-10-31 14:56:50,582    INFO scheduling jobs:
2019-10-31 14:56:57,994   DEBUG Dhanu => PING(20)
2019-10-31 14:57:06,116   DEBUG lava-logs => PING(20)
2019-10-31 14:57:10,595    INFO scheduling health checks:
2019-10-31 14:57:10,618    INFO scheduling jobs:
2019-10-31 14:57:18,052   DEBUG Dhanu => PING(20)
2019-10-31 14:57:26,136   DEBUG lava-logs => PING(20)
2019-10-31 14:57:30,631    INFO scheduling health checks:
2019-10-31 14:57:30,635    INFO scheduling jobs:
2019-10-31 14:57:38,068   DEBUG Dhanu => PING(20)
2019-10-31 14:57:46,158   DEBUG lava-logs => PING(20)
2019-10-31 14:57:50,653    INFO scheduling health checks:
2019-10-31 14:57:50,654    INFO scheduling jobs:
2019-10-31 14:57:58,088   DEBUG Dhanu => PING(20)
2019-10-31 14:58:06,181   DEBUG lava-logs => PING(20)
2019-10-31 14:58:10,663    INFO scheduling health checks:
2019-10-31 14:58:10,667    INFO scheduling jobs:
2019-10-31 14:58:18,123   DEBUG Dhanu => PING(20)
2019-10-31 14:58:26,204   DEBUG lava-logs => PING(20)
2019-10-31 14:58:30,681    INFO scheduling health checks:
2019-10-31 14:58:30,685    INFO scheduling jobs:
2019-10-31 14:58:38,147   DEBUG Dhanu => PING(20)
2019-10-31 14:58:46,223   DEBUG lava-logs => PING(20)
2019-10-31 14:58:50,700    INFO scheduling health checks:
2019-10-31 14:58:50,704    INFO scheduling jobs:
2019-10-31 14:58:58,168   DEBUG Dhanu => PING(20)
2019-10-31 14:59:06,244   DEBUG lava-logs => PING(20)
2019-10-31 14:59:10,719    INFO scheduling health checks:
2019-10-31 14:59:10,723    INFO scheduling jobs:
2019-10-31 14:59:18,192   DEBUG Dhanu => PING(20)
2019-10-31 14:59:26,264   DEBUG lava-logs => PING(20)
2019-10-31 14:59:30,744    INFO scheduling health checks:
2019-10-31 14:59:30,747    INFO scheduling jobs:
2019-10-31 14:59:38,215   DEBUG Dhanu => PING(20)
2019-10-31 14:59:46,286   DEBUG lava-logs => PING(20)
2019-10-31 14:59:50,761    INFO scheduling health checks:
2019-10-31 14:59:50,765    INFO scheduling jobs:
2019-10-31 14:59:58,236   DEBUG Dhanu => PING(20)
2019-10-31 15:00:06,304   DEBUG lava-logs => PING(20)
2019-10-31 15:00:10,778    INFO scheduling health checks:
2019-10-31 15:00:10,782    INFO scheduling jobs:
2019-10-31 15:00:18,256   DEBUG Dhanu => PING(20)
2019-10-31 15:00:26,324   DEBUG lava-logs => PING(20)
2019-10-31 15:00:30,796    INFO scheduling health checks:
2019-10-31 15:00:30,800    INFO scheduling jobs:
2019-10-31 15:00:38,281   DEBUG Dhanu => PING(20)
2019-10-31 15:00:46,346   DEBUG lava-logs => PING(20)
2019-10-31 15:00:50,812    INFO scheduling health checks:
2019-10-31 15:00:50,816    INFO scheduling jobs:
2019-10-31 15:00:58,312   DEBUG Dhanu => PING(20)
2019-10-31 15:01:06,367   DEBUG lava-logs => PING(20)
2019-10-31 15:01:10,829    INFO scheduling health checks:
2019-10-31 15:01:10,833    INFO scheduling jobs:
2019-10-31 15:01:18,336   DEBUG Dhanu => PING(20)
2019-10-31 15:01:26,390   DEBUG lava-logs => PING(20)
2019-10-31 15:01:30,847    INFO scheduling health checks:
2019-10-31 15:01:30,850    INFO scheduling jobs:
2019-10-31 15:01:38,357   DEBUG Dhanu => PING(20)
2019-10-31 15:01:46,411   DEBUG lava-logs => PING(20)
2019-10-31 15:01:50,868    INFO scheduling health checks:
2019-10-31 15:01:50,871    INFO scheduling jobs:
2019-10-31 15:01:58,381   DEBUG Dhanu => PING(20)
2019-10-31 15:02:06,434   DEBUG lava-logs => PING(20)
2019-10-31 15:02:10,887    INFO scheduling health checks:
2019-10-31 15:02:10,891    INFO scheduling jobs:
2019-10-31 15:02:18,405   DEBUG Dhanu => PING(20)
2019-10-31 15:02:26,457   DEBUG lava-logs => PING(20)
2019-10-31 15:02:30,906    INFO scheduling health checks:
2019-10-31 15:02:30,910    INFO scheduling jobs:
2019-10-31 15:02:38,429   DEBUG Dhanu => PING(20)
2019-10-31 15:02:46,480   DEBUG lava-logs => PING(20)
2019-10-31 15:02:50,925    INFO scheduling health checks:
2019-10-31 15:02:50,929    INFO scheduling jobs:
2019-10-31 15:02:58,448   DEBUG Dhanu => PING(20)
2019-10-31 15:03:06,500   DEBUG lava-logs => PING(20)
2019-10-31 15:03:10,947    INFO scheduling health checks:
2019-10-31 15:03:10,951    INFO scheduling jobs:
2019-10-31 15:03:18,468   DEBUG Dhanu => PING(20)
2019-10-31 15:03:26,520   DEBUG lava-logs => PING(20)
2019-10-31 15:03:30,963    INFO scheduling health checks:
2019-10-31 15:03:30,966    INFO scheduling jobs:
2019-10-31 15:03:38,490   DEBUG Dhanu => PING(20)
2019-10-31 15:03:46,542   DEBUG lava-logs => PING(20)
2019-10-31 15:03:50,981    INFO scheduling health checks:
2019-10-31 15:03:50,984    INFO scheduling jobs:
2019-10-31 15:03:58,511   DEBUG Dhanu => PING(20)
2019-10-31 15:04:06,562   DEBUG lava-logs => PING(20)
2019-10-31 15:04:10,999    INFO scheduling health checks:
2019-10-31 15:04:11,003    INFO scheduling jobs:
2019-10-31 15:04:18,528   DEBUG Dhanu => PING(20)
2019-10-31 15:04:26,578   DEBUG lava-logs => PING(20)
2019-10-31 15:04:31,018    INFO scheduling health checks:
2019-10-31 15:04:31,021    INFO scheduling jobs:
2019-10-31 15:04:38,546   DEBUG Dhanu => PING(20)
2019-10-31 15:04:46,598   DEBUG lava-logs => PING(20)
2019-10-31 15:04:51,036    INFO scheduling health checks:
2019-10-31 15:04:51,039    INFO scheduling jobs:
2019-10-31 15:04:58,564   DEBUG Dhanu => PING(20)
2019-10-31 15:05:06,612   DEBUG lava-logs => PING(20)
2019-10-31 15:05:11,051    INFO scheduling health checks:
2019-10-31 15:05:11,055    INFO scheduling jobs:
2019-10-31 15:05:18,582   DEBUG Dhanu => PING(20)
2019-10-31 15:05:26,632   DEBUG lava-logs => PING(20)
2019-10-31 15:05:31,069    INFO scheduling health checks:
2019-10-31 15:05:31,071    INFO scheduling jobs:
2019-10-31 15:05:38,600   DEBUG Dhanu => PING(20)
2019-10-31 15:05:46,652   DEBUG lava-logs => PING(20)
2019-10-31 15:05:51,082    INFO scheduling health checks:
2019-10-31 15:05:51,086    INFO scheduling jobs:
2019-10-31 15:05:58,616   DEBUG Dhanu => PING(20)
2019-10-31 15:06:06,674   DEBUG lava-logs => PING(20)
2019-10-31 15:06:11,099    INFO scheduling health checks:
2019-10-31 15:06:11,101    INFO scheduling jobs:
2019-10-31 15:06:18,637   DEBUG Dhanu => PING(20)
2019-10-31 15:06:26,696   DEBUG lava-logs => PING(20)
2019-10-31 15:06:31,115    INFO scheduling health checks:
2019-10-31 15:06:31,119    INFO scheduling jobs:
2019-10-31 15:06:38,656   DEBUG Dhanu => PING(20)
2019-10-31 15:06:46,719   DEBUG lava-logs => PING(20)
2019-10-31 15:06:51,137    INFO scheduling health checks:
2019-10-31 15:06:51,141    INFO scheduling jobs:
2019-10-31 15:06:58,677   DEBUG Dhanu => PING(20)
2019-10-31 15:07:06,742   DEBUG lava-logs => PING(20)
2019-10-31 15:07:11,155    INFO scheduling health checks:
2019-10-31 15:07:11,159    INFO scheduling jobs:
2019-10-31 15:07:18,702   DEBUG Dhanu => PING(20)
2019-10-31 15:07:26,765   DEBUG lava-logs => PING(20)
2019-10-31 15:07:31,173    INFO scheduling health checks:
2019-10-31 15:07:31,177    INFO scheduling jobs:
2019-10-31 15:07:38,725   DEBUG Dhanu => PING(20)
2019-10-31 15:07:44,435   DEBUG lava-logs => PING(20)
2019-10-31 15:07:44,458   DEBUG lava-logs => PING(20)
2019-10-31 15:07:51,193    INFO scheduling health checks:
2019-10-31 15:07:51,197    INFO scheduling jobs:
2019-10-31 15:07:58,749   DEBUG Dhanu => PING(20)
2019-10-31 15:08:04,476   DEBUG lava-logs => PING(20)
2019-10-31 15:08:11,215    INFO scheduling health checks:
2019-10-31 15:08:11,219    INFO scheduling jobs:
2019-10-31 15:08:24,499   DEBUG lava-logs => PING(20)
2019-10-31 15:08:31,235    INFO scheduling health checks:
2019-10-31 15:08:31,239    INFO scheduling jobs:
2019-10-31 15:08:44,520   DEBUG lava-logs => PING(20)
2019-10-31 15:08:51,253    INFO scheduling health checks:
2019-10-31 15:08:51,257    INFO scheduling jobs:
2019-10-31 15:09:04,540   DEBUG lava-logs => PING(20)
2019-10-31 15:09:10,351   ERROR [STATE] Dispatcher <Dhanu> goes OFFLINE
2019-10-31 15:09:11,273    INFO scheduling health checks:
2019-10-31 15:09:11,276    INFO scheduling jobs:
2019-10-31 15:09:24,556   DEBUG lava-logs => PING(20)
2019-10-31 15:09:31,293    INFO scheduling health checks:
2019-10-31 15:09:31,297    INFO scheduling jobs:
2019-10-31 15:09:44,579   DEBUG lava-logs => PING(20)
2019-10-31 15:09:50,380    INFO [POLL] Received a signal, leaving
2019-10-31 15:09:50,389    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 15:09:51,832    INFO [INIT] Dropping privileges
2019-10-31 15:09:51,832   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 15:09:51,833   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 15:09:51,834    INFO [INIT] Marking all workers as offline
2019-10-31 15:09:51,894    INFO [INIT] Starting encryption
2019-10-31 15:09:51,896   DEBUG [INIT] Opening master certificate: /etc/lava-dispatcher/certificates.d/master.key_secret
2019-10-31 15:09:51,897   DEBUG [INIT] Using slaves certificates from: /etc/lava-dispatcher/certificates.d
2019-10-31 15:09:51,897   DEBUG [INIT] Watching /etc/lava-dispatcher/certificates.d
2019-10-31 15:09:51,917    INFO [INIT] LAVA master has started.
2019-10-31 15:09:51,917    INFO [INIT] Using protocol version 3
2019-10-31 15:09:58,079    INFO Dhanu => HELLO
2019-10-31 15:09:58,080 WARNING New dispatcher <Dhanu>
2019-10-31 15:10:03,087   DEBUG Dhanu => PING(20)
2019-10-31 15:10:11,923 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 15:10:23,104   DEBUG Dhanu => PING(20)
2019-10-31 15:10:31,932 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 15:10:43,120   DEBUG Dhanu => PING(20)
2019-10-31 15:10:51,939 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 15:11:03,136   DEBUG Dhanu => PING(20)
2019-10-31 15:11:11,948 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 15:11:23,160   DEBUG Dhanu => PING(20)
2019-10-31 15:11:31,955 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 15:11:43,182   DEBUG Dhanu => PING(20)
2019-10-31 15:11:51,963 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 15:12:03,202   DEBUG Dhanu => PING(20)
2019-10-31 15:12:11,971 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 15:12:23,220   DEBUG Dhanu => PING(20)
2019-10-31 15:12:32,005 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 15:12:43,396   DEBUG Dhanu => PING(20)
2019-10-31 15:12:52,015 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 15:13:03,511   DEBUG Dhanu => PING(20)
2019-10-31 15:13:12,021 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 15:13:23,532   DEBUG Dhanu => PING(20)
2019-10-31 15:13:32,029 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 15:13:43,552   DEBUG Dhanu => PING(20)
2019-10-31 15:13:52,037 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 15:14:03,577   DEBUG Dhanu => PING(20)
2019-10-31 15:14:12,043 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 15:14:23,600   DEBUG Dhanu => PING(20)
2019-10-31 15:14:32,050 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 15:14:43,618   DEBUG Dhanu => PING(20)
2019-10-31 15:14:52,057 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 15:15:03,636   DEBUG Dhanu => PING(20)
2019-10-31 15:15:12,064 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 15:15:23,652   DEBUG Dhanu => PING(20)
2019-10-31 15:15:32,068 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 15:15:43,672   DEBUG Dhanu => PING(20)
2019-10-31 15:15:52,074 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 15:16:03,688   DEBUG Dhanu => PING(20)
2019-10-31 15:16:12,081 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 15:16:23,705   DEBUG Dhanu => PING(20)
2019-10-31 15:16:32,088 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 15:16:43,728   DEBUG Dhanu => PING(20)
2019-10-31 15:16:52,096 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 15:17:03,744   DEBUG Dhanu => PING(20)
2019-10-31 15:17:12,105 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 15:17:23,764   DEBUG Dhanu => PING(20)
2019-10-31 15:17:32,113 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 15:17:43,786   DEBUG Dhanu => PING(20)
2019-10-31 15:17:52,121 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 15:18:03,808   DEBUG Dhanu => PING(20)
2019-10-31 15:18:12,128 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 15:18:23,824   DEBUG Dhanu => PING(20)
2019-10-31 15:18:32,136 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 15:18:43,848   DEBUG Dhanu => PING(20)
2019-10-31 15:18:52,142 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 15:19:03,868   DEBUG Dhanu => PING(20)
2019-10-31 15:19:12,150 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 15:19:23,892   DEBUG Dhanu => PING(20)
2019-10-31 15:19:32,158 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 15:19:43,912   DEBUG Dhanu => PING(20)
2019-10-31 15:19:52,166 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 15:20:03,928   DEBUG Dhanu => PING(20)
2019-10-31 15:20:12,173 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 15:20:23,944   DEBUG Dhanu => PING(20)
2019-10-31 15:20:32,178 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 15:20:43,963   DEBUG Dhanu => PING(20)
2019-10-31 15:20:52,185 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 15:21:03,980   DEBUG Dhanu => PING(20)
2019-10-31 15:21:12,193 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 09:57:18,417    INFO [POLL] Received a signal, leaving
2019-10-31 09:57:18,418    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 09:57:23,503    INFO [INIT] Dropping privileges
2019-10-31 09:57:23,503   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 09:57:23,503   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 09:57:23,505    INFO [INIT] Marking all workers as offline
2019-10-31 09:57:23,528    INFO [INIT] Starting encryption
2019-10-31 09:57:23,530   DEBUG [INIT] Opening master certificate: /etc/lava-dispatcher/certificates.d/master.key_secret
2019-10-31 09:57:23,530   DEBUG [INIT] Using slaves certificates from: /etc/lava-dispatcher/certificates.d
2019-10-31 09:57:23,530   DEBUG [INIT] Watching /etc/lava-dispatcher/certificates.d
2019-10-31 09:57:23,546    INFO [INIT] LAVA master has started.
2019-10-31 09:57:23,546    INFO [INIT] Using protocol version 3
2019-10-31 09:57:27,152    INFO Dhanu => HELLO
2019-10-31 09:57:27,153 WARNING New dispatcher <Dhanu>
2019-10-31 09:57:32,156   DEBUG Dhanu => PING(20)
2019-10-31 09:57:43,557 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 09:57:52,188   DEBUG Dhanu => PING(20)
2019-10-31 09:58:03,567 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 09:58:12,204   DEBUG Dhanu => PING(20)
2019-10-31 09:58:23,573 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 09:58:32,228   DEBUG Dhanu => PING(20)
2019-10-31 09:58:43,581 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 09:58:52,245   DEBUG Dhanu => PING(20)
2019-10-31 09:59:03,591 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 09:59:12,384   DEBUG Dhanu => PING(20)
2019-10-31 09:59:23,619 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 09:59:32,405   DEBUG Dhanu => PING(20)
2019-10-31 09:59:43,628 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 09:59:52,430   DEBUG Dhanu => PING(20)
2019-10-31 10:00:03,636 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:00:12,448   DEBUG Dhanu => PING(20)
2019-10-31 10:00:23,645 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:00:32,473   DEBUG Dhanu => PING(20)
2019-10-31 10:00:43,652 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:00:52,492   DEBUG Dhanu => PING(20)
2019-10-31 10:01:03,658 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:01:12,512   DEBUG Dhanu => PING(20)
2019-10-31 10:01:23,667 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:01:32,537   DEBUG Dhanu => PING(20)
2019-10-31 10:01:43,675 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:01:52,555   DEBUG Dhanu => PING(20)
2019-10-31 10:02:03,683 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:02:12,575   DEBUG Dhanu => PING(20)
2019-10-31 10:02:23,692 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:02:32,614   DEBUG Dhanu => PING(20)
2019-10-31 10:02:43,697 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:02:52,633   DEBUG Dhanu => PING(20)
2019-10-31 10:03:03,704 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:03:12,651   DEBUG Dhanu => PING(20)
2019-10-31 10:03:23,711 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:03:32,668   DEBUG Dhanu => PING(20)
2019-10-31 10:03:43,721 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:03:52,684   DEBUG Dhanu => PING(20)
2019-10-31 10:04:03,728 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:04:12,707   DEBUG Dhanu => PING(20)
2019-10-31 10:04:23,736 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:04:32,727   DEBUG Dhanu => PING(20)
2019-10-31 10:04:43,744 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:04:52,745   DEBUG Dhanu => PING(20)
2019-10-31 10:05:03,750 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:05:12,770   DEBUG Dhanu => PING(20)
2019-10-31 10:05:23,758 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:05:32,795   DEBUG Dhanu => PING(20)
2019-10-31 10:05:43,765 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:05:52,819   DEBUG Dhanu => PING(20)
2019-10-31 10:06:03,773 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:06:12,840   DEBUG Dhanu => PING(20)
2019-10-31 10:06:23,781 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:06:32,857   DEBUG Dhanu => PING(20)
2019-10-31 10:06:43,789 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:06:52,875   DEBUG Dhanu => PING(20)
2019-10-31 10:07:03,794 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:07:12,895   DEBUG Dhanu => PING(20)
2019-10-31 10:07:23,805 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:07:32,919   DEBUG Dhanu => PING(20)
2019-10-31 10:07:43,815 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:07:52,937   DEBUG Dhanu => PING(20)
2019-10-31 10:08:03,826 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:08:12,962   DEBUG Dhanu => PING(20)
2019-10-31 10:08:23,836 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:08:32,985   DEBUG Dhanu => PING(20)
2019-10-31 10:08:43,847 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:08:53,004   DEBUG Dhanu => PING(20)
2019-10-31 10:09:03,954 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:09:13,025   DEBUG Dhanu => PING(20)
2019-10-31 10:09:23,962 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:09:33,044   DEBUG Dhanu => PING(20)
2019-10-31 10:09:43,971 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:09:53,063   DEBUG Dhanu => PING(20)
2019-10-31 10:10:03,978 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:10:13,081   DEBUG Dhanu => PING(20)
2019-10-31 10:10:23,985 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:10:33,101   DEBUG Dhanu => PING(20)
2019-10-31 10:10:43,994 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:10:53,120   DEBUG Dhanu => PING(20)
2019-10-31 10:11:04,000 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:11:13,143   DEBUG Dhanu => PING(20)
2019-10-31 10:11:24,008 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:11:33,166   DEBUG Dhanu => PING(20)
2019-10-31 10:11:44,016 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:11:53,189   DEBUG Dhanu => PING(20)
2019-10-31 10:12:04,021 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:12:13,211   DEBUG Dhanu => PING(20)
2019-10-31 10:12:24,028 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:12:33,235   DEBUG Dhanu => PING(20)
2019-10-31 10:12:44,037 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:12:53,259   DEBUG Dhanu => PING(20)
2019-10-31 10:13:04,044 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:13:13,280   DEBUG Dhanu => PING(20)
2019-10-31 10:13:24,053 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:13:33,297   DEBUG Dhanu => PING(20)
2019-10-31 10:13:44,063 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:13:53,317   DEBUG Dhanu => PING(20)
2019-10-31 10:14:04,071 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:14:13,337   DEBUG Dhanu => PING(20)
2019-10-31 10:14:24,079 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:14:33,360   DEBUG Dhanu => PING(20)
2019-10-31 10:14:44,087 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:14:53,381   DEBUG Dhanu => PING(20)
2019-10-31 10:15:04,097 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:15:13,399   DEBUG Dhanu => PING(20)
2019-10-31 10:15:24,105 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:15:33,421   DEBUG Dhanu => PING(20)
2019-10-31 10:15:44,114 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:15:53,444   DEBUG Dhanu => PING(20)
2019-10-31 10:16:04,122 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:16:13,464   DEBUG Dhanu => PING(20)
2019-10-31 10:16:24,130 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:16:33,484   DEBUG Dhanu => PING(20)
2019-10-31 10:16:44,137 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:16:53,500   DEBUG Dhanu => PING(20)
2019-10-31 10:17:04,145 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:17:13,519   DEBUG Dhanu => PING(20)
2019-10-31 10:17:24,153 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:17:33,540   DEBUG Dhanu => PING(20)
2019-10-31 10:17:44,159 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:17:53,556   DEBUG Dhanu => PING(20)
2019-10-31 10:17:58,366    INFO scheduling health checks:
2019-10-31 10:17:58,725    INFO scheduling jobs:
2019-10-31 10:17:58,727   DEBUG - qemu
2019-10-31 10:17:58,909   ERROR [CLOSE] Unknown exception raised, leaving!
2019-10-31 10:17:58,909   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 799, in main_loop
    jobs = schedule(self.logger, self.events["available_dt"])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 3, in top-level template code
    {% set memory = '1024' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-10-31 10:17:58,951    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 10:18:05,372    INFO [INIT] Dropping privileges
2019-10-31 10:18:05,372   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 10:18:05,372   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 10:18:05,374    INFO [INIT] Marking all workers as offline
2019-10-31 10:18:05,416    INFO [INIT] Starting encryption
2019-10-31 10:18:05,418   DEBUG [INIT] Opening master certificate: /etc/lava-dispatcher/certificates.d/master.key_secret
2019-10-31 10:18:05,419   DEBUG [INIT] Using slaves certificates from: /etc/lava-dispatcher/certificates.d
2019-10-31 10:18:05,419   DEBUG [INIT] Watching /etc/lava-dispatcher/certificates.d
2019-10-31 10:18:05,441    INFO [INIT] LAVA master has started.
2019-10-31 10:18:05,441    INFO [INIT] Using protocol version 3
2019-10-31 10:18:13,573   DEBUG Dhanu => PING(20)
2019-10-31 10:18:13,575 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-10-31 10:18:25,454 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:18:33,591   DEBUG Dhanu => PING(20)
2019-10-31 10:18:45,486 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:18:53,613   DEBUG Dhanu => PING(20)
2019-10-31 10:19:05,538 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:19:13,633   DEBUG Dhanu => PING(20)
2019-10-31 10:19:25,548 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:19:33,651   DEBUG Dhanu => PING(20)
2019-10-31 10:19:45,556 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:19:53,667   DEBUG Dhanu => PING(20)
2019-10-31 10:20:05,564 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:20:13,683   DEBUG Dhanu => PING(20)
2019-10-31 10:20:25,572 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:20:33,703   DEBUG Dhanu => PING(20)
2019-10-31 10:20:45,579 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:20:53,721   DEBUG Dhanu => PING(20)
2019-10-31 10:21:05,587 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:21:13,746   DEBUG Dhanu => PING(20)
2019-10-31 10:21:25,595 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:21:33,766   DEBUG Dhanu => PING(20)
2019-10-31 10:21:45,603 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:21:53,784   DEBUG Dhanu => PING(20)
2019-10-31 10:22:05,610 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:22:13,799   DEBUG Dhanu => PING(20)
2019-10-31 10:22:25,618 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:22:33,815   DEBUG Dhanu => PING(20)
2019-10-31 10:22:45,628 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:22:53,837   DEBUG Dhanu => PING(20)
2019-10-31 10:23:05,631 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:23:13,860   DEBUG Dhanu => PING(20)
2019-10-31 10:23:25,639 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:23:33,885   DEBUG Dhanu => PING(20)
2019-10-31 10:23:45,647 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:23:53,908   DEBUG Dhanu => PING(20)
2019-10-31 10:24:05,653 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:24:13,933   DEBUG Dhanu => PING(20)
2019-10-31 10:24:25,660 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:24:33,953   DEBUG Dhanu => PING(20)
2019-10-31 10:24:45,671 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:24:53,978   DEBUG Dhanu => PING(20)
2019-10-31 10:25:05,683 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:25:14,000   DEBUG Dhanu => PING(20)
2019-10-31 10:25:25,694 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:25:34,015   DEBUG Dhanu => PING(20)
2019-10-31 10:25:45,705 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:25:54,033   DEBUG Dhanu => PING(20)
2019-10-31 10:26:05,715 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:26:14,052   DEBUG Dhanu => PING(20)
2019-10-31 10:26:25,726 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:26:34,071   DEBUG Dhanu => PING(20)
2019-10-31 10:26:45,737 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:26:54,091   DEBUG Dhanu => PING(20)
2019-10-31 10:27:05,747 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:27:14,107   DEBUG Dhanu => PING(20)
2019-10-31 10:27:25,754 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:27:34,125   DEBUG Dhanu => PING(20)
2019-10-31 10:27:45,766 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:27:54,150   DEBUG Dhanu => PING(20)
2019-10-31 10:28:05,774 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:28:14,171   DEBUG Dhanu => PING(20)
2019-10-31 10:28:25,786 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:28:34,189   DEBUG Dhanu => PING(20)
2019-10-31 10:28:45,797 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:28:54,207   DEBUG Dhanu => PING(20)
2019-10-31 10:29:05,807 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:29:14,226   DEBUG Dhanu => PING(20)
2019-10-31 10:29:25,816 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:29:34,244   DEBUG Dhanu => PING(20)
2019-10-31 10:29:45,824 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:29:54,260   DEBUG Dhanu => PING(20)
2019-10-31 10:30:05,831 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:30:14,279   DEBUG Dhanu => PING(20)
2019-10-31 10:30:25,838 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:30:34,297   DEBUG Dhanu => PING(20)
2019-10-31 10:30:45,850 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:30:54,316   DEBUG Dhanu => PING(20)
2019-10-31 10:31:05,861 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:31:14,336   DEBUG Dhanu => PING(20)
2019-10-31 10:31:25,872 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:31:34,355   DEBUG Dhanu => PING(20)
2019-10-31 10:31:45,882 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:31:54,373   DEBUG Dhanu => PING(20)
2019-10-31 10:32:05,890 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:32:14,391   DEBUG Dhanu => PING(20)
2019-10-31 10:32:25,902 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:32:34,412   DEBUG Dhanu => PING(20)
2019-10-31 10:32:45,909 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:32:54,432   DEBUG Dhanu => PING(20)
2019-10-31 10:33:05,919 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:33:14,453   DEBUG Dhanu => PING(20)
2019-10-31 10:33:25,930 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:33:34,472   DEBUG Dhanu => PING(20)
2019-10-31 10:33:45,938 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:33:54,491   DEBUG Dhanu => PING(20)
2019-10-31 10:34:05,950 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:34:14,515   DEBUG Dhanu => PING(20)
2019-10-31 10:34:25,961 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:34:34,535   DEBUG Dhanu => PING(20)
2019-10-31 10:34:45,972 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:34:54,557   DEBUG Dhanu => PING(20)
2019-10-31 10:35:05,984 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:35:14,582   DEBUG Dhanu => PING(20)
2019-10-31 10:35:25,991 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:35:34,605   DEBUG Dhanu => PING(20)
2019-10-31 10:35:46,002 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:35:54,628   DEBUG Dhanu => PING(20)
2019-10-31 10:36:06,011 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:36:14,652   DEBUG Dhanu => PING(20)
2019-10-31 10:36:26,018 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:36:34,672   DEBUG Dhanu => PING(20)
2019-10-31 10:36:46,025 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:36:54,696   DEBUG Dhanu => PING(20)
2019-10-31 10:37:06,033 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:37:14,720   DEBUG Dhanu => PING(20)
2019-10-31 10:37:26,041 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:37:34,744   DEBUG Dhanu => PING(20)
2019-10-31 10:37:46,048 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:37:54,765   DEBUG Dhanu => PING(20)
2019-10-31 10:38:06,056 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:38:14,790   DEBUG Dhanu => PING(20)
2019-10-31 10:38:26,067 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:38:34,814   DEBUG Dhanu => PING(20)
2019-10-31 10:38:46,078 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:38:54,839   DEBUG Dhanu => PING(20)
2019-10-31 10:39:06,086 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:39:14,863   DEBUG Dhanu => PING(20)
2019-10-31 10:39:26,096 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:39:34,884   DEBUG Dhanu => PING(20)
2019-10-31 10:39:46,107 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:39:54,908   DEBUG Dhanu => PING(20)
2019-10-31 10:40:06,118 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:40:14,933   DEBUG Dhanu => PING(20)
2019-10-31 10:40:26,129 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:40:34,957   DEBUG Dhanu => PING(20)
2019-10-31 10:40:46,140 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:40:54,982   DEBUG Dhanu => PING(20)
2019-10-31 10:41:06,151 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:41:15,004   DEBUG Dhanu => PING(20)
2019-10-31 10:41:26,162 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:41:35,028   DEBUG Dhanu => PING(20)
2019-10-31 10:41:46,169 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:41:55,052   DEBUG Dhanu => PING(20)
2019-10-31 10:42:06,177 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:42:15,076   DEBUG Dhanu => PING(20)
2019-10-31 10:42:26,186 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:42:35,098   DEBUG Dhanu => PING(20)
2019-10-31 10:42:46,197 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:42:55,123   DEBUG Dhanu => PING(20)
2019-10-31 10:43:06,204 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:43:15,144   DEBUG Dhanu => PING(20)
2019-10-31 10:43:26,214 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:43:35,168   DEBUG Dhanu => PING(20)
2019-10-31 10:43:46,225 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:43:55,189   DEBUG Dhanu => PING(20)
2019-10-31 10:44:06,236 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:44:15,214   DEBUG Dhanu => PING(20)
2019-10-31 10:44:26,248 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:44:35,236   DEBUG Dhanu => PING(20)
2019-10-31 10:44:46,259 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:44:55,259   DEBUG Dhanu => PING(20)
2019-10-31 10:45:06,269 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:45:15,283   DEBUG Dhanu => PING(20)
2019-10-31 10:45:26,280 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:45:35,307   DEBUG Dhanu => PING(20)
2019-10-31 10:45:46,291 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:45:55,328   DEBUG Dhanu => PING(20)
2019-10-31 10:46:06,301 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:46:15,349   DEBUG Dhanu => PING(20)
2019-10-31 10:46:26,311 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:46:35,374   DEBUG Dhanu => PING(20)
2019-10-31 10:46:46,318 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:46:55,396   DEBUG Dhanu => PING(20)
2019-10-31 10:47:06,326 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:47:15,421   DEBUG Dhanu => PING(20)
2019-10-31 10:47:26,334 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:47:35,444   DEBUG Dhanu => PING(20)
2019-10-31 10:47:46,342 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:47:55,468   DEBUG Dhanu => PING(20)
2019-10-31 10:48:06,350 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:48:15,492   DEBUG Dhanu => PING(20)
2019-10-31 10:48:26,358 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:48:35,513   DEBUG Dhanu => PING(20)
2019-10-31 10:48:46,366 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:48:55,536   DEBUG Dhanu => PING(20)
2019-10-31 10:49:06,374 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:49:15,549   DEBUG Dhanu => PING(20)
2019-10-31 10:49:26,382 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:49:35,569   DEBUG Dhanu => PING(20)
2019-10-31 10:49:46,392 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:49:55,590   DEBUG Dhanu => PING(20)
2019-10-31 10:50:06,402 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:50:15,613   DEBUG Dhanu => PING(20)
2019-10-31 10:50:26,412 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:50:35,632   DEBUG Dhanu => PING(20)
2019-10-31 10:50:46,423 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:50:55,657   DEBUG Dhanu => PING(20)
2019-10-31 10:51:06,432 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:51:15,680   DEBUG Dhanu => PING(20)
2019-10-31 10:51:26,440 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:51:35,697   DEBUG Dhanu => PING(20)
2019-10-31 10:51:46,449 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:51:55,721   DEBUG Dhanu => PING(20)
2019-10-31 10:52:06,458 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:52:15,744   DEBUG Dhanu => PING(20)
2019-10-31 10:52:26,469 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:52:35,761   DEBUG Dhanu => PING(20)
2019-10-31 10:52:46,478 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:52:55,781   DEBUG Dhanu => PING(20)
2019-10-31 10:53:06,488 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:53:15,799   DEBUG Dhanu => PING(20)
2019-10-31 10:53:26,495 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:53:35,821   DEBUG Dhanu => PING(20)
2019-10-31 10:53:46,504 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:53:55,844   DEBUG Dhanu => PING(20)
2019-10-31 10:54:06,512 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:54:15,865   DEBUG Dhanu => PING(20)
2019-10-31 10:54:26,520 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:54:35,885   DEBUG Dhanu => PING(20)
2019-10-31 10:54:46,529 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:54:55,907   DEBUG Dhanu => PING(20)
2019-10-31 10:55:06,539 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:55:15,925   DEBUG Dhanu => PING(20)
2019-10-31 10:55:26,548 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:55:35,944   DEBUG Dhanu => PING(20)
2019-10-31 10:55:46,559 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:55:55,959   DEBUG Dhanu => PING(20)
2019-10-31 10:56:06,566 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:56:15,983   DEBUG Dhanu => PING(20)
2019-10-31 10:56:26,575 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:56:35,999   DEBUG Dhanu => PING(20)
2019-10-31 10:56:46,584 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:56:56,034   DEBUG Dhanu => PING(20)
2019-10-31 10:57:06,591 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:57:16,052   DEBUG Dhanu => PING(20)
2019-10-31 10:57:26,601 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:57:36,071   DEBUG Dhanu => PING(20)
2019-10-31 10:57:46,609 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:57:56,091   DEBUG Dhanu => PING(20)
2019-10-31 10:58:06,617 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:58:16,111   DEBUG Dhanu => PING(20)
2019-10-31 10:58:26,627 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:58:36,131   DEBUG Dhanu => PING(20)
2019-10-31 10:58:46,638 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:58:56,152   DEBUG Dhanu => PING(20)
2019-10-31 10:59:06,646 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:59:16,178   DEBUG Dhanu => PING(20)
2019-10-31 10:59:26,654 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:59:36,200   DEBUG Dhanu => PING(20)
2019-10-31 10:59:46,663 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 10:59:56,224   DEBUG Dhanu => PING(20)
2019-10-31 11:00:06,674 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:00:16,246   DEBUG Dhanu => PING(20)
2019-10-31 11:00:26,682 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:00:36,267   DEBUG Dhanu => PING(20)
2019-10-31 11:00:46,692 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:00:56,291   DEBUG Dhanu => PING(20)
2019-10-31 11:01:06,700 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:01:16,312   DEBUG Dhanu => PING(20)
2019-10-31 11:01:26,709 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:01:36,331   DEBUG Dhanu => PING(20)
2019-10-31 11:01:46,717 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:01:56,348   DEBUG Dhanu => PING(20)
2019-10-31 11:02:06,727 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:02:16,363   DEBUG Dhanu => PING(20)
2019-10-31 11:02:26,734 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:02:36,387   DEBUG Dhanu => PING(20)
2019-10-31 11:02:46,745 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:02:56,408   DEBUG Dhanu => PING(20)
2019-10-31 11:03:06,755 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:03:16,423   DEBUG Dhanu => PING(20)
2019-10-31 11:03:26,765 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:03:36,438   DEBUG Dhanu => PING(20)
2019-10-31 11:03:46,775 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:03:56,459   DEBUG Dhanu => PING(20)
2019-10-31 11:04:06,783 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:04:16,479   DEBUG Dhanu => PING(20)
2019-10-31 11:04:26,790 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:04:36,501   DEBUG Dhanu => PING(20)
2019-10-31 11:04:46,799 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:04:56,520   DEBUG Dhanu => PING(20)
2019-10-31 11:05:06,806 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:05:16,543   DEBUG Dhanu => PING(20)
2019-10-31 11:05:26,816 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:05:36,566   DEBUG Dhanu => PING(20)
2019-10-31 11:05:46,826 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:05:56,591   DEBUG Dhanu => PING(20)
2019-10-31 11:06:06,834 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:06:16,612   DEBUG Dhanu => PING(20)
2019-10-31 11:06:26,842 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:06:36,631   DEBUG Dhanu => PING(20)
2019-10-31 11:06:46,852 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:06:56,648   DEBUG Dhanu => PING(20)
2019-10-31 11:07:06,860 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:07:16,671   DEBUG Dhanu => PING(20)
2019-10-31 11:07:26,867 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:07:36,692   DEBUG Dhanu => PING(20)
2019-10-31 11:07:46,874 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:07:56,711   DEBUG Dhanu => PING(20)
2019-10-31 11:08:06,883 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:08:16,727   DEBUG Dhanu => PING(20)
2019-10-31 11:08:26,891 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:08:36,743   DEBUG Dhanu => PING(20)
2019-10-31 11:08:46,901 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:08:56,765   DEBUG Dhanu => PING(20)
2019-10-31 11:09:06,910 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:09:16,790   DEBUG Dhanu => PING(20)
2019-10-31 11:09:26,919 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:09:36,812   DEBUG Dhanu => PING(20)
2019-10-31 11:09:46,927 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:09:56,827   DEBUG Dhanu => PING(20)
2019-10-31 11:10:06,934 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:10:16,851   DEBUG Dhanu => PING(20)
2019-10-31 11:10:26,940 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:10:36,867   DEBUG Dhanu => PING(20)
2019-10-31 11:10:46,948 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:10:56,891   DEBUG Dhanu => PING(20)
2019-10-31 11:11:06,956 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:11:16,915   DEBUG Dhanu => PING(20)
2019-10-31 11:11:26,964 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:11:36,935   DEBUG Dhanu => PING(20)
2019-10-31 11:11:46,971 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:11:56,959   DEBUG Dhanu => PING(20)
2019-10-31 11:12:06,978 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:12:16,982   DEBUG Dhanu => PING(20)
2019-10-31 11:12:26,982 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:12:37,001   DEBUG Dhanu => PING(20)
2019-10-31 11:12:46,991 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:12:57,021   DEBUG Dhanu => PING(20)
2019-10-31 11:13:07,001 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:13:17,044   DEBUG Dhanu => PING(20)
2019-10-31 11:13:27,008 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:13:37,063   DEBUG Dhanu => PING(20)
2019-10-31 11:13:47,015 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:13:57,080   DEBUG Dhanu => PING(20)
2019-10-31 11:14:07,023 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:14:17,099   DEBUG Dhanu => PING(20)
2019-10-31 11:14:27,030 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:14:37,116   DEBUG Dhanu => PING(20)
2019-10-31 11:14:47,038 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:14:57,131   DEBUG Dhanu => PING(20)
2019-10-31 11:15:07,045 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:15:17,153   DEBUG Dhanu => PING(20)
2019-10-31 11:15:27,053 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:15:37,177   DEBUG Dhanu => PING(20)
2019-10-31 11:15:47,061 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:15:57,197   DEBUG Dhanu => PING(20)
2019-10-31 11:16:07,069 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:16:17,218   DEBUG Dhanu => PING(20)
2019-10-31 11:16:27,077 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:16:37,237   DEBUG Dhanu => PING(20)
2019-10-31 11:16:47,086 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:16:57,256   DEBUG Dhanu => PING(20)
2019-10-31 11:17:07,093 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:17:17,272   DEBUG Dhanu => PING(20)
2019-10-31 11:17:27,100 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:17:37,292   DEBUG Dhanu => PING(20)
2019-10-31 11:17:47,108 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:17:57,314   DEBUG Dhanu => PING(20)
2019-10-31 11:18:07,115 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:18:17,332   DEBUG Dhanu => PING(20)
2019-10-31 11:18:27,124 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:18:37,348   DEBUG Dhanu => PING(20)
2019-10-31 11:18:47,132 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:18:57,364   DEBUG Dhanu => PING(20)
2019-10-31 11:19:07,140 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:19:17,381   DEBUG Dhanu => PING(20)
2019-10-31 11:19:27,146 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:19:37,400   DEBUG Dhanu => PING(20)
2019-10-31 11:19:47,154 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:19:57,419   DEBUG Dhanu => PING(20)
2019-10-31 11:20:07,158 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:20:17,439   DEBUG Dhanu => PING(20)
2019-10-31 11:20:27,166 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:20:37,458   DEBUG Dhanu => PING(20)
2019-10-31 11:20:47,174 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:20:57,480   DEBUG Dhanu => PING(20)
2019-10-31 11:21:07,182 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:21:17,502   DEBUG Dhanu => PING(20)
2019-10-31 11:21:27,189 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:21:37,524   DEBUG Dhanu => PING(20)
2019-10-31 11:21:47,196 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:21:57,544   DEBUG Dhanu => PING(20)
2019-10-31 11:22:07,205 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:22:17,563   DEBUG Dhanu => PING(20)
2019-10-31 11:22:27,215 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:22:37,587   DEBUG Dhanu => PING(20)
2019-10-31 11:22:47,223 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:22:57,604   DEBUG Dhanu => PING(20)
2019-10-31 11:23:07,232 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:23:17,625   DEBUG Dhanu => PING(20)
2019-10-31 11:23:27,241 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:23:37,650   DEBUG Dhanu => PING(20)
2019-10-31 11:23:47,250 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:23:57,668   DEBUG Dhanu => PING(20)
2019-10-31 11:24:07,260 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:24:17,684   DEBUG Dhanu => PING(20)
2019-10-31 11:24:27,269 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:24:37,699   DEBUG Dhanu => PING(20)
2019-10-31 11:24:47,277 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:24:57,717   DEBUG Dhanu => PING(20)
2019-10-31 11:25:07,283 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:25:17,739   DEBUG Dhanu => PING(20)
2019-10-31 11:25:27,292 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:25:37,761   DEBUG Dhanu => PING(20)
2019-10-31 11:25:47,300 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:25:57,780   DEBUG Dhanu => PING(20)
2019-10-31 11:26:07,306 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:26:17,795   DEBUG Dhanu => PING(20)
2019-10-31 11:26:27,316 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:26:37,811   DEBUG Dhanu => PING(20)
2019-10-31 11:26:47,325 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:26:57,833   DEBUG Dhanu => PING(20)
2019-10-31 11:27:07,332 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:27:17,851   DEBUG Dhanu => PING(20)
2019-10-31 11:27:27,339 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:27:37,867   DEBUG Dhanu => PING(20)
2019-10-31 11:27:47,344 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:27:57,891   DEBUG Dhanu => PING(20)
2019-10-31 11:28:07,352 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:28:17,911   DEBUG Dhanu => PING(20)
2019-10-31 11:28:27,360 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:28:37,935   DEBUG Dhanu => PING(20)
2019-10-31 11:28:47,368 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:28:57,952   DEBUG Dhanu => PING(20)
2019-10-31 11:29:07,376 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:29:17,971   DEBUG Dhanu => PING(20)
2019-10-31 11:29:27,385 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:29:37,988   DEBUG Dhanu => PING(20)
2019-10-31 11:29:47,393 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:29:58,004   DEBUG Dhanu => PING(20)
2019-10-31 11:30:07,401 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:30:18,019   DEBUG Dhanu => PING(20)
2019-10-31 11:30:27,411 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:30:38,040   DEBUG Dhanu => PING(20)
2019-10-31 11:30:47,418 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:30:58,055   DEBUG Dhanu => PING(20)
2019-10-31 11:31:07,425 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:31:18,077   DEBUG Dhanu => PING(20)
2019-10-31 11:31:27,432 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:31:38,101   DEBUG Dhanu => PING(20)
2019-10-31 11:31:47,441 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:31:58,126   DEBUG Dhanu => PING(20)
2019-10-31 11:32:07,447 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:32:18,148   DEBUG Dhanu => PING(20)
2019-10-31 11:32:27,454 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:32:38,171   DEBUG Dhanu => PING(20)
2019-10-31 11:32:47,462 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:32:58,195   DEBUG Dhanu => PING(20)
2019-10-31 11:33:07,468 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:33:18,217   DEBUG Dhanu => PING(20)
2019-10-31 11:33:27,476 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:33:38,241   DEBUG Dhanu => PING(20)
2019-10-31 11:33:47,484 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:33:58,265   DEBUG Dhanu => PING(20)
2019-10-31 11:34:07,492 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:34:18,288   DEBUG Dhanu => PING(20)
2019-10-31 11:34:27,500 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:34:38,313   DEBUG Dhanu => PING(20)
2019-10-31 11:34:47,508 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:34:58,337   DEBUG Dhanu => PING(20)
2019-10-31 11:35:07,517 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:35:18,358   DEBUG Dhanu => PING(20)
2019-10-31 11:35:27,525 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:35:38,379   DEBUG Dhanu => PING(20)
2019-10-31 11:35:47,533 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:35:58,396   DEBUG Dhanu => PING(20)
2019-10-31 11:36:07,541 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:36:18,416   DEBUG Dhanu => PING(20)
2019-10-31 11:36:27,548 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:36:38,440   DEBUG Dhanu => PING(20)
2019-10-31 11:36:47,555 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:36:58,456   DEBUG Dhanu => PING(20)
2019-10-31 11:37:07,197    INFO [POLL] Received a signal, leaving
2019-10-31 11:37:07,198    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 11:37:17,430    INFO [INIT] Dropping privileges
2019-10-31 11:37:17,430   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 11:37:17,430   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 11:37:17,432    INFO [INIT] Marking all workers as offline
2019-10-31 11:37:17,480    INFO [INIT] Starting encryption
2019-10-31 11:37:17,482   DEBUG [INIT] Opening master certificate: /etc/lava-dispatcher/certificates.d/master.key_secret
2019-10-31 11:37:17,496   DEBUG [INIT] Using slaves certificates from: /etc/lava-dispatcher/certificates.d
2019-10-31 11:37:17,496   DEBUG [INIT] Watching /etc/lava-dispatcher/certificates.d
2019-10-31 11:37:17,509    INFO [INIT] LAVA master has started.
2019-10-31 11:37:17,509    INFO [INIT] Using protocol version 3
2019-10-31 11:37:17,709    INFO Dhanu => HELLO
2019-10-31 11:37:17,709 WARNING New dispatcher <Dhanu>
2019-10-31 11:37:22,715   DEBUG Dhanu => PING(20)
2019-10-31 11:37:37,523 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:37:42,731   DEBUG Dhanu => PING(20)
2019-10-31 11:37:57,536 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:38:02,752   DEBUG Dhanu => PING(20)
2019-10-31 11:38:17,550 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:38:22,773   DEBUG Dhanu => PING(20)
2019-10-31 11:38:37,558 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:38:42,795   DEBUG Dhanu => PING(20)
2019-10-31 11:38:57,565 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:39:02,815   DEBUG Dhanu => PING(20)
2019-10-31 11:39:17,574 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:39:22,831   DEBUG Dhanu => PING(20)
2019-10-31 11:39:37,586 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:39:42,847   DEBUG Dhanu => PING(20)
2019-10-31 11:39:57,601 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:40:02,868   DEBUG Dhanu => PING(20)
2019-10-31 11:40:17,614 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:40:22,892   DEBUG Dhanu => PING(20)
2019-10-31 11:40:37,624 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:40:42,911   DEBUG Dhanu => PING(20)
2019-10-31 11:40:57,638 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:41:02,928   DEBUG Dhanu => PING(20)
2019-10-31 11:41:17,649 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:41:22,945   DEBUG Dhanu => PING(20)
2019-10-31 11:41:37,663 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:41:42,963   DEBUG Dhanu => PING(20)
2019-10-31 11:41:57,674 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:42:02,979   DEBUG Dhanu => PING(20)
2019-10-31 11:42:17,687 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:42:22,996   DEBUG Dhanu => PING(20)
2019-10-31 11:42:37,702 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:42:43,013   DEBUG Dhanu => PING(20)
2019-10-31 11:42:57,714 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:43:03,031   DEBUG Dhanu => PING(20)
2019-10-31 11:43:17,726 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:43:23,057   DEBUG Dhanu => PING(20)
2019-10-31 11:43:37,741 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:43:43,081   DEBUG Dhanu => PING(20)
2019-10-31 11:43:57,756 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:44:03,100   DEBUG Dhanu => PING(20)
2019-10-31 11:44:17,770 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:44:23,120   DEBUG Dhanu => PING(20)
2019-10-31 11:44:37,825 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:44:43,136   DEBUG Dhanu => PING(20)
2019-10-31 11:44:57,832 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:45:03,156   DEBUG Dhanu => PING(20)
2019-10-31 11:45:17,839 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:45:23,177   DEBUG Dhanu => PING(20)
2019-10-31 11:45:37,847 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:45:43,199   DEBUG Dhanu => PING(20)
2019-10-31 11:45:57,855 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:46:03,220   DEBUG Dhanu => PING(20)
2019-10-31 11:46:17,863 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:46:23,239   DEBUG Dhanu => PING(20)
2019-10-31 11:46:37,870 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:46:43,259   DEBUG Dhanu => PING(20)
2019-10-31 11:46:57,877 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:47:03,279   DEBUG Dhanu => PING(20)
2019-10-31 11:47:17,884 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:47:23,299   DEBUG Dhanu => PING(20)
2019-10-31 11:47:37,891 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:47:43,315   DEBUG Dhanu => PING(20)
2019-10-31 11:47:57,899 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:48:03,335   DEBUG Dhanu => PING(20)
2019-10-31 11:48:17,908 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:48:23,355   DEBUG Dhanu => PING(20)
2019-10-31 11:48:37,919 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:48:43,371   DEBUG Dhanu => PING(20)
2019-10-31 11:48:57,933 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:49:03,395   DEBUG Dhanu => PING(20)
2019-10-31 11:49:17,947 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:49:23,416   DEBUG Dhanu => PING(20)
2019-10-31 11:49:37,958 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:49:43,435   DEBUG Dhanu => PING(20)
2019-10-31 11:49:57,972 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:50:03,459   DEBUG Dhanu => PING(20)
2019-10-31 11:50:17,987 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:50:23,485   DEBUG Dhanu => PING(20)
2019-10-31 11:50:38,001 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:50:43,508   DEBUG Dhanu => PING(20)
2019-10-31 11:50:58,016 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:51:03,533   DEBUG Dhanu => PING(20)
2019-10-31 11:51:18,030 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:51:23,556   DEBUG Dhanu => PING(20)
2019-10-31 11:51:38,044 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:51:43,581   DEBUG Dhanu => PING(20)
2019-10-31 11:51:58,058 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:52:03,604   DEBUG Dhanu => PING(20)
2019-10-31 11:52:18,070 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:52:23,627   DEBUG Dhanu => PING(20)
2019-10-31 11:52:38,085 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:52:43,647   DEBUG Dhanu => PING(20)
2019-10-31 11:52:58,092 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:53:03,668   DEBUG Dhanu => PING(20)
2019-10-31 11:53:18,105 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:53:23,693   DEBUG Dhanu => PING(20)
2019-10-31 11:53:38,119 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:53:43,716   DEBUG Dhanu => PING(20)
2019-10-31 11:53:58,131 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:54:03,740   DEBUG Dhanu => PING(20)
2019-10-31 11:54:18,145 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:54:23,763   DEBUG Dhanu => PING(20)
2019-10-31 11:54:38,155 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:54:43,787   DEBUG Dhanu => PING(20)
2019-10-31 11:54:58,169 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:55:03,812   DEBUG Dhanu => PING(20)
2019-10-31 11:55:18,183 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:55:23,836   DEBUG Dhanu => PING(20)
2019-10-31 11:55:38,197 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:55:43,861   DEBUG Dhanu => PING(20)
2019-10-31 11:55:58,211 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:56:03,880   DEBUG Dhanu => PING(20)
2019-10-31 11:56:18,225 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:56:23,903   DEBUG Dhanu => PING(20)
2019-10-31 11:56:38,239 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:56:43,925   DEBUG Dhanu => PING(20)
2019-10-31 11:56:58,250 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:57:03,948   DEBUG Dhanu => PING(20)
2019-10-31 11:57:18,264 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:57:23,972   DEBUG Dhanu => PING(20)
2019-10-31 11:57:38,279 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:57:43,993   DEBUG Dhanu => PING(20)
2019-10-31 11:57:58,291 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:58:04,015   DEBUG Dhanu => PING(20)
2019-10-31 11:58:18,299 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:58:24,036   DEBUG Dhanu => PING(20)
2019-10-31 11:58:38,307 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:58:44,053   DEBUG Dhanu => PING(20)
2019-10-31 11:58:58,321 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:59:04,072   DEBUG Dhanu => PING(20)
2019-10-31 11:59:18,331 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:59:24,092   DEBUG Dhanu => PING(20)
2019-10-31 11:59:38,343 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 11:59:44,213   DEBUG Dhanu => PING(20)
2019-10-31 11:59:58,356 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:00:04,236   DEBUG Dhanu => PING(20)
2019-10-31 12:00:18,370 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:00:24,260   DEBUG Dhanu => PING(20)
2019-10-31 12:00:38,384 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:00:44,283   DEBUG Dhanu => PING(20)
2019-10-31 12:00:58,398 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:01:04,307   DEBUG Dhanu => PING(20)
2019-10-31 12:01:18,411 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:01:24,332   DEBUG Dhanu => PING(20)
2019-10-31 12:01:38,424 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:01:44,353   DEBUG Dhanu => PING(20)
2019-10-31 12:01:58,439 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:02:04,378   DEBUG Dhanu => PING(20)
2019-10-31 12:02:18,453 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:02:24,400   DEBUG Dhanu => PING(20)
2019-10-31 12:02:38,461 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:02:44,425   DEBUG Dhanu => PING(20)
2019-10-31 12:02:58,470 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:03:04,449   DEBUG Dhanu => PING(20)
2019-10-31 12:03:18,478 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:03:24,474   DEBUG Dhanu => PING(20)
2019-10-31 12:03:38,486 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:03:44,498   DEBUG Dhanu => PING(20)
2019-10-31 12:03:58,498 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:04:04,523   DEBUG Dhanu => PING(20)
2019-10-31 12:04:18,512 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:04:24,547   DEBUG Dhanu => PING(20)
2019-10-31 12:04:38,522 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:04:44,564   DEBUG Dhanu => PING(20)
2019-10-31 12:04:58,536 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:05:04,587   DEBUG Dhanu => PING(20)
2019-10-31 12:05:18,549 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:05:24,605   DEBUG Dhanu => PING(20)
2019-10-31 12:05:38,556 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:05:44,629   DEBUG Dhanu => PING(20)
2019-10-31 12:05:58,564 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:06:04,654   DEBUG Dhanu => PING(20)
2019-10-31 12:06:18,578 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:06:24,678   DEBUG Dhanu => PING(20)
2019-10-31 12:06:38,591 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:06:44,703   DEBUG Dhanu => PING(20)
2019-10-31 12:06:58,603 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:07:04,723   DEBUG Dhanu => PING(20)
2019-10-31 12:07:18,615 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:07:24,746   DEBUG Dhanu => PING(20)
2019-10-31 12:07:38,629 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:07:44,760   DEBUG Dhanu => PING(20)
2019-10-31 12:07:58,642 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:08:04,782   DEBUG Dhanu => PING(20)
2019-10-31 12:08:18,656 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:08:24,802   DEBUG Dhanu => PING(20)
2019-10-31 12:08:38,670 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:08:44,848   DEBUG Dhanu => PING(20)
2019-10-31 12:08:58,684 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:09:04,872   DEBUG Dhanu => PING(20)
2019-10-31 12:09:18,692 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:09:24,888   DEBUG Dhanu => PING(20)
2019-10-31 12:09:38,706 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:09:44,912   DEBUG Dhanu => PING(20)
2019-10-31 12:09:58,719 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:10:04,932   DEBUG Dhanu => PING(20)
2019-10-31 12:10:18,727 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:10:24,957   DEBUG Dhanu => PING(20)
2019-10-31 12:10:38,734 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:10:44,980   DEBUG Dhanu => PING(20)
2019-10-31 12:10:58,744 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:11:05,005   DEBUG Dhanu => PING(20)
2019-10-31 12:11:18,758 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:11:25,027   DEBUG Dhanu => PING(20)
2019-10-31 12:11:38,771 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:11:45,052   DEBUG Dhanu => PING(20)
2019-10-31 12:11:58,784 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:12:05,073   DEBUG Dhanu => PING(20)
2019-10-31 12:12:18,797 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:12:25,115   DEBUG Dhanu => PING(20)
2019-10-31 12:12:38,806 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:12:45,135   DEBUG Dhanu => PING(20)
2019-10-31 12:12:58,815 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:13:05,160   DEBUG Dhanu => PING(20)
2019-10-31 12:13:18,829 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:13:25,185   DEBUG Dhanu => PING(20)
2019-10-31 12:13:38,843 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:13:45,205   DEBUG Dhanu => PING(20)
2019-10-31 12:13:58,856 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:14:05,229   DEBUG Dhanu => PING(20)
2019-10-31 12:14:18,866 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:14:25,252   DEBUG Dhanu => PING(20)
2019-10-31 12:14:38,873 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:14:45,276   DEBUG Dhanu => PING(20)
2019-10-31 12:14:54,782    INFO [POLL] Received a signal, leaving
2019-10-31 12:14:54,782    INFO [CLOSE] Closing the controler socket and dropping messages
2019-10-31 12:14:59,272    INFO [INIT] Dropping privileges
2019-10-31 12:14:59,272   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-10-31 12:14:59,272   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-10-31 12:14:59,274    INFO [INIT] Marking all workers as offline
2019-10-31 12:14:59,344    INFO [INIT] Starting encryption
2019-10-31 12:14:59,346   DEBUG [INIT] Opening master certificate: /etc/lava-dispatcher/certificates.d/master.key_secret
2019-10-31 12:14:59,346   DEBUG [INIT] Using slaves certificates from: /etc/lava-dispatcher/certificates.d
2019-10-31 12:14:59,347   DEBUG [INIT] Watching /etc/lava-dispatcher/certificates.d
2019-10-31 12:14:59,362    INFO [INIT] LAVA master has started.
2019-10-31 12:14:59,363    INFO [INIT] Using protocol version 3
2019-10-31 12:15:01,895    INFO Dhanu => HELLO
2019-10-31 12:15:01,896 WARNING New dispatcher <Dhanu>
2019-10-31 12:15:06,901   DEBUG Dhanu => PING(20)
2019-10-31 12:15:19,374 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:15:26,919   DEBUG Dhanu => PING(20)
2019-10-31 12:15:39,382 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:15:46,935   DEBUG Dhanu => PING(20)
2019-10-31 12:15:59,415 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:16:07,182   DEBUG Dhanu => PING(20)
2019-10-31 12:16:19,522 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:16:27,200   DEBUG Dhanu => PING(20)
2019-10-31 12:16:39,529 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:16:47,219   DEBUG Dhanu => PING(20)
2019-10-31 12:16:59,537 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:17:07,236   DEBUG Dhanu => PING(20)
2019-10-31 12:17:19,545 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:17:27,251   DEBUG Dhanu => PING(20)
2019-10-31 12:17:39,551 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:17:47,267   DEBUG Dhanu => PING(20)
2019-10-31 12:17:59,588 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:18:07,291   DEBUG Dhanu => PING(20)
2019-10-31 12:18:19,596 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:18:27,309   DEBUG Dhanu => PING(20)
2019-10-31 12:18:39,606 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:18:47,329   DEBUG Dhanu => PING(20)
2019-10-31 12:18:59,614 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:19:07,351   DEBUG Dhanu => PING(20)
2019-10-31 12:19:19,622 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:19:27,371   DEBUG Dhanu => PING(20)
2019-10-31 12:19:39,630 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:19:47,395   DEBUG Dhanu => PING(20)
2019-10-31 12:19:59,639 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:20:07,416   DEBUG Dhanu => PING(20)
2019-10-31 12:20:19,647 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:20:27,434   DEBUG Dhanu => PING(20)
2019-10-31 12:20:39,655 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:20:47,456   DEBUG Dhanu => PING(20)
2019-10-31 12:20:59,662 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:21:07,480   DEBUG Dhanu => PING(20)
2019-10-31 12:21:19,670 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:21:27,501   DEBUG Dhanu => PING(20)
2019-10-31 12:21:39,678 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:21:47,525   DEBUG Dhanu => PING(20)
2019-10-31 12:21:59,686 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:22:07,547   DEBUG Dhanu => PING(20)
2019-10-31 12:22:19,695 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:22:27,567   DEBUG Dhanu => PING(20)
2019-10-31 12:22:39,700 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:22:47,584   DEBUG Dhanu => PING(20)
2019-10-31 12:22:59,708 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:23:07,603   DEBUG Dhanu => PING(20)
2019-10-31 12:23:19,716 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:23:27,624   DEBUG Dhanu => PING(20)
2019-10-31 12:23:39,723 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:23:47,648   DEBUG Dhanu => PING(20)
2019-10-31 12:23:59,731 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:24:07,668   DEBUG Dhanu => PING(20)
2019-10-31 12:24:19,738 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:24:27,687   DEBUG Dhanu => PING(20)
2019-10-31 12:24:39,746 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:24:47,711   DEBUG Dhanu => PING(20)
2019-10-31 12:24:59,753 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:25:07,729   DEBUG Dhanu => PING(20)
2019-10-31 12:25:19,762 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:25:27,751   DEBUG Dhanu => PING(20)
2019-10-31 12:25:39,770 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:25:47,775   DEBUG Dhanu => PING(20)
2019-10-31 12:25:59,777 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:26:07,800   DEBUG Dhanu => PING(20)
2019-10-31 12:26:19,785 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:26:27,820   DEBUG Dhanu => PING(20)
2019-10-31 12:26:39,794 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:26:47,844   DEBUG Dhanu => PING(20)
2019-10-31 12:26:59,801 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:27:07,868   DEBUG Dhanu => PING(20)
2019-10-31 12:27:19,809 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:27:27,893   DEBUG Dhanu => PING(20)
2019-10-31 12:27:39,817 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:27:47,912   DEBUG Dhanu => PING(20)
2019-10-31 12:27:59,824 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:28:07,936   DEBUG Dhanu => PING(20)
2019-10-31 12:28:19,832 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:28:27,960   DEBUG Dhanu => PING(20)
2019-10-31 12:28:39,840 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:28:47,984   DEBUG Dhanu => PING(20)
2019-10-31 12:28:59,847 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:29:08,007   DEBUG Dhanu => PING(20)
2019-10-31 12:29:19,854 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:29:28,024   DEBUG Dhanu => PING(20)
2019-10-31 12:29:39,862 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:29:48,048   DEBUG Dhanu => PING(20)
2019-10-31 12:29:59,871 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:30:08,070   DEBUG Dhanu => PING(20)
2019-10-31 12:30:19,878 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:30:28,094   DEBUG Dhanu => PING(20)
2019-10-31 12:30:39,887 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:30:48,113   DEBUG Dhanu => PING(20)
2019-10-31 12:30:59,893 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:31:08,134   DEBUG Dhanu => PING(20)
2019-10-31 12:31:19,901 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:31:28,155   DEBUG Dhanu => PING(20)
2019-10-31 12:31:39,909 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:31:48,176   DEBUG Dhanu => PING(20)
2019-10-31 12:31:59,917 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:32:08,196   DEBUG Dhanu => PING(20)
2019-10-31 12:32:19,925 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:32:28,221   DEBUG Dhanu => PING(20)
2019-10-31 12:32:39,934 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:32:48,244   DEBUG Dhanu => PING(20)
2019-10-31 12:32:59,941 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:33:08,269   DEBUG Dhanu => PING(20)
2019-10-31 12:33:19,949 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:33:28,294   DEBUG Dhanu => PING(20)
2019-10-31 12:33:39,957 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:33:48,316   DEBUG Dhanu => PING(20)
2019-10-31 12:33:59,966 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:34:08,340   DEBUG Dhanu => PING(20)
2019-10-31 12:34:19,973 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:34:28,365   DEBUG Dhanu => PING(20)
2019-10-31 12:34:39,981 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:34:48,387   DEBUG Dhanu => PING(20)
2019-10-31 12:34:59,989 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:35:08,408   DEBUG Dhanu => PING(20)
2019-10-31 12:35:19,998 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:35:28,433   DEBUG Dhanu => PING(20)
2019-10-31 12:35:40,006 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:35:48,457   DEBUG Dhanu => PING(20)
2019-10-31 12:36:00,014 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:36:08,482   DEBUG Dhanu => PING(20)
2019-10-31 12:36:20,017 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:36:28,507   DEBUG Dhanu => PING(20)
2019-10-31 12:36:40,025 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:36:48,528   DEBUG Dhanu => PING(20)
2019-10-31 12:37:00,033 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:37:08,552   DEBUG Dhanu => PING(20)
2019-10-31 12:37:20,038 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:37:28,575   DEBUG Dhanu => PING(20)
2019-10-31 12:37:40,046 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:37:48,599   DEBUG Dhanu => PING(20)
2019-10-31 12:38:00,053 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:38:08,620   DEBUG Dhanu => PING(20)
2019-10-31 12:38:20,060 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:38:28,641   DEBUG Dhanu => PING(20)
2019-10-31 12:38:40,067 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:38:48,664   DEBUG Dhanu => PING(20)
2019-10-31 12:39:00,074 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:39:08,684   DEBUG Dhanu => PING(20)
2019-10-31 12:39:20,082 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:39:28,708   DEBUG Dhanu => PING(20)
2019-10-31 12:39:40,090 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:39:48,729   DEBUG Dhanu => PING(20)
2019-10-31 12:40:00,101 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:40:08,753   DEBUG Dhanu => PING(20)
2019-10-31 12:40:20,112 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:40:28,778   DEBUG Dhanu => PING(20)
2019-10-31 12:40:40,120 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:40:48,803   DEBUG Dhanu => PING(20)
2019-10-31 12:41:00,127 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:41:08,827   DEBUG Dhanu => PING(20)
2019-10-31 12:41:20,135 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:41:28,850   DEBUG Dhanu => PING(20)
2019-10-31 12:41:40,146 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:41:48,870   DEBUG Dhanu => PING(20)
2019-10-31 12:42:00,154 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:42:08,891   DEBUG Dhanu => PING(20)
2019-10-31 12:42:20,162 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:42:28,911   DEBUG Dhanu => PING(20)
2019-10-31 12:42:40,171 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:42:48,933   DEBUG Dhanu => PING(20)
2019-10-31 12:43:00,179 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:43:08,954   DEBUG Dhanu => PING(20)
2019-10-31 12:43:20,186 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:43:28,976   DEBUG Dhanu => PING(20)
2019-10-31 12:43:40,198 WARNING lava-logs is offline: can't schedule jobs
2019-10-31 12:43:49,001   DEBUG Dhanu => PING(20)
2019-11-04 04:52:14,104   ERROR [STATE] Dispatcher <Dhanu> goes OFFLINE
2019-11-04 04:52:14,887 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 04:52:14,965   DEBUG Dhanu => PING(20)
2019-11-04 04:52:34,965 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 04:52:34,983   DEBUG Dhanu => PING(20)
2019-11-04 04:52:54,968 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 04:52:54,999   DEBUG Dhanu => PING(20)
2019-11-04 04:53:14,975 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 04:53:15,015   DEBUG Dhanu => PING(20)
2019-11-04 04:53:34,982 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 04:53:35,039   DEBUG Dhanu => PING(20)
2019-11-04 04:53:54,989 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 04:53:55,060   DEBUG Dhanu => PING(20)
2019-11-04 04:54:14,996 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 04:54:15,080   DEBUG Dhanu => PING(20)
2019-11-04 04:54:35,003 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 04:54:35,102   DEBUG Dhanu => PING(20)
2019-11-04 04:54:55,010 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 04:54:55,125   DEBUG Dhanu => PING(20)
2019-11-04 04:55:15,017 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 04:55:15,145   DEBUG Dhanu => PING(20)
2019-11-04 04:55:35,024 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 04:55:35,165   DEBUG Dhanu => PING(20)
2019-11-04 04:55:55,032 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 04:55:55,189   DEBUG Dhanu => PING(20)
2019-11-04 04:56:15,039 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 04:56:15,212   DEBUG Dhanu => PING(20)
2019-11-04 04:56:35,047 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 04:56:35,231   DEBUG Dhanu => PING(20)
2019-11-04 04:56:55,055 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 04:56:55,252   DEBUG Dhanu => PING(20)
2019-11-04 04:57:15,062 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 04:57:15,276   DEBUG Dhanu => PING(20)
2019-11-04 04:57:35,066 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 04:57:35,299   DEBUG Dhanu => PING(20)
2019-11-04 04:57:55,073 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 04:57:55,323   DEBUG Dhanu => PING(20)
2019-11-04 04:58:15,080 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 04:58:15,347   DEBUG Dhanu => PING(20)
2019-11-04 04:58:35,088 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 04:58:35,365   DEBUG Dhanu => PING(20)
2019-11-04 04:58:55,096 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 04:58:55,389   DEBUG Dhanu => PING(20)
2019-11-04 04:59:15,103 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 04:59:15,414   DEBUG Dhanu => PING(20)
2019-11-04 04:59:35,110 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 04:59:35,436   DEBUG Dhanu => PING(20)
2019-11-04 04:59:55,117 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 04:59:55,461   DEBUG Dhanu => PING(20)
2019-11-04 05:00:15,124 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:00:15,481   DEBUG Dhanu => PING(20)
2019-11-04 05:00:35,132 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:00:35,504   DEBUG Dhanu => PING(20)
2019-11-04 05:00:55,140 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:00:55,521   DEBUG Dhanu => PING(20)
2019-11-04 05:01:15,148 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:01:15,545   DEBUG Dhanu => PING(20)
2019-11-04 05:01:35,155 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:01:35,564   DEBUG Dhanu => PING(20)
2019-11-04 05:01:55,161 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:01:55,584   DEBUG Dhanu => PING(20)
2019-11-04 05:02:15,166 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:02:15,603   DEBUG Dhanu => PING(20)
2019-11-04 05:02:35,174 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:02:35,627   DEBUG Dhanu => PING(20)
2019-11-04 05:02:55,179 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:02:55,649   DEBUG Dhanu => PING(20)
2019-11-04 05:03:15,187 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:03:15,669   DEBUG Dhanu => PING(20)
2019-11-04 05:03:35,195 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:03:35,690   DEBUG Dhanu => PING(20)
2019-11-04 05:03:55,202 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:03:55,714   DEBUG Dhanu => PING(20)
2019-11-04 05:04:15,209 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:04:15,736   DEBUG Dhanu => PING(20)
2019-11-04 05:04:35,216 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:04:35,755   DEBUG Dhanu => PING(20)
2019-11-04 05:04:55,223 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:04:55,777   DEBUG Dhanu => PING(20)
2019-11-04 05:05:15,230 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:05:15,798   DEBUG Dhanu => PING(20)
2019-11-04 05:05:35,236 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:05:35,816   DEBUG Dhanu => PING(20)
2019-11-04 05:05:55,243 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:05:55,836   DEBUG Dhanu => PING(20)
2019-11-04 05:06:15,249 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:06:15,855   DEBUG Dhanu => PING(20)
2019-11-04 05:06:35,256 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:06:35,876   DEBUG Dhanu => PING(20)
2019-11-04 05:06:55,263 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:06:55,899   DEBUG Dhanu => PING(20)
2019-11-04 05:07:15,273 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:07:15,923   DEBUG Dhanu => PING(20)
2019-11-04 05:07:35,281 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:07:35,945   DEBUG Dhanu => PING(20)
2019-11-04 05:07:55,288 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:07:55,965   DEBUG Dhanu => PING(20)
2019-11-04 05:08:15,297 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:08:15,983   DEBUG Dhanu => PING(20)
2019-11-04 05:08:35,304 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:08:36,008   DEBUG Dhanu => PING(20)
2019-11-04 05:08:55,307 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:08:56,028   DEBUG Dhanu => PING(20)
2019-11-04 05:09:15,315 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:09:16,050   DEBUG Dhanu => PING(20)
2019-11-04 05:09:35,323 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:09:36,072   DEBUG Dhanu => PING(20)
2019-11-04 05:09:55,331 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:09:56,096   DEBUG Dhanu => PING(20)
2019-11-04 05:10:15,339 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:10:16,117   DEBUG Dhanu => PING(20)
2019-11-04 05:10:35,346 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:10:36,141   DEBUG Dhanu => PING(20)
2019-11-04 05:10:55,353 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:10:56,166   DEBUG Dhanu => PING(20)
2019-11-04 05:11:15,361 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:11:16,187   DEBUG Dhanu => PING(20)
2019-11-04 05:11:35,369 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:11:36,211   DEBUG Dhanu => PING(20)
2019-11-04 05:11:55,377 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:11:56,235   DEBUG Dhanu => PING(20)
2019-11-04 05:12:15,383 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:12:16,251   DEBUG Dhanu => PING(20)
2019-11-04 05:12:35,389 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:12:36,267   DEBUG Dhanu => PING(20)
2019-11-04 05:12:55,413 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:12:56,288   DEBUG Dhanu => PING(20)
2019-11-04 05:13:15,421 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:13:16,307   DEBUG Dhanu => PING(20)
2019-11-04 05:13:35,428 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:13:36,332   DEBUG Dhanu => PING(20)
2019-11-04 05:13:55,435 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:13:56,356   DEBUG Dhanu => PING(20)
2019-11-04 05:14:15,442 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:14:16,381   DEBUG Dhanu => PING(20)
2019-11-04 05:14:35,450 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:14:36,404   DEBUG Dhanu => PING(20)
2019-11-04 05:14:55,459 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:14:56,424   DEBUG Dhanu => PING(20)
2019-11-04 05:15:15,466 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:15:16,448   DEBUG Dhanu => PING(20)
2019-11-04 05:15:35,474 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:15:36,472   DEBUG Dhanu => PING(20)
2019-11-04 05:15:55,481 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:15:56,496   DEBUG Dhanu => PING(20)
2019-11-04 05:16:15,489 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:16:16,521   DEBUG Dhanu => PING(20)
2019-11-04 05:16:35,496 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:16:36,544   DEBUG Dhanu => PING(20)
2019-11-04 05:16:55,504 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:16:56,563   DEBUG Dhanu => PING(20)
2019-11-04 05:17:15,511 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:17:16,585   DEBUG Dhanu => PING(20)
2019-11-04 05:17:35,519 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:17:36,607   DEBUG Dhanu => PING(20)
2019-11-04 05:17:55,527 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:17:56,629   DEBUG Dhanu => PING(20)
2019-11-04 05:18:15,534 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:18:16,651   DEBUG Dhanu => PING(20)
2019-11-04 05:18:35,542 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:18:36,676   DEBUG Dhanu => PING(20)
2019-11-04 05:18:55,550 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:18:56,695   DEBUG Dhanu => PING(20)
2019-11-04 05:19:15,558 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:19:16,720   DEBUG Dhanu => PING(20)
2019-11-04 05:19:35,566 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:19:36,744   DEBUG Dhanu => PING(20)
2019-11-04 05:19:55,574 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:19:56,768   DEBUG Dhanu => PING(20)
2019-11-04 05:20:15,583 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:20:16,792   DEBUG Dhanu => PING(20)
2019-11-04 05:20:35,590 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:20:36,816   DEBUG Dhanu => PING(20)
2019-11-04 05:20:55,598 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:20:56,840   DEBUG Dhanu => PING(20)
2019-11-04 05:21:15,607 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:21:16,865   DEBUG Dhanu => PING(20)
2019-11-04 05:21:35,614 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:21:36,889   DEBUG Dhanu => PING(20)
2019-11-04 05:21:55,622 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:21:56,913   DEBUG Dhanu => PING(20)
2019-11-04 05:22:15,630 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:22:16,935   DEBUG Dhanu => PING(20)
2019-11-04 05:22:35,638 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:22:36,957   DEBUG Dhanu => PING(20)
2019-11-04 05:22:55,645 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:22:56,980   DEBUG Dhanu => PING(20)
2019-11-04 05:23:15,653 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:23:16,999   DEBUG Dhanu => PING(20)
2019-11-04 05:23:35,656 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:23:37,016   DEBUG Dhanu => PING(20)
2019-11-04 05:23:55,663 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:23:57,031   DEBUG Dhanu => PING(20)
2019-11-04 05:24:15,671 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:24:17,051   DEBUG Dhanu => PING(20)
2019-11-04 05:24:17,076    INFO scheduling health checks:
2019-11-04 05:24:18,132    INFO scheduling jobs:
2019-11-04 05:24:18,137   DEBUG - qemu
2019-11-04 05:24:19,018   ERROR [CLOSE] Unknown exception raised, leaving!
2019-11-04 05:24:19,019   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 799, in main_loop
    jobs = schedule(self.logger, self.events["available_dt"])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 4, in top-level template code
    {% set netdevice = 'tap' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 4, in top-level template code
    {% set netdevice = 'tap' %}
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 4, in top-level template code
    {% set netdevice = 'tap' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/devices/qemu01.jinja2", line 1, in top-level template code
    {% extends 'qemu01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-11-04 05:24:19,275    INFO [CLOSE] Closing the controler socket and dropping messages
2019-11-04 05:24:24,774    INFO [INIT] Dropping privileges
2019-11-04 05:24:24,774   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-11-04 05:24:24,774   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-11-04 05:24:24,776    INFO [INIT] Marking all workers as offline
2019-11-04 05:24:24,811    INFO [INIT] Starting encryption
2019-11-04 05:24:24,813   DEBUG [INIT] Opening master certificate: /etc/lava-dispatcher/certificates.d/master.key_secret
2019-11-04 05:24:24,847   DEBUG [INIT] Using slaves certificates from: /etc/lava-dispatcher/certificates.d
2019-11-04 05:24:24,848   DEBUG [INIT] Watching /etc/lava-dispatcher/certificates.d
2019-11-04 05:24:24,867    INFO [INIT] LAVA master has started.
2019-11-04 05:24:24,868    INFO [INIT] Using protocol version 3
2019-11-04 05:24:37,068   DEBUG Dhanu => PING(20)
2019-11-04 05:24:37,068 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-11-04 05:24:44,875 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:24:57,085   DEBUG Dhanu => PING(20)
2019-11-04 05:25:04,884 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:25:17,104   DEBUG Dhanu => PING(20)
2019-11-04 05:25:24,890 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:25:37,119   DEBUG Dhanu => PING(20)
2019-11-04 05:25:44,897 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:25:57,141   DEBUG Dhanu => PING(20)
2019-11-04 05:26:04,905 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:26:17,160   DEBUG Dhanu => PING(20)
2019-11-04 05:26:24,913 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:26:37,184   DEBUG Dhanu => PING(20)
2019-11-04 05:26:44,921 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:26:57,205   DEBUG Dhanu => PING(20)
2019-11-04 05:27:04,929 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:27:17,225   DEBUG Dhanu => PING(20)
2019-11-04 05:27:24,937 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:27:37,243   DEBUG Dhanu => PING(20)
2019-11-04 05:27:44,945 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:27:57,280   DEBUG Dhanu => PING(20)
2019-11-04 05:28:04,953 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:28:17,295   DEBUG Dhanu => PING(20)
2019-11-04 05:28:24,962 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:28:37,311   DEBUG Dhanu => PING(20)
2019-11-04 05:28:44,969 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:28:57,335   DEBUG Dhanu => PING(20)
2019-11-04 05:29:04,976 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:29:17,359   DEBUG Dhanu => PING(20)
2019-11-04 05:29:24,985 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:29:37,381   DEBUG Dhanu => PING(20)
2019-11-04 05:29:44,993 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:29:57,401   DEBUG Dhanu => PING(20)
2019-11-04 05:30:05,000 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:30:17,426   DEBUG Dhanu => PING(20)
2019-11-04 05:30:25,008 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:30:37,446   DEBUG Dhanu => PING(20)
2019-11-04 05:30:45,016 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:30:57,468   DEBUG Dhanu => PING(20)
2019-11-04 05:31:05,023 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:31:17,492   DEBUG Dhanu => PING(20)
2019-11-04 05:31:25,031 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:31:37,516   DEBUG Dhanu => PING(20)
2019-11-04 05:31:45,039 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:31:57,537   DEBUG Dhanu => PING(20)
2019-11-04 05:32:05,045 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:32:17,562   DEBUG Dhanu => PING(20)
2019-11-04 05:32:25,053 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:32:37,587   DEBUG Dhanu => PING(20)
2019-11-04 05:32:45,061 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:32:57,607   DEBUG Dhanu => PING(20)
2019-11-04 05:33:05,068 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:33:17,631   DEBUG Dhanu => PING(20)
2019-11-04 05:33:25,077 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:33:37,649   DEBUG Dhanu => PING(20)
2019-11-04 05:33:45,085 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:33:57,667   DEBUG Dhanu => PING(20)
2019-11-04 05:34:05,093 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:34:17,691   DEBUG Dhanu => PING(20)
2019-11-04 05:34:25,100 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:34:37,716   DEBUG Dhanu => PING(20)
2019-11-04 05:34:45,108 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:34:57,740   DEBUG Dhanu => PING(20)
2019-11-04 05:35:05,116 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:35:17,760   DEBUG Dhanu => PING(20)
2019-11-04 05:35:25,122 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:35:37,781   DEBUG Dhanu => PING(20)
2019-11-04 05:35:45,130 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:35:57,796   DEBUG Dhanu => PING(20)
2019-11-04 05:36:05,138 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:36:17,819   DEBUG Dhanu => PING(20)
2019-11-04 05:36:25,146 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:36:37,836   DEBUG Dhanu => PING(20)
2019-11-04 05:36:45,155 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:36:57,856   DEBUG Dhanu => PING(20)
2019-11-04 05:37:05,162 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:37:17,876   DEBUG Dhanu => PING(20)
2019-11-04 05:37:25,170 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:37:37,897   DEBUG Dhanu => PING(20)
2019-11-04 05:37:45,177 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:37:57,921   DEBUG Dhanu => PING(20)
2019-11-04 05:38:05,185 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:38:17,945   DEBUG Dhanu => PING(20)
2019-11-04 05:38:25,193 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:38:37,970   DEBUG Dhanu => PING(20)
2019-11-04 05:38:45,201 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:38:57,988   DEBUG Dhanu => PING(20)
2019-11-04 05:39:05,209 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:39:18,008   DEBUG Dhanu => PING(20)
2019-11-04 05:39:25,217 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:39:38,032   DEBUG Dhanu => PING(20)
2019-11-04 05:39:45,224 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:39:58,056   DEBUG Dhanu => PING(20)
2019-11-04 05:40:05,231 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:40:18,081   DEBUG Dhanu => PING(20)
2019-11-04 05:40:25,239 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:40:38,101   DEBUG Dhanu => PING(20)
2019-11-04 05:40:45,247 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:40:58,121   DEBUG Dhanu => PING(20)
2019-11-04 05:41:05,254 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:41:18,143   DEBUG Dhanu => PING(20)
2019-11-04 05:41:25,263 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:41:38,164   DEBUG Dhanu => PING(20)
2019-11-04 05:41:45,271 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:41:58,184   DEBUG Dhanu => PING(20)
2019-11-04 05:42:05,278 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:42:18,207   DEBUG Dhanu => PING(20)
2019-11-04 05:42:25,285 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:42:38,227   DEBUG Dhanu => PING(20)
2019-11-04 05:42:45,293 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:42:58,248   DEBUG Dhanu => PING(20)
2019-11-04 05:43:05,301 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:43:18,269   DEBUG Dhanu => PING(20)
2019-11-04 05:43:25,309 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:43:38,289   DEBUG Dhanu => PING(20)
2019-11-04 05:43:45,317 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:43:58,314   DEBUG Dhanu => PING(20)
2019-11-04 05:44:05,325 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:44:18,337   DEBUG Dhanu => PING(20)
2019-11-04 05:44:25,332 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:44:38,362   DEBUG Dhanu => PING(20)
2019-11-04 05:44:45,339 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:44:58,386   DEBUG Dhanu => PING(20)
2019-11-04 05:45:05,347 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:45:18,407   DEBUG Dhanu => PING(20)
2019-11-04 05:45:25,354 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:45:38,432   DEBUG Dhanu => PING(20)
2019-11-04 05:45:45,362 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:45:58,456   DEBUG Dhanu => PING(20)
2019-11-04 05:46:05,370 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:46:18,480   DEBUG Dhanu => PING(20)
2019-11-04 05:46:25,378 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:46:38,505   DEBUG Dhanu => PING(20)
2019-11-04 05:46:45,385 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:46:58,524   DEBUG Dhanu => PING(20)
2019-11-04 05:47:05,393 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:47:18,546   DEBUG Dhanu => PING(20)
2019-11-04 05:47:25,401 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:47:38,569   DEBUG Dhanu => PING(20)
2019-11-04 05:47:45,409 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:47:58,591   DEBUG Dhanu => PING(20)
2019-11-04 05:48:05,417 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:48:18,612   DEBUG Dhanu => PING(20)
2019-11-04 05:48:25,425 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:48:38,637   DEBUG Dhanu => PING(20)
2019-11-04 05:48:45,433 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:48:58,662   DEBUG Dhanu => PING(20)
2019-11-04 05:49:05,441 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:49:18,687   DEBUG Dhanu => PING(20)
2019-11-04 05:49:25,450 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:49:38,708   DEBUG Dhanu => PING(20)
2019-11-04 05:49:45,458 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:49:58,732   DEBUG Dhanu => PING(20)
2019-11-04 05:50:05,465 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:50:18,757   DEBUG Dhanu => PING(20)
2019-11-04 05:50:25,474 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:50:38,781   DEBUG Dhanu => PING(20)
2019-11-04 05:50:45,481 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:50:58,801   DEBUG Dhanu => PING(20)
2019-11-04 05:51:05,489 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:51:18,821   DEBUG Dhanu => PING(20)
2019-11-04 05:51:25,496 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:51:38,844   DEBUG Dhanu => PING(20)
2019-11-04 05:51:45,505 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:51:58,865   DEBUG Dhanu => PING(20)
2019-11-04 05:52:05,512 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:52:18,885   DEBUG Dhanu => PING(20)
2019-11-04 05:52:25,521 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:52:38,908   DEBUG Dhanu => PING(20)
2019-11-04 05:52:45,529 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:52:58,925   DEBUG Dhanu => PING(20)
2019-11-04 05:53:05,537 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:53:18,944   DEBUG Dhanu => PING(20)
2019-11-04 05:53:25,544 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:53:38,965   DEBUG Dhanu => PING(20)
2019-11-04 05:53:45,552 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:53:58,988   DEBUG Dhanu => PING(20)
2019-11-04 05:54:05,559 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:54:19,008   DEBUG Dhanu => PING(20)
2019-11-04 05:54:25,564 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:54:39,033   DEBUG Dhanu => PING(20)
2019-11-04 05:54:45,571 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:54:59,055   DEBUG Dhanu => PING(20)
2019-11-04 05:55:05,579 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:55:19,076   DEBUG Dhanu => PING(20)
2019-11-04 05:55:25,587 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:55:39,096   DEBUG Dhanu => PING(20)
2019-11-04 05:55:45,594 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:55:59,112   DEBUG Dhanu => PING(20)
2019-11-04 05:56:05,601 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:57:50,862   DEBUG Dhanu => PING(20)
2019-11-04 05:57:50,913 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:58:10,887   DEBUG Dhanu => PING(20)
2019-11-04 05:58:10,926 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:58:30,907   DEBUG Dhanu => PING(20)
2019-11-04 05:58:30,934 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:58:50,923   DEBUG Dhanu => PING(20)
2019-11-04 05:58:50,953 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:59:10,939   DEBUG Dhanu => PING(20)
2019-11-04 05:59:10,967 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:59:30,959   DEBUG Dhanu => PING(20)
2019-11-04 05:59:30,978 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 05:59:50,983   DEBUG Dhanu => PING(20)
2019-11-04 05:59:51,003 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:00:11,002   DEBUG Dhanu => PING(20)
2019-11-04 06:00:11,027 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:00:31,023   DEBUG Dhanu => PING(20)
2019-11-04 06:00:31,051 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:00:51,047   DEBUG Dhanu => PING(20)
2019-11-04 06:00:51,064 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:01:11,072   DEBUG Dhanu => PING(20)
2019-11-04 06:01:11,099 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:01:31,096   DEBUG Dhanu => PING(20)
2019-11-04 06:01:31,112 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:01:51,120   DEBUG Dhanu => PING(20)
2019-11-04 06:01:51,148 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:02:11,145   DEBUG Dhanu => PING(20)
2019-11-04 06:02:11,161 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:02:31,168 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:02:31,175   DEBUG Dhanu => PING(20)
2019-11-04 06:02:51,175 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:02:51,195   DEBUG Dhanu => PING(20)
2019-11-04 06:03:11,191 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:03:11,217   DEBUG Dhanu => PING(20)
2019-11-04 06:03:31,211 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:03:31,241   DEBUG Dhanu => PING(20)
2019-11-04 06:03:51,231 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:03:51,263   DEBUG Dhanu => PING(20)
2019-11-04 06:04:11,250 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:04:11,287   DEBUG Dhanu => PING(20)
2019-11-04 06:04:31,257 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:04:31,306   DEBUG Dhanu => PING(20)
2019-11-04 06:04:51,270 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:04:51,324   DEBUG Dhanu => PING(20)
2019-11-04 06:05:11,286 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:05:11,343   DEBUG Dhanu => PING(20)
2019-11-04 06:05:31,300 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:05:31,359   DEBUG Dhanu => PING(20)
2019-11-04 06:05:51,318 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:05:51,376   DEBUG Dhanu => PING(20)
2019-11-04 06:06:11,338 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:06:11,399   DEBUG Dhanu => PING(20)
2019-11-04 06:06:31,358 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:06:31,423   DEBUG Dhanu => PING(20)
2019-11-04 06:06:51,378 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:06:51,447   DEBUG Dhanu => PING(20)
2019-11-04 06:07:11,398 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:07:11,468   DEBUG Dhanu => PING(20)
2019-11-04 06:07:31,417 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:07:31,492   DEBUG Dhanu => PING(20)
2019-11-04 06:07:51,437 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:07:51,515   DEBUG Dhanu => PING(20)
2019-11-04 06:08:11,457 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:08:11,539   DEBUG Dhanu => PING(20)
2019-11-04 06:08:31,471 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:08:31,561   DEBUG Dhanu => PING(20)
2019-11-04 06:08:51,485 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:08:51,585   DEBUG Dhanu => PING(20)
2019-11-04 06:09:11,505 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:09:11,609   DEBUG Dhanu => PING(20)
2019-11-04 06:09:31,524 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:09:31,633   DEBUG Dhanu => PING(20)
2019-11-04 06:09:51,542 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:09:51,652   DEBUG Dhanu => PING(20)
2019-11-04 06:10:11,558 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:10:11,675   DEBUG Dhanu => PING(20)
2019-11-04 06:10:31,574 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:10:31,691   DEBUG Dhanu => PING(20)
2019-11-04 06:10:51,594 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:10:51,709   DEBUG Dhanu => PING(20)
2019-11-04 06:11:11,614 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:11:11,730   DEBUG Dhanu => PING(20)
2019-11-04 06:11:31,634 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:11:31,755   DEBUG Dhanu => PING(20)
2019-11-04 06:11:51,654 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:11:51,776   DEBUG Dhanu => PING(20)
2019-11-04 06:12:11,674 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:12:11,799   DEBUG Dhanu => PING(20)
2019-11-04 06:12:31,690 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:12:31,821   DEBUG Dhanu => PING(20)
2019-11-04 06:12:51,706 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:12:51,843   DEBUG Dhanu => PING(20)
2019-11-04 06:13:11,726 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:13:11,867   DEBUG Dhanu => PING(20)
2019-11-04 06:13:31,734 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:13:31,885   DEBUG Dhanu => PING(20)
2019-11-04 06:13:51,752 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:13:51,905   DEBUG Dhanu => PING(20)
2019-11-04 06:14:11,770 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:14:11,929   DEBUG Dhanu => PING(20)
2019-11-04 06:14:31,790 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:14:31,949   DEBUG Dhanu => PING(20)
2019-11-04 06:14:51,809 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:14:51,969   DEBUG Dhanu => PING(20)
2019-11-04 06:15:11,826 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:15:11,988   DEBUG Dhanu => PING(20)
2019-11-04 06:15:31,846 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:15:32,009   DEBUG Dhanu => PING(20)
2019-11-04 06:15:51,866 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:15:52,033   DEBUG Dhanu => PING(20)
2019-11-04 06:16:11,874 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:16:12,056   DEBUG Dhanu => PING(20)
2019-11-04 06:16:31,887 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:16:32,075   DEBUG Dhanu => PING(20)
2019-11-04 06:16:51,898 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:16:52,091   DEBUG Dhanu => PING(20)
2019-11-04 06:17:11,913 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:17:12,107   DEBUG Dhanu => PING(20)
2019-11-04 06:17:31,933 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:17:32,125   DEBUG Dhanu => PING(20)
2019-11-04 06:17:51,950 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:17:52,149   DEBUG Dhanu => PING(20)
2019-11-04 06:18:11,957 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:18:12,172   DEBUG Dhanu => PING(20)
2019-11-04 06:18:31,974 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:18:32,191   DEBUG Dhanu => PING(20)
2019-11-04 06:18:51,994 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:18:52,213   DEBUG Dhanu => PING(20)
2019-11-04 06:19:12,013 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:19:12,235   DEBUG Dhanu => PING(20)
2019-11-04 06:19:32,027 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:19:32,255   DEBUG Dhanu => PING(20)
2019-11-04 06:19:52,038 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:19:52,274   DEBUG Dhanu => PING(20)
2019-11-04 06:20:12,046 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:20:12,296   DEBUG Dhanu => PING(20)
2019-11-04 06:20:32,064 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:20:32,321   DEBUG Dhanu => PING(20)
2019-11-04 06:20:52,084 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:20:52,342   DEBUG Dhanu => PING(20)
2019-11-04 06:21:12,103 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:21:12,367   DEBUG Dhanu => PING(20)
2019-11-04 06:21:32,123 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:21:32,391   DEBUG Dhanu => PING(20)
2019-11-04 06:21:52,130 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:21:52,413   DEBUG Dhanu => PING(20)
2019-11-04 06:22:12,148 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:22:12,436   DEBUG Dhanu => PING(20)
2019-11-04 06:22:32,168 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:22:32,460   DEBUG Dhanu => PING(20)
2019-11-04 06:22:52,187 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:22:52,484   DEBUG Dhanu => PING(20)
2019-11-04 06:23:12,206 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:23:12,509   DEBUG Dhanu => PING(20)
2019-11-04 06:23:32,216 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:23:32,532   DEBUG Dhanu => PING(20)
2019-11-04 06:23:52,235 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:23:52,555   DEBUG Dhanu => PING(20)
2019-11-04 06:24:12,255 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:24:12,579   DEBUG Dhanu => PING(20)
2019-11-04 06:24:32,270 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:24:32,604   DEBUG Dhanu => PING(20)
2019-11-04 06:24:52,288 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:24:52,628   DEBUG Dhanu => PING(20)
2019-11-04 06:25:12,306 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:25:12,651   DEBUG Dhanu => PING(20)
2019-11-04 06:25:32,322 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:25:32,676   DEBUG Dhanu => PING(20)
2019-11-04 06:25:52,338 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:25:52,696   DEBUG Dhanu => PING(20)
2019-11-04 06:26:12,354 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:26:12,720   DEBUG Dhanu => PING(20)
2019-11-04 06:26:32,373 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:26:32,743   DEBUG Dhanu => PING(20)
2019-11-04 06:26:52,392 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:26:52,764   DEBUG Dhanu => PING(20)
2019-11-04 06:27:12,409 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:27:12,784   DEBUG Dhanu => PING(20)
2019-11-04 06:27:32,429 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:27:32,808   DEBUG Dhanu => PING(20)
2019-11-04 06:27:52,446 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:27:52,832   DEBUG Dhanu => PING(20)
2019-11-04 06:28:12,462 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:28:12,856   DEBUG Dhanu => PING(20)
2019-11-04 06:28:32,482 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:28:32,879   DEBUG Dhanu => PING(20)
2019-11-04 06:28:52,496 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:28:52,903   DEBUG Dhanu => PING(20)
2019-11-04 06:29:12,515 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:29:12,925   DEBUG Dhanu => PING(20)
2019-11-04 06:29:32,534 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:29:32,949   DEBUG Dhanu => PING(20)
2019-11-04 06:29:52,553 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:29:52,971   DEBUG Dhanu => PING(20)
2019-11-04 06:30:12,572 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:30:12,993   DEBUG Dhanu => PING(20)
2019-11-04 06:30:32,590 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:30:33,012   DEBUG Dhanu => PING(20)
2019-11-04 06:30:52,604 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:30:53,036   DEBUG Dhanu => PING(20)
2019-11-04 06:31:12,612 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:31:13,061   DEBUG Dhanu => PING(20)
2019-11-04 06:31:32,626 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:31:33,083   DEBUG Dhanu => PING(20)
2019-11-04 06:31:52,646 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:31:53,101   DEBUG Dhanu => PING(20)
2019-11-04 06:32:12,665 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:32:13,123   DEBUG Dhanu => PING(20)
2019-11-04 06:32:32,685 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:32:33,147   DEBUG Dhanu => PING(20)
2019-11-04 06:32:52,702 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:32:53,169   DEBUG Dhanu => PING(20)
2019-11-04 06:33:12,721 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:33:13,194   DEBUG Dhanu => PING(20)
2019-11-04 06:33:32,738 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:33:33,218   DEBUG Dhanu => PING(20)
2019-11-04 06:33:52,746 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:33:53,235   DEBUG Dhanu => PING(20)
2019-11-04 06:34:12,764 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:34:13,251   DEBUG Dhanu => PING(20)
2019-11-04 06:34:32,783 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:34:33,275   DEBUG Dhanu => PING(20)
2019-11-04 06:34:52,795 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:34:53,300   DEBUG Dhanu => PING(20)
2019-11-04 06:35:12,814 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:35:13,325   DEBUG Dhanu => PING(20)
2019-11-04 06:35:32,833 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:35:33,349   DEBUG Dhanu => PING(20)
2019-11-04 06:35:52,852 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:35:53,371   DEBUG Dhanu => PING(20)
2019-11-04 06:36:12,871 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:36:13,395   DEBUG Dhanu => PING(20)
2019-11-04 06:36:32,891 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:36:33,419   DEBUG Dhanu => PING(20)
2019-11-04 06:36:52,910 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:36:53,443   DEBUG Dhanu => PING(20)
2019-11-04 06:37:12,929 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:37:13,468   DEBUG Dhanu => PING(20)
2019-11-04 06:37:32,948 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:37:33,489   DEBUG Dhanu => PING(20)
2019-11-04 06:37:52,967 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:37:53,512   DEBUG Dhanu => PING(20)
2019-11-04 06:38:12,986 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:38:13,536   DEBUG Dhanu => PING(20)
2019-11-04 06:38:33,005 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:38:33,559   DEBUG Dhanu => PING(20)
2019-11-04 06:38:53,022 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:38:53,583   DEBUG Dhanu => PING(20)
2019-11-04 06:39:13,039 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:39:13,607   DEBUG Dhanu => PING(20)
2019-11-04 06:39:33,059 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:39:33,623   DEBUG Dhanu => PING(20)
2019-11-04 06:39:53,078 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:39:53,648   DEBUG Dhanu => PING(20)
2019-11-04 06:40:13,089 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:40:13,673   DEBUG Dhanu => PING(20)
2019-11-04 06:40:33,108 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:40:33,697   DEBUG Dhanu => PING(20)
2019-11-04 06:40:53,128 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:40:53,722   DEBUG Dhanu => PING(20)
2019-11-04 06:41:13,147 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:41:13,743   DEBUG Dhanu => PING(20)
2019-11-04 06:41:33,166 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:41:33,768   DEBUG Dhanu => PING(20)
2019-11-04 06:41:53,184 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:41:53,789   DEBUG Dhanu => PING(20)
2019-11-04 06:42:13,204 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:42:13,813   DEBUG Dhanu => PING(20)
2019-11-04 06:42:33,223 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:42:33,832   DEBUG Dhanu => PING(20)
2019-11-04 06:42:53,242 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:42:53,855   DEBUG Dhanu => PING(20)
2019-11-04 06:43:13,255 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:43:13,879   DEBUG Dhanu => PING(20)
2019-11-04 06:43:33,263 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:43:33,904   DEBUG Dhanu => PING(20)
2019-11-04 06:43:53,271 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:43:53,928   DEBUG Dhanu => PING(20)
2019-11-04 06:44:13,278 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:44:13,953   DEBUG Dhanu => PING(20)
2019-11-04 06:44:33,285 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:44:33,977   DEBUG Dhanu => PING(20)
2019-11-04 06:44:53,300 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:44:53,998   DEBUG Dhanu => PING(20)
2019-11-04 06:45:13,318 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:45:14,019   DEBUG Dhanu => PING(20)
2019-11-04 06:45:33,336 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:45:34,043   DEBUG Dhanu => PING(20)
2019-11-04 06:45:53,355 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:45:54,067   DEBUG Dhanu => PING(20)
2019-11-04 06:46:13,374 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:46:14,092   DEBUG Dhanu => PING(20)
2019-11-04 06:46:33,388 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:46:34,116   DEBUG Dhanu => PING(20)
2019-11-04 06:46:53,404 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:46:54,141   DEBUG Dhanu => PING(20)
2019-11-04 06:47:13,423 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:47:14,165   DEBUG Dhanu => PING(20)
2019-11-04 06:47:33,442 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:47:34,185   DEBUG Dhanu => PING(20)
2019-11-04 06:47:53,461 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:47:54,209   DEBUG Dhanu => PING(20)
2019-11-04 06:48:13,480 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:48:14,228   DEBUG Dhanu => PING(20)
2019-11-04 06:48:33,492 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:48:34,248   DEBUG Dhanu => PING(20)
2019-11-04 06:48:53,512 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:48:54,268   DEBUG Dhanu => PING(20)
2019-11-04 06:49:13,520 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:49:14,289   DEBUG Dhanu => PING(20)
2019-11-04 06:49:33,527 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:49:34,314   DEBUG Dhanu => PING(20)
2019-11-04 06:49:53,533 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:49:54,335   DEBUG Dhanu => PING(20)
2019-11-04 06:50:13,542 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:50:14,359   DEBUG Dhanu => PING(20)
2019-11-04 06:50:33,549 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:50:34,383   DEBUG Dhanu => PING(20)
2019-11-04 06:50:53,556 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:50:54,404   DEBUG Dhanu => PING(20)
2019-11-04 06:51:13,564 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:51:14,429   DEBUG Dhanu => PING(20)
2019-11-04 06:51:33,572 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:51:34,453   DEBUG Dhanu => PING(20)
2019-11-04 06:51:53,582 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:51:54,472   DEBUG Dhanu => PING(20)
2019-11-04 06:52:13,598 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:52:14,495   DEBUG Dhanu => PING(20)
2019-11-04 06:52:33,617 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:52:34,520   DEBUG Dhanu => PING(20)
2019-11-04 06:52:53,636 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:52:54,544   DEBUG Dhanu => PING(20)
2019-11-04 06:53:13,647 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:53:14,567   DEBUG Dhanu => PING(20)
2019-11-04 06:53:33,663 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:53:34,591   DEBUG Dhanu => PING(20)
2019-11-04 06:53:53,680 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:53:54,611   DEBUG Dhanu => PING(20)
2019-11-04 06:54:13,693 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:54:14,630   DEBUG Dhanu => PING(20)
2019-11-04 06:54:33,701 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:54:34,655   DEBUG Dhanu => PING(20)
2019-11-04 06:54:53,718 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:54:54,679   DEBUG Dhanu => PING(20)
2019-11-04 06:55:13,737 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:55:14,697   DEBUG Dhanu => PING(20)
2019-11-04 06:55:33,754 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:55:34,721   DEBUG Dhanu => PING(20)
2019-11-04 06:55:53,773 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:55:54,745   DEBUG Dhanu => PING(20)
2019-11-04 06:56:13,781 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:56:14,769   DEBUG Dhanu => PING(20)
2019-11-04 06:56:33,797 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:56:34,792   DEBUG Dhanu => PING(20)
2019-11-04 06:56:53,814 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:56:54,809   DEBUG Dhanu => PING(20)
2019-11-04 06:57:13,830 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:57:14,831   DEBUG Dhanu => PING(20)
2019-11-04 06:57:33,849 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:57:34,855   DEBUG Dhanu => PING(20)
2019-11-04 06:57:53,868 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:57:54,880   DEBUG Dhanu => PING(20)
2019-11-04 06:58:13,887 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:58:14,904   DEBUG Dhanu => PING(20)
2019-11-04 06:58:33,905 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:58:34,929   DEBUG Dhanu => PING(20)
2019-11-04 06:58:53,924 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:58:54,953   DEBUG Dhanu => PING(20)
2019-11-04 06:59:13,931 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:59:14,971   DEBUG Dhanu => PING(20)
2019-11-04 06:59:33,945 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:59:34,996   DEBUG Dhanu => PING(20)
2019-11-04 06:59:53,954 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 06:59:55,017   DEBUG Dhanu => PING(20)
2019-11-04 07:00:13,973 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:00:15,039   DEBUG Dhanu => PING(20)
2019-11-04 07:00:33,991 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:00:35,060   DEBUG Dhanu => PING(20)
2019-11-04 07:00:54,010 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:00:55,084   DEBUG Dhanu => PING(20)
2019-11-04 07:01:14,024 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:01:15,107   DEBUG Dhanu => PING(20)
2019-11-04 07:01:34,042 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:01:35,132   DEBUG Dhanu => PING(20)
2019-11-04 07:01:54,061 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:01:55,155   DEBUG Dhanu => PING(20)
2019-11-04 07:02:14,079 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:02:15,180   DEBUG Dhanu => PING(20)
2019-11-04 07:02:34,098 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:02:35,200   DEBUG Dhanu => PING(20)
2019-11-04 07:02:54,106 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:02:55,219   DEBUG Dhanu => PING(20)
2019-11-04 07:03:14,122 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:03:15,240   DEBUG Dhanu => PING(20)
2019-11-04 07:03:34,130 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:03:35,265   DEBUG Dhanu => PING(20)
2019-11-04 07:03:54,143 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:03:55,289   DEBUG Dhanu => PING(20)
2019-11-04 07:04:14,156 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:04:15,307   DEBUG Dhanu => PING(20)
2019-11-04 07:04:34,174 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:04:35,327   DEBUG Dhanu => PING(20)
2019-11-04 07:04:54,193 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:04:55,347   DEBUG Dhanu => PING(20)
2019-11-04 07:05:14,210 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:05:15,368   DEBUG Dhanu => PING(20)
2019-11-04 07:05:34,229 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:05:35,391   DEBUG Dhanu => PING(20)
2019-11-04 07:05:54,242 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:05:55,415   DEBUG Dhanu => PING(20)
2019-11-04 07:06:14,261 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:06:15,439   DEBUG Dhanu => PING(20)
2019-11-04 07:06:34,269 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:06:35,463   DEBUG Dhanu => PING(20)
2019-11-04 07:06:54,281 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:06:55,488   DEBUG Dhanu => PING(20)
2019-11-04 07:07:14,289 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:07:15,512   DEBUG Dhanu => PING(20)
2019-11-04 07:07:34,297 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:07:35,533   DEBUG Dhanu => PING(20)
2019-11-04 07:07:54,305 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:07:55,557   DEBUG Dhanu => PING(20)
2019-11-04 07:08:14,317 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:08:15,574   DEBUG Dhanu => PING(20)
2019-11-04 07:08:34,335 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:08:35,597   DEBUG Dhanu => PING(20)
2019-11-04 07:08:54,353 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:08:55,619   DEBUG Dhanu => PING(20)
2019-11-04 07:09:14,372 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:09:15,639   DEBUG Dhanu => PING(20)
2019-11-04 07:09:34,390 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:09:35,657   DEBUG Dhanu => PING(20)
2019-11-04 07:09:54,409 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:09:55,681   DEBUG Dhanu => PING(20)
2019-11-04 07:10:14,417 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:10:15,699   DEBUG Dhanu => PING(20)
2019-11-04 07:10:34,432 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:10:35,719   DEBUG Dhanu => PING(20)
2019-11-04 07:10:54,440 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:10:55,743   DEBUG Dhanu => PING(20)
2019-11-04 07:11:14,457 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:11:15,762   DEBUG Dhanu => PING(20)
2019-11-04 07:11:34,475 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:11:35,783   DEBUG Dhanu => PING(20)
2019-11-04 07:11:54,483 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:11:55,809   DEBUG Dhanu => PING(20)
2019-11-04 07:12:14,496 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:12:15,833   DEBUG Dhanu => PING(20)
2019-11-04 07:12:34,514 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:12:35,853   DEBUG Dhanu => PING(20)
2019-11-04 07:12:54,523 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:12:55,877   DEBUG Dhanu => PING(20)
2019-11-04 07:13:14,540 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:13:15,900   DEBUG Dhanu => PING(20)
2019-11-04 07:13:34,559 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:13:35,920   DEBUG Dhanu => PING(20)
2019-11-04 07:13:54,577 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:13:55,944   DEBUG Dhanu => PING(20)
2019-11-04 07:14:14,595 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:14:15,969   DEBUG Dhanu => PING(20)
2019-11-04 07:14:34,613 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:14:35,993   DEBUG Dhanu => PING(20)
2019-11-04 07:14:54,631 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:14:56,017   DEBUG Dhanu => PING(20)
2019-11-04 07:15:14,640 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:15:16,036   DEBUG Dhanu => PING(20)
2019-11-04 07:15:34,657 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:15:36,057   DEBUG Dhanu => PING(20)
2019-11-04 07:15:54,675 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:15:56,082   DEBUG Dhanu => PING(20)
2019-11-04 07:16:14,690 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:16:16,106   DEBUG Dhanu => PING(20)
2019-11-04 07:16:34,709 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:16:36,131   DEBUG Dhanu => PING(20)
2019-11-04 07:16:54,726 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:16:56,147   DEBUG Dhanu => PING(20)
2019-11-04 07:17:14,742 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:17:16,167   DEBUG Dhanu => PING(20)
2019-11-04 07:17:34,758 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:17:36,184   DEBUG Dhanu => PING(20)
2019-11-04 07:17:54,774 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:17:56,199   DEBUG Dhanu => PING(20)
2019-11-04 07:18:14,792 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:18:16,215   DEBUG Dhanu => PING(20)
2019-11-04 07:18:34,811 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:18:36,231   DEBUG Dhanu => PING(20)
2019-11-04 07:18:54,829 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:18:56,251   DEBUG Dhanu => PING(20)
2019-11-04 07:19:14,847 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:19:16,273   DEBUG Dhanu => PING(20)
2019-11-04 07:19:34,863 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:19:36,295   DEBUG Dhanu => PING(20)
2019-11-04 07:19:54,878 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:19:56,311   DEBUG Dhanu => PING(20)
2019-11-04 07:20:14,894 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:20:16,331   DEBUG Dhanu => PING(20)
2019-11-04 07:20:34,910 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:20:36,347   DEBUG Dhanu => PING(20)
2019-11-04 07:20:54,918 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:20:56,366   DEBUG Dhanu => PING(20)
2019-11-04 07:21:14,929 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:21:16,389   DEBUG Dhanu => PING(20)
2019-11-04 07:21:34,948 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:21:36,412   DEBUG Dhanu => PING(20)
2019-11-04 07:21:54,966 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:21:56,435   DEBUG Dhanu => PING(20)
2019-11-04 07:22:14,982 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:22:16,453   DEBUG Dhanu => PING(20)
2019-11-04 07:22:34,990 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:22:36,474   DEBUG Dhanu => PING(20)
2019-11-04 07:22:55,008 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:22:56,495   DEBUG Dhanu => PING(20)
2019-11-04 07:23:15,026 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:23:16,515   DEBUG Dhanu => PING(20)
2019-11-04 07:23:35,044 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:23:36,536   DEBUG Dhanu => PING(20)
2019-11-04 07:23:55,062 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:23:56,559   DEBUG Dhanu => PING(20)
2019-11-04 07:24:15,080 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:24:16,584   DEBUG Dhanu => PING(20)
2019-11-04 07:24:35,098 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:24:36,603   DEBUG Dhanu => PING(20)
2019-11-04 07:24:55,106 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:24:56,619   DEBUG Dhanu => PING(20)
2019-11-04 07:25:15,123 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:25:16,642   DEBUG Dhanu => PING(20)
2019-11-04 07:25:35,139 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:25:36,659   DEBUG Dhanu => PING(20)
2019-11-04 07:25:55,155 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:25:56,677   DEBUG Dhanu => PING(20)
2019-11-04 07:26:15,171 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:26:16,696   DEBUG Dhanu => PING(20)
2019-11-04 07:26:35,186 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:26:36,714   DEBUG Dhanu => PING(20)
2019-11-04 07:26:55,202 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:26:56,735   DEBUG Dhanu => PING(20)
2019-11-04 07:27:15,220 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:27:16,756   DEBUG Dhanu => PING(20)
2019-11-04 07:27:35,239 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:27:36,780   DEBUG Dhanu => PING(20)
2019-11-04 07:27:55,257 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:27:56,798   DEBUG Dhanu => PING(20)
2019-11-04 07:28:15,275 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:28:16,819   DEBUG Dhanu => PING(20)
2019-11-04 07:28:35,293 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:28:36,839   DEBUG Dhanu => PING(20)
2019-11-04 07:28:55,311 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:28:56,863   DEBUG Dhanu => PING(20)
2019-11-04 07:29:15,329 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:29:16,879   DEBUG Dhanu => PING(20)
2019-11-04 07:29:35,347 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:29:36,903   DEBUG Dhanu => PING(20)
2019-11-04 07:29:55,360 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:29:56,927   DEBUG Dhanu => PING(20)
2019-11-04 07:30:15,378 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:30:16,948   DEBUG Dhanu => PING(20)
2019-11-04 07:30:35,396 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:30:36,972   DEBUG Dhanu => PING(20)
2019-11-04 07:30:55,415 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:30:56,997   DEBUG Dhanu => PING(20)
2019-11-04 07:31:15,426 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:31:17,019   DEBUG Dhanu => PING(20)
2019-11-04 07:31:35,441 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:31:37,038   DEBUG Dhanu => PING(20)
2019-11-04 07:31:55,459 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:31:57,060   DEBUG Dhanu => PING(20)
2019-11-04 07:32:15,470 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:32:17,085   DEBUG Dhanu => PING(20)
2019-11-04 07:32:35,486 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:32:37,109   DEBUG Dhanu => PING(20)
2019-11-04 07:32:55,494 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:32:57,129   DEBUG Dhanu => PING(20)
2019-11-04 07:33:15,504 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:33:17,153   DEBUG Dhanu => PING(20)
2019-11-04 07:33:35,521 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:33:37,176   DEBUG Dhanu => PING(20)
2019-11-04 07:33:55,539 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:33:57,201   DEBUG Dhanu => PING(20)
2019-11-04 07:34:15,547 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:34:17,224   DEBUG Dhanu => PING(20)
2019-11-04 07:34:35,559 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:34:37,248   DEBUG Dhanu => PING(20)
2019-11-04 07:34:55,577 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:34:57,273   DEBUG Dhanu => PING(20)
2019-11-04 07:35:15,595 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:35:17,297   DEBUG Dhanu => PING(20)
2019-11-04 07:35:35,613 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:35:37,319   DEBUG Dhanu => PING(20)
2019-11-04 07:35:55,631 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:35:57,340   DEBUG Dhanu => PING(20)
2019-11-04 07:36:15,649 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:36:17,361   DEBUG Dhanu => PING(20)
2019-11-04 07:36:35,667 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:36:37,383   DEBUG Dhanu => PING(20)
2019-11-04 07:36:55,685 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:36:57,406   DEBUG Dhanu => PING(20)
2019-11-04 07:37:15,703 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:37:17,425   DEBUG Dhanu => PING(20)
2019-11-04 07:37:35,710 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:37:37,447   DEBUG Dhanu => PING(20)
2019-11-04 07:37:55,718 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:37:57,468   DEBUG Dhanu => PING(20)
2019-11-04 07:38:15,732 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:38:17,493   DEBUG Dhanu => PING(20)
2019-11-04 07:38:35,750 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:38:37,515   DEBUG Dhanu => PING(20)
2019-11-04 07:38:55,758 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:38:57,537   DEBUG Dhanu => PING(20)
2019-11-04 07:39:15,774 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:39:17,561   DEBUG Dhanu => PING(20)
2019-11-04 07:39:35,792 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:39:37,581   DEBUG Dhanu => PING(20)
2019-11-04 07:39:55,810 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:39:57,605   DEBUG Dhanu => PING(20)
2019-11-04 07:40:15,828 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:40:17,629   DEBUG Dhanu => PING(20)
2019-11-04 07:40:35,846 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:40:37,653   DEBUG Dhanu => PING(20)
2019-11-04 07:40:55,864 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:40:57,675   DEBUG Dhanu => PING(20)
2019-11-04 07:41:15,882 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:41:17,700   DEBUG Dhanu => PING(20)
2019-11-04 07:41:35,901 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:41:37,723   DEBUG Dhanu => PING(20)
2019-11-04 07:41:55,919 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:41:57,741   DEBUG Dhanu => PING(20)
2019-11-04 07:42:15,937 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:42:17,765   DEBUG Dhanu => PING(20)
2019-11-04 07:42:35,955 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:42:37,789   DEBUG Dhanu => PING(20)
2019-11-04 07:42:55,963 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:42:57,806   DEBUG Dhanu => PING(20)
2019-11-04 07:43:15,977 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:43:17,823   DEBUG Dhanu => PING(20)
2019-11-04 07:43:35,995 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:43:37,847   DEBUG Dhanu => PING(20)
2019-11-04 07:43:56,010 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:43:57,868   DEBUG Dhanu => PING(20)
2019-11-04 07:44:16,028 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:44:17,891   DEBUG Dhanu => PING(20)
2019-11-04 07:44:36,036 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:44:37,916   DEBUG Dhanu => PING(20)
2019-11-04 07:44:56,052 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:44:57,939   DEBUG Dhanu => PING(20)
2019-11-04 07:45:16,067 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:45:17,959   DEBUG Dhanu => PING(20)
2019-11-04 07:45:36,084 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:45:37,980   DEBUG Dhanu => PING(20)
2019-11-04 07:45:56,102 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:45:58,005   DEBUG Dhanu => PING(20)
2019-11-04 07:46:16,120 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:46:18,023   DEBUG Dhanu => PING(20)
2019-11-04 07:46:36,138 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:46:38,039   DEBUG Dhanu => PING(20)
2019-11-04 07:46:56,156 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:46:58,063   DEBUG Dhanu => PING(20)
2019-11-04 07:47:16,173 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 07:47:18,088   DEBUG Dhanu => PING(20)
2019-11-04 08:09:59,127   DEBUG Dhanu => PING(20)
2019-11-04 08:09:59,186 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:10:19,144   DEBUG Dhanu => PING(20)
2019-11-04 08:10:19,190 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:10:39,164   DEBUG Dhanu => PING(20)
2019-11-04 08:10:39,195 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:10:59,179   DEBUG Dhanu => PING(20)
2019-11-04 08:10:59,203 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:11:19,196   DEBUG Dhanu => PING(20)
2019-11-04 08:11:19,208 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:11:39,212   DEBUG Dhanu => PING(20)
2019-11-04 08:11:39,262 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:11:59,228   DEBUG Dhanu => PING(20)
2019-11-04 08:11:59,267 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:12:19,243   DEBUG Dhanu => PING(20)
2019-11-04 08:12:19,273 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:12:39,261   DEBUG Dhanu => PING(20)
2019-11-04 08:12:39,301 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:12:59,279   DEBUG Dhanu => PING(20)
2019-11-04 08:12:59,308 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:13:19,295   DEBUG Dhanu => PING(20)
2019-11-04 08:13:19,314 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:13:39,311   DEBUG Dhanu => PING(20)
2019-11-04 08:13:39,329 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:13:59,327   DEBUG Dhanu => PING(20)
2019-11-04 08:13:59,353 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:14:19,348   DEBUG Dhanu => PING(20)
2019-11-04 08:14:19,377 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:14:39,361   DEBUG Dhanu => PING(20)
2019-11-04 08:14:39,391 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:14:59,383   DEBUG Dhanu => PING(20)
2019-11-04 08:14:59,414 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:15:19,404   DEBUG Dhanu => PING(20)
2019-11-04 08:15:19,427 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:15:39,424   DEBUG Dhanu => PING(20)
2019-11-04 08:15:39,451 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:15:42,343    INFO scheduling health checks:
2019-11-04 08:15:43,563    INFO scheduling jobs:
2019-11-04 08:15:43,621   DEBUG - kvm
2019-11-04 08:15:50,017   ERROR [CLOSE] Unknown exception raised, leaving!
2019-11-04 08:15:50,018   ERROR maximum recursion depth exceeded in comparison
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 687, in handle
    self.main_loop(options)
  File "/usr/lib/python3/dist-packages/lava_server/management/commands/lava-master.py", line 799, in main_loop
    jobs = schedule(self.logger, self.events["available_dt"])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 40, in schedule
    jobs.extend(schedule_jobs(logger, available_devices))
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 194, in schedule_jobs
    schedule_jobs_for_device_type(logger, dt, available_devices[dt.name])
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 222, in schedule_jobs_for_device_type
    new_job = schedule_jobs_for_device(logger, device)
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/scheduler.py", line 245, in schedule_jobs_for_device
    if not device.is_valid():
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 669, in is_valid
    rendered = self.load_configuration()
  File "/usr/lib/python3/dist-packages/lava_scheduler_app/models.py", line 822, in load_configuration
    device_template = template.render(**job_ctx)
  File "/usr/lib/python3/dist-packages/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/etc/lava-server/dispatcher-config/device-types/kvm01.jinja2", line 4, in top-level template code
    {% set netdevice = 'tap' %}
  File "/etc/lava-server/dispatcher-config/device-types/kvm01.jinja2", line 4, in top-level template code
    {% set netdevice = 'tap' %}
  File "/etc/lava-server/dispatcher-config/device-types/kvm01.jinja2", line 4, in top-level template code
    {% set netdevice = 'tap' %}
  [Previous line repeated 971 more times]
  File "/etc/lava-server/dispatcher-config/device-types/kvm01.jinja2", line 1, in top-level template code
    {% extends 'kvm01.jinja2' %}
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 351, in get
    return self[key]
  File "/usr/lib/python3/dist-packages/jinja2/utils.py", line 400, in __getitem__
    rv = self._mapping[key]
RecursionError: maximum recursion depth exceeded in comparison
2019-11-04 08:15:50,360    INFO [CLOSE] Closing the controler socket and dropping messages
2019-11-04 08:16:04,939    INFO [INIT] Dropping privileges
2019-11-04 08:16:04,939   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-11-04 08:16:04,939   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-11-04 08:16:04,941    INFO [INIT] Marking all workers as offline
2019-11-04 08:16:04,999    INFO [INIT] Starting encryption
2019-11-04 08:16:05,001   DEBUG [INIT] Opening master certificate: /etc/lava-dispatcher/certificates.d/master.key_secret
2019-11-04 08:16:05,001   DEBUG [INIT] Using slaves certificates from: /etc/lava-dispatcher/certificates.d
2019-11-04 08:16:05,002   DEBUG [INIT] Watching /etc/lava-dispatcher/certificates.d
2019-11-04 08:16:05,016    INFO [INIT] LAVA master has started.
2019-11-04 08:16:05,017    INFO [INIT] Using protocol version 3
2019-11-04 08:16:05,045   DEBUG Dhanu => PING(20)
2019-11-04 08:16:05,045 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-11-04 08:16:25,035 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:16:25,064   DEBUG Dhanu => PING(20)
2019-11-04 08:16:45,051 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:16:45,081   DEBUG Dhanu => PING(20)
2019-11-04 08:17:05,070 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:17:05,105   DEBUG Dhanu => PING(20)
2019-11-04 08:17:25,087 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:17:25,129   DEBUG Dhanu => PING(20)
2019-11-04 08:17:45,107 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:17:45,153   DEBUG Dhanu => PING(20)
2019-11-04 08:18:05,126 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:18:05,176   DEBUG Dhanu => PING(20)
2019-11-04 08:18:25,140 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:18:25,198   DEBUG Dhanu => PING(20)
2019-11-04 08:18:45,160 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:18:45,222   DEBUG Dhanu => PING(20)
2019-11-04 08:19:05,180 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:19:05,243   DEBUG Dhanu => PING(20)
2019-11-04 08:19:25,200 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:19:25,264   DEBUG Dhanu => PING(20)
2019-11-04 08:19:45,219 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:19:45,288   DEBUG Dhanu => PING(20)
2019-11-04 08:20:05,238 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:20:05,311   DEBUG Dhanu => PING(20)
2019-11-04 08:20:25,246 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:20:25,335   DEBUG Dhanu => PING(20)
2019-11-04 08:20:45,259 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:20:45,360   DEBUG Dhanu => PING(20)
2019-11-04 08:21:05,279 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:21:05,377   DEBUG Dhanu => PING(20)
2019-11-04 08:21:25,299 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:21:25,398   DEBUG Dhanu => PING(20)
2019-11-04 08:21:45,319 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:21:45,418   DEBUG Dhanu => PING(20)
2019-11-04 08:22:05,339 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:22:05,442   DEBUG Dhanu => PING(20)
2019-11-04 08:22:25,350 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:22:25,467   DEBUG Dhanu => PING(20)
2019-11-04 08:22:45,369 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:22:45,492   DEBUG Dhanu => PING(20)
2019-11-04 08:23:05,377 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:23:05,516   DEBUG Dhanu => PING(20)
2019-11-04 08:23:25,389 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:23:25,540   DEBUG Dhanu => PING(20)
2019-11-04 08:23:45,409 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:23:45,559   DEBUG Dhanu => PING(20)
2019-11-04 08:24:05,429 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:24:05,578   DEBUG Dhanu => PING(20)
2019-11-04 08:24:25,449 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:24:25,600   DEBUG Dhanu => PING(20)
2019-11-04 08:24:45,467 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:24:45,624   DEBUG Dhanu => PING(20)
2019-11-04 08:25:05,486 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:25:05,648   DEBUG Dhanu => PING(20)
2019-11-04 08:25:25,506 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:25:25,673   DEBUG Dhanu => PING(20)
2019-11-04 08:25:45,523 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:25:45,697   DEBUG Dhanu => PING(20)
2019-11-04 08:26:05,542 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:26:05,720   DEBUG Dhanu => PING(20)
2019-11-04 08:26:25,557 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:26:25,745   DEBUG Dhanu => PING(20)
2019-11-04 08:26:45,577 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:26:45,764   DEBUG Dhanu => PING(20)
2019-11-04 08:27:05,596 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:27:05,784   DEBUG Dhanu => PING(20)
2019-11-04 08:27:25,616 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:27:25,808   DEBUG Dhanu => PING(20)
2019-11-04 08:27:45,635 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:27:45,829   DEBUG Dhanu => PING(20)
2019-11-04 08:28:05,654 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:28:05,853   DEBUG Dhanu => PING(20)
2019-11-04 08:28:25,673 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:28:25,878   DEBUG Dhanu => PING(20)
2019-11-04 08:28:45,691 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:28:45,902   DEBUG Dhanu => PING(20)
2019-11-04 08:29:05,711 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:29:05,924   DEBUG Dhanu => PING(20)
2019-11-04 08:29:18,459    INFO [POLL] Received a signal, leaving
2019-11-04 08:29:18,460    INFO [CLOSE] Closing the controler socket and dropping messages
2019-11-04 08:29:19,431    INFO [INIT] Dropping privileges
2019-11-04 08:29:19,431   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-11-04 08:29:19,431   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-11-04 08:29:19,433    INFO [INIT] Marking all workers as offline
2019-11-04 08:29:19,508    INFO [INIT] Starting encryption
2019-11-04 08:29:19,510   DEBUG [INIT] Opening master certificate: /etc/lava-dispatcher/certificates.d/master.key_secret
2019-11-04 08:29:19,510   DEBUG [INIT] Using slaves certificates from: /etc/lava-dispatcher/certificates.d
2019-11-04 08:29:19,511   DEBUG [INIT] Watching /etc/lava-dispatcher/certificates.d
2019-11-04 08:29:19,526    INFO [INIT] LAVA master has started.
2019-11-04 08:29:19,526    INFO [INIT] Using protocol version 3
2019-11-04 08:29:25,944   DEBUG Dhanu => PING(20)
2019-11-04 08:29:25,944 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-11-04 08:29:26,994    INFO Dhanu => HELLO
2019-11-04 08:29:26,994 WARNING Dispatcher <Dhanu> has RESTARTED
2019-11-04 08:29:32,001   DEBUG Dhanu => PING(20)
2019-11-04 08:29:39,531 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:29:52,026   DEBUG Dhanu => PING(20)
2019-11-04 08:29:59,538 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:30:12,046   DEBUG Dhanu => PING(20)
2019-11-04 08:30:19,545 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:30:32,063   DEBUG Dhanu => PING(20)
2019-11-04 08:30:39,553 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:30:52,080   DEBUG Dhanu => PING(20)
2019-11-04 08:30:53,102    INFO [POLL] Received a signal, leaving
2019-11-04 08:30:53,103    INFO [CLOSE] Closing the controler socket and dropping messages
2019-11-04 14:05:37,415    INFO [INIT] Dropping privileges
2019-11-04 14:05:37,479   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-11-04 14:05:37,480   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-11-04 14:05:37,557    INFO [INIT] Marking all workers as offline
2019-11-04 14:05:37,688    INFO [INIT] Starting encryption
2019-11-04 14:05:37,690   DEBUG [INIT] Opening master certificate: /etc/lava-dispatcher/certificates.d/master.key_secret
2019-11-04 14:05:37,732   DEBUG [INIT] Using slaves certificates from: /etc/lava-dispatcher/certificates.d
2019-11-04 14:05:37,733   DEBUG [INIT] Watching /etc/lava-dispatcher/certificates.d
2019-11-04 14:05:37,740    INFO [INIT] LAVA master has started.
2019-11-04 14:05:37,740    INFO [INIT] Using protocol version 3
2019-11-04 14:05:37,829    INFO Dhanu => HELLO
2019-11-04 14:05:37,830 WARNING New dispatcher <Dhanu>
2019-11-04 14:05:37,909    INFO Dhanu => HELLO_RETRY
2019-11-04 14:05:37,910 WARNING Dispatcher <Dhanu> was not confirmed
2019-11-04 14:05:37,954    INFO Dhanu => HELLO_RETRY
2019-11-04 14:05:37,955 WARNING Dispatcher <Dhanu> was not confirmed
2019-11-04 14:05:37,998    INFO Dhanu => HELLO_RETRY
2019-11-04 14:05:37,999 WARNING Dispatcher <Dhanu> was not confirmed
2019-11-04 14:05:38,043    INFO Dhanu => HELLO_RETRY
2019-11-04 14:05:38,043 WARNING Dispatcher <Dhanu> was not confirmed
2019-11-04 14:05:38,087    INFO Dhanu => HELLO_RETRY
2019-11-04 14:05:38,088 WARNING Dispatcher <Dhanu> was not confirmed
2019-11-04 14:05:43,095   DEBUG Dhanu => PING(20)
2019-11-04 14:05:57,752 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 14:06:03,118   DEBUG Dhanu => PING(20)
2019-11-04 14:06:18,077 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 14:06:23,136   DEBUG Dhanu => PING(20)
2019-11-04 14:06:38,086 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 14:06:43,156   DEBUG Dhanu => PING(20)
2019-11-04 14:06:58,093 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 14:07:03,176   DEBUG Dhanu => PING(20)
2019-11-04 14:07:18,100 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 14:07:23,192   DEBUG Dhanu => PING(20)
2019-11-04 14:07:38,107 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 14:07:43,209   DEBUG Dhanu => PING(20)
2019-11-04 14:07:58,111 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 14:08:03,225   DEBUG Dhanu => PING(20)
2019-11-04 14:08:18,117 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 14:08:23,241   DEBUG Dhanu => PING(20)
2019-11-04 14:08:38,124 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 14:08:43,265   DEBUG Dhanu => PING(20)
2019-11-04 14:08:58,132 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 14:09:03,281   DEBUG Dhanu => PING(20)
2019-11-04 14:09:18,140 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 14:09:23,316   DEBUG Dhanu => PING(20)
2019-11-04 14:09:38,147 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 14:09:43,336   DEBUG Dhanu => PING(20)
2019-11-04 14:09:58,155 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 14:10:03,356   DEBUG Dhanu => PING(20)
2019-11-04 14:10:18,163 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 14:10:23,381   DEBUG Dhanu => PING(20)
2019-11-04 14:10:38,170 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 14:10:43,402   DEBUG Dhanu => PING(20)
2019-11-04 14:10:58,176 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 14:11:03,421   DEBUG Dhanu => PING(20)
2019-11-04 14:11:18,184 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 14:11:23,442   DEBUG Dhanu => PING(20)
2019-11-04 14:11:38,192 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 14:11:43,462   DEBUG Dhanu => PING(20)
2019-11-04 14:11:58,199 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 14:12:03,481   DEBUG Dhanu => PING(20)
2019-11-04 14:12:18,208 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 14:12:23,502   DEBUG Dhanu => PING(20)
2019-11-04 14:12:38,216 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 14:12:43,524   DEBUG Dhanu => PING(20)
2019-11-04 14:12:58,223 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 14:13:03,540   DEBUG Dhanu => PING(20)
2019-11-04 14:13:18,227 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 14:13:23,558   DEBUG Dhanu => PING(20)
2019-11-04 14:13:38,235 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 14:13:43,573   DEBUG Dhanu => PING(20)
2019-11-04 14:13:58,242 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 14:14:03,594   DEBUG Dhanu => PING(20)
2019-11-04 14:14:18,252 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 14:14:23,613   DEBUG Dhanu => PING(20)
2019-11-04 14:14:38,259 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 14:14:43,632   DEBUG Dhanu => PING(20)
2019-11-04 14:14:58,266 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 14:15:03,652   DEBUG Dhanu => PING(20)
2019-11-04 14:15:18,273 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 14:15:23,673   DEBUG Dhanu => PING(20)
2019-11-04 14:15:38,282 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 14:15:43,694   DEBUG Dhanu => PING(20)
2019-11-04 14:15:58,289 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 14:16:03,714   DEBUG Dhanu => PING(20)
2019-11-04 14:16:18,296 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:45:28,169    INFO [POLL] Received a signal, leaving
2019-11-04 08:45:28,169    INFO [CLOSE] Closing the controler socket and dropping messages
2019-11-04 08:45:29,138    INFO [INIT] Dropping privileges
2019-11-04 08:45:29,138   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-11-04 08:45:29,138   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-11-04 08:45:29,140    INFO [INIT] Marking all workers as offline
2019-11-04 08:45:29,164    INFO [INIT] Starting encryption
2019-11-04 08:45:29,165   DEBUG [INIT] Opening master certificate: /etc/lava-dispatcher/certificates.d/master.key_secret
2019-11-04 08:45:29,165   DEBUG [INIT] Using slaves certificates from: /etc/lava-dispatcher/certificates.d
2019-11-04 08:45:29,166   DEBUG [INIT] Watching /etc/lava-dispatcher/certificates.d
2019-11-04 08:45:29,179    INFO [INIT] LAVA master has started.
2019-11-04 08:45:29,179    INFO [INIT] Using protocol version 3
2019-11-04 08:45:33,537    INFO Dhanu => HELLO
2019-11-04 08:45:33,538 WARNING New dispatcher <Dhanu>
2019-11-04 08:45:38,544   DEBUG Dhanu => PING(20)
2019-11-04 08:45:49,188 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:45:58,565   DEBUG Dhanu => PING(20)
2019-11-04 08:46:09,202 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:46:18,583   DEBUG Dhanu => PING(20)
2019-11-04 08:46:29,209 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:46:38,603   DEBUG Dhanu => PING(20)
2019-11-04 08:46:49,217 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:46:58,623   DEBUG Dhanu => PING(20)
2019-11-04 08:47:09,224 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:47:18,643   DEBUG Dhanu => PING(20)
2019-11-04 08:47:29,234 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:47:38,665   DEBUG Dhanu => PING(20)
2019-11-04 08:47:49,245 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:47:58,686   DEBUG Dhanu => PING(20)
2019-11-04 08:48:09,255 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:48:18,709   DEBUG Dhanu => PING(20)
2019-11-04 08:48:29,266 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:48:38,731   DEBUG Dhanu => PING(20)
2019-11-04 08:48:49,274 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:48:58,751   DEBUG Dhanu => PING(20)
2019-11-04 08:49:09,280 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:49:18,770   DEBUG Dhanu => PING(20)
2019-11-04 08:49:29,288 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:49:38,785   DEBUG Dhanu => PING(20)
2019-11-04 08:49:49,296 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:49:58,801   DEBUG Dhanu => PING(20)
2019-11-04 08:50:09,304 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:50:18,818   DEBUG Dhanu => PING(20)
2019-11-04 08:50:29,314 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:50:38,842   DEBUG Dhanu => PING(20)
2019-11-04 08:50:49,324 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:50:58,865   DEBUG Dhanu => PING(20)
2019-11-04 08:51:09,333 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:51:18,886   DEBUG Dhanu => PING(20)
2019-11-04 08:51:29,340 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:51:38,907   DEBUG Dhanu => PING(20)
2019-11-04 08:51:49,348 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:51:58,926   DEBUG Dhanu => PING(20)
2019-11-04 08:52:09,356 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:52:18,943   DEBUG Dhanu => PING(20)
2019-11-04 08:52:29,360 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:52:38,968   DEBUG Dhanu => PING(20)
2019-11-04 08:52:49,364 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:52:58,989   DEBUG Dhanu => PING(20)
2019-11-04 08:53:09,367 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:53:19,005   DEBUG Dhanu => PING(20)
2019-11-04 08:53:29,374 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:53:39,027   DEBUG Dhanu => PING(20)
2019-11-04 08:53:49,382 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:53:59,049   DEBUG Dhanu => PING(20)
2019-11-04 08:54:09,390 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:54:19,071   DEBUG Dhanu => PING(20)
2019-11-04 08:54:29,401 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:54:39,096   DEBUG Dhanu => PING(20)
2019-11-04 08:54:49,411 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:54:59,120   DEBUG Dhanu => PING(20)
2019-11-04 08:55:09,421 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:55:19,133   DEBUG Dhanu => PING(20)
2019-11-04 08:55:29,428 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:55:39,159   DEBUG Dhanu => PING(20)
2019-11-04 08:55:49,438 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:55:59,181   DEBUG Dhanu => PING(20)
2019-11-04 08:56:09,447 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:56:19,206   DEBUG Dhanu => PING(20)
2019-11-04 08:56:29,456 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:56:39,227   DEBUG Dhanu => PING(20)
2019-11-04 08:56:49,466 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:56:59,252   DEBUG Dhanu => PING(20)
2019-11-04 08:57:09,476 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:57:19,273   DEBUG Dhanu => PING(20)
2019-11-04 08:57:29,487 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:57:39,297   DEBUG Dhanu => PING(20)
2019-11-04 08:57:49,497 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:57:59,319   DEBUG Dhanu => PING(20)
2019-11-04 08:58:09,507 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:58:19,341   DEBUG Dhanu => PING(20)
2019-11-04 08:58:29,514 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:58:39,363   DEBUG Dhanu => PING(20)
2019-11-04 08:58:49,522 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:58:59,387   DEBUG Dhanu => PING(20)
2019-11-04 08:59:09,528 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:59:19,404   DEBUG Dhanu => PING(20)
2019-11-04 08:59:29,538 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:59:39,423   DEBUG Dhanu => PING(20)
2019-11-04 08:59:49,548 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 08:59:59,441   DEBUG Dhanu => PING(20)
2019-11-04 09:00:09,556 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:00:19,457   DEBUG Dhanu => PING(20)
2019-11-04 09:00:29,566 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:00:39,478   DEBUG Dhanu => PING(20)
2019-11-04 09:00:49,574 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:00:59,497   DEBUG Dhanu => PING(20)
2019-11-04 09:01:09,583 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:01:19,519   DEBUG Dhanu => PING(20)
2019-11-04 09:01:29,590 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:01:39,537   DEBUG Dhanu => PING(20)
2019-11-04 09:01:49,598 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:01:59,557   DEBUG Dhanu => PING(20)
2019-11-04 09:02:09,606 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:02:19,577   DEBUG Dhanu => PING(20)
2019-11-04 09:02:29,612 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:02:39,590   DEBUG Dhanu => PING(20)
2019-11-04 09:02:49,620 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:02:59,611   DEBUG Dhanu => PING(20)
2019-11-04 09:03:09,630 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:03:19,633   DEBUG Dhanu => PING(20)
2019-11-04 09:03:29,638 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:03:39,650   DEBUG Dhanu => PING(20)
2019-11-04 09:03:49,646 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:03:59,665   DEBUG Dhanu => PING(20)
2019-11-04 09:04:09,654 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:04:19,687   DEBUG Dhanu => PING(20)
2019-11-04 09:04:29,660 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:04:39,706   DEBUG Dhanu => PING(20)
2019-11-04 09:04:49,668 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:04:59,722   DEBUG Dhanu => PING(20)
2019-11-04 09:05:09,676 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:05:19,740   DEBUG Dhanu => PING(20)
2019-11-04 09:05:29,686 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:05:39,763   DEBUG Dhanu => PING(20)
2019-11-04 09:05:49,694 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:05:59,786   DEBUG Dhanu => PING(20)
2019-11-04 09:06:09,703 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:06:19,810   DEBUG Dhanu => PING(20)
2019-11-04 09:06:29,712 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:06:39,833   DEBUG Dhanu => PING(20)
2019-11-04 09:06:49,720 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:06:59,853   DEBUG Dhanu => PING(20)
2019-11-04 09:07:09,730 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:07:19,877   DEBUG Dhanu => PING(20)
2019-11-04 09:07:29,738 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:07:39,901   DEBUG Dhanu => PING(20)
2019-11-04 09:07:49,746 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:07:59,919   DEBUG Dhanu => PING(20)
2019-11-04 09:08:09,754 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:08:19,943   DEBUG Dhanu => PING(20)
2019-11-04 09:08:29,761 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:08:39,963   DEBUG Dhanu => PING(20)
2019-11-04 09:08:49,768 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:08:59,988   DEBUG Dhanu => PING(20)
2019-11-04 09:09:09,776 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:09:20,011   DEBUG Dhanu => PING(20)
2019-11-04 09:09:29,784 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:09:40,035   DEBUG Dhanu => PING(20)
2019-11-04 09:09:49,792 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:10:00,057   DEBUG Dhanu => PING(20)
2019-11-04 09:10:09,800 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:10:20,079   DEBUG Dhanu => PING(20)
2019-11-04 09:10:29,808 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:10:40,101   DEBUG Dhanu => PING(20)
2019-11-04 09:10:49,817 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:11:00,121   DEBUG Dhanu => PING(20)
2019-11-04 09:11:09,827 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:11:20,143   DEBUG Dhanu => PING(20)
2019-11-04 09:11:29,836 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:11:40,163   DEBUG Dhanu => PING(20)
2019-11-04 09:11:49,846 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:12:00,187   DEBUG Dhanu => PING(20)
2019-11-04 09:12:09,854 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:12:20,205   DEBUG Dhanu => PING(20)
2019-11-04 09:12:29,862 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:12:40,225   DEBUG Dhanu => PING(20)
2019-11-04 09:12:49,872 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:13:00,247   DEBUG Dhanu => PING(20)
2019-11-04 09:13:09,881 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:13:20,269   DEBUG Dhanu => PING(20)
2019-11-04 09:13:29,890 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:13:40,293   DEBUG Dhanu => PING(20)
2019-11-04 09:13:49,900 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:14:00,313   DEBUG Dhanu => PING(20)
2019-11-04 09:14:09,908 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:14:20,338   DEBUG Dhanu => PING(20)
2019-11-04 09:14:29,918 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:14:40,359   DEBUG Dhanu => PING(20)
2019-11-04 09:14:49,927 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:15:00,382   DEBUG Dhanu => PING(20)
2019-11-04 09:15:09,936 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:15:20,399   DEBUG Dhanu => PING(20)
2019-11-04 09:15:29,945 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:15:40,419   DEBUG Dhanu => PING(20)
2019-11-04 09:15:49,954 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:16:00,444   DEBUG Dhanu => PING(20)
2019-11-04 09:16:09,963 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:16:20,465   DEBUG Dhanu => PING(20)
2019-11-04 09:16:29,972 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:16:40,487   DEBUG Dhanu => PING(20)
2019-11-04 09:16:49,981 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:17:00,510   DEBUG Dhanu => PING(20)
2019-11-04 09:17:09,991 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:17:20,529   DEBUG Dhanu => PING(20)
2019-11-04 09:17:29,999 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:17:40,553   DEBUG Dhanu => PING(20)
2019-11-04 09:17:50,007 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:18:00,573   DEBUG Dhanu => PING(20)
2019-11-04 09:18:10,015 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:18:20,595   DEBUG Dhanu => PING(20)
2019-11-04 09:18:30,023 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:18:40,617   DEBUG Dhanu => PING(20)
2019-11-04 09:18:50,031 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:19:00,637   DEBUG Dhanu => PING(20)
2019-11-04 09:19:10,038 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:19:20,657   DEBUG Dhanu => PING(20)
2019-11-04 09:19:30,045 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:19:40,682   DEBUG Dhanu => PING(20)
2019-11-04 09:19:50,054 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:20:00,706   DEBUG Dhanu => PING(20)
2019-11-04 09:20:10,061 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:20:20,730   DEBUG Dhanu => PING(20)
2019-11-04 09:20:30,069 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:20:40,752   DEBUG Dhanu => PING(20)
2019-11-04 09:20:50,076 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:21:00,774   DEBUG Dhanu => PING(20)
2019-11-04 09:21:10,084 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:21:20,795   DEBUG Dhanu => PING(20)
2019-11-04 09:21:30,092 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:21:40,814   DEBUG Dhanu => PING(20)
2019-11-04 09:21:50,099 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:22:00,838   DEBUG Dhanu => PING(20)
2019-11-04 09:22:10,108 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:22:20,859   DEBUG Dhanu => PING(20)
2019-11-04 09:22:30,116 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:22:40,879   DEBUG Dhanu => PING(20)
2019-11-04 09:22:50,123 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:23:00,903   DEBUG Dhanu => PING(20)
2019-11-04 09:23:10,131 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:23:20,927   DEBUG Dhanu => PING(20)
2019-11-04 09:23:30,141 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:23:40,947   DEBUG Dhanu => PING(20)
2019-11-04 09:23:50,149 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:24:00,969   DEBUG Dhanu => PING(20)
2019-11-04 09:24:10,156 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:24:20,990   DEBUG Dhanu => PING(20)
2019-11-04 09:24:30,164 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:24:41,010   DEBUG Dhanu => PING(20)
2019-11-04 09:24:50,172 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:25:01,029   DEBUG Dhanu => PING(20)
2019-11-04 09:25:10,180 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:25:21,053   DEBUG Dhanu => PING(20)
2019-11-04 09:25:30,188 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:25:41,078   DEBUG Dhanu => PING(20)
2019-11-04 09:25:50,196 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:26:01,101   DEBUG Dhanu => PING(20)
2019-11-04 09:26:10,204 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:26:21,125   DEBUG Dhanu => PING(20)
2019-11-04 09:26:30,212 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:26:41,143   DEBUG Dhanu => PING(20)
2019-11-04 09:26:50,219 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:27:01,161   DEBUG Dhanu => PING(20)
2019-11-04 09:27:10,226 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:27:21,186   DEBUG Dhanu => PING(20)
2019-11-04 09:27:30,232 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:27:41,206   DEBUG Dhanu => PING(20)
2019-11-04 09:27:50,240 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:28:01,227   DEBUG Dhanu => PING(20)
2019-11-04 09:28:10,247 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:28:21,251   DEBUG Dhanu => PING(20)
2019-11-04 09:28:30,255 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:33:21,538   DEBUG Dhanu => PING(20)
2019-11-04 09:33:30,362 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:33:41,560   DEBUG Dhanu => PING(20)
2019-11-04 09:33:50,370 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:34:01,579   DEBUG Dhanu => PING(20)
2019-11-04 09:34:10,379 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:34:21,599   DEBUG Dhanu => PING(20)
2019-11-04 09:34:30,387 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:34:41,623   DEBUG Dhanu => PING(20)
2019-11-04 09:34:50,395 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:35:01,641   DEBUG Dhanu => PING(20)
2019-11-04 09:35:10,402 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:35:21,662   DEBUG Dhanu => PING(20)
2019-11-04 09:35:30,407 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:35:41,681   DEBUG Dhanu => PING(20)
2019-11-04 09:35:50,412 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:36:01,697   DEBUG Dhanu => PING(20)
2019-11-04 09:36:10,420 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:36:21,719   DEBUG Dhanu => PING(20)
2019-11-04 09:36:30,426 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:36:41,743   DEBUG Dhanu => PING(20)
2019-11-04 09:36:50,434 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:37:01,761   DEBUG Dhanu => PING(20)
2019-11-04 09:37:10,442 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:37:21,782   DEBUG Dhanu => PING(20)
2019-11-04 09:37:30,451 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:37:41,801   DEBUG Dhanu => PING(20)
2019-11-04 09:37:50,457 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:37:53,610    INFO [POLL] Received a signal, leaving
2019-11-04 09:37:53,611    INFO [CLOSE] Closing the controler socket and dropping messages
2019-11-04 09:37:54,549    INFO [INIT] Dropping privileges
2019-11-04 09:37:54,549   DEBUG Switching to (lavaserver(128), lavaserver(134))
2019-11-04 09:37:54,549   DEBUG [INIT] Dumping config to /var/lib/lava-server/default/media/lava-master-config.yaml
2019-11-04 09:37:54,551    INFO [INIT] Marking all workers as offline
2019-11-04 09:37:54,611    INFO [INIT] Starting encryption
2019-11-04 09:37:54,613   DEBUG [INIT] Opening master certificate: /etc/lava-dispatcher/certificates.d/master.key_secret
2019-11-04 09:37:54,613   DEBUG [INIT] Using slaves certificates from: /etc/lava-dispatcher/certificates.d
2019-11-04 09:37:54,614   DEBUG [INIT] Watching /etc/lava-dispatcher/certificates.d
2019-11-04 09:37:54,633    INFO [INIT] LAVA master has started.
2019-11-04 09:37:54,633    INFO [INIT] Using protocol version 3
2019-11-04 09:38:01,821   DEBUG Dhanu => PING(20)
2019-11-04 09:38:01,821 WARNING Unknown dispatcher <Dhanu> (server crashed)
2019-11-04 09:38:14,645 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:38:21,846   DEBUG Dhanu => PING(20)
2019-11-04 09:38:34,655 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:38:41,870   DEBUG Dhanu => PING(20)
2019-11-04 09:38:54,663 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:39:01,889   DEBUG Dhanu => PING(20)
2019-11-04 09:39:14,671 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:39:21,910   DEBUG Dhanu => PING(20)
2019-11-04 09:39:34,681 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:39:41,925   DEBUG Dhanu => PING(20)
2019-11-04 09:39:54,692 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:40:01,970   DEBUG Dhanu => PING(20)
2019-11-04 09:40:14,704 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:40:21,998   DEBUG Dhanu => PING(20)
2019-11-04 09:40:34,716 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:40:42,017   DEBUG Dhanu => PING(20)
2019-11-04 09:40:54,728 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:41:02,033   DEBUG Dhanu => PING(20)
2019-11-04 09:41:14,740 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:41:22,051   DEBUG Dhanu => PING(20)
2019-11-04 09:41:34,745 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:41:42,066   DEBUG Dhanu => PING(20)
2019-11-04 09:41:54,754 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:42:02,091   DEBUG Dhanu => PING(20)
2019-11-04 09:42:14,761 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:42:22,115   DEBUG Dhanu => PING(20)
2019-11-04 09:42:34,768 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:42:42,133   DEBUG Dhanu => PING(20)
2019-11-04 09:42:54,779 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:43:02,158   DEBUG Dhanu => PING(20)
2019-11-04 09:43:14,791 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:43:22,182   DEBUG Dhanu => PING(20)
2019-11-04 09:43:34,803 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:43:42,202   DEBUG Dhanu => PING(20)
2019-11-04 09:43:54,812 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:44:02,217   DEBUG Dhanu => PING(20)
2019-11-04 09:44:14,824 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:44:22,235   DEBUG Dhanu => PING(20)
2019-11-04 09:44:34,836 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:44:42,253   DEBUG Dhanu => PING(20)
2019-11-04 09:44:54,849 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:45:02,269   DEBUG Dhanu => PING(20)
2019-11-04 09:45:14,861 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:45:22,565   DEBUG Dhanu => PING(20)
2019-11-04 09:45:34,924 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:45:42,586   DEBUG Dhanu => PING(20)
2019-11-04 09:45:54,931 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:46:02,605   DEBUG Dhanu => PING(20)
2019-11-04 09:46:14,939 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:46:22,629   DEBUG Dhanu => PING(20)
2019-11-04 09:46:34,947 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:46:42,645   DEBUG Dhanu => PING(20)
2019-11-04 09:46:54,949 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:47:02,665   DEBUG Dhanu => PING(20)
2019-11-04 09:47:14,957 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:47:22,685   DEBUG Dhanu => PING(20)
2019-11-04 09:47:34,964 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:47:42,700   DEBUG Dhanu => PING(20)
2019-11-04 09:47:54,971 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:48:02,721   DEBUG Dhanu => PING(20)
2019-11-04 09:48:14,977 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:48:22,742   DEBUG Dhanu => PING(20)
2019-11-04 09:48:34,984 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:48:42,763   DEBUG Dhanu => PING(20)
2019-11-04 09:48:54,991 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:49:02,781   DEBUG Dhanu => PING(20)
2019-11-04 09:49:14,998 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:49:22,799   DEBUG Dhanu => PING(20)
2019-11-04 09:49:35,000 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:49:42,821   DEBUG Dhanu => PING(20)
2019-11-04 09:49:55,008 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:50:02,840   DEBUG Dhanu => PING(20)
2019-11-04 09:50:15,015 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:50:22,857   DEBUG Dhanu => PING(20)
2019-11-04 09:50:35,025 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:50:42,873   DEBUG Dhanu => PING(20)
2019-11-04 09:50:55,032 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:51:02,889   DEBUG Dhanu => PING(20)
2019-11-04 09:51:15,044 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:51:22,911   DEBUG Dhanu => PING(20)
2019-11-04 09:51:35,052 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:51:42,931   DEBUG Dhanu => PING(20)
2019-11-04 09:51:55,064 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:52:02,953   DEBUG Dhanu => PING(20)
2019-11-04 09:52:15,076 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:52:22,975   DEBUG Dhanu => PING(20)
2019-11-04 09:52:35,084 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:52:42,997   DEBUG Dhanu => PING(20)
2019-11-04 09:52:55,096 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:53:03,013   DEBUG Dhanu => PING(20)
2019-11-04 09:53:15,108 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:53:23,031   DEBUG Dhanu => PING(20)
2019-11-04 09:53:35,120 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:53:43,051   DEBUG Dhanu => PING(20)
2019-11-04 09:53:55,133 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:54:03,076   DEBUG Dhanu => PING(20)
2019-11-04 09:54:15,145 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:54:23,100   DEBUG Dhanu => PING(20)
2019-11-04 09:54:35,157 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:54:43,125   DEBUG Dhanu => PING(20)
2019-11-04 09:54:55,169 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:55:03,146   DEBUG Dhanu => PING(20)
2019-11-04 09:55:15,180 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:55:23,171   DEBUG Dhanu => PING(20)
2019-11-04 09:55:35,188 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:55:43,189   DEBUG Dhanu => PING(20)
2019-11-04 09:55:55,196 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:56:03,207   DEBUG Dhanu => PING(20)
2019-11-04 09:56:15,208 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:56:23,231   DEBUG Dhanu => PING(20)
2019-11-04 09:56:35,215 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:56:43,256   DEBUG Dhanu => PING(20)
2019-11-04 09:56:55,222 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:57:03,280   DEBUG Dhanu => PING(20)
2019-11-04 09:57:15,232 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:57:23,305   DEBUG Dhanu => PING(20)
2019-11-04 09:57:35,243 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:57:43,329   DEBUG Dhanu => PING(20)
2019-11-04 09:57:55,255 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:58:03,353   DEBUG Dhanu => PING(20)
2019-11-04 09:58:15,264 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:58:23,373   DEBUG Dhanu => PING(20)
2019-11-04 09:58:35,271 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:58:43,412   DEBUG Dhanu => PING(20)
2019-11-04 09:58:55,282 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:59:03,436   DEBUG Dhanu => PING(20)
2019-11-04 09:59:15,294 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:59:23,461   DEBUG Dhanu => PING(20)
2019-11-04 09:59:35,306 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 09:59:43,483   DEBUG Dhanu => PING(20)
2019-11-04 09:59:55,318 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:00:03,506   DEBUG Dhanu => PING(20)
2019-11-04 10:00:15,329 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:00:23,525   DEBUG Dhanu => PING(20)
2019-11-04 10:00:35,336 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:00:43,547   DEBUG Dhanu => PING(20)
2019-11-04 10:00:55,347 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:01:03,569   DEBUG Dhanu => PING(20)
2019-11-04 10:01:15,358 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:01:23,593   DEBUG Dhanu => PING(20)
2019-11-04 10:01:35,406 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:01:43,811   DEBUG Dhanu => PING(20)
2019-11-04 10:01:55,417 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:02:03,832   DEBUG Dhanu => PING(20)
2019-11-04 10:02:15,428 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:02:23,855   DEBUG Dhanu => PING(20)
2019-11-04 10:02:35,440 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:02:43,877   DEBUG Dhanu => PING(20)
2019-11-04 10:02:55,452 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:03:03,899   DEBUG Dhanu => PING(20)
2019-11-04 10:03:15,463 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:03:23,919   DEBUG Dhanu => PING(20)
2019-11-04 10:03:35,474 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:03:43,939   DEBUG Dhanu => PING(20)
2019-11-04 10:03:55,485 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:04:03,964   DEBUG Dhanu => PING(20)
2019-11-04 10:04:15,496 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:04:23,988   DEBUG Dhanu => PING(20)
2019-11-04 10:04:35,507 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:04:44,011   DEBUG Dhanu => PING(20)
2019-11-04 10:04:55,515 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:05:04,034   DEBUG Dhanu => PING(20)
2019-11-04 10:05:15,522 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:05:24,049   DEBUG Dhanu => PING(20)
2019-11-04 10:05:35,530 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:05:44,066   DEBUG Dhanu => PING(20)
2019-11-04 10:05:55,540 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:06:04,082   DEBUG Dhanu => PING(20)
2019-11-04 10:06:15,548 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:06:24,101   DEBUG Dhanu => PING(20)
2019-11-04 10:06:35,556 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:06:44,117   DEBUG Dhanu => PING(20)
2019-11-04 10:06:55,567 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:07:04,142   DEBUG Dhanu => PING(20)
2019-11-04 10:07:15,576 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:07:24,158   DEBUG Dhanu => PING(20)
2019-11-04 10:07:35,587 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:07:44,181   DEBUG Dhanu => PING(20)
2019-11-04 10:07:55,598 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:08:04,199   DEBUG Dhanu => PING(20)
2019-11-04 10:08:15,608 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:08:24,218   DEBUG Dhanu => PING(20)
2019-11-04 10:08:35,616 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:08:44,233   DEBUG Dhanu => PING(20)
2019-11-04 10:08:55,624 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:09:04,249   DEBUG Dhanu => PING(20)
2019-11-04 10:09:15,632 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:09:24,265   DEBUG Dhanu => PING(20)
2019-11-04 10:09:35,640 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:09:44,285   DEBUG Dhanu => PING(20)
2019-11-04 10:09:55,651 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:10:04,301   DEBUG Dhanu => PING(20)
2019-11-04 10:10:15,660 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:10:24,322   DEBUG Dhanu => PING(20)
2019-11-04 10:10:35,668 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:10:44,337   DEBUG Dhanu => PING(20)
2019-11-04 10:10:55,677 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:11:04,355   DEBUG Dhanu => PING(20)
2019-11-04 10:11:15,684 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:11:24,374   DEBUG Dhanu => PING(20)
2019-11-04 10:11:35,692 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:11:44,393   DEBUG Dhanu => PING(20)
2019-11-04 10:11:55,703 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:12:04,411   DEBUG Dhanu => PING(20)
2019-11-04 10:12:15,713 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:12:24,429   DEBUG Dhanu => PING(20)
2019-11-04 10:12:35,724 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:12:44,445   DEBUG Dhanu => PING(20)
2019-11-04 10:12:55,732 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:13:04,461   DEBUG Dhanu => PING(20)
2019-11-04 10:13:15,743 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:13:24,477   DEBUG Dhanu => PING(20)
2019-11-04 10:13:35,754 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:13:44,493   DEBUG Dhanu => PING(20)
2019-11-04 10:13:55,764 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:14:04,510   DEBUG Dhanu => PING(20)
2019-11-04 10:14:15,775 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:14:24,534   DEBUG Dhanu => PING(20)
2019-11-04 10:14:35,783 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:14:44,558   DEBUG Dhanu => PING(20)
2019-11-04 10:14:55,791 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:15:04,576   DEBUG Dhanu => PING(20)
2019-11-04 10:15:15,799 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:15:24,601   DEBUG Dhanu => PING(20)
2019-11-04 10:15:35,807 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:15:44,622   DEBUG Dhanu => PING(20)
2019-11-04 10:15:55,817 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:16:04,642   DEBUG Dhanu => PING(20)
2019-11-04 10:16:15,828 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:16:24,668   DEBUG Dhanu => PING(20)
2019-11-04 10:16:35,836 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:16:44,685   DEBUG Dhanu => PING(20)
2019-11-04 10:16:55,847 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:17:04,706   DEBUG Dhanu => PING(20)
2019-11-04 10:17:15,855 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:17:24,721   DEBUG Dhanu => PING(20)
2019-11-04 10:17:35,864 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:17:44,737   DEBUG Dhanu => PING(20)
2019-11-04 10:17:55,872 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:18:04,749   DEBUG Dhanu => PING(20)
2019-11-04 10:18:15,880 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:18:24,771   DEBUG Dhanu => PING(20)
2019-11-04 10:18:35,888 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:18:44,789   DEBUG Dhanu => PING(20)
2019-11-04 10:18:55,894 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:19:04,803   DEBUG Dhanu => PING(20)
2019-11-04 10:19:15,901 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:19:24,821   DEBUG Dhanu => PING(20)
2019-11-04 10:19:35,907 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:19:44,838   DEBUG Dhanu => PING(20)
2019-11-04 10:19:55,912 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:20:04,857   DEBUG Dhanu => PING(20)
2019-11-04 10:20:15,920 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:20:24,873   DEBUG Dhanu => PING(20)
2019-11-04 10:20:35,928 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:20:44,893   DEBUG Dhanu => PING(20)
2019-11-04 10:20:55,936 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:21:04,909   DEBUG Dhanu => PING(20)
2019-11-04 10:21:15,942 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:21:24,925   DEBUG Dhanu => PING(20)
2019-11-04 10:21:35,949 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:21:44,941   DEBUG Dhanu => PING(20)
2019-11-04 10:21:55,956 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:22:04,957   DEBUG Dhanu => PING(20)
2019-11-04 10:22:15,964 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:22:24,977   DEBUG Dhanu => PING(20)
2019-11-04 10:22:35,971 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:22:44,993   DEBUG Dhanu => PING(20)
2019-11-04 10:22:55,980 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:23:05,009   DEBUG Dhanu => PING(20)
2019-11-04 10:23:15,989 WARNING lava-logs is offline: can't schedule jobs
2019-11-04 10:23:25,025   DEBUG Dhanu => PING(20)