2021-11-09T16:49:11.520 INFO:root:teuthology version: 1.1.0-c56135d1 2021-11-09T16:49:11.657 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba030.front.sepia.ceph.com' reimaging 2021-11-09T16:49:11.658 INFO:teuthology.lock.ops:Updating [ubuntu@gibba030.front.sepia.ceph.com]: reset os type and version on server 2021-11-09T16:49:11.658 INFO:teuthology.lock.ops:Updating gibba030.front.sepia.ceph.com on lock server 2021-11-09T16:49:11.679 INFO:teuthology.lock.ops:Node 'ubuntu@gibba030.front.sepia.ceph.com' reimaging is complete 2021-11-09T16:49:11.679 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba045.front.sepia.ceph.com' reimaging 2021-11-09T16:49:11.680 INFO:teuthology.lock.ops:Updating [ubuntu@gibba045.front.sepia.ceph.com]: reset os type and version on server 2021-11-09T16:49:11.680 INFO:teuthology.lock.ops:Updating gibba045.front.sepia.ceph.com on lock server 2021-11-09T16:49:11.706 INFO:teuthology.lock.ops:Node 'ubuntu@gibba045.front.sepia.ceph.com' reimaging is complete 2021-11-09T16:49:11.896 INFO:teuthology.provision.fog.gibba030:Scheduling deploy of centos 8.3 2021-11-09T16:49:11.928 INFO:teuthology.provision.fog.gibba045:Scheduling deploy of centos 8.3 2021-11-09T16:49:12.233 INFO:teuthology.orchestra.console:Power off gibba030 2021-11-09T16:49:12.247 INFO:teuthology.orchestra.console:Power off gibba045 2021-11-09T16:49:20.623 INFO:teuthology.orchestra.console:Power off for gibba030 completed 2021-11-09T16:49:20.627 INFO:teuthology.orchestra.console:Power off for gibba045 completed 2021-11-09T16:49:20.724 INFO:teuthology.orchestra.console:Power on gibba030 2021-11-09T16:49:20.732 INFO:teuthology.orchestra.console:Power on gibba045 2021-11-09T16:49:29.097 INFO:teuthology.orchestra.console:Power on for gibba030 completed 2021-11-09T16:49:29.103 INFO:teuthology.orchestra.console:Power on for gibba045 completed 2021-11-09T16:49:29.198 INFO:teuthology.provision.fog.gibba030:Waiting for deploy to finish 2021-11-09T16:49:29.204 INFO:teuthology.provision.fog.gibba045:Waiting for deploy to finish 2021-11-09T16:53:26.132 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-11-09T16:53:36.537 INFO:teuthology.provision.fog.gibba045:Node is ready 2021-11-09T16:53:36.551 INFO:teuthology.orchestra.run.gibba045.stdout:gibba032 2021-11-09T16:53:36.603 INFO:teuthology.orchestra.run.gibba045.stdout:172.21.2.132 gibba032.front.sepia.ceph.com gibba032 2021-11-09T16:53:36.905 INFO:teuthology.provision.fog.gibba045:Deploy complete! 2021-11-09T16:54:00.644 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-11-09T16:54:00.946 INFO:teuthology.provision.fog.gibba030:Node is ready 2021-11-09T16:54:00.957 INFO:teuthology.orchestra.run.gibba030.stdout:gibba030.front.sepia.ceph.com 2021-11-09T16:54:01.008 INFO:teuthology.orchestra.run.gibba030.stdout:172.21.2.130 gibba030.front.sepia.ceph.com gibba030 2021-11-09T16:54:01.328 INFO:teuthology.provision.fog.gibba030:Deploy complete! 2021-11-09T16:54:01.525 INFO:teuthology.lock.ops:Checking gibba030.front.sepia.ceph.com 2021-11-09T16:54:01.526 INFO:teuthology.lock.ops:New key found. Updating... 2021-11-09T16:54:01.545 INFO:teuthology.lock.ops:Checking gibba045.front.sepia.ceph.com 2021-11-09T16:54:01.546 INFO:teuthology.lock.ops:New key found. Updating... 2021-11-09T16:54:01.565 INFO:teuthology.lock.ops:Updating [gibba030.front.sepia.ceph.com]: set os type and version on server 2021-11-09T16:54:01.565 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba030.front.sepia.ceph.com' 2021-11-09T16:54:01.798 INFO:teuthology.orchestra.run.gibba030.stdout:x86_64 2021-11-09T16:54:01.849 INFO:teuthology.orchestra.run.gibba030.stdout:NAME="CentOS Linux" 2021-11-09T16:54:01.850 INFO:teuthology.orchestra.run.gibba030.stdout:VERSION="8" 2021-11-09T16:54:01.850 INFO:teuthology.orchestra.run.gibba030.stdout:ID="centos" 2021-11-09T16:54:01.850 INFO:teuthology.orchestra.run.gibba030.stdout:ID_LIKE="rhel fedora" 2021-11-09T16:54:01.850 INFO:teuthology.orchestra.run.gibba030.stdout:VERSION_ID="8" 2021-11-09T16:54:01.851 INFO:teuthology.orchestra.run.gibba030.stdout:PLATFORM_ID="platform:el8" 2021-11-09T16:54:01.851 INFO:teuthology.orchestra.run.gibba030.stdout:PRETTY_NAME="CentOS Linux 8" 2021-11-09T16:54:01.851 INFO:teuthology.orchestra.run.gibba030.stdout:ANSI_COLOR="0;31" 2021-11-09T16:54:01.851 INFO:teuthology.orchestra.run.gibba030.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-11-09T16:54:01.852 INFO:teuthology.orchestra.run.gibba030.stdout:HOME_URL="https://centos.org/" 2021-11-09T16:54:01.852 INFO:teuthology.orchestra.run.gibba030.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-11-09T16:54:01.852 INFO:teuthology.orchestra.run.gibba030.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-11-09T16:54:01.852 INFO:teuthology.orchestra.run.gibba030.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-11-09T16:54:01.853 INFO:teuthology.lock.ops:Updating gibba030.front.sepia.ceph.com on lock server 2021-11-09T16:54:01.878 INFO:teuthology.lock.ops:Updating [gibba045.front.sepia.ceph.com]: set os type and version on server 2021-11-09T16:54:01.878 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba045.front.sepia.ceph.com' 2021-11-09T16:54:02.149 INFO:teuthology.orchestra.run.gibba045.stdout:x86_64 2021-11-09T16:54:02.202 INFO:teuthology.orchestra.run.gibba045.stdout:NAME="CentOS Linux" 2021-11-09T16:54:02.202 INFO:teuthology.orchestra.run.gibba045.stdout:VERSION="8" 2021-11-09T16:54:02.202 INFO:teuthology.orchestra.run.gibba045.stdout:ID="centos" 2021-11-09T16:54:02.203 INFO:teuthology.orchestra.run.gibba045.stdout:ID_LIKE="rhel fedora" 2021-11-09T16:54:02.203 INFO:teuthology.orchestra.run.gibba045.stdout:VERSION_ID="8" 2021-11-09T16:54:02.203 INFO:teuthology.orchestra.run.gibba045.stdout:PLATFORM_ID="platform:el8" 2021-11-09T16:54:02.203 INFO:teuthology.orchestra.run.gibba045.stdout:PRETTY_NAME="CentOS Linux 8" 2021-11-09T16:54:02.204 INFO:teuthology.orchestra.run.gibba045.stdout:ANSI_COLOR="0;31" 2021-11-09T16:54:02.204 INFO:teuthology.orchestra.run.gibba045.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-11-09T16:54:02.204 INFO:teuthology.orchestra.run.gibba045.stdout:HOME_URL="https://centos.org/" 2021-11-09T16:54:02.204 INFO:teuthology.orchestra.run.gibba045.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-11-09T16:54:02.204 INFO:teuthology.orchestra.run.gibba045.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-11-09T16:54:02.205 INFO:teuthology.orchestra.run.gibba045.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-11-09T16:54:02.205 INFO:teuthology.lock.ops:Updating gibba045.front.sepia.ceph.com on lock server 2021-11-09T16:54:02.304 INFO:teuthology.dispatcher.supervisor:Running job 6479742 2021-11-09T16:54:02.305 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2021-11-03_03:30:03-rados-octopus-distro-default-gibba/6479742 --name teuthology-2021-11-03_03:30:03-rados-octopus-distro-default-gibba --description rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} -- /home/teuthworker/archive/teuthology-2021-11-03_03:30:03-rados-octopus-distro-default-gibba/6479742/orig.config.yaml 2021-11-09T16:54:02.308 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2021-11-03_03:30:03-rados-octopus-distro-default-gibba/6479742 2021-11-09T16:54:02.309 INFO:teuthology.dispatcher.supervisor:Job PID: 24187 2021-11-09T16:54:02.309 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-11-10T04:54:56.956 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-11-10T04:54:57.155 INFO:teuthology.kill:Killing Pids: {24187} 2021-11-10T04:54:58.373 INFO:teuthology.task.internal:roles: ubuntu@gibba030.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2021-11-10T04:54:58.374 INFO:teuthology.task.internal:roles: ubuntu@gibba045.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2021-11-10T04:54:58.374 INFO:teuthology.misc:Compressing logs... 2021-11-10T04:54:58.375 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba030.front.sepia.ceph.com' 2021-11-10T04:54:58.602 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba045.front.sepia.ceph.com' 2021-11-10T04:55:25.227 INFO:teuthology.kill:No teuthology processes running 2021-11-10T04:55:26.405 INFO:teuthology.kill:Nuking machines: ['gibba030', 'gibba045'] 2021-11-10T04:55:27.401 INFO:teuthology.kill:2021-11-10 04:55:27,401.401 INFO:teuthology.nuke:targets: 2021-11-10T04:55:27.402 INFO:teuthology.kill: gibba030.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDG93SFjZ1lIxqKYpbWhukXyq/5ttJHP25XBORxmJP4/35HEP6QelWlN6mUafdUCNiMwUd7TGMqdLxsgKOhRnW90NkYqVEfHzU6JQXaRSfkYPLC2+PVmgUGEz9f8O7OHCkY6TVkBg6oYn7H2PcgMsDuGCIVu1zz6xRdxoROzaDENKBIss15FR4xnxH7Vu2X4vetaeZTD7KMKz+/qCCTVaZgx1tQ8zzIxM03W1rrnQRbdezXCr+iCY9uAj8HaArw7346bZ0HWUYBSwLeTiik+zWc+/nqxV78FHygxLpGbM5nHKOHrT7ERK3R58EfUi/TZwZPqcOZULgjtgPmcNWhyi3AtP7eaxSLNT2SRR/ZVvVMq7idc4+Os0Zx2461FTXloXQ4Zs8KivuxOVN4HuB0NnwLfDAC5bXEOJOKN2150clijUgydzw+7k8JtqIpRTa3DQBjQ9GhqBn3xEGAVcLMcF0mJ82ETQE4YPWxPccibmeCVSabdhupUo1uqYqabKbUZac= 2021-11-10T04:55:27.403 INFO:teuthology.kill: gibba045.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDURKtwqhFbYAQHg5wyeNKmd0D7dc+S7gTBp1tHnCGKUk0DpB8FTagp5LQPHvOylJlYrcf4BQIVpCHPZyvND7T2JRFJbw5DflLYUyeZP0d/XXfYYXE0NPEymPh16wOuaWwarGT9W9P69qU5MTZH3z0I2gfyKEXEMShVJ9aH17ob7+zsaN95QXtwpclYB2xcXQSGLhPnXatVjb6OEcfJmNVTy8fxed4moYS74/yzShswZ2WnD/ET5QRoKBPPqDskDBL7R4GaDuUt2LCC9O6t4oIIAmqUPPNmM2zuDm6DeuehzsF/HfC5qkdSaLe0+Ge9AD+T4D+B6XMLKoJwLna3roBPAhKjo+sUS8mHlc9Bz9IR6jbgAsBf3d+/0FhPUMNZMHUZxJDdahTr+Ljjt1IbWyuQTqoiU1PeSJ9O8pH3T+zWiQNLrMfz2ak3yDtwlob+sTnGhoB/7Vd/7hghnOdobIRgtny4PPC/atdLARivDVskE2JQsV0FXcVwMCSv9Fmsia8= 2021-11-10T04:55:27.428 INFO:teuthology.kill:2021-11-10 04:55:27,428.428 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-10T04:55:27.431 INFO:teuthology.kill:2021-11-10 04:55:27,431.431 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-10T04:55:27.506 INFO:teuthology.kill:2021-11-10 04:55:27,506.506 INFO:teuthology.orchestra.console:Power off gibba030 2021-11-10T04:55:27.520 INFO:teuthology.kill:2021-11-10 04:55:27,520.520 INFO:teuthology.orchestra.console:Power off gibba045 2021-11-10T04:55:35.904 INFO:teuthology.kill:2021-11-10 04:55:35,904.904 INFO:teuthology.orchestra.console:Power off for gibba045 completed 2021-11-10T04:55:35.935 INFO:teuthology.kill:2021-11-10 04:55:35,934.934 INFO:teuthology.orchestra.console:Power off for gibba030 completed 2021-11-10T04:55:36.052 INFO:teuthology.kill:2021-11-10 04:55:36,052.052 INFO:teuthology.lock.ops:unlocked: gibba045.front.sepia.ceph.com 2021-11-10T04:55:36.079 INFO:teuthology.kill:2021-11-10 04:55:36,079.079 INFO:teuthology.lock.ops:unlocked: gibba030.front.sepia.ceph.com 2021-11-10T04:57:36.415 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-11-10T04:57:36.516 WARNING:teuthology.dispatcher.supervisor:Was going to unlock gibba030 but it was locked by another job: /home/teuthworker/archive/teuthology-2021-11-03_03:30:03-rados-octopus-distro-default-gibba/6479828 2021-11-10T04:57:36.517 WARNING:teuthology.dispatcher.supervisor:Was going to unlock gibba045 but it was locked by another job: /home/teuthworker/archive/teuthology-2021-11-03_03:30:03-rados-octopus-distro-default-gibba/6479828