2021-12-05T18:51:52.772 INFO:root:teuthology version: 1.1.0-844d1377
2021-12-05T18:51:52.892 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi049.front.sepia.ceph.com' reimaging
2021-12-05T18:51:52.893 INFO:teuthology.lock.ops:Updating [ubuntu@smithi049.front.sepia.ceph.com]: reset os type and version on server
2021-12-05T18:51:52.894 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server
2021-12-05T18:51:52.913 INFO:teuthology.lock.ops:Node 'ubuntu@smithi049.front.sepia.ceph.com' reimaging is complete
2021-12-05T18:51:52.914 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi106.front.sepia.ceph.com' reimaging
2021-12-05T18:51:52.915 INFO:teuthology.lock.ops:Updating [ubuntu@smithi106.front.sepia.ceph.com]: reset os type and version on server
2021-12-05T18:51:52.916 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server
2021-12-05T18:51:52.934 INFO:teuthology.lock.ops:Node 'ubuntu@smithi106.front.sepia.ceph.com' reimaging is complete
2021-12-05T18:51:53.141 INFO:teuthology.provision.fog.smithi106:Scheduling deploy of centos 8.3
2021-12-05T18:51:53.152 INFO:teuthology.provision.fog.smithi049:Scheduling deploy of centos 8.3
2021-12-05T18:51:53.520 INFO:teuthology.orchestra.console:Power off smithi049
2021-12-05T18:51:53.555 INFO:teuthology.orchestra.console:Power off smithi106
2021-12-05T18:52:01.892 INFO:teuthology.orchestra.console:Power off for smithi049 completed
2021-12-05T18:52:01.993 INFO:teuthology.orchestra.console:Power on smithi049
2021-12-05T18:52:06.034 INFO:teuthology.orchestra.console:Power off for smithi106 completed
2021-12-05T18:52:06.136 INFO:teuthology.orchestra.console:Power on smithi106
2021-12-05T18:52:10.365 INFO:teuthology.orchestra.console:Power on for smithi049 completed
2021-12-05T18:52:10.385 INFO:teuthology.orchestra.console:Power on for smithi106 completed
2021-12-05T18:52:10.466 INFO:teuthology.provision.fog.smithi049:Waiting for deploy to finish
2021-12-05T18:52:10.485 INFO:teuthology.provision.fog.smithi106:Waiting for deploy to finish
2021-12-05T18:57:00.092 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-05T18:57:00.392 INFO:teuthology.provision.fog.smithi106:Node is ready
2021-12-05T18:57:00.409 INFO:teuthology.orchestra.run.smithi106.stdout:smithi106.front.sepia.ceph.com
2021-12-05T18:57:00.465 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.15.106 smithi106.front.sepia.ceph.com smithi106
2021-12-05T18:57:00.790 INFO:teuthology.provision.fog.smithi106:Deploy complete!
2021-12-05T18:57:27.259 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-05T18:57:27.543 INFO:teuthology.provision.fog.smithi049:Node is ready
2021-12-05T18:57:27.558 INFO:teuthology.orchestra.run.smithi049.stdout:smithi049.front.sepia.ceph.com
2021-12-05T18:57:27.614 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49 smithi049.front.sepia.ceph.com smithi049
2021-12-05T18:57:28.053 INFO:teuthology.provision.fog.smithi049:Deploy complete!
2021-12-05T18:57:28.253 INFO:teuthology.lock.ops:Checking smithi049.front.sepia.ceph.com
2021-12-05T18:57:28.255 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-05T18:57:28.276 INFO:teuthology.lock.ops:Checking smithi106.front.sepia.ceph.com
2021-12-05T18:57:28.277 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-05T18:57:28.296 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: set os type and version on server
2021-12-05T18:57:28.297 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com'
2021-12-05T18:57:28.565 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64
2021-12-05T18:57:28.619 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="CentOS Linux"
2021-12-05T18:57:28.620 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="8"
2021-12-05T18:57:28.620 INFO:teuthology.orchestra.run.smithi049.stdout:ID="centos"
2021-12-05T18:57:28.620 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="rhel fedora"
2021-12-05T18:57:28.621 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="8"
2021-12-05T18:57:28.621 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el8"
2021-12-05T18:57:28.621 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="CentOS Linux 8"
2021-12-05T18:57:28.621 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31"
2021-12-05T18:57:28.621 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-05T18:57:28.622 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://centos.org/"
2021-12-05T18:57:28.622 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-12-05T18:57:28.622 INFO:teuthology.orchestra.run.smithi049.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-12-05T18:57:28.622 INFO:teuthology.orchestra.run.smithi049.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-12-05T18:57:28.624 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server
2021-12-05T18:57:28.642 INFO:teuthology.lock.ops:Updating [smithi106.front.sepia.ceph.com]: set os type and version on server
2021-12-05T18:57:28.642 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com'
2021-12-05T18:57:28.913 INFO:teuthology.orchestra.run.smithi106.stdout:x86_64
2021-12-05T18:57:28.969 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="CentOS Linux"
2021-12-05T18:57:28.969 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="8"
2021-12-05T18:57:28.970 INFO:teuthology.orchestra.run.smithi106.stdout:ID="centos"
2021-12-05T18:57:28.970 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE="rhel fedora"
2021-12-05T18:57:28.971 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="8"
2021-12-05T18:57:28.971 INFO:teuthology.orchestra.run.smithi106.stdout:PLATFORM_ID="platform:el8"
2021-12-05T18:57:28.971 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="CentOS Linux 8"
2021-12-05T18:57:28.972 INFO:teuthology.orchestra.run.smithi106.stdout:ANSI_COLOR="0;31"
2021-12-05T18:57:28.972 INFO:teuthology.orchestra.run.smithi106.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-05T18:57:28.972 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://centos.org/"
2021-12-05T18:57:28.973 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-12-05T18:57:28.973 INFO:teuthology.orchestra.run.smithi106.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-12-05T18:57:28.974 INFO:teuthology.orchestra.run.smithi106.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-12-05T18:57:28.974 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server
2021-12-05T18:57:29.074 INFO:teuthology.dispatcher.supervisor:Running job 6546794
2021-12-05T18:57:29.074 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2021-12-05_15:06:27-rados-WIP_GBH_safe_fast_shutdown_1-distro-basic-smithi/6546794 --name benhanokh-2021-12-05_15:06:27-rados-WIP_GBH_safe_fast_shutdown_1-distro-basic-smithi --description rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} -- /home/teuthworker/archive/benhanokh-2021-12-05_15:06:27-rados-WIP_GBH_safe_fast_shutdown_1-distro-basic-smithi/6546794/orig.config.yaml
2021-12-05T18:57:29.079 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2021-12-05_15:06:27-rados-WIP_GBH_safe_fast_shutdown_1-distro-basic-smithi/6546794
2021-12-05T18:57:29.079 INFO:teuthology.dispatcher.supervisor:Job PID: 27190
2021-12-05T18:57:29.080 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-12-06T06:58:22.664 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-12-06T06:58:22.850 INFO:teuthology.kill:Killing Pids: {27190}
2021-12-06T06:58:24.056 INFO:teuthology.task.internal:roles: ubuntu@smithi049.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2021-12-06T06:58:24.057 INFO:teuthology.task.internal:roles: ubuntu@smithi106.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2021-12-06T06:58:24.057 INFO:teuthology.misc:Compressing logs...
2021-12-06T06:58:24.058 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com'
2021-12-06T06:58:24.268 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com'
2021-12-06T06:58:24.636 INFO:teuthology.misc:Compressing logs...
2021-12-06T06:58:25.388 INFO:teuthology.orchestra.run.smithi106.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-12-06T06:58:25.665 INFO:teuthology.orchestra.run.smithi049.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-12-06T06:58:26.178 INFO:teuthology.misc:Compressing logs...
2021-12-06T06:58:42.686 INFO:teuthology.kill:No teuthology processes running
2021-12-06T06:58:43.949 INFO:teuthology.kill:Nuking machines: ['smithi049', 'smithi106']
2021-12-06T06:58:44.958 INFO:teuthology.kill:2021-12-06 06:58:44,957.957 INFO:teuthology.nuke:targets:
2021-12-06T06:58:44.959 INFO:teuthology.kill:  smithi049.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC38AAy4M2YjF2jBphrn6S13YdtCFMpx/2JZlPIX9WVBcnIXRTv/Ck370Vi21Kg21x6IhGImvgs+yA/YRFccA23kHHjPpCISWogovkYcxAZtPAP4dmEOe6xs3vOWrbsh1uOEGPXhf+ij8qb6vQr4UjQ4gK/mLJE8lOENtHDRqfmaXz74HHD9UH88J/LMaWNDbdBW4nhyKyJs6CcOSTa5MSgiWQttT7FMKp7KDSUCOI1S72mxC/aAZX0D0dkbgxJ3bTMQbCpU8QKuAuq3/eG5PBXsweDxfw2H7oPMjSRmn/QHPucOqdY7/6wH1/swgk57Zr4ng9/TH6Uvm6l9x8BmaRQPhRW4k9L0jAQTk9WdkIAOVGDr0Y2FSaWYo9bVjrx3RIkTcY6EGubR9PZlCZ+ON8Fecfv6A2H+5kWhV8qFR6n0rNXDfZ+Cdy3Tcc2FWVImWcwy1w39de1pV1auAgYTqHzbSekEnrg/0hmnloOVGuLMmO5qNUpt8Lr/yKPCJKSww8=
2021-12-06T06:58:44.959 INFO:teuthology.kill:  smithi106.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPdoppdmGwwZQrtnHZql326jTu8I53Wqe/lrAPQsZbQB8j3WfeUpJVWIajgzv0gAma8KdD60ymFyr/aZE+0NVkAC8wU1wf06VAf3t/ofC+hnJMuX/qJdxmJCxmJyimLXYPIBpSQEwhwK/ulewaRxx6n/XgAi/N29/eSq/JCoECgft1F9V6eqtg2+HnhO8Bg1ZAhiNir/tg4vrxqIYNHG8VidRq9bSplvpeVFOVhFGPxIMVDCHWY5po6VcyYW2ouHa52jhMDy5EezCIlTg6FwWus2RB3FdthxHxay7MCVEtT5Ym4Ud2yNpadEsmtL+GiS4jy01VAcQ60WXooXyUWr2fcKP1XX6dM10knqG/JrCnfWuyLi2sGoUDTIQS/be/fEB0pzkW1rEGZbO2pLqjVV32v9QY4ifB9U6NjRIky/VlYp/pZV4ODfbYypeVe4mHLoIkuPbIaX/PfhvWJunD798CxU6SvNFHKvyVSssVYxKHu+LWrV8+FPMaq/qcbf8YvYU=
2021-12-06T06:58:44.984 INFO:teuthology.kill:2021-12-06 06:58:44,984.984 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-06T06:58:44.987 INFO:teuthology.kill:2021-12-06 06:58:44,987.987 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-06T06:58:45.062 INFO:teuthology.kill:2021-12-06 06:58:45,061.061 INFO:teuthology.orchestra.console:Power off smithi049
2021-12-06T06:58:45.076 INFO:teuthology.kill:2021-12-06 06:58:45,075.075 INFO:teuthology.orchestra.console:Power off smithi106
2021-12-06T06:58:53.435 INFO:teuthology.kill:2021-12-06 06:58:53,434.434 INFO:teuthology.orchestra.console:Power off for smithi049 completed
2021-12-06T06:58:53.440 INFO:teuthology.kill:2021-12-06 06:58:53,439.439 INFO:teuthology.orchestra.console:Power off for smithi106 completed
2021-12-06T06:58:53.591 INFO:teuthology.kill:2021-12-06 06:58:53,590.590 INFO:teuthology.lock.ops:unlocked: smithi049.front.sepia.ceph.com
2021-12-06T06:58:53.595 INFO:teuthology.kill:2021-12-06 06:58:53,595.595 INFO:teuthology.lock.ops:unlocked: smithi106.front.sepia.ceph.com
2021-12-06T07:00:53.937 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-12-06T07:00:54.041 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi049 but it was locked by another job: /home/teuthworker/archive/teuthology-2021-12-06_06:07:02-rbd-pacific-distro-default-smithi/6547454
2021-12-06T07:00:54.042 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi106 but it was locked by another job: /home/teuthworker/archive/teuthology-2021-12-06_06:07:02-rbd-pacific-distro-default-smithi/6547454