2021-11-23T19:51:14.613 INFO:root:teuthology version: 1.1.0-6cfddd5e
2021-11-23T19:51:14.757 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi163.front.sepia.ceph.com' reimaging
2021-11-23T19:51:14.758 INFO:teuthology.lock.ops:Updating [ubuntu@smithi163.front.sepia.ceph.com]: reset os type and version on server
2021-11-23T19:51:14.758 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server
2021-11-23T19:51:14.779 INFO:teuthology.lock.ops:Node 'ubuntu@smithi163.front.sepia.ceph.com' reimaging is complete
2021-11-23T19:51:14.779 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi179.front.sepia.ceph.com' reimaging
2021-11-23T19:51:14.780 INFO:teuthology.lock.ops:Updating [ubuntu@smithi179.front.sepia.ceph.com]: reset os type and version on server
2021-11-23T19:51:14.780 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server
2021-11-23T19:51:14.803 INFO:teuthology.lock.ops:Node 'ubuntu@smithi179.front.sepia.ceph.com' reimaging is complete
2021-11-23T19:51:14.990 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of rhel 8.4
2021-11-23T19:51:15.035 INFO:teuthology.provision.fog.smithi179:Scheduling deploy of rhel 8.4
2021-11-23T19:51:15.356 INFO:teuthology.orchestra.console:Power off smithi163
2021-11-23T19:51:15.411 INFO:teuthology.orchestra.console:Power off smithi179
2021-11-23T19:51:23.746 INFO:teuthology.orchestra.console:Power off for smithi163 completed
2021-11-23T19:51:23.847 INFO:teuthology.orchestra.console:Power on smithi163
2021-11-23T19:51:27.899 INFO:teuthology.orchestra.console:Power off for smithi179 completed
2021-11-23T19:51:28.000 INFO:teuthology.orchestra.console:Power on smithi179
2021-11-23T19:51:32.227 INFO:teuthology.orchestra.console:Power on for smithi163 completed
2021-11-23T19:51:32.257 INFO:teuthology.orchestra.console:Power on for smithi179 completed
2021-11-23T19:51:32.328 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish
2021-11-23T19:51:32.357 INFO:teuthology.provision.fog.smithi179:Waiting for deploy to finish
2021-11-23T19:56:22.003 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-23T19:56:22.203 INFO:teuthology.provision.fog.smithi179:Node is ready
2021-11-23T19:56:22.218 INFO:teuthology.orchestra.run.smithi179.stdout:smithi179.front.sepia.ceph.com
2021-11-23T19:56:22.275 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.15.179 smithi179.front.sepia.ceph.com smithi179
2021-11-23T19:56:22.605 INFO:teuthology.provision.fog.smithi179:Deploy complete!
2021-11-23T19:56:49.091 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-23T19:56:49.348 INFO:teuthology.provision.fog.smithi163:Node is ready
2021-11-23T19:56:49.364 INFO:teuthology.orchestra.run.smithi163.stdout:smithi163.front.sepia.ceph.com
2021-11-23T19:56:49.420 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163 smithi163.front.sepia.ceph.com smithi163
2021-11-23T19:56:49.743 INFO:teuthology.provision.fog.smithi163:Deploy complete!
2021-11-23T19:56:49.893 INFO:teuthology.lock.ops:Checking smithi163.front.sepia.ceph.com
2021-11-23T19:56:49.894 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-23T19:56:49.946 INFO:teuthology.lock.ops:Checking smithi179.front.sepia.ceph.com
2021-11-23T19:56:49.946 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-23T19:56:49.965 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: set os type and version on server
2021-11-23T19:56:49.966 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com'
2021-11-23T19:56:50.191 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64
2021-11-23T19:56:50.245 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="Red Hat Enterprise Linux"
2021-11-23T19:56:50.246 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="8.4 (Ootpa)"
2021-11-23T19:56:50.246 INFO:teuthology.orchestra.run.smithi163.stdout:ID="rhel"
2021-11-23T19:56:50.247 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="fedora"
2021-11-23T19:56:50.247 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="8.4"
2021-11-23T19:56:50.247 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el8"
2021-11-23T19:56:50.248 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2021-11-23T19:56:50.248 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31"
2021-11-23T19:56:50.248 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2021-11-23T19:56:50.248 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://www.redhat.com/"
2021-11-23T19:56:50.248 INFO:teuthology.orchestra.run.smithi163.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2021-11-23T19:56:50.249 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-11-23T19:56:50.249 INFO:teuthology.orchestra.run.smithi163.stdout:
2021-11-23T19:56:50.250 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-11-23T19:56:50.250 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2021-11-23T19:56:50.250 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-11-23T19:56:50.251 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2021-11-23T19:56:50.252 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server
2021-11-23T19:56:50.270 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: set os type and version on server
2021-11-23T19:56:50.271 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com'
2021-11-23T19:56:50.509 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64
2021-11-23T19:56:50.563 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="Red Hat Enterprise Linux"
2021-11-23T19:56:50.564 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="8.4 (Ootpa)"
2021-11-23T19:56:50.564 INFO:teuthology.orchestra.run.smithi179.stdout:ID="rhel"
2021-11-23T19:56:50.564 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="fedora"
2021-11-23T19:56:50.564 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="8.4"
2021-11-23T19:56:50.565 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el8"
2021-11-23T19:56:50.565 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2021-11-23T19:56:50.565 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31"
2021-11-23T19:56:50.565 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2021-11-23T19:56:50.566 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://www.redhat.com/"
2021-11-23T19:56:50.566 INFO:teuthology.orchestra.run.smithi179.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2021-11-23T19:56:50.566 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-11-23T19:56:50.566 INFO:teuthology.orchestra.run.smithi179.stdout:
2021-11-23T19:56:50.566 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-11-23T19:56:50.567 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2021-11-23T19:56:50.567 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-11-23T19:56:50.567 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2021-11-23T19:56:50.568 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server
2021-11-23T19:56:50.671 INFO:teuthology.dispatcher.supervisor:Running job 6522501
2021-11-23T19:56:50.672 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2021-11-23_15:13:21-rados-wip-yuri2-testing-2021-11-22-1532-distro-basic-smithi/6522501 --name yuriw-2021-11-23_15:13:21-rados-wip-yuri2-testing-2021-11-22-1532-distro-basic-smithi --description rados/cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} -- /home/teuthworker/archive/yuriw-2021-11-23_15:13:21-rados-wip-yuri2-testing-2021-11-22-1532-distro-basic-smithi/6522501/orig.config.yaml
2021-11-23T19:56:50.675 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2021-11-23_15:13:21-rados-wip-yuri2-testing-2021-11-22-1532-distro-basic-smithi/6522501
2021-11-23T19:56:50.676 INFO:teuthology.dispatcher.supervisor:Job PID: 15749
2021-11-23T19:56:50.676 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-11-24T07:57:46.792 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-11-24T07:57:47.003 INFO:teuthology.kill:Killing Pids: {15749}
2021-11-24T07:57:48.266 INFO:teuthology.task.internal:roles: ubuntu@smithi163.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a']
2021-11-24T07:57:48.268 INFO:teuthology.task.internal:roles: ubuntu@smithi179.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a']
2021-11-24T07:57:48.269 INFO:teuthology.misc:Compressing logs...
2021-11-24T07:57:48.269 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com'
2021-11-24T07:57:48.503 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com'
2021-11-24T07:57:48.812 INFO:teuthology.misc:Compressing logs...
2021-11-24T07:57:49.846 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-11-24T07:57:50.195 INFO:teuthology.misc:Compressing logs...
2021-11-24T07:58:02.712 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/60fbf22c-4c9a-11ec-8c2d-001a4aab830c/ceph-mon.a.log: file size changed while zipping
2021-11-24T07:58:07.365 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/60fbf22c-4c9a-11ec-8c2d-001a4aab830c/ceph-mon.c.log: file size changed while zipping
2021-11-24T07:58:32.639 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/60fbf22c-4c9a-11ec-8c2d-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2021-11-24T07:59:12.264 INFO:teuthology.orchestra.run.smithi179.stderr:gzip: /var/log/ceph/60fbf22c-4c9a-11ec-8c2d-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2021-11-24T07:59:13.334 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/60fbf22c-4c9a-11ec-8c2d-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2021-11-24T07:59:24.315 INFO:teuthology.orchestra.run.smithi179.stderr:gzip: /var/log/ceph/60fbf22c-4c9a-11ec-8c2d-001a4aab830c/ceph-mon.b.log: file size changed while zipping
2021-11-24T07:59:31.468 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/60fbf22c-4c9a-11ec-8c2d-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2021-11-24T07:59:35.798 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/60fbf22c-4c9a-11ec-8c2d-001a4aab830c/ceph-mgr.y.log: file size changed while zipping
2021-11-24T08:00:13.561 INFO:teuthology.orchestra.run.smithi179.stderr:gzip: /var/log/ceph/60fbf22c-4c9a-11ec-8c2d-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2021-11-24T08:02:12.056 INFO:teuthology.kill:No teuthology processes running
2021-11-24T08:02:13.220 INFO:teuthology.kill:Nuking machines: ['smithi163', 'smithi179']
2021-11-24T08:02:14.171 INFO:teuthology.kill:2021-11-24 08:02:14,171.171 INFO:teuthology.nuke:targets:
2021-11-24T08:02:14.172 INFO:teuthology.kill:  smithi163.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPgWSEIvOMI9AyPGLs69FQm1oKPs+JPlUKOQXfY6Kvw3TLjGGC/ywpipZtc0Slf26YxUKYUCowtmYxLJ3gxmAW8vx4wCFj5OLL2afKfhJqkQEK0x+ERNkYIoYBXuMeh3LcJcxILWdTId6M8abW1b/JBHc04NxnAr/eeLmPbt83zuMUVaP6fdALvIybyDOy7ozDoLhtRewI5aNAqsUfopwNgOp4lPIRduHERlcaXvp3CyPcIN+5kO8l94FcbR1PuoQOBfHYb+edsxGiDZDkzb66cAFKQi7EBlnFXwNJG11tyl8rfY/M2Cc/focPY6X2pDNv3Vu0aneTVqhOwg+rv+snmvAgi0LSs8ELnQJTlfZBS/fzfdkYt97w8Zpyb3JMTblHNzHhOebSbSQd9E5+7qPi1jtEr/AQb7lw1mLRm6Rb6psMHtVUlLchYg/dYhAUnq44/h9pP8c5IpeeCi6ZftjhewBypto3bbdRbJe7k6xCW0qA5L4dSONnMiqsIsrE6dc=
2021-11-24T08:02:14.173 INFO:teuthology.kill:  smithi179.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCfkcS/69RUpChR6kfubK4MZDg0t604rO384dW3Ag9pBLFYCSqblvePnKHWkvHU0RYvUFDFXoX+bUM/SrWiTD5tw32dCl1EjI4M03F+E9g5RqiTbZBgUy5rG4iyOb8XXA/PDHUcQLYF1tQuHYwtF0jRRyvGqPD2dHb1CVKd0QzqH/NKN9AzagDY+uRerNKtmlmmDEsWi1qzjfu/TGetigxdoUxOchCmHETfW/mnp9h1GKFvzjHc6ukBLQUDzF8wN1Q3QJN3s6JuPyJJBJGSTRGvFAdlJ/1l2neCoLKJrf+KuRwHnxrtEQrF6qql79FK9X98oiYkGbXWAaOSgsOSNef7tMY4MhU0PpSw4+rd0pwLdc5R7jzLO5Gh7rk/DVSd6GfSmaclj3kXWXbtxGeY4Ymog9gTiVMcqVhmAeCEOH/GmPItAHe/jdeT/FJ9UMIzRgR/m5aL6Uhz8UZdEKFFzNLy9AMbj/Pza8TMwvKqjRyDovt/loge1sf1+94ewYSzAhU=
2021-11-24T08:02:14.201 INFO:teuthology.kill:2021-11-24 08:02:14,200.200 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-24T08:02:14.204 INFO:teuthology.kill:2021-11-24 08:02:14,204.204 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-24T08:02:14.284 INFO:teuthology.kill:2021-11-24 08:02:14,283.283 INFO:teuthology.orchestra.console:Power off smithi179
2021-11-24T08:02:14.300 INFO:teuthology.kill:2021-11-24 08:02:14,300.300 INFO:teuthology.orchestra.console:Power off smithi163
2021-11-24T08:02:22.666 INFO:teuthology.kill:2021-11-24 08:02:22,665.665 INFO:teuthology.orchestra.console:Power off for smithi163 completed
2021-11-24T08:02:22.822 INFO:teuthology.kill:2021-11-24 08:02:22,821.821 INFO:teuthology.lock.ops:unlocked: smithi163.front.sepia.ceph.com
2021-11-24T08:02:26.767 INFO:teuthology.kill:2021-11-24 08:02:26,767.767 INFO:teuthology.orchestra.console:Power off for smithi179 completed
2021-11-24T08:02:26.914 INFO:teuthology.kill:2021-11-24 08:02:26,914.914 INFO:teuthology.lock.ops:unlocked: smithi179.front.sepia.ceph.com
2021-11-24T08:04:27.236 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-11-24T08:04:27.336 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi163 but it was locked by another job: /home/teuthworker/archive/vshankar-2021-11-24_07:14:27-fs-wip-vshankar-testing-20211124-094330-testing-default-smithi/6523812
2021-11-24T08:04:27.337 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi179 but it was locked by another job: /home/teuthworker/archive/vshankar-2021-11-24_07:14:27-fs-wip-vshankar-testing-20211124-094330-testing-default-smithi/6523812