2021-11-13T09:43:06.850 INFO:root:teuthology version: 1.1.0-d4737010
2021-11-13T09:43:06.982 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi068.front.sepia.ceph.com' reimaging
2021-11-13T09:43:06.984 INFO:teuthology.lock.ops:Updating [ubuntu@smithi068.front.sepia.ceph.com]: reset os type and version on server
2021-11-13T09:43:06.984 INFO:teuthology.lock.ops:Updating smithi068.front.sepia.ceph.com on lock server
2021-11-13T09:43:07.005 INFO:teuthology.lock.ops:Node 'ubuntu@smithi068.front.sepia.ceph.com' reimaging is complete
2021-11-13T09:43:07.005 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi081.front.sepia.ceph.com' reimaging
2021-11-13T09:43:07.006 INFO:teuthology.lock.ops:Updating [ubuntu@smithi081.front.sepia.ceph.com]: reset os type and version on server
2021-11-13T09:43:07.006 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server
2021-11-13T09:43:07.025 INFO:teuthology.lock.ops:Node 'ubuntu@smithi081.front.sepia.ceph.com' reimaging is complete
2021-11-13T09:43:07.215 INFO:teuthology.provision.fog.smithi068:Scheduling deploy of centos 8.stream
2021-11-13T09:43:07.234 INFO:teuthology.provision.fog.smithi081:Scheduling deploy of centos 8.stream
2021-11-13T09:43:07.533 INFO:teuthology.orchestra.console:Power off smithi068
2021-11-13T09:43:07.576 INFO:teuthology.orchestra.console:Power off smithi081
2021-11-13T09:43:20.023 INFO:teuthology.orchestra.console:Power off for smithi068 completed
2021-11-13T09:43:20.054 INFO:teuthology.orchestra.console:Power off for smithi081 completed
2021-11-13T09:43:20.125 INFO:teuthology.orchestra.console:Power on smithi068
2021-11-13T09:43:20.155 INFO:teuthology.orchestra.console:Power on smithi081
2021-11-13T09:43:24.386 INFO:teuthology.orchestra.console:Power on for smithi068 completed
2021-11-13T09:43:24.488 INFO:teuthology.provision.fog.smithi068:Waiting for deploy to finish
2021-11-13T09:43:28.522 INFO:teuthology.orchestra.console:Power on for smithi081 completed
2021-11-13T09:43:28.623 INFO:teuthology.provision.fog.smithi081:Waiting for deploy to finish
2021-11-13T09:48:18.013 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-13T09:48:18.303 INFO:teuthology.provision.fog.smithi081:Node is ready
2021-11-13T09:48:18.369 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081.front.sepia.ceph.com
2021-11-13T09:48:18.437 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81 smithi081.front.sepia.ceph.com smithi081
2021-11-13T09:48:18.823 INFO:teuthology.provision.fog.smithi081:Deploy complete!
2021-11-13T09:48:29.030 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-13T09:48:29.317 INFO:teuthology.provision.fog.smithi068:Node is ready
2021-11-13T09:48:29.335 INFO:teuthology.orchestra.run.smithi068.stdout:smithi068.front.sepia.ceph.com
2021-11-13T09:48:29.392 INFO:teuthology.orchestra.run.smithi068.stdout:172.21.15.68 smithi068.front.sepia.ceph.com smithi068
2021-11-13T09:48:29.720 INFO:teuthology.provision.fog.smithi068:Deploy complete!
2021-11-13T09:48:29.876 INFO:teuthology.lock.ops:Checking smithi068.front.sepia.ceph.com
2021-11-13T09:48:29.877 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-13T09:48:29.899 INFO:teuthology.lock.ops:Checking smithi081.front.sepia.ceph.com
2021-11-13T09:48:29.899 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-13T09:48:29.917 INFO:teuthology.lock.ops:Updating [smithi068.front.sepia.ceph.com]: set os type and version on server
2021-11-13T09:48:29.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi068.front.sepia.ceph.com'
2021-11-13T09:48:30.102 INFO:teuthology.orchestra.run.smithi068.stdout:x86_64
2021-11-13T09:48:30.158 INFO:teuthology.orchestra.run.smithi068.stdout:NAME="CentOS Stream"
2021-11-13T09:48:30.158 INFO:teuthology.orchestra.run.smithi068.stdout:VERSION="8"
2021-11-13T09:48:30.159 INFO:teuthology.orchestra.run.smithi068.stdout:ID="centos"
2021-11-13T09:48:30.159 INFO:teuthology.orchestra.run.smithi068.stdout:ID_LIKE="rhel fedora"
2021-11-13T09:48:30.159 INFO:teuthology.orchestra.run.smithi068.stdout:VERSION_ID="8"
2021-11-13T09:48:30.159 INFO:teuthology.orchestra.run.smithi068.stdout:PLATFORM_ID="platform:el8"
2021-11-13T09:48:30.160 INFO:teuthology.orchestra.run.smithi068.stdout:PRETTY_NAME="CentOS Stream 8"
2021-11-13T09:48:30.160 INFO:teuthology.orchestra.run.smithi068.stdout:ANSI_COLOR="0;31"
2021-11-13T09:48:30.160 INFO:teuthology.orchestra.run.smithi068.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-11-13T09:48:30.160 INFO:teuthology.orchestra.run.smithi068.stdout:HOME_URL="https://centos.org/"
2021-11-13T09:48:30.161 INFO:teuthology.orchestra.run.smithi068.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-11-13T09:48:30.161 INFO:teuthology.orchestra.run.smithi068.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-11-13T09:48:30.161 INFO:teuthology.orchestra.run.smithi068.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-11-13T09:48:30.162 INFO:teuthology.lock.ops:Updating smithi068.front.sepia.ceph.com on lock server
2021-11-13T09:48:30.181 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: set os type and version on server
2021-11-13T09:48:30.181 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com'
2021-11-13T09:48:30.416 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64
2021-11-13T09:48:30.472 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream"
2021-11-13T09:48:30.472 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8"
2021-11-13T09:48:30.472 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos"
2021-11-13T09:48:30.472 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora"
2021-11-13T09:48:30.473 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8"
2021-11-13T09:48:30.473 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8"
2021-11-13T09:48:30.473 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 8"
2021-11-13T09:48:30.473 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31"
2021-11-13T09:48:30.474 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-11-13T09:48:30.474 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/"
2021-11-13T09:48:30.474 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-11-13T09:48:30.474 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-11-13T09:48:30.474 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-11-13T09:48:30.475 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server
2021-11-13T09:48:30.593 INFO:teuthology.dispatcher.supervisor:Running job 6500554
2021-11-13T09:48:30.593 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/bin/teuthology -v --owner scheduled_amathuri@teuthology --archive /home/teuthworker/archive/amathuri-2021-11-12_19:23:57-rados-wip-yuri-master-10.29.21-distro-basic-smithi/6500554 --name amathuri-2021-11-12_19:23:57-rados-wip-yuri-master-10.29.21-distro-basic-smithi --description rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8.stream} thrashers/fastread thrashosds-health workloads/ec-radosbench} -- /home/teuthworker/archive/amathuri-2021-11-12_19:23:57-rados-wip-yuri-master-10.29.21-distro-basic-smithi/6500554/orig.config.yaml
2021-11-13T09:48:30.597 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/amathuri-2021-11-12_19:23:57-rados-wip-yuri-master-10.29.21-distro-basic-smithi/6500554
2021-11-13T09:48:30.598 INFO:teuthology.dispatcher.supervisor:Job PID: 15456
2021-11-13T09:48:30.599 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-11-13T21:49:26.672 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-11-13T21:49:26.885 INFO:teuthology.kill:Killing Pids: {15456}
2021-11-13T21:49:28.203 INFO:teuthology.task.internal:roles: ubuntu@smithi068.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2021-11-13T21:49:28.203 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2021-11-13T21:49:28.204 INFO:teuthology.misc:Compressing logs...
2021-11-13T21:49:28.204 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi068.front.sepia.ceph.com'
2021-11-13T21:49:28.462 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com'
2021-11-13T21:49:29.010 INFO:teuthology.misc:Compressing logs...
2021-11-13T21:49:29.359 INFO:teuthology.orchestra.run.smithi068.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-11-13T21:49:29.476 INFO:teuthology.misc:Compressing logs...
2021-11-13T21:49:41.822 INFO:teuthology.orchestra.run.smithi068.stderr:gzip: /var/log/ceph/ceph-mon.c.log: file size changed while zipping
2021-11-13T21:49:51.193 INFO:teuthology.orchestra.run.smithi068.stderr:gzip: /var/log/ceph/ceph-mgr.y.log: file size changed while zipping
2021-11-13T21:55:27.252 INFO:teuthology.orchestra.run.smithi068.stderr:gzip: /var/log/ceph/ceph-osd.0.log: file size changed while zipping
2021-11-13T22:01:08.919 INFO:teuthology.orchestra.run.smithi068.stderr:gzip: /var/log/ceph/ceph-osd.2.log: file size changed while zipping
2021-11-13T22:04:23.471 INFO:teuthology.orchestra.run.smithi068.stderr:gzip: /var/log/ceph/ceph-osd.1.log: file size changed while zipping
2021-11-13T22:04:54.476 INFO:teuthology.orchestra.run.smithi068.stderr:gzip: /var/log/ceph/ceph-mon.a.log: file size changed while zipping
2021-11-13T22:10:03.988 INFO:teuthology.kill:No teuthology processes running
2021-11-13T22:10:05.278 INFO:teuthology.kill:Nuking machines: ['smithi068', 'smithi081']
2021-11-13T22:10:06.341 INFO:teuthology.kill:2021-11-13 22:10:06,341.341 INFO:teuthology.nuke:targets:
2021-11-13T22:10:06.342 INFO:teuthology.kill:  smithi068.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNa5EAEKikOQarSpwc+pcr96QmAIDLjMegoSaQ4kVsIySXyaUOKwa5seDLYM6sqh23MDzrLrxdU1bXH7jCcQx4OtEjw+KutaBcNWgZBDNiq7Ru2w5p0vUlR3Y1Zw5nqdpy7riZuzyDKqhiknN66PRd3K9u9EDN4rv/oJEJVAZUPKrttRpJM06GWtbYNIAEOCvzxGcqHuW2yNs5WWuTyfpZHvU4c7gwfGPWHw9UFAJH4L0OgYGBMJY6iGnwVRBQ0fg7voOF/u1BJ4Z4ZRjYuCe4NLEqSZEwjmNgbGwv68x2GrdxR6a2fZcg3OY+k45rIrnRFtvIAbf2okTxhZ4XYkqE5KNXwMOAkASLcPxpvOwhgesSI4Pk75FlwHO1UxoUgLXIPbVS9z+DDYTCc2CgMG3kPyapJxcqdx1OnnvFFjMOh+m6oJW8qD250JMDLk22RScXdYajADGaovcL+fgcAmWS3Q4pyYKnaXQzDapFIHrWZTwOUNacxyf/HCLQRvDbaVM=
2021-11-13T22:10:06.343 INFO:teuthology.kill:  smithi081.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC55ITCv1e292/VE++gORRVIzplRVtob6zFIao6IRDw3pMqQ/sINZwjq/FYmEdJYlW/R+AsTmTekgW35Oryj4xjCfdAzT7E5mm+k4fcWjxDOC/vZZzGA/ofsgH5ADKjbw6ycUFY8hKRyPF9jjdnoRAT1wqjLzDHj8edQ3ITqDyXi6sox1INFPZPpxFLMbGcFf7mG5qHyhV393qsiJHVJGaeQ0/JS+ARiPOcpAKGyXf2wjma4tElxCSweb0fzRqyRYhMsMV94+gc+hcze7+VM5i0rzcUqfJSCCyPYiEoLuo/ms1EfJhLoFH1Vp4ytICmU1U5HuZyjUPvBYM0I+nwv5sTEN23RkL2nc9bsUTzYI7hZ/nV38vkldr1g5KAse9sRWhgdq+E9bOA/CdfpaeleDxnJytTYFWryYye5BfRWMmzIgw+qFsb7Dk/yN/iC5nVum8DwbSPv8w0c8Dw6GhOHvobRvWn7k20dnlOrk0DnMxIZdoFTr7ADKV+hQ/2M/TSmfE=
2021-11-13T22:10:06.370 INFO:teuthology.kill:2021-11-13 22:10:06,370.370 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-13T22:10:06.374 INFO:teuthology.kill:2021-11-13 22:10:06,374.374 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-13T22:10:06.457 INFO:teuthology.kill:2021-11-13 22:10:06,457.457 INFO:teuthology.orchestra.console:Power off smithi068
2021-11-13T22:10:06.469 INFO:teuthology.kill:2021-11-13 22:10:06,469.469 INFO:teuthology.orchestra.console:Power off smithi081
2021-11-13T22:10:18.939 INFO:teuthology.kill:2021-11-13 22:10:18,938.938 INFO:teuthology.orchestra.console:Power off for smithi068 completed
2021-11-13T22:10:18.945 INFO:teuthology.kill:2021-11-13 22:10:18,945.945 INFO:teuthology.orchestra.console:Power off for smithi081 completed
2021-11-13T22:10:19.094 INFO:teuthology.kill:2021-11-13 22:10:19,093.093 INFO:teuthology.lock.ops:unlocked: smithi068.front.sepia.ceph.com
2021-11-13T22:10:19.107 INFO:teuthology.kill:2021-11-13 22:10:19,107.107 INFO:teuthology.lock.ops:unlocked: smithi081.front.sepia.ceph.com
2021-11-13T22:12:19.406 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-11-13T22:12:19.506 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi068 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-11-13_14:31:12-fs-wip-yuriw-master-11.12.21-distro-basic-smithi/6501259
2021-11-13T22:12:19.506 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi081 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-11-13_14:31:12-fs-wip-yuriw-master-11.12.21-distro-basic-smithi/6501259