2023-05-21T21:46:06.838 INFO:root:teuthology version: 0.0.1.dev100+g01abd1e
2023-05-21T21:46:07.208 INFO:teuthology.lock.ops:Start node 'smithi002.front.sepia.ceph.com' reimaging
2023-05-21T21:46:07.209 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: reset os type and version on server
2023-05-21T21:46:07.210 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server
2023-05-21T21:46:07.238 INFO:teuthology.lock.ops:Node 'smithi002.front.sepia.ceph.com' reimaging is complete
2023-05-21T21:46:07.239 INFO:teuthology.lock.ops:Start node 'smithi008.front.sepia.ceph.com' reimaging
2023-05-21T21:46:07.239 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: reset os type and version on server
2023-05-21T21:46:07.239 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server
2023-05-21T21:46:07.262 INFO:teuthology.lock.ops:Node 'smithi008.front.sepia.ceph.com' reimaging is complete
2023-05-21T21:46:07.396 INFO:teuthology.provision.fog.smithi002:Scheduling deploy of centos 8.stream
2023-05-21T21:46:07.415 INFO:teuthology.provision.fog.smithi008:Scheduling deploy of centos 8.stream
2023-05-21T21:46:07.597 INFO:teuthology.orchestra.console:Power off smithi002
2023-05-21T21:46:07.683 INFO:teuthology.orchestra.console:Power off smithi008
2023-05-21T21:46:16.214 INFO:teuthology.orchestra.console:Power off for smithi008 completed
2023-05-21T21:46:16.221 INFO:teuthology.orchestra.console:Power off for smithi002 completed
2023-05-21T21:46:16.316 INFO:teuthology.orchestra.console:Power on smithi008
2023-05-21T21:46:16.324 INFO:teuthology.orchestra.console:Power on smithi002
2023-05-21T21:46:24.684 INFO:teuthology.orchestra.console:Power on for smithi008 completed
2023-05-21T21:46:24.785 INFO:teuthology.provision.fog.smithi008:Waiting for deploy to finish
2023-05-21T21:46:24.816 INFO:teuthology.orchestra.console:Power on for smithi002 completed
2023-05-21T21:46:24.917 INFO:teuthology.provision.fog.smithi002:Waiting for deploy to finish
2023-05-21T21:49:13.968 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.8
2023-05-21T21:49:13.970 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.2
2023-05-21T21:49:23.024 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.8
2023-05-21T21:49:23.025 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.2
2023-05-21T21:49:32.080 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.8
2023-05-21T21:49:32.081 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.2
2023-05-21T21:49:41.140 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.8
2023-05-21T21:49:41.141 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.2
2023-05-21T21:49:50.224 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.8
2023-05-21T21:50:47.196 WARNING:teuthology.provision.fog:timed out
2023-05-21T21:50:53.643 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-05-21T21:50:53.946 INFO:teuthology.provision.fog.smithi002:Node is ready
2023-05-21T21:50:53.967 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002.front.sepia.ceph.com
2023-05-21T21:50:54.029 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2 smithi002.front.sepia.ceph.com smithi002
2023-05-21T21:50:54.377 INFO:teuthology.provision.fog.smithi002:Deploy complete!
2023-05-21T21:50:56.231 WARNING:teuthology.provision.fog:timed out
2023-05-21T21:51:02.459 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-05-21T21:51:02.685 INFO:teuthology.provision.fog.smithi008:Node is ready
2023-05-21T21:51:02.705 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008.front.sepia.ceph.com
2023-05-21T21:51:02.765 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8 smithi008.front.sepia.ceph.com smithi008
2023-05-21T21:51:03.104 INFO:teuthology.provision.fog.smithi008:Deploy complete!
2023-05-21T21:51:03.288 INFO:teuthology.lock.ops:Checking smithi002.front.sepia.ceph.com
2023-05-21T21:51:03.289 INFO:teuthology.lock.ops:New key found. Updating...
2023-05-21T21:51:03.317 INFO:teuthology.lock.ops:Checking smithi008.front.sepia.ceph.com
2023-05-21T21:51:03.317 INFO:teuthology.lock.ops:New key found. Updating...
2023-05-21T21:51:03.334 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: set os type and version on server
2023-05-21T21:51:03.335 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com'
2023-05-21T21:51:03.540 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64
2023-05-21T21:51:03.601 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream"
2023-05-21T21:51:03.602 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="8"
2023-05-21T21:51:03.602 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos"
2023-05-21T21:51:03.602 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora"
2023-05-21T21:51:03.602 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="8"
2023-05-21T21:51:03.602 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el8"
2023-05-21T21:51:03.602 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 8"
2023-05-21T21:51:03.603 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31"
2023-05-21T21:51:03.603 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-05-21T21:51:03.603 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/"
2023-05-21T21:51:03.603 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-05-21T21:51:03.603 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-05-21T21:51:03.603 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-05-21T21:51:03.604 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server
2023-05-21T21:51:03.625 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: set os type and version on server
2023-05-21T21:51:03.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com'
2023-05-21T21:51:03.818 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64
2023-05-21T21:51:03.877 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="CentOS Stream"
2023-05-21T21:51:03.878 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8"
2023-05-21T21:51:03.878 INFO:teuthology.orchestra.run.smithi008.stdout:ID="centos"
2023-05-21T21:51:03.878 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="rhel fedora"
2023-05-21T21:51:03.879 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8"
2023-05-21T21:51:03.879 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8"
2023-05-21T21:51:03.879 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="CentOS Stream 8"
2023-05-21T21:51:03.879 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31"
2023-05-21T21:51:03.880 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-05-21T21:51:03.880 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://centos.org/"
2023-05-21T21:51:03.880 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-05-21T21:51:03.881 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-05-21T21:51:03.881 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-05-21T21:51:03.882 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server
2023-05-21T21:51:03.995 INFO:teuthology.dispatcher.supervisor:Running job 7281965
2023-05-21T21:51:03.995 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_01abd1ed90624b09fd81d9cb3a79e2834351f0ca/virtualenv/bin/teuthology -v --owner scheduled_sjust@teuthology --archive /home/teuthworker/archive/sjust-2023-05-21_21:38:43-crimson-rados-wip-matanb-crimson-testing-21.5-reef-distro-default-smithi/7281965 --name sjust-2023-05-21_21:38:43-crimson-rados-wip-matanb-crimson-testing-21.5-reef-distro-default-smithi --description crimson-rados/basic/{centos_latest clusters/fixed-2 crimson_qa_overrides deploy/ceph tasks/rados_api_tests} -- /home/teuthworker/archive/sjust-2023-05-21_21:38:43-crimson-rados-wip-matanb-crimson-testing-21.5-reef-distro-default-smithi/7281965/orig.config.yaml
2023-05-21T21:51:03.999 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/sjust-2023-05-21_21:38:43-crimson-rados-wip-matanb-crimson-testing-21.5-reef-distro-default-smithi/7281965
2023-05-21T21:51:03.999 INFO:teuthology.dispatcher.supervisor:Job PID: 13666
2023-05-21T21:51:04.000 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-05-22T09:51:10.574 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2023-05-22T09:51:14.164 INFO:teuthology.kill:Killing Pids: {13666}
2023-05-22T09:51:17.245 INFO:teuthology.task.internal:roles: ubuntu@smithi002.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a']
2023-05-22T09:51:17.278 INFO:teuthology.task.internal:roles: ubuntu@smithi008.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']
2023-05-22T09:51:17.355 INFO:teuthology.misc:Compressing logs...
2023-05-22T09:51:17.492 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com'
2023-05-22T09:51:22.288 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com'
2023-05-22T09:51:22.358 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log
2023-05-22T09:51:22.422 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log
2023-05-22T09:51:22.422 INFO:teuthology.orchestra.run.smithi002.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log:	  0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz
2023-05-22T09:51:22.422 INFO:teuthology.orchestra.run.smithi002.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log:	 83.2% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz
2023-05-22T09:51:22.633 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log
2023-05-22T09:51:22.634 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log
2023-05-22T09:51:22.634 INFO:teuthology.orchestra.run.smithi008.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log:	/home/ubuntu/cephtest/archive/syslog/misc.log:	  0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz
2023-05-22T09:51:22.635 INFO:teuthology.orchestra.run.smithi008.stderr: 83.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz
2023-05-22T09:51:23.822 INFO:teuthology.kill:No teuthology processes running
2023-05-22T09:51:25.269 INFO:teuthology.kill:Nuking machines: ['smithi002', 'smithi008']
2023-05-22T09:51:25.946 INFO:teuthology.kill:2023-05-22 09:51:25,946.946 INFO:teuthology.nuke:targets:
2023-05-22T09:51:25.947 INFO:teuthology.kill:  smithi002.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDX2QvH+BbO91a9putG3hXkB8BSK5A2yZn086u+D2j/lxEESJ9YVIt5pKZuQaU2oZKdCwUZ7EZEeFqB6rrxjKLvsSgXt2RjImVP8sfFBRyNes76JMQ9pWWXW5CuxGHHNcKNl0s5z3dBgJAY4cs5gVrZhFPWYRH7mw5OG+btI+oSABX/IBN6Vwm4/sgonwSiIh0lWi07R83wBGcfIpVS176ubd9fiVbzaLX3m8BRFm9HCYdZwwFZk9sk2UAo3HE9rl8W+Qc40mArv2Lo4a0OspqvVaCd75odsbZByOIiAGXSsyBZ+UTF7oBkl8QoRgMYgWPqK8Pguyk4YxRxabO7hv1EkJiVhGtQyzJ/xbST1ppF1htbuIK5QkERkUOGAjD6QzePN78bbdXLf3FxYLcd/c6Kk+38o5GGkGYUI5pgyo3aMnbUU+XTvEGNidIDX8w1sJAlB08NMumlkwpnxinIbBGu2I3XZf/8QPW54mkpePbQf07r9zjOXWCJ2ftpG6cXbn8=
2023-05-22T09:51:25.947 INFO:teuthology.kill:  smithi008.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDzDG7/fp1ZpOC896ik48b+KTYUTWhd2RBymYQmDZT7cZS2duMu7DYQDcrZVr8g33JZtDW3cEjdqOWQAhBSo+wFOiZa0GrPHsIKEx0JQbxV5y6dr32WOP5HGHiqU4oX0bc/7GntNGHWhoj4E/PaTk9MEYJoDfbROeqbVOkBpU37dmEzPSU63lkNaR9THq4nBjyNXOtT0f8hZEDCzwbGQmuuHvILL/yAy4mPUC9opipObKsr0Sn/Zi9kVLX291xShdi+SHF0RXNRsbs9813K4bSgU/qGYSOpKSnP68fYA7z2C5kTqzTMURCfOmNL8L/b/pEoCDtvz48vsHIkvz7yu8wzmcw4tXdJ/rAweFmURjvI7wvXN/fz2/EH5G/N3heN9XQEyLy8bGSnn5RylOHoheDOrOP0vrZX1Ehdm87ddFNvwW3ckul6mlQ7NuQhwgHLXITIHVeFt/38ZBfXAxzfQ3St4WQBpL1H+PD6lKljDUJctL8z7+gNxipzA13wEwSO7SE=
2023-05-22T09:51:25.948 INFO:teuthology.kill:2023-05-22 09:51:25,946.946 INFO:teuthology.nuke:Checking targets against current locks
2023-05-22T09:51:26.005 INFO:teuthology.kill:2023-05-22 09:51:26,005.005 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-05-22T09:51:26.060 INFO:teuthology.kill:2023-05-22 09:51:26,060.060 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-05-22T09:51:26.072 INFO:teuthology.kill:2023-05-22 09:51:26,072.072 INFO:teuthology.orchestra.console:Power off smithi002
2023-05-22T09:51:26.135 INFO:teuthology.kill:2023-05-22 09:51:26,135.135 INFO:teuthology.orchestra.console:Power off smithi008
2023-05-22T09:51:34.443 INFO:teuthology.kill:2023-05-22 09:51:34,443.443 INFO:teuthology.orchestra.console:Power off for smithi002 completed
2023-05-22T09:51:34.504 INFO:teuthology.kill:2023-05-22 09:51:34,503.503 INFO:teuthology.orchestra.console:Power off for smithi008 completed
2023-05-22T09:51:34.619 INFO:teuthology.kill:2023-05-22 09:51:34,619.619 INFO:teuthology.lock.ops:unlocked: smithi002.front.sepia.ceph.com
2023-05-22T09:51:34.658 INFO:teuthology.kill:2023-05-22 09:51:34,658.658 INFO:teuthology.lock.ops:unlocked: smithi008.front.sepia.ceph.com
2023-05-22T09:53:35.169 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2023-05-22T09:53:35.458 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi002 but it was locked by another job: /home/teuthworker/archive/adking-2023-05-22_01:46:07-orch:cephadm-wip-adk2-testing-2023-05-21-1627-reef-distro-default-smithi/7282276
2023-05-22T09:53:35.460 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi008 but it was locked by another job: /home/teuthworker/archive/adking-2023-05-22_01:46:07-orch:cephadm-wip-adk2-testing-2023-05-21-1627-reef-distro-default-smithi/7282276