2023-06-13T21:48:16.452 INFO:root:teuthology version: 0.0.1.dev120+g2ef0dcd 2023-06-13T21:48:16.662 INFO:teuthology.lock.ops:Start node 'smithi062.front.sepia.ceph.com' reimaging 2023-06-13T21:48:16.663 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: reset os type and version on server 2023-06-13T21:48:16.663 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2023-06-13T21:48:16.692 INFO:teuthology.lock.ops:Start node 'smithi117.front.sepia.ceph.com' reimaging 2023-06-13T21:48:16.692 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: reset os type and version on server 2023-06-13T21:48:16.693 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2023-06-13T21:48:16.717 INFO:teuthology.lock.ops:Start node 'smithi191.front.sepia.ceph.com' reimaging 2023-06-13T21:48:16.717 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: reset os type and version on server 2023-06-13T21:48:16.717 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2023-06-13T21:48:16.858 INFO:teuthology.provision.fog.smithi062:Scheduling deploy of ubuntu 22.04 2023-06-13T21:48:16.868 INFO:teuthology.provision.fog.smithi117:Scheduling deploy of ubuntu 22.04 2023-06-13T21:48:16.923 INFO:teuthology.provision.fog.smithi191:Scheduling deploy of ubuntu 22.04 2023-06-13T21:48:17.092 INFO:teuthology.orchestra.console:Power off smithi062 2023-06-13T21:48:17.107 INFO:teuthology.orchestra.console:Power off smithi117 2023-06-13T21:48:17.132 INFO:teuthology.orchestra.console:Power off smithi191 2023-06-13T21:48:17.243 INFO:teuthology.orchestra.console:Power off for smithi062 completed 2023-06-13T21:48:17.265 INFO:teuthology.orchestra.console:Power off for smithi117 completed 2023-06-13T21:48:17.345 INFO:teuthology.orchestra.console:Power on smithi062 2023-06-13T21:48:17.367 INFO:teuthology.orchestra.console:Power on smithi117 2023-06-13T21:48:25.503 INFO:teuthology.orchestra.console:Power off for smithi191 completed 2023-06-13T21:48:25.604 INFO:teuthology.orchestra.console:Power on smithi191 2023-06-13T21:48:25.757 INFO:teuthology.orchestra.console:Power on for smithi062 completed 2023-06-13T21:48:25.850 INFO:teuthology.orchestra.console:Power on for smithi117 completed 2023-06-13T21:48:25.858 INFO:teuthology.provision.fog.smithi062:Waiting for deploy to finish 2023-06-13T21:48:25.951 INFO:teuthology.provision.fog.smithi117:Waiting for deploy to finish 2023-06-13T21:48:33.969 INFO:teuthology.orchestra.console:Power on for smithi191 completed 2023-06-13T21:48:34.070 INFO:teuthology.provision.fog.smithi191:Waiting for deploy to finish 2023-06-13T21:51:44.752 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-06-13T21:51:44.753 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-06-13T21:51:52.980 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-06-13T21:51:53.808 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-06-13T21:51:53.809 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-06-13T21:52:02.069 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-06-13T21:52:02.864 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-06-13T21:52:02.865 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-06-13T21:52:11.152 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-06-13T21:52:11.920 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-06-13T21:52:11.921 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-06-13T21:52:20.208 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-06-13T21:52:20.976 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-06-13T21:52:20.977 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-06-13T21:52:29.268 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-06-13T21:52:30.032 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-06-13T21:52:30.033 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-06-13T21:52:38.352 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-06-13T21:53:36.086 WARNING:teuthology.provision.fog:timed out 2023-06-13T21:53:36.087 WARNING:teuthology.provision.fog:timed out 2023-06-13T21:53:42.273 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-13T21:53:42.323 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-13T21:53:42.680 INFO:teuthology.provision.fog.smithi117:Node is ready 2023-06-13T21:53:42.727 INFO:teuthology.orchestra.run.smithi117.stdout:smithi117.front.sepia.ceph.com 2023-06-13T21:53:42.745 INFO:teuthology.provision.fog.smithi062:Node is ready 2023-06-13T21:53:42.776 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117 smithi117.front.sepia.ceph.com smithi117 2023-06-13T21:53:42.793 INFO:teuthology.orchestra.run.smithi062.stdout:smithi062.front.sepia.ceph.com 2023-06-13T21:53:42.841 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62 smithi062.front.sepia.ceph.com smithi062 2023-06-13T21:53:43.119 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-13T21:53:43.120 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="Ubuntu" 2023-06-13T21:53:43.120 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="22.04" 2023-06-13T21:53:43.120 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-13T21:53:43.120 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_CODENAME=jammy 2023-06-13T21:53:43.120 INFO:teuthology.orchestra.run.smithi117.stdout:ID=ubuntu 2023-06-13T21:53:43.121 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE=debian 2023-06-13T21:53:43.121 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-13T21:53:43.121 INFO:teuthology.orchestra.run.smithi117.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-13T21:53:43.121 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-13T21:53:43.121 INFO:teuthology.orchestra.run.smithi117.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-13T21:53:43.121 INFO:teuthology.orchestra.run.smithi117.stdout:UBUNTU_CODENAME=jammy 2023-06-13T21:53:43.122 INFO:teuthology.provision.fog.smithi117:Deploy complete! 2023-06-13T21:53:43.226 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-13T21:53:43.226 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="Ubuntu" 2023-06-13T21:53:43.227 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="22.04" 2023-06-13T21:53:43.227 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-13T21:53:43.227 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_CODENAME=jammy 2023-06-13T21:53:43.228 INFO:teuthology.orchestra.run.smithi062.stdout:ID=ubuntu 2023-06-13T21:53:43.228 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE=debian 2023-06-13T21:53:43.228 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-13T21:53:43.229 INFO:teuthology.orchestra.run.smithi062.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-13T21:53:43.229 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-13T21:53:43.229 INFO:teuthology.orchestra.run.smithi062.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-13T21:53:43.229 INFO:teuthology.orchestra.run.smithi062.stdout:UBUNTU_CODENAME=jammy 2023-06-13T21:53:43.230 INFO:teuthology.provision.fog.smithi062:Deploy complete! 2023-06-13T21:53:44.359 WARNING:teuthology.provision.fog:timed out 2023-06-13T21:53:50.580 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-13T21:53:51.080 INFO:teuthology.provision.fog.smithi191:Node is ready 2023-06-13T21:53:51.128 INFO:teuthology.orchestra.run.smithi191.stdout:smithi191.front.sepia.ceph.com 2023-06-13T21:53:51.175 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.15.191 smithi191.front.sepia.ceph.com smithi191 2023-06-13T21:53:51.567 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-13T21:53:51.567 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="Ubuntu" 2023-06-13T21:53:51.567 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="22.04" 2023-06-13T21:53:51.567 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-13T21:53:51.567 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_CODENAME=jammy 2023-06-13T21:53:51.568 INFO:teuthology.orchestra.run.smithi191.stdout:ID=ubuntu 2023-06-13T21:53:51.568 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE=debian 2023-06-13T21:53:51.568 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-13T21:53:51.568 INFO:teuthology.orchestra.run.smithi191.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-13T21:53:51.568 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-13T21:53:51.568 INFO:teuthology.orchestra.run.smithi191.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-13T21:53:51.568 INFO:teuthology.orchestra.run.smithi191.stdout:UBUNTU_CODENAME=jammy 2023-06-13T21:53:51.569 INFO:teuthology.provision.fog.smithi191:Deploy complete! 2023-06-13T21:53:51.774 INFO:teuthology.lock.ops:Checking smithi062.front.sepia.ceph.com 2023-06-13T21:53:51.775 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-13T21:53:51.808 INFO:teuthology.lock.ops:Checking smithi117.front.sepia.ceph.com 2023-06-13T21:53:51.808 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-13T21:53:51.832 INFO:teuthology.lock.ops:Checking smithi191.front.sepia.ceph.com 2023-06-13T21:53:51.833 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-13T21:53:51.859 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: set os type and version on server 2023-06-13T21:53:51.859 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-06-13T21:53:52.101 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2023-06-13T21:53:52.150 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-13T21:53:52.150 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="Ubuntu" 2023-06-13T21:53:52.150 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="22.04" 2023-06-13T21:53:52.151 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-13T21:53:52.151 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_CODENAME=jammy 2023-06-13T21:53:52.151 INFO:teuthology.orchestra.run.smithi062.stdout:ID=ubuntu 2023-06-13T21:53:52.152 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE=debian 2023-06-13T21:53:52.152 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-13T21:53:52.152 INFO:teuthology.orchestra.run.smithi062.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-13T21:53:52.153 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-13T21:53:52.153 INFO:teuthology.orchestra.run.smithi062.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-13T21:53:52.153 INFO:teuthology.orchestra.run.smithi062.stdout:UBUNTU_CODENAME=jammy 2023-06-13T21:53:52.153 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2023-06-13T21:53:52.182 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: set os type and version on server 2023-06-13T21:53:52.183 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2023-06-13T21:53:52.411 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64 2023-06-13T21:53:52.459 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-13T21:53:52.460 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="Ubuntu" 2023-06-13T21:53:52.460 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="22.04" 2023-06-13T21:53:52.460 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-13T21:53:52.460 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_CODENAME=jammy 2023-06-13T21:53:52.460 INFO:teuthology.orchestra.run.smithi117.stdout:ID=ubuntu 2023-06-13T21:53:52.461 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE=debian 2023-06-13T21:53:52.461 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-13T21:53:52.461 INFO:teuthology.orchestra.run.smithi117.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-13T21:53:52.461 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-13T21:53:52.461 INFO:teuthology.orchestra.run.smithi117.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-13T21:53:52.461 INFO:teuthology.orchestra.run.smithi117.stdout:UBUNTU_CODENAME=jammy 2023-06-13T21:53:52.462 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2023-06-13T21:53:52.482 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: set os type and version on server 2023-06-13T21:53:52.482 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-06-13T21:53:52.716 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2023-06-13T21:53:52.763 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-13T21:53:52.764 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="Ubuntu" 2023-06-13T21:53:52.765 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="22.04" 2023-06-13T21:53:52.765 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-13T21:53:52.765 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_CODENAME=jammy 2023-06-13T21:53:52.766 INFO:teuthology.orchestra.run.smithi191.stdout:ID=ubuntu 2023-06-13T21:53:52.766 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE=debian 2023-06-13T21:53:52.767 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-13T21:53:52.767 INFO:teuthology.orchestra.run.smithi191.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-13T21:53:52.767 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-13T21:53:52.767 INFO:teuthology.orchestra.run.smithi191.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-13T21:53:52.767 INFO:teuthology.orchestra.run.smithi191.stdout:UBUNTU_CODENAME=jammy 2023-06-13T21:53:52.768 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2023-06-13T21:53:52.898 INFO:teuthology.dispatcher.supervisor:Running job 7302584 2023-06-13T21:53:52.899 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-06-13_14:58:18-rados-wip-yuri8-testing-2023-06-12-1236-reef-distro-default-smithi/7302584 --name yuriw-2023-06-13_14:58:18-rados-wip-yuri8-testing-2023-06-12-1236-reef-distro-default-smithi --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} -- /home/teuthworker/archive/yuriw-2023-06-13_14:58:18-rados-wip-yuri8-testing-2023-06-12-1236-reef-distro-default-smithi/7302584/orig.config.yaml 2023-06-13T21:53:52.903 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-06-13_14:58:18-rados-wip-yuri8-testing-2023-06-12-1236-reef-distro-default-smithi/7302584 2023-06-13T21:53:52.904 INFO:teuthology.dispatcher.supervisor:Job PID: 32607 2023-06-13T21:53:52.904 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-13T22:05:53.965 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-13T22:05:54.097 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-13T22:05:54.098 INFO:teuthology.nuke:Checking targets against current locks 2023-06-13T22:05:54.149 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-13T22:05:54.180 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-13T22:05:54.198 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-13T22:05:54.232 INFO:teuthology.orchestra.console:Power off smithi062 2023-06-13T22:05:54.273 INFO:teuthology.orchestra.console:Power off smithi191 2023-06-13T22:05:54.290 INFO:teuthology.orchestra.console:Power off smithi117 2023-06-13T22:05:54.401 INFO:teuthology.orchestra.console:Power off for smithi062 completed 2023-06-13T22:05:54.424 INFO:teuthology.orchestra.console:Power off for smithi191 completed 2023-06-13T22:05:54.435 INFO:teuthology.orchestra.console:Power off for smithi117 completed 2023-06-13T22:05:54.565 INFO:teuthology.lock.ops:unlocked: smithi062.front.sepia.ceph.com 2023-06-13T22:05:54.572 INFO:teuthology.lock.ops:unlocked: smithi191.front.sepia.ceph.com 2023-06-13T22:05:54.588 INFO:teuthology.lock.ops:unlocked: smithi117.front.sepia.ceph.com