2023-12-27T22:04:33.950 INFO:root:teuthology version: 0.0.1.dev228+g01dd171 2023-12-27T22:04:33.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T22:04:34.092 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb2e6e6f940>, signals=[15]) 2023-12-27T22:04:34.092 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging 2023-12-27T22:04:34.092 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server 2023-12-27T22:04:34.092 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-12-27T22:04:34.111 INFO:teuthology.lock.ops:Start node 'smithi175.front.sepia.ceph.com' reimaging 2023-12-27T22:04:34.112 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: reset os type and version on server 2023-12-27T22:04:34.112 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2023-12-27T22:04:34.242 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_centos_8.stream (ID 3) 2023-12-27T22:04:34.251 DEBUG:teuthology.provision.fog.smithi175:Requesting image smithi_centos_8.stream (ID 3) 2023-12-27T22:04:34.292 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of centos 8.stream 2023-12-27T22:04:34.295 INFO:teuthology.provision.fog.smithi175:Scheduling deploy of centos 8.stream 2023-12-27T22:04:34.536 INFO:teuthology.orchestra.console.smithi175:Power off 2023-12-27T22:04:34.536 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-27T22:04:34.553 INFO:teuthology.orchestra.console.smithi161:Power off 2023-12-27T22:04:34.554 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-27T22:04:34.561 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off 2023-12-27T22:04:34.561 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-27T22:04:34.574 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2023-12-27T22:04:34.575 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-27T22:04:34.583 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2023-12-27T22:04:34.597 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-12-27T22:04:38.585 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-27T22:04:38.598 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-27T22:04:38.695 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2023-12-27T22:04:38.705 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-12-27T22:04:42.697 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-27T22:04:42.707 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-27T22:04:42.807 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2023-12-27T22:04:42.815 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-12-27T22:04:42.915 INFO:teuthology.orchestra.console.smithi161:Power off completed 2023-12-27T22:04:43.016 INFO:teuthology.orchestra.console.smithi161:Power on 2023-12-27T22:04:43.016 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-27T22:04:43.037 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On 2023-12-27T22:04:43.038 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-27T22:04:43.059 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-12-27T22:04:46.809 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-27T22:04:46.920 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2023-12-27T22:04:47.021 INFO:teuthology.orchestra.console.smithi175:Power off completed 2023-12-27T22:04:47.060 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-27T22:04:47.122 INFO:teuthology.orchestra.console.smithi175:Power on 2023-12-27T22:04:47.122 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-27T22:04:47.143 DEBUG:teuthology.orchestra.console.smithi175:power on output: Chassis Power Control: Up/On 2023-12-27T22:04:47.143 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-27T22:04:47.164 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2023-12-27T22:04:47.169 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-12-27T22:04:51.169 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-27T22:04:51.176 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-27T22:04:51.278 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2023-12-27T22:04:51.284 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-12-27T22:04:51.384 INFO:teuthology.orchestra.console.smithi161:Power on completed 2023-12-27T22:04:51.485 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish 2023-12-27T22:04:55.281 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-27T22:04:55.392 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2023-12-27T22:04:55.493 INFO:teuthology.orchestra.console.smithi175:Power on completed 2023-12-27T22:04:55.593 INFO:teuthology.provision.fog.smithi175:Waiting for deploy to finish 2023-12-27T22:07:26.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-27T22:07:26.586 ERROR:teuthology.orchestra.connection:Error authenticating with smithi175.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-27T22:07:37.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-27T22:07:55.665 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-12-27T22:08:01.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-27T22:08:04.721 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-12-27T22:08:10.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-27T22:08:13.777 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-12-27T22:08:19.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-27T22:08:22.837 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-12-27T22:08:28.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-27T22:08:30.589 WARNING:teuthology.provision.fog.smithi175:timed out 2023-12-27T22:08:31.889 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-12-27T22:08:36.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-27T22:08:37.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-27T22:08:55.057 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-12-27T22:09:01.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-27T22:09:03.642 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-27T22:09:03.643 DEBUG:teuthology.orchestra.run.smithi175:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-27T22:09:28.613 INFO:teuthology.provision.fog.smithi175:Node is ready 2023-12-27T22:09:28.613 DEBUG:teuthology.orchestra.run.smithi175:> hostname 2023-12-27T22:09:28.637 INFO:teuthology.orchestra.run.smithi175.stdout:smithi175.front.sepia.ceph.com 2023-12-27T22:09:28.638 DEBUG:teuthology.orchestra.run.smithi175:> grep smithi175.front.sepia.ceph.com /etc/hosts 2023-12-27T22:09:28.699 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.175 smithi175.front.sepia.ceph.com smithi175 2023-12-27T22:09:28.699 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175 2023-12-27T22:09:28.827 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175.front.sepia.ceph.com/smithi175/g' /etc/hosts 2023-12-27T22:09:28.860 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/172.21.15.175/172.21.15.175/g' /etc/hosts 2023-12-27T22:09:28.932 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175.front.sepia.ceph.com/smithi175/g' /etc/hostname 2023-12-27T22:09:29.003 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175 2023-12-27T22:09:29.072 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2023-12-27T22:09:29.131 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream" 2023-12-27T22:09:29.131 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="8" 2023-12-27T22:09:29.132 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos" 2023-12-27T22:09:29.132 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora" 2023-12-27T22:09:29.132 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="8" 2023-12-27T22:09:29.132 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el8" 2023-12-27T22:09:29.132 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-27T22:09:29.132 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2023-12-27T22:09:29.132 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-27T22:09:29.132 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/" 2023-12-27T22:09:29.132 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-27T22:09:29.132 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-27T22:09:29.132 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-27T22:09:29.133 INFO:teuthology.provision.fog.smithi175:Deploy complete! 2023-12-27T22:09:29.134 DEBUG:teuthology.parallel:result is None 2023-12-27T22:09:37.892 WARNING:teuthology.provision.fog.smithi161:timed out 2023-12-27T22:09:43.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-27T22:09:44.131 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-27T22:09:44.131 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-27T22:09:44.386 INFO:teuthology.provision.fog.smithi161:Node is ready 2023-12-27T22:09:44.386 DEBUG:teuthology.orchestra.run.smithi161:> hostname 2023-12-27T22:09:44.445 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com 2023-12-27T22:09:44.446 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161.front.sepia.ceph.com /etc/hosts 2023-12-27T22:09:44.505 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161 2023-12-27T22:09:44.505 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2023-12-27T22:09:44.596 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hosts 2023-12-27T22:09:44.624 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts 2023-12-27T22:09:44.693 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hostname 2023-12-27T22:09:44.760 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2023-12-27T22:09:44.826 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2023-12-27T22:09:44.883 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2023-12-27T22:09:44.883 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8" 2023-12-27T22:09:44.884 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2023-12-27T22:09:44.884 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2023-12-27T22:09:44.884 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8" 2023-12-27T22:09:44.884 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8" 2023-12-27T22:09:44.884 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-27T22:09:44.884 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2023-12-27T22:09:44.884 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-27T22:09:44.884 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2023-12-27T22:09:44.884 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-27T22:09:44.884 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-27T22:09:44.884 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-27T22:09:44.884 INFO:teuthology.provision.fog.smithi161:Deploy complete! 2023-12-27T22:09:44.885 DEBUG:teuthology.parallel:result is None 2023-12-27T22:09:45.034 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com 2023-12-27T22:09:45.035 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-27T22:09:45.056 INFO:teuthology.lock.ops:Checking smithi175.front.sepia.ceph.com 2023-12-27T22:09:45.056 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-27T22:09:45.074 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server 2023-12-27T22:09:45.074 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-12-27T22:09:45.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-27T22:09:45.142 DEBUG:teuthology.orchestra.run.smithi161:> true 2023-12-27T22:09:45.211 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-12-27T22:09:45.211 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2023-12-27T22:09:45.268 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2023-12-27T22:09:45.268 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2023-12-27T22:09:45.326 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2023-12-27T22:09:45.326 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8" 2023-12-27T22:09:45.326 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2023-12-27T22:09:45.326 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2023-12-27T22:09:45.326 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8" 2023-12-27T22:09:45.326 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8" 2023-12-27T22:09:45.326 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-27T22:09:45.326 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2023-12-27T22:09:45.326 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-27T22:09:45.327 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2023-12-27T22:09:45.327 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-27T22:09:45.327 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-27T22:09:45.327 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-27T22:09:45.327 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-12-27T22:09:45.348 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: set os type and version on server 2023-12-27T22:09:45.348 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-12-27T22:09:45.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-27T22:09:45.416 DEBUG:teuthology.orchestra.run.smithi175:> true 2023-12-27T22:09:45.491 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-12-27T22:09:45.491 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2023-12-27T22:09:45.552 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2023-12-27T22:09:45.552 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2023-12-27T22:09:45.613 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream" 2023-12-27T22:09:45.614 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="8" 2023-12-27T22:09:45.614 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos" 2023-12-27T22:09:45.614 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora" 2023-12-27T22:09:45.614 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="8" 2023-12-27T22:09:45.614 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el8" 2023-12-27T22:09:45.614 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-27T22:09:45.614 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2023-12-27T22:09:45.614 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-27T22:09:45.614 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/" 2023-12-27T22:09:45.614 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-27T22:09:45.614 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-27T22:09:45.614 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-27T22:09:45.615 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2023-12-27T22:09:45.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T22:09:45.712 INFO:teuthology.dispatcher.supervisor:Running job 7502356 2023-12-27T22:09:45.712 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-27_21:01:10-rados-wip-yuri7-testing-2023-12-27-1008-pacific-distro-default-smithi/7502356 --name yuriw-2023-12-27_21:01:10-rados-wip-yuri7-testing-2023-12-27-1008-pacific-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} -- /home/teuthworker/archive/yuriw-2023-12-27_21:01:10-rados-wip-yuri7-testing-2023-12-27-1008-pacific-distro-default-smithi/7502356/orig.config.yaml 2023-12-27T22:09:45.716 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-27_21:01:10-rados-wip-yuri7-testing-2023-12-27-1008-pacific-distro-default-smithi/7502356 2023-12-27T22:09:45.716 INFO:teuthology.dispatcher.supervisor:Job PID: 191634 2023-12-27T22:09:45.716 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-27T22:11:45.718 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T22:13:45.782 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T22:15:45.850 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T22:17:45.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T22:19:45.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T22:21:46.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T22:23:46.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T22:25:46.202 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T22:27:46.272 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T22:29:46.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T22:31:46.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T22:33:46.469 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T22:35:46.530 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T22:37:46.598 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T22:39:46.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T22:41:46.736 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T22:43:46.801 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T22:45:46.869 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T22:47:46.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T22:49:47.025 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T22:51:47.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T22:53:47.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T22:55:47.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T22:57:47.292 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T22:59:47.366 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T23:01:47.444 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T23:03:47.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T23:05:47.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T23:07:47.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T23:09:47.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T23:11:47.797 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T23:13:47.861 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T23:15:47.937 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T23:17:48.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T23:19:48.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T23:21:48.186 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T23:23:48.262 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T23:25:48.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T23:27:48.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T23:29:48.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T23:31:48.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T23:33:48.624 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T23:35:48.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T23:37:48.773 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T23:39:48.850 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T23:41:48.929 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T23:43:48.994 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T23:45:49.069 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T23:47:49.141 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T23:49:49.226 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T23:51:49.296 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T23:53:49.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T23:55:49.440 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T23:57:49.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-27T23:59:49.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T00:01:49.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T00:03:49.698 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T00:05:49.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T00:07:49.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T00:09:49.898 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T00:11:49.962 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T00:13:50.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T00:15:50.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T00:17:50.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T00:19:50.394 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T00:21:50.466 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T00:23:50.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T00:25:50.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T00:27:50.681 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T00:29:50.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T00:31:50.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T00:33:50.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T00:35:50.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T00:37:51.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T00:39:51.134 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T00:41:51.204 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T00:43:51.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T00:45:51.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T00:47:51.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T00:49:51.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T00:51:51.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T00:53:51.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T00:55:51.920 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T00:57:51.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T00:59:52.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T01:01:52.149 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T01:03:52.230 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T01:05:52.300 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T01:07:52.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T01:09:52.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T01:11:52.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T01:13:52.754 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T01:15:52.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T01:17:52.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T01:19:52.974 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T01:21:53.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T01:23:53.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T01:25:53.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T01:27:53.268 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T01:29:53.341 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T01:31:53.410 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T01:33:53.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T01:35:53.562 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T01:37:53.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T01:39:53.746 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T01:41:53.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T01:43:54.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T01:45:54.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T01:47:54.432 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T01:49:54.520 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T01:51:54.590 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T01:53:54.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T01:53:54.790 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-28T01:53:54.996 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-28T01:53:54.996 INFO:teuthology.nuke:Checking targets against current locks 2023-12-28T01:53:55.044 DEBUG:teuthology.nuke:shortname: smithi161 2023-12-28T01:53:55.044 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-28T01:53:55.062 DEBUG:teuthology.nuke:shortname: smithi175 2023-12-28T01:53:55.062 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-28T01:53:55.065 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-27_21:01:10-rados-wip-yuri7-testing-2023-12-27-1008-pacific-distro-default-smithi/7502356', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-27 22:04:33.120842', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKHKCkTsJNr7K2bFm7zLsidUHZUfUABflVNIC9goU4/1mpf8Jz3It/rRaWFkXyVQAycm57XXxyND3nDyGE9TtUw='} 2023-12-28T01:53:55.090 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-27_21:01:10-rados-wip-yuri7-testing-2023-12-27-1008-pacific-distro-default-smithi/7502356', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-27 22:04:33.119179', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKlIkSCc9YhlLtCimZb5P6AsFYVaZJWWZ9QT2aXjciCN19PyPDPONIosH0Bi1iwwyWoF3UT/e2A8dcPLkCbaAuU='} 2023-12-28T01:53:55.113 INFO:teuthology.orchestra.console.smithi161:Power off 2023-12-28T01:53:55.114 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-28T01:53:55.138 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2023-12-28T01:53:55.139 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-28T01:53:55.150 INFO:teuthology.orchestra.console.smithi175:Power off 2023-12-28T01:53:55.150 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-28T01:53:55.159 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-12-28T01:53:55.169 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off 2023-12-28T01:53:55.170 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-28T01:53:55.190 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2023-12-28T01:53:55.260 INFO:teuthology.orchestra.console.smithi161:Power off completed 2023-12-28T01:53:55.291 INFO:teuthology.orchestra.console.smithi175:Power off completed 2023-12-28T01:53:55.416 INFO:teuthology.lock.ops:unlocked: smithi161.front.sepia.ceph.com 2023-12-28T01:53:55.431 INFO:teuthology.lock.ops:unlocked: smithi175.front.sepia.ceph.com