2024-01-18T15:15:16.352 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-18T15:15:16.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T15:15:16.498 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb7b6749c10>, signals=[15]) 2024-01-18T15:15:16.498 INFO:teuthology.lock.ops:Start node 'smithi115.front.sepia.ceph.com' reimaging 2024-01-18T15:15:16.498 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: reset os type and version on server 2024-01-18T15:15:16.499 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2024-01-18T15:15:16.522 INFO:teuthology.lock.ops:Start node 'smithi129.front.sepia.ceph.com' reimaging 2024-01-18T15:15:16.523 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: reset os type and version on server 2024-01-18T15:15:16.523 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2024-01-18T15:15:16.660 DEBUG:teuthology.provision.fog.smithi129:Requesting image smithi_centos_9.stream (ID 10) 2024-01-18T15:15:16.664 DEBUG:teuthology.provision.fog.smithi115:Requesting image smithi_centos_9.stream (ID 10) 2024-01-18T15:15:16.703 INFO:teuthology.provision.fog.smithi129:Scheduling deploy of centos 9.stream 2024-01-18T15:15:16.707 INFO:teuthology.provision.fog.smithi115:Scheduling deploy of centos 9.stream 2024-01-18T15:15:16.935 INFO:teuthology.orchestra.console.smithi115:Power off 2024-01-18T15:15:16.936 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-18T15:15:16.950 INFO:teuthology.orchestra.console.smithi129:Power off 2024-01-18T15:15:16.950 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-18T15:15:16.959 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off 2024-01-18T15:15:16.959 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T15:15:16.973 DEBUG:teuthology.orchestra.console.smithi129:power off output: Chassis Power Control: Down/Off 2024-01-18T15:15:16.973 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T15:15:16.985 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2024-01-18T15:15:16.995 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2024-01-18T15:15:20.988 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T15:15:20.996 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T15:15:21.097 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2024-01-18T15:15:21.108 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2024-01-18T15:15:25.100 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T15:15:25.109 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T15:15:25.210 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2024-01-18T15:15:25.218 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2024-01-18T15:15:25.311 INFO:teuthology.orchestra.console.smithi115:Power off completed 2024-01-18T15:15:25.319 INFO:teuthology.orchestra.console.smithi129:Power off completed 2024-01-18T15:15:25.412 INFO:teuthology.orchestra.console.smithi115:Power on 2024-01-18T15:15:25.412 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-18T15:15:25.419 INFO:teuthology.orchestra.console.smithi129:Power on 2024-01-18T15:15:25.419 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-18T15:15:25.434 DEBUG:teuthology.orchestra.console.smithi115:power on output: Chassis Power Control: Up/On 2024-01-18T15:15:25.434 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T15:15:25.442 DEBUG:teuthology.orchestra.console.smithi129:power on output: Chassis Power Control: Up/On 2024-01-18T15:15:25.442 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T15:15:25.455 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2024-01-18T15:15:25.462 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2024-01-18T15:15:29.460 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T15:15:29.468 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T15:15:29.570 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2024-01-18T15:15:29.576 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2024-01-18T15:15:33.575 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T15:15:33.583 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T15:15:33.685 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2024-01-18T15:15:33.692 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2024-01-18T15:15:33.787 INFO:teuthology.orchestra.console.smithi115:Power on completed 2024-01-18T15:15:33.793 INFO:teuthology.orchestra.console.smithi129:Power on completed 2024-01-18T15:15:33.888 INFO:teuthology.provision.fog.smithi115:Waiting for deploy to finish 2024-01-18T15:15:33.895 INFO:teuthology.provision.fog.smithi129:Waiting for deploy to finish 2024-01-18T15:18:04.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T15:18:04.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T15:18:23.296 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-01-18T15:18:23.297 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-01-18T15:18:29.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T15:18:29.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T15:18:32.380 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-01-18T15:18:32.380 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-01-18T15:18:38.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T15:18:38.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T15:18:41.468 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-01-18T15:18:41.468 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-01-18T15:18:47.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T15:18:47.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T15:18:50.556 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-01-18T15:18:50.556 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-01-18T15:18:56.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T15:18:56.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T15:18:59.644 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-01-18T15:18:59.644 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-01-18T15:19:05.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T15:19:05.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T15:19:08.732 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-01-18T15:19:14.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T15:19:41.013 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-18T15:19:41.013 DEBUG:teuthology.orchestra.run.smithi129:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-18T15:20:06.541 INFO:teuthology.provision.fog.smithi129:Node is ready 2024-01-18T15:20:06.541 DEBUG:teuthology.orchestra.run.smithi129:> hostname 2024-01-18T15:20:06.560 INFO:teuthology.orchestra.run.smithi129.stdout:smithi129.front.sepia.ceph.com 2024-01-18T15:20:06.560 DEBUG:teuthology.orchestra.run.smithi129:> grep smithi129.front.sepia.ceph.com /etc/hosts 2024-01-18T15:20:06.617 INFO:teuthology.orchestra.run.smithi129.stdout:172.21.15.129 smithi129.front.sepia.ceph.com smithi129 2024-01-18T15:20:06.617 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname smithi129 2024-01-18T15:20:06.743 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi129.front.sepia.ceph.com/smithi129/g' /etc/hosts 2024-01-18T15:20:06.774 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/172.21.15.129/172.21.15.129/g' /etc/hosts 2024-01-18T15:20:06.842 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi129.front.sepia.ceph.com/smithi129/g' /etc/hostname 2024-01-18T15:20:06.911 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname smithi129 2024-01-18T15:20:06.977 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2024-01-18T15:20:07.033 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream" 2024-01-18T15:20:07.033 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="9" 2024-01-18T15:20:07.033 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos" 2024-01-18T15:20:07.033 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora" 2024-01-18T15:20:07.033 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="9" 2024-01-18T15:20:07.033 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el9" 2024-01-18T15:20:07.033 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-18T15:20:07.033 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2024-01-18T15:20:07.033 INFO:teuthology.orchestra.run.smithi129.stdout:LOGO="fedora-logo-icon" 2024-01-18T15:20:07.033 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-18T15:20:07.033 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/" 2024-01-18T15:20:07.033 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-18T15:20:07.033 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-18T15:20:07.033 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-18T15:20:07.034 INFO:teuthology.provision.fog.smithi129:Deploy complete! 2024-01-18T15:20:07.035 DEBUG:teuthology.parallel:result is None 2024-01-18T15:20:14.744 WARNING:teuthology.provision.fog.smithi115:timed out 2024-01-18T15:20:20.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T15:20:21.092 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-18T15:20:21.092 DEBUG:teuthology.orchestra.run.smithi115:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-18T15:20:21.425 INFO:teuthology.provision.fog.smithi115:Node is ready 2024-01-18T15:20:21.425 DEBUG:teuthology.orchestra.run.smithi115:> hostname 2024-01-18T15:20:21.439 INFO:teuthology.orchestra.run.smithi115.stdout:smithi115.front.sepia.ceph.com 2024-01-18T15:20:21.440 DEBUG:teuthology.orchestra.run.smithi115:> grep smithi115.front.sepia.ceph.com /etc/hosts 2024-01-18T15:20:21.495 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115 smithi115.front.sepia.ceph.com smithi115 2024-01-18T15:20:21.496 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115 2024-01-18T15:20:21.611 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hosts 2024-01-18T15:20:21.638 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/172.21.15.115/172.21.15.115/g' /etc/hosts 2024-01-18T15:20:21.706 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hostname 2024-01-18T15:20:21.774 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115 2024-01-18T15:20:21.840 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2024-01-18T15:20:21.894 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream" 2024-01-18T15:20:21.894 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="9" 2024-01-18T15:20:21.894 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos" 2024-01-18T15:20:21.894 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora" 2024-01-18T15:20:21.894 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="9" 2024-01-18T15:20:21.895 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el9" 2024-01-18T15:20:21.895 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-18T15:20:21.895 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2024-01-18T15:20:21.895 INFO:teuthology.orchestra.run.smithi115.stdout:LOGO="fedora-logo-icon" 2024-01-18T15:20:21.895 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-18T15:20:21.895 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/" 2024-01-18T15:20:21.895 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-18T15:20:21.895 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-18T15:20:21.895 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-18T15:20:21.895 INFO:teuthology.provision.fog.smithi115:Deploy complete! 2024-01-18T15:20:21.896 DEBUG:teuthology.parallel:result is None 2024-01-18T15:20:22.092 INFO:teuthology.lock.ops:Checking smithi115.front.sepia.ceph.com 2024-01-18T15:20:22.093 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-18T15:20:22.123 INFO:teuthology.lock.ops:Checking smithi129.front.sepia.ceph.com 2024-01-18T15:20:22.124 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-18T15:20:22.141 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: set os type and version on server 2024-01-18T15:20:22.141 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-01-18T15:20:22.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T15:20:22.228 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-01-18T15:20:22.293 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-01-18T15:20:22.294 DEBUG:teuthology.orchestra.run.smithi115:> uname -m 2024-01-18T15:20:22.347 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2024-01-18T15:20:22.348 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2024-01-18T15:20:22.402 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream" 2024-01-18T15:20:22.402 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="9" 2024-01-18T15:20:22.403 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos" 2024-01-18T15:20:22.403 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora" 2024-01-18T15:20:22.403 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="9" 2024-01-18T15:20:22.403 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el9" 2024-01-18T15:20:22.403 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-18T15:20:22.403 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2024-01-18T15:20:22.403 INFO:teuthology.orchestra.run.smithi115.stdout:LOGO="fedora-logo-icon" 2024-01-18T15:20:22.403 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-18T15:20:22.403 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/" 2024-01-18T15:20:22.403 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-18T15:20:22.403 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-18T15:20:22.403 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-18T15:20:22.404 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2024-01-18T15:20:22.432 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: set os type and version on server 2024-01-18T15:20:22.432 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-01-18T15:20:22.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T15:20:22.519 DEBUG:teuthology.orchestra.run.smithi129:> true 2024-01-18T15:20:22.690 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-01-18T15:20:22.690 DEBUG:teuthology.orchestra.run.smithi129:> uname -m 2024-01-18T15:20:22.744 INFO:teuthology.orchestra.run.smithi129.stdout:x86_64 2024-01-18T15:20:22.744 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2024-01-18T15:20:22.798 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream" 2024-01-18T15:20:22.798 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="9" 2024-01-18T15:20:22.798 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos" 2024-01-18T15:20:22.798 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora" 2024-01-18T15:20:22.798 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="9" 2024-01-18T15:20:22.798 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el9" 2024-01-18T15:20:22.798 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-18T15:20:22.798 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2024-01-18T15:20:22.799 INFO:teuthology.orchestra.run.smithi129.stdout:LOGO="fedora-logo-icon" 2024-01-18T15:20:22.799 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-18T15:20:22.799 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/" 2024-01-18T15:20:22.799 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-18T15:20:22.799 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-18T15:20:22.799 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-18T15:20:22.799 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2024-01-18T15:20:22.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T15:20:22.909 INFO:teuthology.dispatcher.supervisor:Running job 7520333 2024-01-18T15:20:22.909 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-18_15:10:37-rados-wip-yuri3-testing-2024-01-17-0753-distro-default-smithi/7520333 --name yuriw-2024-01-18_15:10:37-rados-wip-yuri3-testing-2024-01-17-0753-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} -- /home/teuthworker/archive/yuriw-2024-01-18_15:10:37-rados-wip-yuri3-testing-2024-01-17-0753-distro-default-smithi/7520333/orig.config.yaml 2024-01-18T15:20:22.911 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-01-18_15:10:37-rados-wip-yuri3-testing-2024-01-17-0753-distro-default-smithi/7520333 2024-01-18T15:20:22.911 INFO:teuthology.dispatcher.supervisor:Job PID: 1707312 2024-01-18T15:20:22.912 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-18T15:22:23.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T15:24:23.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T15:26:23.276 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T15:28:23.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T15:30:23.634 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T15:32:23.804 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T15:34:23.981 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T15:36:24.150 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T15:38:24.278 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T15:40:24.450 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T15:42:24.616 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T15:44:24.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T15:46:24.988 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T15:48:25.149 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T15:50:25.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T15:52:25.500 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T15:54:25.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T15:56:25.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T15:58:25.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T16:00:26.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T16:02:26.298 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T16:04:26.484 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T16:06:26.642 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T16:08:26.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T16:10:27.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T16:12:27.226 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T16:14:27.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T16:16:27.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T16:18:27.704 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T16:20:27.876 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T16:22:28.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T16:24:28.200 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T16:26:28.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T16:28:28.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T16:30:28.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T16:32:28.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T16:34:29.036 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T16:36:29.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T16:38:29.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T16:40:29.548 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T16:42:29.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T16:44:29.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T16:46:30.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T16:48:30.118 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T16:50:30.284 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T16:52:30.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T16:54:30.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T16:56:30.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T16:58:30.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T17:00:31.030 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T17:02:31.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T17:04:31.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T17:06:31.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T17:08:31.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T17:08:31.729 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-18T17:08:31.906 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-18T17:08:31.906 INFO:teuthology.nuke:Checking targets against current locks 2024-01-18T17:08:31.951 DEBUG:teuthology.nuke:shortname: smithi115 2024-01-18T17:08:31.951 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-18T17:08:31.973 DEBUG:teuthology.nuke:shortname: smithi129 2024-01-18T17:08:31.973 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-18T17:08:31.979 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-18_15:10:37-rados-wip-yuri3-testing-2024-01-17-0753-distro-default-smithi/7520333', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-18 15:15:15.336742', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGNNuw0ILUmj316S44u1VTXuyAq4Gd7Wwz0F0JUMqTDHHier4b2EnCMqJ790pmhAVvFfqdV6+zHHc0ZnspU5RiI='} 2024-01-18T17:08:31.988 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi129.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-18_15:10:37-rados-wip-yuri3-testing-2024-01-17-0753-distro-default-smithi/7520333', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-18 15:15:15.338015', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFdHGbVV8+hq4Z8x+umqPOj8K5zxvXV+C+Uza2okjF+s1dsiMOGz4RkCe1On0KQuPVhWxectIxHtLBAQKNr17n0='} 2024-01-18T17:08:32.018 INFO:teuthology.orchestra.console.smithi115:Power off 2024-01-18T17:08:32.018 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-18T17:08:32.040 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off 2024-01-18T17:08:32.040 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T17:08:32.054 INFO:teuthology.orchestra.console.smithi129:Power off 2024-01-18T17:08:32.054 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-18T17:08:32.062 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2024-01-18T17:08:32.074 DEBUG:teuthology.orchestra.console.smithi129:power off output: Chassis Power Control: Down/Off 2024-01-18T17:08:32.075 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T17:08:32.095 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2024-01-18T17:08:32.163 INFO:teuthology.orchestra.console.smithi115:Power off completed 2024-01-18T17:08:32.196 INFO:teuthology.orchestra.console.smithi129:Power off completed 2024-01-18T17:08:32.313 INFO:teuthology.lock.ops:unlocked: smithi115.front.sepia.ceph.com 2024-01-18T17:08:32.336 INFO:teuthology.lock.ops:unlocked: smithi129.front.sepia.ceph.com