2024-01-15T08:46:15.473 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-15T08:46:15.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T08:46:15.623 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbce0b48c10>, signals=[15]) 2024-01-15T08:46:15.623 INFO:teuthology.lock.ops:Start node 'smithi086.front.sepia.ceph.com' reimaging 2024-01-15T08:46:15.623 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: reset os type and version on server 2024-01-15T08:46:15.623 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2024-01-15T08:46:15.643 INFO:teuthology.lock.ops:Start node 'smithi194.front.sepia.ceph.com' reimaging 2024-01-15T08:46:15.643 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: reset os type and version on server 2024-01-15T08:46:15.643 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2024-01-15T08:46:15.764 DEBUG:teuthology.provision.fog.smithi086:Requesting image smithi_centos_9.stream (ID 10) 2024-01-15T08:46:15.788 DEBUG:teuthology.provision.fog.smithi194:Requesting image smithi_centos_9.stream (ID 10) 2024-01-15T08:46:15.809 INFO:teuthology.provision.fog.smithi086:Scheduling deploy of centos 9.stream 2024-01-15T08:46:15.847 INFO:teuthology.provision.fog.smithi194:Scheduling deploy of centos 9.stream 2024-01-15T08:46:16.025 INFO:teuthology.orchestra.console.smithi086:Power off 2024-01-15T08:46:16.025 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-15T08:46:16.050 DEBUG:teuthology.orchestra.console.smithi086:power off output: Chassis Power Control: Down/Off 2024-01-15T08:46:16.050 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-15T08:46:16.062 INFO:teuthology.orchestra.console.smithi194:Power off 2024-01-15T08:46:16.063 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-15T08:46:16.071 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2024-01-15T08:46:16.083 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off 2024-01-15T08:46:16.084 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-15T08:46:16.105 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2024-01-15T08:46:20.075 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-15T08:46:20.105 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-15T08:46:20.183 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2024-01-15T08:46:20.214 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2024-01-15T08:46:24.189 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-15T08:46:24.215 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-15T08:46:24.298 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2024-01-15T08:46:24.323 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2024-01-15T08:46:24.423 INFO:teuthology.orchestra.console.smithi194:Power off completed 2024-01-15T08:46:24.524 INFO:teuthology.orchestra.console.smithi194:Power on 2024-01-15T08:46:24.524 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-15T08:46:24.545 DEBUG:teuthology.orchestra.console.smithi194:power on output: Chassis Power Control: Up/On 2024-01-15T08:46:24.545 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-15T08:46:24.565 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2024-01-15T08:46:28.303 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-15T08:46:28.411 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2024-01-15T08:46:28.512 INFO:teuthology.orchestra.console.smithi086:Power off completed 2024-01-15T08:46:28.565 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-15T08:46:28.612 INFO:teuthology.orchestra.console.smithi086:Power on 2024-01-15T08:46:28.613 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-15T08:46:28.631 DEBUG:teuthology.orchestra.console.smithi086:power on output: Chassis Power Control: Up/On 2024-01-15T08:46:28.632 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-15T08:46:28.650 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2024-01-15T08:46:28.673 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2024-01-15T08:46:32.656 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-15T08:46:32.674 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-15T08:46:32.764 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2024-01-15T08:46:32.781 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2024-01-15T08:46:32.866 INFO:teuthology.orchestra.console.smithi086:Power on completed 2024-01-15T08:46:32.882 INFO:teuthology.orchestra.console.smithi194:Power on completed 2024-01-15T08:46:32.967 INFO:teuthology.provision.fog.smithi086:Waiting for deploy to finish 2024-01-15T08:46:32.983 INFO:teuthology.provision.fog.smithi194:Waiting for deploy to finish 2024-01-15T08:49:03.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T08:49:06.716 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-01-15T08:49:12.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T08:49:15.808 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-01-15T08:49:18.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T08:49:21.756 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-01-15T08:49:21.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T08:49:24.860 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-01-15T08:49:27.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T08:49:30.812 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-01-15T08:49:30.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T08:49:33.916 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-01-15T08:49:36.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T08:49:39.872 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-01-15T08:49:39.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T08:49:42.976 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-01-15T08:49:45.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T08:49:48.956 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-01-15T08:49:48.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T08:49:52.032 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-01-15T08:49:54.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T08:49:58.016 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-01-15T08:49:58.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T08:50:04.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T08:50:07.100 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-01-15T08:50:13.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T08:50:58.081 WARNING:teuthology.provision.fog.smithi194:timed out 2024-01-15T08:51:04.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T08:51:04.315 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-15T08:51:04.319 DEBUG:teuthology.orchestra.run.smithi194:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-15T08:51:04.624 INFO:teuthology.provision.fog.smithi194:Node is ready 2024-01-15T08:51:04.624 DEBUG:teuthology.orchestra.run.smithi194:> hostname 2024-01-15T08:51:04.641 INFO:teuthology.orchestra.run.smithi194.stdout:smithi194.front.sepia.ceph.com 2024-01-15T08:51:04.641 DEBUG:teuthology.orchestra.run.smithi194:> grep smithi194.front.sepia.ceph.com /etc/hosts 2024-01-15T08:51:04.696 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.194 smithi194.front.sepia.ceph.com smithi194 2024-01-15T08:51:04.696 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194 2024-01-15T08:51:04.820 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194.front.sepia.ceph.com/smithi194/g' /etc/hosts 2024-01-15T08:51:04.848 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/172.21.15.194/172.21.15.194/g' /etc/hosts 2024-01-15T08:51:04.915 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194.front.sepia.ceph.com/smithi194/g' /etc/hostname 2024-01-15T08:51:04.983 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194 2024-01-15T08:51:05.049 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2024-01-15T08:51:05.103 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream" 2024-01-15T08:51:05.103 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="9" 2024-01-15T08:51:05.103 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos" 2024-01-15T08:51:05.103 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora" 2024-01-15T08:51:05.104 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="9" 2024-01-15T08:51:05.104 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el9" 2024-01-15T08:51:05.104 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-15T08:51:05.104 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2024-01-15T08:51:05.104 INFO:teuthology.orchestra.run.smithi194.stdout:LOGO="fedora-logo-icon" 2024-01-15T08:51:05.104 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-15T08:51:05.104 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/" 2024-01-15T08:51:05.104 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-15T08:51:05.104 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-15T08:51:05.104 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-15T08:51:05.105 INFO:teuthology.provision.fog.smithi194:Deploy complete! 2024-01-15T08:51:05.106 DEBUG:teuthology.parallel:result is None 2024-01-15T08:51:13.115 WARNING:teuthology.provision.fog.smithi086:timed out 2024-01-15T08:51:19.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T08:51:19.383 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-15T08:51:19.384 DEBUG:teuthology.orchestra.run.smithi086:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-15T08:51:19.702 INFO:teuthology.provision.fog.smithi086:Node is ready 2024-01-15T08:51:19.702 DEBUG:teuthology.orchestra.run.smithi086:> hostname 2024-01-15T08:51:19.716 INFO:teuthology.orchestra.run.smithi086.stdout:smithi086.front.sepia.ceph.com 2024-01-15T08:51:19.717 DEBUG:teuthology.orchestra.run.smithi086:> grep smithi086.front.sepia.ceph.com /etc/hosts 2024-01-15T08:51:19.772 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86 smithi086.front.sepia.ceph.com smithi086 2024-01-15T08:51:19.773 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname smithi086 2024-01-15T08:51:19.874 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/smithi086.front.sepia.ceph.com/smithi086/g' /etc/hosts 2024-01-15T08:51:19.902 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/172.21.15.86/172.21.15.86/g' /etc/hosts 2024-01-15T08:51:19.969 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/smithi086.front.sepia.ceph.com/smithi086/g' /etc/hostname 2024-01-15T08:51:20.037 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname smithi086 2024-01-15T08:51:20.105 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2024-01-15T08:51:20.159 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="CentOS Stream" 2024-01-15T08:51:20.159 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="9" 2024-01-15T08:51:20.159 INFO:teuthology.orchestra.run.smithi086.stdout:ID="centos" 2024-01-15T08:51:20.159 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="rhel fedora" 2024-01-15T08:51:20.159 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="9" 2024-01-15T08:51:20.160 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el9" 2024-01-15T08:51:20.160 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-15T08:51:20.160 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2024-01-15T08:51:20.160 INFO:teuthology.orchestra.run.smithi086.stdout:LOGO="fedora-logo-icon" 2024-01-15T08:51:20.160 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-15T08:51:20.160 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://centos.org/" 2024-01-15T08:51:20.160 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-15T08:51:20.160 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-15T08:51:20.160 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-15T08:51:20.160 INFO:teuthology.provision.fog.smithi086:Deploy complete! 2024-01-15T08:51:20.161 DEBUG:teuthology.parallel:result is None 2024-01-15T08:51:20.327 INFO:teuthology.lock.ops:Checking smithi086.front.sepia.ceph.com 2024-01-15T08:51:20.327 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-15T08:51:20.363 INFO:teuthology.lock.ops:Checking smithi194.front.sepia.ceph.com 2024-01-15T08:51:20.363 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-15T08:51:20.389 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: set os type and version on server 2024-01-15T08:51:20.389 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-01-15T08:51:20.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T08:51:20.480 DEBUG:teuthology.orchestra.run.smithi086:> true 2024-01-15T08:51:20.546 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-01-15T08:51:20.546 DEBUG:teuthology.orchestra.run.smithi086:> uname -m 2024-01-15T08:51:20.601 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2024-01-15T08:51:20.601 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2024-01-15T08:51:20.654 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="CentOS Stream" 2024-01-15T08:51:20.655 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="9" 2024-01-15T08:51:20.655 INFO:teuthology.orchestra.run.smithi086.stdout:ID="centos" 2024-01-15T08:51:20.655 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="rhel fedora" 2024-01-15T08:51:20.655 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="9" 2024-01-15T08:51:20.655 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el9" 2024-01-15T08:51:20.655 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-15T08:51:20.655 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2024-01-15T08:51:20.655 INFO:teuthology.orchestra.run.smithi086.stdout:LOGO="fedora-logo-icon" 2024-01-15T08:51:20.655 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-15T08:51:20.655 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://centos.org/" 2024-01-15T08:51:20.655 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-15T08:51:20.655 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-15T08:51:20.656 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-15T08:51:20.656 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2024-01-15T08:51:20.680 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: set os type and version on server 2024-01-15T08:51:20.680 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-01-15T08:51:20.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T08:51:20.766 DEBUG:teuthology.orchestra.run.smithi194:> true 2024-01-15T08:51:20.934 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-01-15T08:51:20.934 DEBUG:teuthology.orchestra.run.smithi194:> uname -m 2024-01-15T08:51:20.989 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2024-01-15T08:51:20.989 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2024-01-15T08:51:21.043 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream" 2024-01-15T08:51:21.044 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="9" 2024-01-15T08:51:21.044 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos" 2024-01-15T08:51:21.044 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora" 2024-01-15T08:51:21.044 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="9" 2024-01-15T08:51:21.044 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el9" 2024-01-15T08:51:21.044 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-15T08:51:21.044 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2024-01-15T08:51:21.044 INFO:teuthology.orchestra.run.smithi194.stdout:LOGO="fedora-logo-icon" 2024-01-15T08:51:21.044 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-15T08:51:21.044 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/" 2024-01-15T08:51:21.044 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-15T08:51:21.045 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-15T08:51:21.045 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-15T08:51:21.045 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2024-01-15T08:51:21.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T08:51:21.175 INFO:teuthology.dispatcher.supervisor:Running job 7517061 2024-01-15T08:51:21.175 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_matan@teuthology --archive /home/teuthworker/archive/matan-2024-01-15_08:45:27-crimson-rados-wip-matanb-crimson-return-no-supp-distro-crimson-smithi/7517061 --name matan-2024-01-15_08:45:27-crimson-rados-wip-matanb-crimson-return-no-supp-distro-crimson-smithi --description crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests} -- /home/teuthworker/archive/matan-2024-01-15_08:45:27-crimson-rados-wip-matanb-crimson-return-no-supp-distro-crimson-smithi/7517061/orig.config.yaml 2024-01-15T08:51:21.179 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/matan-2024-01-15_08:45:27-crimson-rados-wip-matanb-crimson-return-no-supp-distro-crimson-smithi/7517061 2024-01-15T08:51:21.180 INFO:teuthology.dispatcher.supervisor:Job PID: 2080219 2024-01-15T08:51:21.180 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-15T08:53:21.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T08:55:21.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T08:57:21.646 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T08:59:21.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T09:01:21.996 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T09:03:22.146 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T09:05:22.308 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T09:07:22.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T09:09:22.657 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T09:11:22.762 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T09:13:22.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T09:15:23.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T09:17:23.258 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T09:19:23.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T09:21:23.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T09:23:23.964 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T09:25:24.114 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T09:27:24.289 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T09:29:24.458 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T09:31:24.669 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T09:33:24.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T09:35:25.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T09:37:25.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T09:39:25.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T09:41:25.553 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T09:43:25.656 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T09:45:25.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T09:47:25.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T09:49:26.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T09:51:26.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T09:53:26.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T09:55:26.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T09:57:26.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T09:59:27.008 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T10:01:27.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T10:03:27.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T10:05:27.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T10:07:27.909 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T10:09:28.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T10:11:28.200 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T10:13:28.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T10:15:28.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T10:17:28.656 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T10:19:28.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T10:21:29.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T10:23:29.344 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T10:25:29.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T10:27:29.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T10:29:29.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T10:31:29.976 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T10:33:30.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T10:35:30.236 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T10:37:30.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T10:39:30.472 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T10:41:30.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T10:43:30.932 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T10:45:31.086 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T10:47:31.200 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T10:49:31.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T10:51:31.521 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T10:53:31.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T10:55:31.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T10:57:31.992 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T10:59:32.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T11:01:32.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T11:03:32.485 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T11:05:32.641 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T11:07:32.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T11:09:33.018 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T11:11:33.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T11:13:33.234 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T11:15:33.306 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T11:17:33.546 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T11:19:33.732 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T11:21:33.928 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T11:23:34.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T11:25:34.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T11:27:34.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T11:29:34.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T11:31:34.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T11:33:34.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T11:35:34.994 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T11:37:35.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T11:39:35.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T11:41:35.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T11:43:35.650 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T11:45:35.804 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T11:47:36.030 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T11:49:36.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T11:51:36.310 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T11:53:36.484 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T11:55:36.592 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T11:57:36.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T11:59:36.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T12:01:37.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T12:03:37.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T12:05:37.238 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T12:07:37.412 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T12:09:37.584 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T12:11:37.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T12:13:37.773 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T12:15:37.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T12:17:38.064 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T12:19:38.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T12:21:38.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T12:23:38.556 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T12:23:38.630 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-15T12:23:38.755 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-15T12:23:38.755 INFO:teuthology.nuke:Checking targets against current locks 2024-01-15T12:23:38.799 DEBUG:teuthology.nuke:shortname: smithi086 2024-01-15T12:23:38.800 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-15T12:23:38.822 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi086.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-01-15_08:45:27-crimson-rados-wip-matanb-crimson-return-no-supp-distro-crimson-smithi/7517061', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-15 08:46:14.501109', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCe5grDqx3nIBf5aJc5G+w+pYF+RMSy/LWFR26q4Obw6T13jFgNGcbjhSjAnSJVkg9/3AK7CQeXjvEnhYwmMlwM='} 2024-01-15T12:23:38.828 DEBUG:teuthology.nuke:shortname: smithi194 2024-01-15T12:23:38.828 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-15T12:23:38.847 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-01-15_08:45:27-crimson-rados-wip-matanb-crimson-return-no-supp-distro-crimson-smithi/7517061', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-15 08:46:14.502474', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJcOvjfj3CJApSnj/RH2xO6RHZdFrY/Y1sjLy9NO/ZkPJqgMUJqQ5IUN3q9heBzts/XQFd6DeVFGbUOSO13JfnE='} 2024-01-15T12:23:38.875 INFO:teuthology.orchestra.console.smithi086:Power off 2024-01-15T12:23:38.875 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-15T12:23:38.893 INFO:teuthology.orchestra.console.smithi194:Power off 2024-01-15T12:23:38.894 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-15T12:23:38.902 DEBUG:teuthology.orchestra.console.smithi086:power off output: Chassis Power Control: Down/Off 2024-01-15T12:23:38.903 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-15T12:23:38.915 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off 2024-01-15T12:23:38.915 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-15T12:23:38.923 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2024-01-15T12:23:38.935 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2024-01-15T12:23:39.024 INFO:teuthology.orchestra.console.smithi086:Power off completed 2024-01-15T12:23:39.036 INFO:teuthology.orchestra.console.smithi194:Power off completed 2024-01-15T12:23:39.178 INFO:teuthology.lock.ops:unlocked: smithi086.front.sepia.ceph.com 2024-01-15T12:23:39.186 INFO:teuthology.lock.ops:unlocked: smithi194.front.sepia.ceph.com