2023-11-23T02:25:52.035 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-23T02:25:52.036 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T02:25:52.184 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff9ab9faee0>, signals=[15]) 2023-11-23T02:25:52.184 INFO:teuthology.lock.ops:Start node 'smithi081.front.sepia.ceph.com' reimaging 2023-11-23T02:25:52.185 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: reset os type and version on server 2023-11-23T02:25:52.185 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2023-11-23T02:25:52.206 INFO:teuthology.lock.ops:Start node 'smithi141.front.sepia.ceph.com' reimaging 2023-11-23T02:25:52.206 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: reset os type and version on server 2023-11-23T02:25:52.206 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server 2023-11-23T02:25:52.322 DEBUG:teuthology.provision.fog.smithi081:Requesting image smithi_centos_8.stream (ID 3) 2023-11-23T02:25:52.339 DEBUG:teuthology.provision.fog.smithi141:Requesting image smithi_centos_8.stream (ID 3) 2023-11-23T02:25:52.366 INFO:teuthology.provision.fog.smithi081:Scheduling deploy of centos 8.stream 2023-11-23T02:25:52.377 INFO:teuthology.provision.fog.smithi141:Scheduling deploy of centos 8.stream 2023-11-23T02:25:52.563 INFO:teuthology.orchestra.console.smithi081:Power off 2023-11-23T02:25:52.563 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-23T02:25:52.575 INFO:teuthology.orchestra.console.smithi141:Power off 2023-11-23T02:25:52.576 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-23T02:25:52.584 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off 2023-11-23T02:25:52.584 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T02:25:52.598 DEBUG:teuthology.orchestra.console.smithi141:power off output: Chassis Power Control: Down/Off 2023-11-23T02:25:52.598 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T02:25:52.606 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2023-11-23T02:25:52.620 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-11-23T02:25:56.610 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T02:25:56.620 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T02:25:56.719 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2023-11-23T02:25:56.728 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-11-23T02:26:00.724 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T02:26:00.731 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T02:26:00.833 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-11-23T02:26:00.840 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-11-23T02:26:00.934 INFO:teuthology.orchestra.console.smithi081:Power off completed 2023-11-23T02:26:00.940 INFO:teuthology.orchestra.console.smithi141:Power off completed 2023-11-23T02:26:01.036 INFO:teuthology.orchestra.console.smithi081:Power on 2023-11-23T02:26:01.036 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-23T02:26:01.043 INFO:teuthology.orchestra.console.smithi141:Power on 2023-11-23T02:26:01.043 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-23T02:26:01.056 DEBUG:teuthology.orchestra.console.smithi081:power on output: Chassis Power Control: Up/On 2023-11-23T02:26:01.056 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T02:26:01.063 DEBUG:teuthology.orchestra.console.smithi141:power on output: Chassis Power Control: Up/On 2023-11-23T02:26:01.063 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T02:26:01.076 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-11-23T02:26:01.082 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-11-23T02:26:05.079 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T02:26:05.086 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T02:26:05.188 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-11-23T02:26:05.194 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-11-23T02:26:09.193 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T02:26:09.200 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T02:26:09.302 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2023-11-23T02:26:09.313 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-11-23T02:26:09.403 INFO:teuthology.orchestra.console.smithi081:Power on completed 2023-11-23T02:26:09.414 INFO:teuthology.orchestra.console.smithi141:Power on completed 2023-11-23T02:26:09.504 INFO:teuthology.provision.fog.smithi081:Waiting for deploy to finish 2023-11-23T02:26:09.515 INFO:teuthology.provision.fog.smithi141:Waiting for deploy to finish 2023-11-23T02:29:15.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T02:29:33.666 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-11-23T02:29:39.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T02:29:42.722 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-11-23T02:29:48.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T02:29:51.778 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-11-23T02:29:57.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T02:30:57.799 WARNING:teuthology.provision.fog.smithi141:timed out 2023-11-23T02:31:03.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T02:31:04.060 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-23T02:31:04.060 DEBUG:teuthology.orchestra.run.smithi141:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-23T02:31:04.294 INFO:teuthology.provision.fog.smithi141:Node is ready 2023-11-23T02:31:04.294 DEBUG:teuthology.orchestra.run.smithi141:> hostname 2023-11-23T02:31:04.353 INFO:teuthology.orchestra.run.smithi141.stdout:smithi141.front.sepia.ceph.com 2023-11-23T02:31:04.353 DEBUG:teuthology.orchestra.run.smithi141:> grep smithi141.front.sepia.ceph.com /etc/hosts 2023-11-23T02:31:04.412 INFO:teuthology.orchestra.run.smithi141.stdout:172.21.15.141 smithi141.front.sepia.ceph.com smithi141 2023-11-23T02:31:04.412 DEBUG:teuthology.orchestra.run.smithi141:> sudo hostname smithi141 2023-11-23T02:31:04.514 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/smithi141.front.sepia.ceph.com/smithi141/g' /etc/hosts 2023-11-23T02:31:04.542 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/172.21.15.141/172.21.15.141/g' /etc/hosts 2023-11-23T02:31:04.611 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/smithi141.front.sepia.ceph.com/smithi141/g' /etc/hostname 2023-11-23T02:31:04.679 DEBUG:teuthology.orchestra.run.smithi141:> sudo hostname smithi141 2023-11-23T02:31:04.746 DEBUG:teuthology.orchestra.run.smithi141:> cat /etc/os-release 2023-11-23T02:31:04.805 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="CentOS Stream" 2023-11-23T02:31:04.806 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="8" 2023-11-23T02:31:04.806 INFO:teuthology.orchestra.run.smithi141.stdout:ID="centos" 2023-11-23T02:31:04.806 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE="rhel fedora" 2023-11-23T02:31:04.807 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="8" 2023-11-23T02:31:04.807 INFO:teuthology.orchestra.run.smithi141.stdout:PLATFORM_ID="platform:el8" 2023-11-23T02:31:04.807 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-23T02:31:04.807 INFO:teuthology.orchestra.run.smithi141.stdout:ANSI_COLOR="0;31" 2023-11-23T02:31:04.808 INFO:teuthology.orchestra.run.smithi141.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-23T02:31:04.808 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://centos.org/" 2023-11-23T02:31:04.808 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-23T02:31:04.808 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-23T02:31:04.808 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-23T02:31:04.809 INFO:teuthology.provision.fog.smithi141:Deploy complete! 2023-11-23T02:31:04.810 DEBUG:teuthology.parallel:result is None 2023-11-23T02:36:26.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T02:36:29.474 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-11-23T02:36:35.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T02:36:38.530 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-11-23T02:36:44.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T02:36:47.618 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-11-23T02:36:53.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T02:36:56.678 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-11-23T02:37:02.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T02:37:05.766 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-11-23T02:37:11.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T02:37:14.850 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-11-23T02:37:20.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T02:37:23.910 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-11-23T02:37:29.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T02:38:29.974 WARNING:teuthology.provision.fog.smithi081:timed out 2023-11-23T02:38:35.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T02:38:36.188 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-23T02:38:36.189 DEBUG:teuthology.orchestra.run.smithi081:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-23T02:38:36.456 INFO:teuthology.provision.fog.smithi081:Node is ready 2023-11-23T02:38:36.457 DEBUG:teuthology.orchestra.run.smithi081:> hostname 2023-11-23T02:38:36.476 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081.front.sepia.ceph.com 2023-11-23T02:38:36.476 DEBUG:teuthology.orchestra.run.smithi081:> grep smithi081.front.sepia.ceph.com /etc/hosts 2023-11-23T02:38:36.535 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81 smithi081.front.sepia.ceph.com smithi081 2023-11-23T02:38:36.536 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081 2023-11-23T02:38:36.641 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hosts 2023-11-23T02:38:36.670 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/172.21.15.81/172.21.15.81/g' /etc/hosts 2023-11-23T02:38:36.738 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hostname 2023-11-23T02:38:36.806 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081 2023-11-23T02:38:36.873 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2023-11-23T02:38:36.933 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream" 2023-11-23T02:38:36.933 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8" 2023-11-23T02:38:36.934 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos" 2023-11-23T02:38:36.934 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora" 2023-11-23T02:38:36.934 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8" 2023-11-23T02:38:36.935 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8" 2023-11-23T02:38:36.935 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-23T02:38:36.935 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2023-11-23T02:38:36.935 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-23T02:38:36.936 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/" 2023-11-23T02:38:36.936 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-23T02:38:36.936 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-23T02:38:36.936 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-23T02:38:36.938 INFO:teuthology.provision.fog.smithi081:Deploy complete! 2023-11-23T02:38:36.938 DEBUG:teuthology.parallel:result is None 2023-11-23T02:38:37.110 INFO:teuthology.lock.ops:Checking smithi081.front.sepia.ceph.com 2023-11-23T02:38:37.111 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-23T02:38:37.137 INFO:teuthology.lock.ops:Checking smithi141.front.sepia.ceph.com 2023-11-23T02:38:37.137 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-23T02:38:37.161 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: set os type and version on server 2023-11-23T02:38:37.162 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-11-23T02:38:37.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T02:38:37.227 DEBUG:teuthology.orchestra.run.smithi081:> true 2023-11-23T02:38:37.292 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-11-23T02:38:37.292 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2023-11-23T02:38:37.353 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2023-11-23T02:38:37.355 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2023-11-23T02:38:37.412 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream" 2023-11-23T02:38:37.412 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8" 2023-11-23T02:38:37.412 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos" 2023-11-23T02:38:37.412 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora" 2023-11-23T02:38:37.412 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8" 2023-11-23T02:38:37.412 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8" 2023-11-23T02:38:37.412 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-23T02:38:37.412 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2023-11-23T02:38:37.412 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-23T02:38:37.412 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/" 2023-11-23T02:38:37.412 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-23T02:38:37.413 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-23T02:38:37.413 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-23T02:38:37.413 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2023-11-23T02:38:37.435 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: set os type and version on server 2023-11-23T02:38:37.436 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-11-23T02:38:37.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T02:38:37.508 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-11-23T02:38:37.640 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-11-23T02:38:37.641 DEBUG:teuthology.orchestra.run.smithi141:> uname -m 2023-11-23T02:38:37.700 INFO:teuthology.orchestra.run.smithi141.stdout:x86_64 2023-11-23T02:38:37.700 DEBUG:teuthology.orchestra.run.smithi141:> cat /etc/os-release 2023-11-23T02:38:37.760 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="CentOS Stream" 2023-11-23T02:38:37.760 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="8" 2023-11-23T02:38:37.760 INFO:teuthology.orchestra.run.smithi141.stdout:ID="centos" 2023-11-23T02:38:37.760 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE="rhel fedora" 2023-11-23T02:38:37.760 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="8" 2023-11-23T02:38:37.761 INFO:teuthology.orchestra.run.smithi141.stdout:PLATFORM_ID="platform:el8" 2023-11-23T02:38:37.761 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-23T02:38:37.761 INFO:teuthology.orchestra.run.smithi141.stdout:ANSI_COLOR="0;31" 2023-11-23T02:38:37.761 INFO:teuthology.orchestra.run.smithi141.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-23T02:38:37.761 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://centos.org/" 2023-11-23T02:38:37.761 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-23T02:38:37.761 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-23T02:38:37.761 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-23T02:38:37.762 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server 2023-11-23T02:38:37.786 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T02:38:37.907 INFO:teuthology.dispatcher.supervisor:Running job 7464474 2023-11-23T02:38:37.907 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-11-23_02:25:02-upgrade:reef-x-main-distro-default-smithi/7464474 --name teuthology-2023-11-23_02:25:02-upgrade:reef-x-main-distro-default-smithi --description upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} -- /home/teuthworker/archive/teuthology-2023-11-23_02:25:02-upgrade:reef-x-main-distro-default-smithi/7464474/orig.config.yaml 2023-11-23T02:38:37.919 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-11-23_02:25:02-upgrade:reef-x-main-distro-default-smithi/7464474 2023-11-23T02:38:37.919 INFO:teuthology.dispatcher.supervisor:Job PID: 321726 2023-11-23T02:38:37.919 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-23T02:40:38.020 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T02:42:38.212 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T02:44:38.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T02:46:38.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T02:48:38.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T02:50:38.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T02:52:39.042 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T02:54:39.204 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T02:56:39.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T02:58:39.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T03:00:39.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T03:02:39.902 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T03:04:40.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T03:06:40.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T03:08:40.404 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T03:10:40.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T03:12:40.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T03:14:40.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T03:16:41.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T03:18:41.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T03:20:41.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T03:22:41.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T03:24:41.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T03:26:41.958 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T03:28:42.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T03:30:42.286 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T03:32:42.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T03:34:42.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T03:36:42.797 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T03:38:42.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T03:40:43.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T03:42:43.269 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T03:44:43.432 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T03:46:43.595 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T03:48:43.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T03:50:43.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T03:52:44.076 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T03:54:44.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T03:56:44.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T03:58:44.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T04:00:44.746 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T04:02:44.882 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T04:04:45.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T04:06:45.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T04:08:45.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T04:10:45.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T04:12:45.542 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T04:14:45.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T04:16:45.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T04:18:46.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T04:20:46.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T04:20:46.289 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-11-23T04:20:46.410 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-23T04:20:46.410 INFO:teuthology.nuke:Checking targets against current locks 2023-11-23T04:20:46.460 DEBUG:teuthology.nuke:shortname: smithi081 2023-11-23T04:20:46.461 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-23T04:20:46.479 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-11-23_02:25:02-upgrade:reef-x-main-distro-default-smithi/7464474', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-23 02:25:51.242727', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE2HiMpgJvVI5Bumho7dnIgsR5lDMKVx0YaZ1O+GJ6PLxlKPbG8oNPbW7v5XxXUiixULImrNq550lCWr5HsvsdY='} 2023-11-23T04:20:46.494 DEBUG:teuthology.nuke:shortname: smithi141 2023-11-23T04:20:46.494 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-23T04:20:46.511 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi141.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-11-23_02:25:02-upgrade:reef-x-main-distro-default-smithi/7464474', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-23 02:25:51.240953', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNxh/rt/Tzh9eu7angyY9mqDHI8vbWIEudjkozkSAIQ7qDosEv8BJkWTbafaHLAt6pLgGauXFNFTEsqlrgCKFl0='} 2023-11-23T04:20:46.524 INFO:teuthology.orchestra.console.smithi081:Power off 2023-11-23T04:20:46.524 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-23T04:20:46.547 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off 2023-11-23T04:20:46.547 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T04:20:46.560 INFO:teuthology.orchestra.console.smithi141:Power off 2023-11-23T04:20:46.560 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-23T04:20:46.567 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-11-23T04:20:46.580 DEBUG:teuthology.orchestra.console.smithi141:power off output: Chassis Power Control: Down/Off 2023-11-23T04:20:46.580 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T04:20:46.600 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-11-23T04:20:46.668 INFO:teuthology.orchestra.console.smithi081:Power off completed 2023-11-23T04:20:46.701 INFO:teuthology.orchestra.console.smithi141:Power off completed 2023-11-23T04:20:46.821 INFO:teuthology.lock.ops:unlocked: smithi081.front.sepia.ceph.com 2023-11-23T04:20:46.845 INFO:teuthology.lock.ops:unlocked: smithi141.front.sepia.ceph.com