2023-10-25T04:07:38.912 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-25T04:07:38.913 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T04:07:39.045 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd80ecfb670>, signals=[15]) 2023-10-25T04:07:39.046 INFO:teuthology.lock.ops:Start node 'smithi181.front.sepia.ceph.com' reimaging 2023-10-25T04:07:39.047 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: reset os type and version on server 2023-10-25T04:07:39.047 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2023-10-25T04:07:39.079 INFO:teuthology.lock.ops:Start node 'smithi194.front.sepia.ceph.com' reimaging 2023-10-25T04:07:39.079 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: reset os type and version on server 2023-10-25T04:07:39.079 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2023-10-25T04:07:39.081 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /host {"name": "smithi181"} 2023-10-25T04:07:39.104 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /host {"name": "smithi194"} 2023-10-25T04:07:39.147 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-25T04:07:39.172 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-25T04:07:39.183 DEBUG:teuthology.provision.fog.smithi181:Requesting image smithi_centos_9.stream (ID 10) 2023-10-25T04:07:39.184 DEBUG:teuthology.provision.fog.smithi181:FOG request: PUT /host/286 {"imageID": 10} 2023-10-25T04:07:39.214 DEBUG:teuthology.provision.fog.smithi194:Requesting image smithi_centos_9.stream (ID 10) 2023-10-25T04:07:39.214 DEBUG:teuthology.provision.fog.smithi194:FOG request: PUT /host/299 {"imageID": 10} 2023-10-25T04:07:39.242 INFO:teuthology.provision.fog.smithi181:Scheduling deploy of centos 9.stream 2023-10-25T04:07:39.242 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-10-25T04:07:39.253 INFO:teuthology.provision.fog.smithi194:Scheduling deploy of centos 9.stream 2023-10-25T04:07:39.253 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-25T04:07:39.296 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /tasktype {"name": "deploy"} 2023-10-25T04:07:39.306 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /tasktype {"name": "deploy"} 2023-10-25T04:07:39.328 DEBUG:teuthology.provision.fog.smithi181:FOG request: POST /host/286/task {"taskTypeID": 1} 2023-10-25T04:07:39.338 DEBUG:teuthology.provision.fog.smithi194:FOG request: POST /host/299/task {"taskTypeID": 1} 2023-10-25T04:07:39.376 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-10-25T04:07:39.404 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-25T04:07:39.481 INFO:teuthology.orchestra.console.smithi181:Power off 2023-10-25T04:07:39.482 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-25T04:07:39.496 INFO:teuthology.orchestra.console.smithi194:Power off 2023-10-25T04:07:39.496 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-25T04:07:39.504 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off 2023-10-25T04:07:39.505 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T04:07:39.518 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off 2023-10-25T04:07:39.518 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T04:07:39.527 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2023-10-25T04:07:39.540 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2023-10-25T04:07:43.530 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T04:07:43.541 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T04:07:43.642 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2023-10-25T04:07:43.651 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2023-10-25T04:07:47.646 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T04:07:47.653 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T04:07:47.756 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2023-10-25T04:07:47.765 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2023-10-25T04:07:47.866 INFO:teuthology.orchestra.console.smithi194:Power off completed 2023-10-25T04:07:47.967 INFO:teuthology.orchestra.console.smithi194:Power on 2023-10-25T04:07:47.967 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-25T04:07:47.988 DEBUG:teuthology.orchestra.console.smithi194:power on output: Chassis Power Control: Up/On 2023-10-25T04:07:47.988 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T04:07:48.009 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2023-10-25T04:07:51.758 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T04:07:51.868 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2023-10-25T04:07:51.969 INFO:teuthology.orchestra.console.smithi181:Power off completed 2023-10-25T04:07:52.011 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T04:07:52.070 INFO:teuthology.orchestra.console.smithi181:Power on 2023-10-25T04:07:52.071 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-25T04:07:52.093 DEBUG:teuthology.orchestra.console.smithi181:power on output: Chassis Power Control: Up/On 2023-10-25T04:07:52.094 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T04:07:52.116 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2023-10-25T04:07:52.120 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2023-10-25T04:07:56.120 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T04:07:56.127 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T04:07:56.229 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2023-10-25T04:07:56.236 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2023-10-25T04:07:56.334 INFO:teuthology.orchestra.console.smithi181:Power on completed 2023-10-25T04:07:56.337 INFO:teuthology.orchestra.console.smithi194:Power on completed 2023-10-25T04:07:56.437 INFO:teuthology.provision.fog.smithi181:Waiting for deploy to finish 2023-10-25T04:07:56.438 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-10-25T04:07:56.442 INFO:teuthology.provision.fog.smithi194:Waiting for deploy to finish 2023-10-25T04:07:56.442 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-25T04:08:11.514 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-10-25T04:08:11.515 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-25T04:08:26.590 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-10-25T04:08:26.592 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-25T04:08:41.658 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-25T04:08:41.660 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-10-25T04:08:56.730 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-10-25T04:08:56.732 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-25T04:09:11.799 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-10-25T04:09:11.801 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-25T04:09:26.871 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-25T04:09:26.872 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-10-25T04:09:41.942 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-25T04:09:41.944 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-10-25T04:09:57.034 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-25T04:09:57.035 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-10-25T04:10:12.098 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-25T04:10:12.100 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-10-25T04:10:27.166 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-25T04:10:27.168 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-10-25T04:10:27.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T04:10:42.233 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-25T04:10:42.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T04:10:45.758 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-10-25T04:10:51.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T04:10:54.878 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-10-25T04:11:00.858 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-10-25T04:11:00.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T04:11:03.930 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-10-25T04:11:06.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T04:11:09.918 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-10-25T04:11:09.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T04:11:12.990 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-10-25T04:11:15.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T04:11:18.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T04:11:19.006 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-10-25T04:11:22.078 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-10-25T04:11:25.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T04:11:28.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T04:11:28.090 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-10-25T04:11:34.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T04:11:37.146 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-10-25T04:11:43.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T04:12:01.534 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-10-25T04:12:07.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T04:12:10.618 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-10-25T04:12:16.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T04:12:19.674 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-10-25T04:12:25.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T04:12:26.041 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T04:12:26.042 DEBUG:teuthology.orchestra.run.smithi194:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-25T04:12:28.085 WARNING:teuthology.provision.fog.smithi181:timed out 2023-10-25T04:12:34.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T04:12:34.373 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T04:12:34.373 DEBUG:teuthology.orchestra.run.smithi181:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-25T04:12:34.679 INFO:teuthology.provision.fog.smithi181:Node is ready 2023-10-25T04:12:34.680 DEBUG:teuthology.orchestra.run.smithi181:> hostname 2023-10-25T04:12:34.735 INFO:teuthology.orchestra.run.smithi181.stdout:smithi181.front.sepia.ceph.com 2023-10-25T04:12:34.735 DEBUG:teuthology.orchestra.run.smithi181:> grep smithi181.front.sepia.ceph.com /etc/hosts 2023-10-25T04:12:34.790 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.181 smithi181.front.sepia.ceph.com smithi181 2023-10-25T04:12:34.790 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181 2023-10-25T04:12:34.897 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181.front.sepia.ceph.com/smithi181/g' /etc/hosts 2023-10-25T04:12:34.924 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/172.21.15.181/172.21.15.181/g' /etc/hosts 2023-10-25T04:12:34.992 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181.front.sepia.ceph.com/smithi181/g' /etc/hostname 2023-10-25T04:12:35.059 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181 2023-10-25T04:12:35.125 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2023-10-25T04:12:35.180 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream" 2023-10-25T04:12:35.180 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="9" 2023-10-25T04:12:35.180 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos" 2023-10-25T04:12:35.181 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora" 2023-10-25T04:12:35.181 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="9" 2023-10-25T04:12:35.181 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el9" 2023-10-25T04:12:35.182 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-25T04:12:35.182 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2023-10-25T04:12:35.182 INFO:teuthology.orchestra.run.smithi181.stdout:LOGO="fedora-logo-icon" 2023-10-25T04:12:35.183 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-25T04:12:35.183 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/" 2023-10-25T04:12:35.183 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-25T04:12:35.184 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-25T04:12:35.184 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-25T04:12:35.185 INFO:teuthology.provision.fog.smithi181:Deploy complete! 2023-10-25T04:12:35.186 DEBUG:teuthology.parallel:result is None 2023-10-25T04:12:41.335 INFO:teuthology.provision.fog.smithi194:Node is ready 2023-10-25T04:12:41.336 DEBUG:teuthology.orchestra.run.smithi194:> hostname 2023-10-25T04:12:41.354 INFO:teuthology.orchestra.run.smithi194.stdout:smithi046 2023-10-25T04:12:41.354 DEBUG:teuthology.orchestra.run.smithi194:> grep smithi046 /etc/hosts 2023-10-25T04:12:41.411 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2023-10-25T04:12:41.412 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194 2023-10-25T04:12:41.546 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi046/smithi194/g' /etc/hosts 2023-10-25T04:12:41.577 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/172.21.15.46/172.21.15.194/g' /etc/hosts 2023-10-25T04:12:41.647 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi046/smithi194/g' /etc/hostname 2023-10-25T04:12:41.715 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194 2023-10-25T04:12:41.781 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2023-10-25T04:12:41.836 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream" 2023-10-25T04:12:41.837 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="9" 2023-10-25T04:12:41.837 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos" 2023-10-25T04:12:41.837 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora" 2023-10-25T04:12:41.837 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="9" 2023-10-25T04:12:41.838 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el9" 2023-10-25T04:12:41.838 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-25T04:12:41.838 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2023-10-25T04:12:41.838 INFO:teuthology.orchestra.run.smithi194.stdout:LOGO="fedora-logo-icon" 2023-10-25T04:12:41.838 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-25T04:12:41.839 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/" 2023-10-25T04:12:41.839 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-25T04:12:41.839 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-25T04:12:41.839 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-25T04:12:41.839 INFO:teuthology.provision.fog.smithi194:Deploy complete! 2023-10-25T04:12:41.840 DEBUG:teuthology.parallel:result is None 2023-10-25T04:12:42.007 INFO:teuthology.lock.ops:Checking smithi181.front.sepia.ceph.com 2023-10-25T04:12:42.008 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-25T04:12:42.035 INFO:teuthology.lock.ops:Checking smithi194.front.sepia.ceph.com 2023-10-25T04:12:42.035 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-25T04:12:42.061 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: set os type and version on server 2023-10-25T04:12:42.061 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2023-10-25T04:12:42.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T04:12:42.144 DEBUG:teuthology.orchestra.run.smithi181:> true 2023-10-25T04:12:42.210 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2023-10-25T04:12:42.210 DEBUG:teuthology.orchestra.run.smithi181:> uname -m 2023-10-25T04:12:42.266 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2023-10-25T04:12:42.266 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2023-10-25T04:12:42.321 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream" 2023-10-25T04:12:42.322 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="9" 2023-10-25T04:12:42.322 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos" 2023-10-25T04:12:42.322 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora" 2023-10-25T04:12:42.322 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="9" 2023-10-25T04:12:42.323 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el9" 2023-10-25T04:12:42.323 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-25T04:12:42.323 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2023-10-25T04:12:42.323 INFO:teuthology.orchestra.run.smithi181.stdout:LOGO="fedora-logo-icon" 2023-10-25T04:12:42.324 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-25T04:12:42.324 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/" 2023-10-25T04:12:42.324 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-25T04:12:42.324 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-25T04:12:42.324 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-25T04:12:42.325 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2023-10-25T04:12:42.343 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: set os type and version on server 2023-10-25T04:12:42.343 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2023-10-25T04:12:42.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T04:12:42.424 DEBUG:teuthology.orchestra.run.smithi194:> true 2023-10-25T04:12:42.489 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2023-10-25T04:12:42.489 DEBUG:teuthology.orchestra.run.smithi194:> uname -m 2023-10-25T04:12:42.543 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2023-10-25T04:12:42.544 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2023-10-25T04:12:42.598 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream" 2023-10-25T04:12:42.598 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="9" 2023-10-25T04:12:42.599 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos" 2023-10-25T04:12:42.599 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora" 2023-10-25T04:12:42.599 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="9" 2023-10-25T04:12:42.599 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el9" 2023-10-25T04:12:42.599 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-25T04:12:42.600 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2023-10-25T04:12:42.600 INFO:teuthology.orchestra.run.smithi194.stdout:LOGO="fedora-logo-icon" 2023-10-25T04:12:42.600 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-25T04:12:42.600 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/" 2023-10-25T04:12:42.600 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-25T04:12:42.601 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-25T04:12:42.601 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-25T04:12:42.601 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2023-10-25T04:12:42.626 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T04:12:42.713 INFO:teuthology.dispatcher.supervisor:Running job 7435615 2023-10-25T04:12:42.714 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-24_00:11:54-rados-wip-yuri4-testing-2023-10-23-0903-distro-default-smithi/7435615 --name yuriw-2023-10-24_00:11:54-rados-wip-yuri4-testing-2023-10-23-0903-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} -- /home/teuthworker/archive/yuriw-2023-10-24_00:11:54-rados-wip-yuri4-testing-2023-10-23-0903-distro-default-smithi/7435615/orig.config.yaml 2023-10-25T04:12:42.717 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-24_00:11:54-rados-wip-yuri4-testing-2023-10-23-0903-distro-default-smithi/7435615 2023-10-25T04:12:42.718 INFO:teuthology.dispatcher.supervisor:Job PID: 1493925 2023-10-25T04:12:42.718 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-25T04:14:42.818 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T04:16:42.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T04:18:43.168 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T04:20:43.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T04:22:43.520 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T04:24:43.698 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T04:26:43.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T04:28:44.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T04:30:44.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T04:32:44.368 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T04:34:44.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T04:36:44.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T04:38:44.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T04:40:45.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T04:42:45.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T04:44:45.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T04:46:45.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T04:48:45.709 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T04:50:45.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T04:52:45.958 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T04:54:46.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T04:56:46.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T04:58:46.438 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T05:00:46.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T05:02:46.778 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T05:04:46.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T05:06:47.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T05:08:47.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T05:10:47.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T05:12:47.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T05:14:47.816 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T05:16:47.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T05:18:48.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T05:20:48.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T05:22:48.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T05:24:48.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T05:26:48.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T05:28:48.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T05:30:49.168 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T05:32:49.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T05:34:49.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T05:36:49.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T05:38:49.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T05:40:50.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T05:42:50.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T05:44:50.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T05:46:50.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T05:48:50.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T05:50:50.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T05:52:51.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T05:54:51.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T05:56:51.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T05:58:51.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T05:58:51.577 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-25T05:58:51.755 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-25T05:58:51.756 INFO:teuthology.nuke:Checking targets against current locks 2023-10-25T05:58:51.804 DEBUG:teuthology.nuke:shortname: smithi181 2023-10-25T05:58:51.804 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-25T05:58:51.831 DEBUG:teuthology.nuke:shortname: smithi194 2023-10-25T05:58:51.832 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-25T05:58:51.835 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-24_00:11:54-rados-wip-yuri4-testing-2023-10-23-0903-distro-default-smithi/7435615', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-25 04:07:38.113914', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHUfoeqxPR/A3edOoJiyAYqKPL/htacXQDlmMj8oW2HX5njA+hi1wwHyoTyTzaUDT50jE7zG1IgP09zpsx3FLPo='} 2023-10-25T05:58:51.860 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-24_00:11:54-rados-wip-yuri4-testing-2023-10-23-0903-distro-default-smithi/7435615', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-25 04:07:38.112413', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKVIT5r6g+OUeW07a3FdzG02fQOVpAugR1CESS/5uZyfUp8w7u/4BpBS2xVNmtd+FMkkDCkKfJGJmOJZCB0+Bpw='} 2023-10-25T05:58:51.893 INFO:teuthology.orchestra.console.smithi181:Power off 2023-10-25T05:58:51.893 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-25T05:58:51.917 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off 2023-10-25T05:58:51.918 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T05:58:51.931 INFO:teuthology.orchestra.console.smithi194:Power off 2023-10-25T05:58:51.932 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-25T05:58:51.943 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2023-10-25T05:58:51.952 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off 2023-10-25T05:58:51.952 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T05:58:51.973 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2023-10-25T05:58:52.044 INFO:teuthology.orchestra.console.smithi181:Power off completed 2023-10-25T05:58:52.075 INFO:teuthology.orchestra.console.smithi194:Power off completed 2023-10-25T05:58:52.193 INFO:teuthology.lock.ops:unlocked: smithi181.front.sepia.ceph.com 2023-10-25T05:58:52.217 INFO:teuthology.lock.ops:unlocked: smithi194.front.sepia.ceph.com