2023-11-16T08:03:34.128 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-16T08:03:34.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T08:03:34.244 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe9d867a670>, signals=[15]) 2023-11-16T08:03:34.245 INFO:teuthology.lock.ops:Start node 'smithi072.front.sepia.ceph.com' reimaging 2023-11-16T08:03:34.245 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: reset os type and version on server 2023-11-16T08:03:34.245 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2023-11-16T08:03:34.267 INFO:teuthology.lock.ops:Start node 'smithi097.front.sepia.ceph.com' reimaging 2023-11-16T08:03:34.267 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: reset os type and version on server 2023-11-16T08:03:34.267 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2023-11-16T08:03:34.269 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /host {"name": "smithi072"} 2023-11-16T08:03:34.292 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /host {"name": "smithi097"} 2023-11-16T08:03:34.342 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-11-16T08:03:34.350 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-11-16T08:03:34.388 DEBUG:teuthology.provision.fog.smithi097:Requesting image smithi_centos_9.stream (ID 10) 2023-11-16T08:03:34.389 DEBUG:teuthology.provision.fog.smithi097:FOG request: PUT /host/202 {"imageID": 10} 2023-11-16T08:03:34.391 DEBUG:teuthology.provision.fog.smithi072:Requesting image smithi_centos_9.stream (ID 10) 2023-11-16T08:03:34.391 DEBUG:teuthology.provision.fog.smithi072:FOG request: PUT /host/177 {"imageID": 10} 2023-11-16T08:03:34.428 INFO:teuthology.provision.fog.smithi097:Scheduling deploy of centos 9.stream 2023-11-16T08:03:34.429 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-11-16T08:03:34.432 INFO:teuthology.provision.fog.smithi072:Scheduling deploy of centos 9.stream 2023-11-16T08:03:34.432 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-11-16T08:03:34.543 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /tasktype {"name": "deploy"} 2023-11-16T08:03:34.547 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /tasktype {"name": "deploy"} 2023-11-16T08:03:34.578 DEBUG:teuthology.provision.fog.smithi097:FOG request: POST /host/202/task {"taskTypeID": 1} 2023-11-16T08:03:34.586 DEBUG:teuthology.provision.fog.smithi072:FOG request: POST /host/177/task {"taskTypeID": 1} 2023-11-16T08:03:34.647 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-11-16T08:03:34.656 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-11-16T08:03:34.824 INFO:teuthology.orchestra.console.smithi097:Power off 2023-11-16T08:03:34.825 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-16T08:03:34.838 INFO:teuthology.orchestra.console.smithi072:Power off 2023-11-16T08:03:34.838 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-16T08:03:34.846 DEBUG:teuthology.orchestra.console.smithi097:power off output: Chassis Power Control: Down/Off 2023-11-16T08:03:34.846 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T08:03:34.861 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off 2023-11-16T08:03:34.862 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T08:03:34.870 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on 2023-11-16T08:03:34.883 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-11-16T08:03:38.875 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T08:03:38.884 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T08:03:38.984 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on 2023-11-16T08:03:38.992 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-11-16T08:03:42.986 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T08:03:42.992 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T08:03:43.095 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off 2023-11-16T08:03:43.101 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-11-16T08:03:43.196 INFO:teuthology.orchestra.console.smithi097:Power off completed 2023-11-16T08:03:43.297 INFO:teuthology.orchestra.console.smithi097:Power on 2023-11-16T08:03:43.297 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-16T08:03:43.319 DEBUG:teuthology.orchestra.console.smithi097:power on output: Chassis Power Control: Up/On 2023-11-16T08:03:43.319 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T08:03:43.339 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off 2023-11-16T08:03:47.106 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T08:03:47.215 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-11-16T08:03:47.315 INFO:teuthology.orchestra.console.smithi072:Power off completed 2023-11-16T08:03:47.340 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T08:03:47.416 INFO:teuthology.orchestra.console.smithi072:Power on 2023-11-16T08:03:47.417 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-16T08:03:47.436 DEBUG:teuthology.orchestra.console.smithi072:power on output: Chassis Power Control: Up/On 2023-11-16T08:03:47.436 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T08:03:47.448 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off 2023-11-16T08:03:47.455 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-11-16T08:03:51.453 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T08:03:51.460 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T08:03:51.562 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on 2023-11-16T08:03:51.567 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-11-16T08:03:51.663 INFO:teuthology.orchestra.console.smithi097:Power on completed 2023-11-16T08:03:51.668 INFO:teuthology.orchestra.console.smithi072:Power on completed 2023-11-16T08:03:51.764 INFO:teuthology.provision.fog.smithi097:Waiting for deploy to finish 2023-11-16T08:03:51.765 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-11-16T08:03:51.768 INFO:teuthology.provision.fog.smithi072:Waiting for deploy to finish 2023-11-16T08:03:51.768 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-11-16T08:04:06.915 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-11-16T08:04:06.916 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-11-16T08:04:22.038 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-11-16T08:04:22.039 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-11-16T08:04:37.184 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-11-16T08:04:37.193 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-11-16T08:04:52.310 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-11-16T08:04:52.349 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-11-16T08:05:07.456 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-11-16T08:05:07.478 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-11-16T08:05:22.629 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-11-16T08:05:22.630 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-11-16T08:05:37.825 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-11-16T08:05:37.827 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-11-16T08:05:52.998 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-11-16T08:05:53.000 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-11-16T08:06:08.113 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-11-16T08:06:08.133 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-11-16T08:06:23.276 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-11-16T08:06:23.302 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-11-16T08:06:38.412 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-11-16T08:06:38.414 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-11-16T08:06:53.510 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-11-16T08:06:53.511 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-11-16T08:06:53.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T08:06:56.666 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-11-16T08:07:02.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T08:07:05.754 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-11-16T08:07:08.604 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-11-16T08:07:11.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T08:07:14.811 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-11-16T08:07:20.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T08:07:23.673 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-11-16T08:07:23.898 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-11-16T08:07:29.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T08:07:32.954 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-11-16T08:07:38.739 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-11-16T08:07:38.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T08:07:38.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T08:07:41.850 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-11-16T08:07:42.010 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-11-16T08:07:47.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T08:07:48.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T08:07:50.938 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-11-16T08:07:56.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T08:07:59.994 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-11-16T08:08:06.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T08:08:09.050 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-11-16T08:08:15.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T08:08:18.142 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-11-16T08:08:24.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T08:08:27.230 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-11-16T08:08:33.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T08:08:48.022 WARNING:teuthology.provision.fog.smithi097:timed out 2023-11-16T08:08:51.578 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-11-16T08:08:54.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T08:08:54.234 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-16T08:08:54.234 DEBUG:teuthology.orchestra.run.smithi097:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-16T08:08:54.558 INFO:teuthology.provision.fog.smithi097:Node is ready 2023-11-16T08:08:54.559 DEBUG:teuthology.orchestra.run.smithi097:> hostname 2023-11-16T08:08:54.573 INFO:teuthology.orchestra.run.smithi097.stdout:smithi097.front.sepia.ceph.com 2023-11-16T08:08:54.573 DEBUG:teuthology.orchestra.run.smithi097:> grep smithi097.front.sepia.ceph.com /etc/hosts 2023-11-16T08:08:54.628 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.15.97 smithi097.front.sepia.ceph.com smithi097 2023-11-16T08:08:54.629 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname smithi097 2023-11-16T08:08:54.754 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi097.front.sepia.ceph.com/smithi097/g' /etc/hosts 2023-11-16T08:08:54.781 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/172.21.15.97/172.21.15.97/g' /etc/hosts 2023-11-16T08:08:54.848 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi097.front.sepia.ceph.com/smithi097/g' /etc/hostname 2023-11-16T08:08:54.915 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname smithi097 2023-11-16T08:08:54.981 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release 2023-11-16T08:08:55.035 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="CentOS Stream" 2023-11-16T08:08:55.035 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="9" 2023-11-16T08:08:55.035 INFO:teuthology.orchestra.run.smithi097.stdout:ID="centos" 2023-11-16T08:08:55.035 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="rhel fedora" 2023-11-16T08:08:55.035 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="9" 2023-11-16T08:08:55.036 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el9" 2023-11-16T08:08:55.036 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-16T08:08:55.036 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31" 2023-11-16T08:08:55.036 INFO:teuthology.orchestra.run.smithi097.stdout:LOGO="fedora-logo-icon" 2023-11-16T08:08:55.036 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-16T08:08:55.036 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://centos.org/" 2023-11-16T08:08:55.036 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-16T08:08:55.036 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-16T08:08:55.036 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-16T08:08:55.037 INFO:teuthology.provision.fog.smithi097:Deploy complete! 2023-11-16T08:08:55.038 DEBUG:teuthology.parallel:result is None 2023-11-16T08:08:57.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T08:09:00.635 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-11-16T08:09:06.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T08:09:09.690 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-11-16T08:09:15.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T08:09:16.121 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-16T08:09:16.121 DEBUG:teuthology.orchestra.run.smithi072:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-16T08:09:41.251 INFO:teuthology.provision.fog.smithi072:Node is ready 2023-11-16T08:09:41.251 DEBUG:teuthology.orchestra.run.smithi072:> hostname 2023-11-16T08:09:41.271 INFO:teuthology.orchestra.run.smithi072.stdout:smithi072.front.sepia.ceph.com 2023-11-16T08:09:41.271 DEBUG:teuthology.orchestra.run.smithi072:> grep smithi072.front.sepia.ceph.com /etc/hosts 2023-11-16T08:09:41.329 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72 smithi072.front.sepia.ceph.com smithi072 2023-11-16T08:09:41.329 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname smithi072 2023-11-16T08:09:41.486 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/smithi072.front.sepia.ceph.com/smithi072/g' /etc/hosts 2023-11-16T08:09:41.516 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/172.21.15.72/172.21.15.72/g' /etc/hosts 2023-11-16T08:09:41.586 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/smithi072.front.sepia.ceph.com/smithi072/g' /etc/hostname 2023-11-16T08:09:41.655 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname smithi072 2023-11-16T08:09:41.723 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2023-11-16T08:09:41.778 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="CentOS Stream" 2023-11-16T08:09:41.778 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="9" 2023-11-16T08:09:41.778 INFO:teuthology.orchestra.run.smithi072.stdout:ID="centos" 2023-11-16T08:09:41.778 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="rhel fedora" 2023-11-16T08:09:41.779 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="9" 2023-11-16T08:09:41.779 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el9" 2023-11-16T08:09:41.779 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-16T08:09:41.779 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2023-11-16T08:09:41.779 INFO:teuthology.orchestra.run.smithi072.stdout:LOGO="fedora-logo-icon" 2023-11-16T08:09:41.779 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-16T08:09:41.779 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://centos.org/" 2023-11-16T08:09:41.779 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-16T08:09:41.779 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-16T08:09:41.779 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-16T08:09:41.780 INFO:teuthology.provision.fog.smithi072:Deploy complete! 2023-11-16T08:09:41.780 DEBUG:teuthology.parallel:result is None 2023-11-16T08:09:41.945 INFO:teuthology.lock.ops:Checking smithi072.front.sepia.ceph.com 2023-11-16T08:09:41.945 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-16T08:09:41.974 INFO:teuthology.lock.ops:Checking smithi097.front.sepia.ceph.com 2023-11-16T08:09:41.975 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-16T08:09:41.999 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: set os type and version on server 2023-11-16T08:09:42.000 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-11-16T08:09:42.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T08:09:42.083 DEBUG:teuthology.orchestra.run.smithi072:> true 2023-11-16T08:09:42.152 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-11-16T08:09:42.152 DEBUG:teuthology.orchestra.run.smithi072:> uname -m 2023-11-16T08:09:42.206 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2023-11-16T08:09:42.206 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2023-11-16T08:09:42.260 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="CentOS Stream" 2023-11-16T08:09:42.260 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="9" 2023-11-16T08:09:42.260 INFO:teuthology.orchestra.run.smithi072.stdout:ID="centos" 2023-11-16T08:09:42.260 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="rhel fedora" 2023-11-16T08:09:42.260 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="9" 2023-11-16T08:09:42.261 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el9" 2023-11-16T08:09:42.261 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-16T08:09:42.261 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2023-11-16T08:09:42.261 INFO:teuthology.orchestra.run.smithi072.stdout:LOGO="fedora-logo-icon" 2023-11-16T08:09:42.261 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-16T08:09:42.261 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://centos.org/" 2023-11-16T08:09:42.261 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-16T08:09:42.261 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-16T08:09:42.261 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-16T08:09:42.262 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2023-11-16T08:09:42.366 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: set os type and version on server 2023-11-16T08:09:42.366 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-11-16T08:09:42.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T08:09:42.448 DEBUG:teuthology.orchestra.run.smithi097:> true 2023-11-16T08:09:42.616 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-11-16T08:09:42.616 DEBUG:teuthology.orchestra.run.smithi097:> uname -m 2023-11-16T08:09:42.670 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64 2023-11-16T08:09:42.670 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release 2023-11-16T08:09:42.724 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="CentOS Stream" 2023-11-16T08:09:42.724 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="9" 2023-11-16T08:09:42.724 INFO:teuthology.orchestra.run.smithi097.stdout:ID="centos" 2023-11-16T08:09:42.724 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="rhel fedora" 2023-11-16T08:09:42.724 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="9" 2023-11-16T08:09:42.724 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el9" 2023-11-16T08:09:42.725 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-16T08:09:42.725 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31" 2023-11-16T08:09:42.725 INFO:teuthology.orchestra.run.smithi097.stdout:LOGO="fedora-logo-icon" 2023-11-16T08:09:42.725 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-16T08:09:42.725 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://centos.org/" 2023-11-16T08:09:42.725 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-16T08:09:42.725 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-16T08:09:42.725 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-16T08:09:42.725 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2023-11-16T08:09:42.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T08:09:42.841 INFO:teuthology.dispatcher.supervisor:Running job 7460443 2023-11-16T08:09:42.855 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_matan@teuthology --archive /home/teuthworker/archive/matan-2023-11-16_08:02:56-crimson-rados-wip-matanb-crimson-testing-11-15-distro-crimson-smithi/7460443 --name matan-2023-11-16_08:02:56-crimson-rados-wip-matanb-crimson-testing-11-15-distro-crimson-smithi --description crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/snaps-few-objects} -- /home/teuthworker/archive/matan-2023-11-16_08:02:56-crimson-rados-wip-matanb-crimson-testing-11-15-distro-crimson-smithi/7460443/orig.config.yaml 2023-11-16T08:09:42.858 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/matan-2023-11-16_08:02:56-crimson-rados-wip-matanb-crimson-testing-11-15-distro-crimson-smithi/7460443 2023-11-16T08:09:42.858 INFO:teuthology.dispatcher.supervisor:Job PID: 4081904 2023-11-16T08:09:42.858 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-16T08:11:42.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T08:13:43.116 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T08:15:43.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T08:17:43.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T08:19:43.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T08:21:43.909 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T08:23:44.014 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T08:25:44.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T08:27:44.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T08:29:44.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T08:31:44.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T08:33:44.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T08:35:44.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T08:37:44.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T08:39:45.130 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T08:41:45.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T08:43:45.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T08:45:45.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T08:47:45.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T08:49:45.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T08:51:46.024 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T08:53:46.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T08:55:46.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T08:57:46.516 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T08:59:46.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T08:59:46.782 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-11-16T08:59:46.865 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-16T08:59:46.865 INFO:teuthology.nuke:Checking targets against current locks 2023-11-16T08:59:46.911 DEBUG:teuthology.nuke:shortname: smithi072 2023-11-16T08:59:46.911 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-16T08:59:46.930 DEBUG:teuthology.nuke:shortname: smithi097 2023-11-16T08:59:46.930 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-16T08:59:46.933 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-11-16_08:02:56-crimson-rados-wip-matanb-crimson-testing-11-15-distro-crimson-smithi/7460443', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-16 08:03:33.316780', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOrzhUG/MqIYfK4tEqKVgf1C1o24UZ3wpFMDgs+kUysJ5K2LjWCMCk5WRn/fZc2SqMErlGE2zfT4YJNTTyvE+fE='} 2023-11-16T08:59:46.955 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi097.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-11-16_08:02:56-crimson-rados-wip-matanb-crimson-testing-11-15-distro-crimson-smithi/7460443', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-16 08:03:33.315132', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC45ej4mnevjtaHqka5jrQ2vrRiUibBHknKVhftbWwY+mdx4Kfy2fdkfq7ElHdaTC5LHBqP1NzpNHe6Ciae3wCA='} 2023-11-16T08:59:46.986 INFO:teuthology.orchestra.console.smithi072:Power off 2023-11-16T08:59:46.986 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-16T08:59:47.009 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off 2023-11-16T08:59:47.009 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T08:59:47.020 INFO:teuthology.orchestra.console.smithi097:Power off 2023-11-16T08:59:47.020 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-16T08:59:47.028 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-11-16T08:59:47.041 DEBUG:teuthology.orchestra.console.smithi097:power off output: Chassis Power Control: Down/Off 2023-11-16T08:59:47.042 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T08:59:47.061 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off 2023-11-16T08:59:47.129 INFO:teuthology.orchestra.console.smithi072:Power off completed 2023-11-16T08:59:47.162 INFO:teuthology.orchestra.console.smithi097:Power off completed 2023-11-16T08:59:47.282 INFO:teuthology.lock.ops:unlocked: smithi072.front.sepia.ceph.com 2023-11-16T08:59:47.307 INFO:teuthology.lock.ops:unlocked: smithi097.front.sepia.ceph.com