2023-08-25T09:26:13.517 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-25T09:26:13.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T09:26:13.657 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f72707ccee0>, signals=[15]) 2023-08-25T09:26:13.658 INFO:teuthology.lock.ops:Start node 'smithi071.front.sepia.ceph.com' reimaging 2023-08-25T09:26:13.659 INFO:teuthology.lock.ops:Updating [smithi071.front.sepia.ceph.com]: reset os type and version on server 2023-08-25T09:26:13.659 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2023-08-25T09:26:13.683 INFO:teuthology.lock.ops:Start node 'smithi164.front.sepia.ceph.com' reimaging 2023-08-25T09:26:13.683 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: reset os type and version on server 2023-08-25T09:26:13.683 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2023-08-25T09:26:13.685 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /host {"name": "smithi071"} 2023-08-25T09:26:13.716 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /host {"name": "smithi164"} 2023-08-25T09:26:13.754 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-25T09:26:13.787 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-25T09:26:13.797 DEBUG:teuthology.provision.fog.smithi071:Requesting image smithi_centos_9.stream (ID 10) 2023-08-25T09:26:13.797 DEBUG:teuthology.provision.fog.smithi071:FOG request: PUT /host/176 {"imageID": 10} 2023-08-25T09:26:13.839 DEBUG:teuthology.provision.fog.smithi164:Requesting image smithi_centos_9.stream (ID 10) 2023-08-25T09:26:13.839 DEBUG:teuthology.provision.fog.smithi164:FOG request: PUT /host/269 {"imageID": 10} 2023-08-25T09:26:13.843 INFO:teuthology.provision.fog.smithi071:Scheduling deploy of centos 9.stream 2023-08-25T09:26:13.844 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-08-25T09:26:13.892 INFO:teuthology.provision.fog.smithi164:Scheduling deploy of centos 9.stream 2023-08-25T09:26:13.893 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-08-25T09:26:13.916 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /tasktype {"name": "deploy"} 2023-08-25T09:26:13.952 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /tasktype {"name": "deploy"} 2023-08-25T09:26:13.956 DEBUG:teuthology.provision.fog.smithi071:FOG request: POST /host/176/task {"taskTypeID": 1} 2023-08-25T09:26:13.990 DEBUG:teuthology.provision.fog.smithi164:FOG request: POST /host/269/task {"taskTypeID": 1} 2023-08-25T09:26:14.027 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-08-25T09:26:14.046 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-08-25T09:26:14.133 INFO:teuthology.orchestra.console.smithi071:Power off 2023-08-25T09:26:14.134 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-25T09:26:14.147 INFO:teuthology.orchestra.console.smithi164:Power off 2023-08-25T09:26:14.148 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-25T09:26:14.157 DEBUG:teuthology.orchestra.console.smithi071:power off output: Chassis Power Control: Down/Off 2023-08-25T09:26:14.158 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T09:26:14.170 DEBUG:teuthology.orchestra.console.smithi164:power off output: Chassis Power Control: Down/Off 2023-08-25T09:26:14.170 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T09:26:14.177 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2023-08-25T09:26:14.190 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2023-08-25T09:26:18.180 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T09:26:18.191 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T09:26:18.290 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2023-08-25T09:26:18.303 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2023-08-25T09:26:22.296 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T09:26:22.305 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T09:26:22.406 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off 2023-08-25T09:26:22.416 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2023-08-25T09:26:22.507 INFO:teuthology.orchestra.console.smithi071:Power off completed 2023-08-25T09:26:22.517 INFO:teuthology.orchestra.console.smithi164:Power off completed 2023-08-25T09:26:22.609 INFO:teuthology.orchestra.console.smithi071:Power on 2023-08-25T09:26:22.609 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-25T09:26:22.618 INFO:teuthology.orchestra.console.smithi164:Power on 2023-08-25T09:26:22.619 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-25T09:26:22.630 DEBUG:teuthology.orchestra.console.smithi071:power on output: Chassis Power Control: Up/On 2023-08-25T09:26:22.630 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T09:26:22.642 DEBUG:teuthology.orchestra.console.smithi164:power on output: Chassis Power Control: Up/On 2023-08-25T09:26:22.643 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T09:26:22.653 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off 2023-08-25T09:26:22.665 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2023-08-25T09:26:26.656 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T09:26:26.666 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T09:26:26.767 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off 2023-08-25T09:26:26.777 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2023-08-25T09:26:26.878 INFO:teuthology.orchestra.console.smithi164:Power on completed 2023-08-25T09:26:26.979 INFO:teuthology.provision.fog.smithi164:Waiting for deploy to finish 2023-08-25T09:26:26.979 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-08-25T09:26:30.772 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T09:26:30.990 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2023-08-25T09:26:31.091 INFO:teuthology.orchestra.console.smithi071:Power on completed 2023-08-25T09:26:31.192 INFO:teuthology.provision.fog.smithi071:Waiting for deploy to finish 2023-08-25T09:26:31.192 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-08-25T09:26:42.056 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-08-25T09:26:46.270 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-08-25T09:26:57.132 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-08-25T09:27:01.332 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-08-25T09:27:12.204 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-08-25T09:27:16.396 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-08-25T09:27:27.272 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-08-25T09:27:31.452 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-08-25T09:27:42.345 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-08-25T09:27:46.516 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-08-25T09:27:57.416 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-08-25T09:28:01.588 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-08-25T09:28:12.498 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-08-25T09:28:16.652 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-08-25T09:28:27.576 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-08-25T09:28:31.712 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-08-25T09:28:42.656 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-08-25T09:28:46.772 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-08-25T09:28:57.740 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-08-25T09:29:01.844 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-08-25T09:29:12.821 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-08-25T09:29:12.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T09:29:15.952 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-08-25T09:29:16.904 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-08-25T09:29:21.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T09:29:25.012 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-08-25T09:29:31.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T09:29:31.964 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-08-25T09:29:32.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T09:29:34.100 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-08-25T09:29:35.088 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-08-25T09:29:40.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T09:29:41.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T09:29:43.184 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-08-25T09:29:44.145 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-08-25T09:29:49.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T09:29:50.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T09:29:52.244 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-08-25T09:29:53.200 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-08-25T09:29:58.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T09:29:59.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T09:30:01.328 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-08-25T09:30:02.256 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-08-25T09:30:07.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T09:30:08.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T09:30:11.312 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-08-25T09:30:17.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T09:30:20.368 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-08-25T09:30:25.776 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-08-25T09:30:26.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T09:30:31.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T09:30:34.836 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-08-25T09:30:40.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T09:30:42.365 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-25T09:30:42.366 DEBUG:teuthology.orchestra.run.smithi164:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-25T09:31:07.730 INFO:teuthology.provision.fog.smithi164:Node is ready 2023-08-25T09:31:07.730 DEBUG:teuthology.orchestra.run.smithi164:> hostname 2023-08-25T09:31:07.750 INFO:teuthology.orchestra.run.smithi164.stdout:smithi164.front.sepia.ceph.com 2023-08-25T09:31:07.750 DEBUG:teuthology.orchestra.run.smithi164:> grep smithi164.front.sepia.ceph.com /etc/hosts 2023-08-25T09:31:07.807 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164 smithi164.front.sepia.ceph.com smithi164 2023-08-25T09:31:07.808 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname smithi164 2023-08-25T09:31:07.923 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164.front.sepia.ceph.com/smithi164/g' /etc/hosts 2023-08-25T09:31:07.954 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/172.21.15.164/172.21.15.164/g' /etc/hosts 2023-08-25T09:31:08.022 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164.front.sepia.ceph.com/smithi164/g' /etc/hostname 2023-08-25T09:31:08.091 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname smithi164 2023-08-25T09:31:08.159 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2023-08-25T09:31:08.213 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="CentOS Stream" 2023-08-25T09:31:08.213 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="9" 2023-08-25T09:31:08.214 INFO:teuthology.orchestra.run.smithi164.stdout:ID="centos" 2023-08-25T09:31:08.214 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="rhel fedora" 2023-08-25T09:31:08.214 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="9" 2023-08-25T09:31:08.214 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el9" 2023-08-25T09:31:08.214 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-25T09:31:08.214 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31" 2023-08-25T09:31:08.214 INFO:teuthology.orchestra.run.smithi164.stdout:LOGO="fedora-logo-icon" 2023-08-25T09:31:08.214 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-25T09:31:08.215 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://centos.org/" 2023-08-25T09:31:08.215 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-25T09:31:08.215 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-25T09:31:08.215 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-25T09:31:08.216 INFO:teuthology.provision.fog.smithi164:Deploy complete! 2023-08-25T09:31:08.217 DEBUG:teuthology.parallel:result is None 2023-08-25T09:31:26.372 WARNING:teuthology.provision.fog.smithi071:timed out 2023-08-25T09:31:32.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T09:31:32.571 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-25T09:31:32.571 DEBUG:teuthology.orchestra.run.smithi071:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-25T09:31:32.926 INFO:teuthology.provision.fog.smithi071:Node is ready 2023-08-25T09:31:32.926 DEBUG:teuthology.orchestra.run.smithi071:> hostname 2023-08-25T09:31:32.941 INFO:teuthology.orchestra.run.smithi071.stdout:smithi071.front.sepia.ceph.com 2023-08-25T09:31:32.942 DEBUG:teuthology.orchestra.run.smithi071:> grep smithi071.front.sepia.ceph.com /etc/hosts 2023-08-25T09:31:32.997 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71 smithi071.front.sepia.ceph.com smithi071 2023-08-25T09:31:32.997 DEBUG:teuthology.orchestra.run.smithi071:> sudo hostname smithi071 2023-08-25T09:31:33.119 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/smithi071.front.sepia.ceph.com/smithi071/g' /etc/hosts 2023-08-25T09:31:33.148 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/172.21.15.71/172.21.15.71/g' /etc/hosts 2023-08-25T09:31:33.215 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/smithi071.front.sepia.ceph.com/smithi071/g' /etc/hostname 2023-08-25T09:31:33.282 DEBUG:teuthology.orchestra.run.smithi071:> sudo hostname smithi071 2023-08-25T09:31:33.348 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2023-08-25T09:31:33.403 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream" 2023-08-25T09:31:33.403 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="9" 2023-08-25T09:31:33.403 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos" 2023-08-25T09:31:33.403 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora" 2023-08-25T09:31:33.404 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="9" 2023-08-25T09:31:33.404 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el9" 2023-08-25T09:31:33.404 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-25T09:31:33.404 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2023-08-25T09:31:33.404 INFO:teuthology.orchestra.run.smithi071.stdout:LOGO="fedora-logo-icon" 2023-08-25T09:31:33.404 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-25T09:31:33.405 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/" 2023-08-25T09:31:33.405 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-25T09:31:33.405 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-25T09:31:33.405 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-25T09:31:33.406 INFO:teuthology.provision.fog.smithi071:Deploy complete! 2023-08-25T09:31:33.406 DEBUG:teuthology.parallel:result is None 2023-08-25T09:31:33.577 INFO:teuthology.lock.ops:Checking smithi071.front.sepia.ceph.com 2023-08-25T09:31:33.578 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-25T09:31:33.603 INFO:teuthology.lock.ops:Checking smithi164.front.sepia.ceph.com 2023-08-25T09:31:33.603 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-25T09:31:33.620 INFO:teuthology.lock.ops:Updating [smithi071.front.sepia.ceph.com]: set os type and version on server 2023-08-25T09:31:33.621 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2023-08-25T09:31:33.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T09:31:33.705 DEBUG:teuthology.orchestra.run.smithi071:> true 2023-08-25T09:31:33.770 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2023-08-25T09:31:33.770 DEBUG:teuthology.orchestra.run.smithi071:> uname -m 2023-08-25T09:31:33.826 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2023-08-25T09:31:33.827 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2023-08-25T09:31:33.881 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream" 2023-08-25T09:31:33.881 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="9" 2023-08-25T09:31:33.881 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos" 2023-08-25T09:31:33.882 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora" 2023-08-25T09:31:33.882 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="9" 2023-08-25T09:31:33.882 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el9" 2023-08-25T09:31:33.882 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-25T09:31:33.882 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2023-08-25T09:31:33.882 INFO:teuthology.orchestra.run.smithi071.stdout:LOGO="fedora-logo-icon" 2023-08-25T09:31:33.883 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-25T09:31:33.883 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/" 2023-08-25T09:31:33.883 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-25T09:31:33.883 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-25T09:31:33.883 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-25T09:31:33.884 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2023-08-25T09:31:33.903 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: set os type and version on server 2023-08-25T09:31:33.903 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2023-08-25T09:31:33.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T09:31:33.988 DEBUG:teuthology.orchestra.run.smithi164:> true 2023-08-25T09:31:34.058 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2023-08-25T09:31:34.059 DEBUG:teuthology.orchestra.run.smithi164:> uname -m 2023-08-25T09:31:34.114 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64 2023-08-25T09:31:34.115 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2023-08-25T09:31:34.171 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="CentOS Stream" 2023-08-25T09:31:34.172 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="9" 2023-08-25T09:31:34.172 INFO:teuthology.orchestra.run.smithi164.stdout:ID="centos" 2023-08-25T09:31:34.172 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="rhel fedora" 2023-08-25T09:31:34.172 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="9" 2023-08-25T09:31:34.172 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el9" 2023-08-25T09:31:34.172 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-25T09:31:34.173 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31" 2023-08-25T09:31:34.173 INFO:teuthology.orchestra.run.smithi164.stdout:LOGO="fedora-logo-icon" 2023-08-25T09:31:34.173 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-25T09:31:34.173 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://centos.org/" 2023-08-25T09:31:34.173 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-25T09:31:34.173 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-25T09:31:34.173 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-25T09:31:34.174 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2023-08-25T09:31:34.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T09:31:34.295 INFO:teuthology.dispatcher.supervisor:Running job 7379327 2023-08-25T09:31:34.295 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-08-25_06:38:25-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379327 --name rishabh-2023-08-25_06:38:25-fs-wip-rishabh-2023aug3-b5-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mds 2-workunit/fs/snaps}} -- /home/teuthworker/archive/rishabh-2023-08-25_06:38:25-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379327/orig.config.yaml 2023-08-25T09:31:34.300 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-08-25_06:38:25-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379327 2023-08-25T09:31:34.301 INFO:teuthology.dispatcher.supervisor:Job PID: 16434 2023-08-25T09:31:34.301 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-25T09:33:34.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T09:35:34.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T09:37:34.754 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T09:39:34.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T09:41:35.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T09:43:36.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T09:45:36.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T09:47:36.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T09:49:36.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T09:51:36.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T09:53:37.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T09:55:37.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T09:57:37.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T09:59:37.549 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T10:01:37.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T10:03:37.877 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T10:05:38.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T10:07:38.217 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T10:09:38.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T10:09:38.452 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-25T10:09:38.645 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-25T10:09:38.646 INFO:teuthology.nuke:Checking targets against current locks 2023-08-25T10:09:38.695 DEBUG:teuthology.nuke:shortname: smithi071 2023-08-25T10:09:38.695 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-25T10:09:38.714 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi071.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-25_06:38:25-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379327', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-25 09:26:12.730620', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGK5rZRhD9wTEpAxb8Xg5U6DSQJKyvneMkKBiMVKngkXaBc4/SOTGnZ0oZgIeugfCUb2mfTjamoEClErqT06Dgg='} 2023-08-25T10:09:38.716 DEBUG:teuthology.nuke:shortname: smithi164 2023-08-25T10:09:38.717 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-25T10:09:38.739 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-25_06:38:25-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379327', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-25 09:26:12.732064', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPKTJ01r1w1pvwRpAElBNol36OwGpEbAZ+Te5ggmgsQD6Q7jm4EX3vtmJk4+R/SANSZWTU3UzOFyPs4IP3cYEwg='} 2023-08-25T10:09:38.758 INFO:teuthology.orchestra.console.smithi071:Power off 2023-08-25T10:09:38.759 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-25T10:09:38.779 DEBUG:teuthology.orchestra.console.smithi071:power off output: Chassis Power Control: Down/Off 2023-08-25T10:09:38.780 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T10:09:38.799 INFO:teuthology.orchestra.console.smithi164:Power off 2023-08-25T10:09:38.800 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-25T10:09:38.812 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off 2023-08-25T10:09:38.824 DEBUG:teuthology.orchestra.console.smithi164:power off output: Chassis Power Control: Down/Off 2023-08-25T10:09:38.824 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T10:09:38.844 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2023-08-25T10:09:38.913 INFO:teuthology.orchestra.console.smithi071:Power off completed 2023-08-25T10:09:38.946 INFO:teuthology.orchestra.console.smithi164:Power off completed 2023-08-25T10:09:39.074 INFO:teuthology.lock.ops:unlocked: smithi071.front.sepia.ceph.com 2023-08-25T10:09:39.098 INFO:teuthology.lock.ops:unlocked: smithi164.front.sepia.ceph.com