2023-08-11T10:50:17.999 INFO:root:teuthology version: 0.0.1.dev181+g7fda959 2023-08-11T10:50:18.001 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T10:50:18.178 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa421ba8ee0>, signals=[15]) 2023-08-11T10:50:18.179 INFO:teuthology.lock.ops:Start node 'smithi172.front.sepia.ceph.com' reimaging 2023-08-11T10:50:18.180 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: reset os type and version on server 2023-08-11T10:50:18.180 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2023-08-11T10:50:18.221 INFO:teuthology.lock.ops:Start node 'smithi203.front.sepia.ceph.com' reimaging 2023-08-11T10:50:18.222 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: reset os type and version on server 2023-08-11T10:50:18.222 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2023-08-11T10:50:18.223 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /host {"name": "smithi172"} 2023-08-11T10:50:18.248 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /host {"name": "smithi203"} 2023-08-11T10:50:18.300 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-11T10:50:18.318 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-11T10:50:18.350 DEBUG:teuthology.provision.fog.smithi172:Requesting image smithi_centos_9.stream (ID 10) 2023-08-11T10:50:18.351 DEBUG:teuthology.provision.fog.smithi172:FOG request: PUT /host/277 {"imageID": 10} 2023-08-11T10:50:18.366 DEBUG:teuthology.provision.fog.smithi203:Requesting image smithi_centos_9.stream (ID 10) 2023-08-11T10:50:18.366 DEBUG:teuthology.provision.fog.smithi203:FOG request: PUT /host/307 {"imageID": 10} 2023-08-11T10:50:18.403 INFO:teuthology.provision.fog.smithi172:Scheduling deploy of centos 9.stream 2023-08-11T10:50:18.403 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-08-11T10:50:18.416 INFO:teuthology.provision.fog.smithi203:Scheduling deploy of centos 9.stream 2023-08-11T10:50:18.416 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-11T10:50:18.458 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /tasktype {"name": "deploy"} 2023-08-11T10:50:18.466 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /tasktype {"name": "deploy"} 2023-08-11T10:50:18.511 DEBUG:teuthology.provision.fog.smithi172:FOG request: POST /host/277/task {"taskTypeID": 1} 2023-08-11T10:50:18.515 DEBUG:teuthology.provision.fog.smithi203:FOG request: POST /host/307/task {"taskTypeID": 1} 2023-08-11T10:50:18.811 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-08-11T10:50:18.815 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-11T10:50:18.908 INFO:teuthology.orchestra.console.smithi203:Power off 2023-08-11T10:50:18.909 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-11T10:50:18.925 INFO:teuthology.orchestra.console.smithi172:Power off 2023-08-11T10:50:18.925 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-11T10:50:18.938 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off 2023-08-11T10:50:18.939 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T10:50:18.949 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off 2023-08-11T10:50:18.950 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T10:50:18.963 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2023-08-11T10:50:18.972 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2023-08-11T10:50:22.969 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T10:50:22.980 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T10:50:23.084 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2023-08-11T10:50:23.095 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2023-08-11T10:50:27.088 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T10:50:27.100 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T10:50:27.202 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2023-08-11T10:50:27.212 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2023-08-11T10:50:27.303 INFO:teuthology.orchestra.console.smithi203:Power off completed 2023-08-11T10:50:27.314 INFO:teuthology.orchestra.console.smithi172:Power off completed 2023-08-11T10:50:27.404 INFO:teuthology.orchestra.console.smithi203:Power on 2023-08-11T10:50:27.405 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-11T10:50:27.415 INFO:teuthology.orchestra.console.smithi172:Power on 2023-08-11T10:50:27.416 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-11T10:50:27.425 DEBUG:teuthology.orchestra.console.smithi203:power on output: Chassis Power Control: Up/On 2023-08-11T10:50:27.426 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T10:50:27.437 DEBUG:teuthology.orchestra.console.smithi172:power on output: Chassis Power Control: Up/On 2023-08-11T10:50:27.438 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T10:50:27.447 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2023-08-11T10:50:27.462 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2023-08-11T10:50:31.452 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T10:50:31.464 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T10:50:31.562 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2023-08-11T10:50:31.574 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2023-08-11T10:50:35.564 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T10:50:35.576 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T10:50:35.687 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2023-08-11T10:50:35.777 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2023-08-11T10:50:35.788 INFO:teuthology.orchestra.console.smithi172:Power on completed 2023-08-11T10:50:35.878 INFO:teuthology.orchestra.console.smithi203:Power on completed 2023-08-11T10:50:35.890 INFO:teuthology.provision.fog.smithi172:Waiting for deploy to finish 2023-08-11T10:50:35.890 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-08-11T10:50:35.981 INFO:teuthology.provision.fog.smithi203:Waiting for deploy to finish 2023-08-11T10:50:35.981 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-11T10:50:50.964 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-08-11T10:50:51.039 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-11T10:51:06.032 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-08-11T10:51:06.094 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-11T10:51:21.100 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-08-11T10:51:21.141 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-11T10:51:36.164 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-08-11T10:51:36.192 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-11T10:51:51.227 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-08-11T10:51:51.241 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-11T10:52:06.300 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-08-11T10:52:06.302 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-11T10:52:21.372 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-08-11T10:52:21.374 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-11T10:52:36.436 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-08-11T10:52:36.439 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-11T10:52:51.512 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-11T10:52:51.515 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-08-11T10:53:06.592 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-08-11T10:53:06.594 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-11T10:53:21.661 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-11T10:53:21.662 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-08-11T10:53:21.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T10:53:21.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T10:53:24.784 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-08-11T10:53:24.788 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-08-11T10:53:30.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T10:53:30.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T10:53:33.844 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-08-11T10:53:33.845 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-08-11T10:53:39.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T10:53:39.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T10:53:42.928 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-08-11T10:53:42.929 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-08-11T10:53:48.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T10:53:48.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T10:53:51.984 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-08-11T10:53:52.016 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-08-11T10:53:57.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T10:53:58.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T10:54:01.040 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-08-11T10:54:01.072 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-08-11T10:54:07.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T10:54:07.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T10:54:10.096 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-08-11T10:54:10.128 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-08-11T10:54:16.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T10:54:16.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T10:54:19.152 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-08-11T10:54:19.188 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-08-11T10:54:25.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T10:54:25.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T10:54:28.208 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-08-11T10:54:34.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T10:55:25.240 WARNING:teuthology.provision.fog.smithi203:timed out 2023-08-11T10:55:31.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T10:55:31.586 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-11T10:55:31.587 DEBUG:teuthology.orchestra.run.smithi203:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-11T10:55:31.937 INFO:teuthology.provision.fog.smithi203:Node is ready 2023-08-11T10:55:31.937 DEBUG:teuthology.orchestra.run.smithi203:> hostname 2023-08-11T10:55:31.952 INFO:teuthology.orchestra.run.smithi203.stdout:smithi203.front.sepia.ceph.com 2023-08-11T10:55:31.952 DEBUG:teuthology.orchestra.run.smithi203:> grep smithi203.front.sepia.ceph.com /etc/hosts 2023-08-11T10:55:32.007 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.15.203 smithi203.front.sepia.ceph.com smithi203 2023-08-11T10:55:32.008 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203 2023-08-11T10:55:32.127 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hosts 2023-08-11T10:55:32.155 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/172.21.15.203/172.21.15.203/g' /etc/hosts 2023-08-11T10:55:32.224 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hostname 2023-08-11T10:55:32.293 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203 2023-08-11T10:55:32.358 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2023-08-11T10:55:32.412 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream" 2023-08-11T10:55:32.413 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="9" 2023-08-11T10:55:32.413 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos" 2023-08-11T10:55:32.413 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora" 2023-08-11T10:55:32.413 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="9" 2023-08-11T10:55:32.413 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el9" 2023-08-11T10:55:32.413 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-11T10:55:32.413 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31" 2023-08-11T10:55:32.414 INFO:teuthology.orchestra.run.smithi203.stdout:LOGO="fedora-logo-icon" 2023-08-11T10:55:32.414 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-11T10:55:32.414 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/" 2023-08-11T10:55:32.414 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-11T10:55:32.414 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-11T10:55:32.414 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-11T10:55:32.415 INFO:teuthology.provision.fog.smithi203:Deploy complete! 2023-08-11T10:55:32.416 DEBUG:teuthology.parallel:result is None 2023-08-11T10:55:34.215 WARNING:teuthology.provision.fog.smithi172:timed out 2023-08-11T10:55:40.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T10:55:40.488 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-11T10:55:40.489 DEBUG:teuthology.orchestra.run.smithi172:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-11T10:55:40.771 INFO:teuthology.provision.fog.smithi172:Node is ready 2023-08-11T10:55:40.771 DEBUG:teuthology.orchestra.run.smithi172:> hostname 2023-08-11T10:55:40.786 INFO:teuthology.orchestra.run.smithi172.stdout:smithi172.front.sepia.ceph.com 2023-08-11T10:55:40.787 DEBUG:teuthology.orchestra.run.smithi172:> grep smithi172.front.sepia.ceph.com /etc/hosts 2023-08-11T10:55:40.841 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.15.172 smithi172.front.sepia.ceph.com smithi172 2023-08-11T10:55:40.841 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172 2023-08-11T10:55:40.981 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi172.front.sepia.ceph.com/smithi172/g' /etc/hosts 2023-08-11T10:55:41.010 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/172.21.15.172/172.21.15.172/g' /etc/hosts 2023-08-11T10:55:41.078 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi172.front.sepia.ceph.com/smithi172/g' /etc/hostname 2023-08-11T10:55:41.146 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172 2023-08-11T10:55:41.213 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2023-08-11T10:55:41.267 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2023-08-11T10:55:41.268 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="9" 2023-08-11T10:55:41.268 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2023-08-11T10:55:41.268 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2023-08-11T10:55:41.268 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="9" 2023-08-11T10:55:41.268 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el9" 2023-08-11T10:55:41.269 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-11T10:55:41.269 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2023-08-11T10:55:41.269 INFO:teuthology.orchestra.run.smithi172.stdout:LOGO="fedora-logo-icon" 2023-08-11T10:55:41.269 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-11T10:55:41.270 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2023-08-11T10:55:41.270 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-11T10:55:41.270 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-11T10:55:41.270 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-11T10:55:41.271 INFO:teuthology.provision.fog.smithi172:Deploy complete! 2023-08-11T10:55:41.271 DEBUG:teuthology.parallel:result is None 2023-08-11T10:55:41.413 INFO:teuthology.lock.ops:Checking smithi172.front.sepia.ceph.com 2023-08-11T10:55:41.414 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-11T10:55:41.440 INFO:teuthology.lock.ops:Checking smithi203.front.sepia.ceph.com 2023-08-11T10:55:41.441 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-11T10:55:41.467 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: set os type and version on server 2023-08-11T10:55:41.468 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-08-11T10:55:41.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T10:55:41.551 DEBUG:teuthology.orchestra.run.smithi172:> true 2023-08-11T10:55:41.626 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-08-11T10:55:41.626 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2023-08-11T10:55:41.680 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2023-08-11T10:55:41.681 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2023-08-11T10:55:41.738 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2023-08-11T10:55:41.738 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="9" 2023-08-11T10:55:41.739 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2023-08-11T10:55:41.739 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2023-08-11T10:55:41.739 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="9" 2023-08-11T10:55:41.739 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el9" 2023-08-11T10:55:41.739 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-11T10:55:41.739 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2023-08-11T10:55:41.739 INFO:teuthology.orchestra.run.smithi172.stdout:LOGO="fedora-logo-icon" 2023-08-11T10:55:41.739 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-11T10:55:41.740 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2023-08-11T10:55:41.740 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-11T10:55:41.740 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-11T10:55:41.740 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-11T10:55:41.741 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2023-08-11T10:55:41.765 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: set os type and version on server 2023-08-11T10:55:41.765 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-08-11T10:55:41.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T10:55:41.848 DEBUG:teuthology.orchestra.run.smithi203:> true 2023-08-11T10:55:41.929 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-08-11T10:55:41.929 DEBUG:teuthology.orchestra.run.smithi203:> uname -m 2023-08-11T10:55:41.988 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64 2023-08-11T10:55:41.989 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2023-08-11T10:55:42.044 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream" 2023-08-11T10:55:42.044 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="9" 2023-08-11T10:55:42.045 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos" 2023-08-11T10:55:42.045 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora" 2023-08-11T10:55:42.045 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="9" 2023-08-11T10:55:42.045 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el9" 2023-08-11T10:55:42.045 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-11T10:55:42.045 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31" 2023-08-11T10:55:42.045 INFO:teuthology.orchestra.run.smithi203.stdout:LOGO="fedora-logo-icon" 2023-08-11T10:55:42.046 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-11T10:55:42.046 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/" 2023-08-11T10:55:42.046 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-11T10:55:42.046 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-11T10:55:42.046 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-11T10:55:42.047 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2023-08-11T10:55:42.074 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T10:55:42.169 INFO:teuthology.dispatcher.supervisor:Running job 7365628 2023-08-11T10:55:42.170 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-08-10_20:13:47-fs-wip-rishabh-2023aug3-b4-testing-default-smithi/7365628 --name rishabh-2023-08-10_20:13:47-fs-wip-rishabh-2023aug3-b4-testing-default-smithi --description fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs_python} -- /home/teuthworker/archive/rishabh-2023-08-10_20:13:47-fs-wip-rishabh-2023aug3-b4-testing-default-smithi/7365628/orig.config.yaml 2023-08-11T10:55:42.174 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-08-10_20:13:47-fs-wip-rishabh-2023aug3-b4-testing-default-smithi/7365628 2023-08-11T10:55:42.175 INFO:teuthology.dispatcher.supervisor:Job PID: 16408 2023-08-11T10:55:42.175 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-11T10:57:42.276 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T10:59:42.448 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T11:01:42.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T11:03:42.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T11:05:42.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T11:07:43.121 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T11:09:43.289 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T11:11:43.453 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T11:13:43.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T11:15:43.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T11:17:43.945 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T11:19:44.114 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T11:21:44.281 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T11:23:44.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T11:23:44.496 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-11T11:23:44.699 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-11T11:23:44.699 INFO:teuthology.nuke:Checking targets against current locks 2023-08-11T11:23:44.752 DEBUG:teuthology.nuke:shortname: smithi172 2023-08-11T11:23:44.753 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-11T11:23:44.773 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-10_20:13:47-fs-wip-rishabh-2023aug3-b4-testing-default-smithi/7365628', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-11 10:50:17.198888', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHeKPo7+Pji3ZAI4DN2ufrOijbujdV2qSTqIAkfJGlKGs0giI2HeeypKRpeVBstTRTrJ94CQQKfdLxzFIjHzufo='} 2023-08-11T11:23:44.776 DEBUG:teuthology.nuke:shortname: smithi203 2023-08-11T11:23:44.776 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-11T11:23:44.799 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-10_20:13:47-fs-wip-rishabh-2023aug3-b4-testing-default-smithi/7365628', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-11 10:50:17.200232', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOseIHoVtakBFPES3O5pgO+IZnb341l3SPGhMH8CJG1AIpu7xY9O68h1NzN7u5vOUTzUwppNk6uVAwpPwzR4eFM='} 2023-08-11T11:23:44.823 INFO:teuthology.orchestra.console.smithi172:Power off 2023-08-11T11:23:44.824 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-11T11:23:44.846 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off 2023-08-11T11:23:44.847 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T11:23:44.867 INFO:teuthology.orchestra.console.smithi203:Power off 2023-08-11T11:23:44.868 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-11T11:23:44.878 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2023-08-11T11:23:44.890 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off 2023-08-11T11:23:44.890 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T11:23:44.913 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2023-08-11T11:23:44.980 INFO:teuthology.orchestra.console.smithi172:Power off completed 2023-08-11T11:23:45.015 INFO:teuthology.orchestra.console.smithi203:Power off completed 2023-08-11T11:23:45.128 INFO:teuthology.lock.ops:unlocked: smithi172.front.sepia.ceph.com 2023-08-11T11:23:45.162 INFO:teuthology.lock.ops:unlocked: smithi203.front.sepia.ceph.com