2023-11-13T13:28:32.835 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-13T13:28:32.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-13T13:28:32.973 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f10fd0ab670>, signals=[15]) 2023-11-13T13:28:32.974 INFO:teuthology.lock.ops:Start node 'smithi125.front.sepia.ceph.com' reimaging 2023-11-13T13:28:32.974 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: reset os type and version on server 2023-11-13T13:28:32.974 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2023-11-13T13:28:32.998 INFO:teuthology.lock.ops:Start node 'smithi204.front.sepia.ceph.com' reimaging 2023-11-13T13:28:32.998 INFO:teuthology.lock.ops:Updating [smithi204.front.sepia.ceph.com]: reset os type and version on server 2023-11-13T13:28:32.999 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2023-11-13T13:28:33.000 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /host {"name": "smithi125"} 2023-11-13T13:28:33.023 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /host {"name": "smithi204"} 2023-11-13T13:28:33.065 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-11-13T13:28:33.088 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-11-13T13:28:33.105 DEBUG:teuthology.provision.fog.smithi125:Requesting image smithi_centos_9.stream (ID 10) 2023-11-13T13:28:33.106 DEBUG:teuthology.provision.fog.smithi125:FOG request: PUT /host/230 {"imageID": 10} 2023-11-13T13:28:33.127 DEBUG:teuthology.provision.fog.smithi204:Requesting image smithi_centos_9.stream (ID 10) 2023-11-13T13:28:33.128 DEBUG:teuthology.provision.fog.smithi204:FOG request: PUT /host/308 {"imageID": 10} 2023-11-13T13:28:33.149 INFO:teuthology.provision.fog.smithi125:Scheduling deploy of centos 9.stream 2023-11-13T13:28:33.149 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-13T13:28:33.179 INFO:teuthology.provision.fog.smithi204:Scheduling deploy of centos 9.stream 2023-11-13T13:28:33.179 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-11-13T13:28:33.221 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /tasktype {"name": "deploy"} 2023-11-13T13:28:33.246 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /tasktype {"name": "deploy"} 2023-11-13T13:28:33.258 DEBUG:teuthology.provision.fog.smithi125:FOG request: POST /host/230/task {"taskTypeID": 1} 2023-11-13T13:28:33.284 DEBUG:teuthology.provision.fog.smithi204:FOG request: POST /host/308/task {"taskTypeID": 1} 2023-11-13T13:28:33.312 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-13T13:28:33.577 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-11-13T13:28:33.655 INFO:teuthology.orchestra.console.smithi125:Power off 2023-11-13T13:28:33.656 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-13T13:28:33.675 DEBUG:teuthology.orchestra.console.smithi125:power off output: Chassis Power Control: Down/Off 2023-11-13T13:28:33.676 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-13T13:28:33.688 INFO:teuthology.orchestra.console.smithi204:Power off 2023-11-13T13:28:33.689 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-13T13:28:33.696 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2023-11-13T13:28:33.708 DEBUG:teuthology.orchestra.console.smithi204:power off output: Chassis Power Control: Down/Off 2023-11-13T13:28:33.708 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-13T13:28:33.728 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on 2023-11-13T13:28:37.702 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-13T13:28:37.730 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-13T13:28:37.811 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2023-11-13T13:28:37.838 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on 2023-11-13T13:28:41.815 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-13T13:28:41.839 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-13T13:28:41.927 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2023-11-13T13:28:41.949 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on 2023-11-13T13:28:42.028 INFO:teuthology.orchestra.console.smithi125:Power off completed 2023-11-13T13:28:42.129 INFO:teuthology.orchestra.console.smithi125:Power on 2023-11-13T13:28:42.129 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-13T13:28:42.153 DEBUG:teuthology.orchestra.console.smithi125:power on output: Chassis Power Control: Up/On 2023-11-13T13:28:42.153 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-13T13:28:42.178 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2023-11-13T13:28:45.954 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-13T13:28:46.065 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off 2023-11-13T13:28:46.166 INFO:teuthology.orchestra.console.smithi204:Power off completed 2023-11-13T13:28:46.179 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-13T13:28:46.267 INFO:teuthology.orchestra.console.smithi204:Power on 2023-11-13T13:28:46.268 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-13T13:28:46.289 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2023-11-13T13:28:46.291 DEBUG:teuthology.orchestra.console.smithi204:power on output: Chassis Power Control: Up/On 2023-11-13T13:28:46.292 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-13T13:28:46.314 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off 2023-11-13T13:28:50.294 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-13T13:28:50.316 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-13T13:28:50.425 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on 2023-11-13T13:28:50.447 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2023-11-13T13:28:50.526 INFO:teuthology.orchestra.console.smithi204:Power on completed 2023-11-13T13:28:50.548 INFO:teuthology.orchestra.console.smithi125:Power on completed 2023-11-13T13:28:50.627 INFO:teuthology.provision.fog.smithi204:Waiting for deploy to finish 2023-11-13T13:28:50.627 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-11-13T13:28:50.649 INFO:teuthology.provision.fog.smithi125:Waiting for deploy to finish 2023-11-13T13:28:50.649 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-13T13:29:05.717 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-11-13T13:29:05.721 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-13T13:29:20.809 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-11-13T13:29:20.810 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-13T13:29:35.898 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-11-13T13:29:35.899 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-13T13:29:50.989 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-13T13:29:50.991 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-11-13T13:30:06.081 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-11-13T13:30:06.083 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-13T13:30:21.175 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-11-13T13:30:21.177 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-13T13:30:36.274 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-11-13T13:30:36.276 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-13T13:30:51.396 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-11-13T13:30:51.398 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-13T13:31:06.513 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-13T13:31:06.515 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-11-13T13:31:21.614 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-11-13T13:31:21.616 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-13T13:31:21.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-13T13:31:36.698 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-11-13T13:31:36.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-13T13:31:39.834 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-11-13T13:31:40.026 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-11-13T13:31:45.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-13T13:31:46.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-13T13:31:48.922 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-11-13T13:31:49.082 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-11-13T13:31:54.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-13T13:31:55.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-13T13:31:58.010 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-11-13T13:31:58.138 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-11-13T13:32:04.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-13T13:32:04.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-13T13:32:07.098 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-11-13T13:32:07.194 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-11-13T13:32:13.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-13T13:32:13.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-13T13:32:16.186 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-11-13T13:32:16.250 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-11-13T13:32:22.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-13T13:32:22.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-13T13:32:25.275 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-11-13T13:32:31.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-13T13:32:34.330 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-11-13T13:32:40.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-13T13:32:58.874 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-11-13T13:33:04.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-13T13:33:07.962 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-11-13T13:33:13.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-13T13:33:17.018 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-11-13T13:33:22.259 WARNING:teuthology.provision.fog.smithi125:timed out 2023-11-13T13:33:23.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-13T13:33:23.301 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-13T13:33:23.302 DEBUG:teuthology.orchestra.run.smithi204:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-13T13:33:28.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-13T13:33:28.524 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-13T13:33:28.525 DEBUG:teuthology.orchestra.run.smithi125:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-13T13:33:28.854 INFO:teuthology.provision.fog.smithi125:Node is ready 2023-11-13T13:33:28.854 DEBUG:teuthology.orchestra.run.smithi125:> hostname 2023-11-13T13:33:28.869 INFO:teuthology.orchestra.run.smithi125.stdout:smithi125.front.sepia.ceph.com 2023-11-13T13:33:28.869 DEBUG:teuthology.orchestra.run.smithi125:> grep smithi125.front.sepia.ceph.com /etc/hosts 2023-11-13T13:33:28.924 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125 smithi125.front.sepia.ceph.com smithi125 2023-11-13T13:33:28.924 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125 2023-11-13T13:33:29.024 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125.front.sepia.ceph.com/smithi125/g' /etc/hosts 2023-11-13T13:33:29.052 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/172.21.15.125/172.21.15.125/g' /etc/hosts 2023-11-13T13:33:29.119 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125.front.sepia.ceph.com/smithi125/g' /etc/hostname 2023-11-13T13:33:29.186 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125 2023-11-13T13:33:29.251 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2023-11-13T13:33:29.306 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="CentOS Stream" 2023-11-13T13:33:29.306 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="9" 2023-11-13T13:33:29.307 INFO:teuthology.orchestra.run.smithi125.stdout:ID="centos" 2023-11-13T13:33:29.307 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="rhel fedora" 2023-11-13T13:33:29.307 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="9" 2023-11-13T13:33:29.307 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el9" 2023-11-13T13:33:29.307 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-13T13:33:29.308 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31" 2023-11-13T13:33:29.308 INFO:teuthology.orchestra.run.smithi125.stdout:LOGO="fedora-logo-icon" 2023-11-13T13:33:29.308 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-13T13:33:29.308 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://centos.org/" 2023-11-13T13:33:29.308 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-13T13:33:29.309 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-13T13:33:29.309 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-13T13:33:29.310 INFO:teuthology.provision.fog.smithi125:Deploy complete! 2023-11-13T13:33:29.311 DEBUG:teuthology.parallel:result is None 2023-11-13T13:33:43.616 INFO:teuthology.provision.fog.smithi204:Node is ready 2023-11-13T13:33:43.617 DEBUG:teuthology.orchestra.run.smithi204:> hostname 2023-11-13T13:33:43.636 INFO:teuthology.orchestra.run.smithi204.stdout:smithi204.front.sepia.ceph.com 2023-11-13T13:33:43.637 DEBUG:teuthology.orchestra.run.smithi204:> grep smithi204.front.sepia.ceph.com /etc/hosts 2023-11-13T13:33:43.694 INFO:teuthology.orchestra.run.smithi204.stdout:172.21.15.204 smithi204.front.sepia.ceph.com smithi204 2023-11-13T13:33:43.695 DEBUG:teuthology.orchestra.run.smithi204:> sudo hostname smithi204 2023-11-13T13:33:43.823 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/smithi204.front.sepia.ceph.com/smithi204/g' /etc/hosts 2023-11-13T13:33:43.854 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/172.21.15.204/172.21.15.204/g' /etc/hosts 2023-11-13T13:33:43.923 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/smithi204.front.sepia.ceph.com/smithi204/g' /etc/hostname 2023-11-13T13:33:43.992 DEBUG:teuthology.orchestra.run.smithi204:> sudo hostname smithi204 2023-11-13T13:33:44.060 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release 2023-11-13T13:33:44.115 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="CentOS Stream" 2023-11-13T13:33:44.115 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="9" 2023-11-13T13:33:44.116 INFO:teuthology.orchestra.run.smithi204.stdout:ID="centos" 2023-11-13T13:33:44.116 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE="rhel fedora" 2023-11-13T13:33:44.116 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="9" 2023-11-13T13:33:44.116 INFO:teuthology.orchestra.run.smithi204.stdout:PLATFORM_ID="platform:el9" 2023-11-13T13:33:44.116 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-13T13:33:44.117 INFO:teuthology.orchestra.run.smithi204.stdout:ANSI_COLOR="0;31" 2023-11-13T13:33:44.117 INFO:teuthology.orchestra.run.smithi204.stdout:LOGO="fedora-logo-icon" 2023-11-13T13:33:44.117 INFO:teuthology.orchestra.run.smithi204.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-13T13:33:44.117 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://centos.org/" 2023-11-13T13:33:44.117 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-13T13:33:44.118 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-13T13:33:44.118 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-13T13:33:44.118 INFO:teuthology.provision.fog.smithi204:Deploy complete! 2023-11-13T13:33:44.119 DEBUG:teuthology.parallel:result is None 2023-11-13T13:33:44.426 INFO:teuthology.lock.ops:Checking smithi125.front.sepia.ceph.com 2023-11-13T13:33:44.427 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-13T13:33:44.456 INFO:teuthology.lock.ops:Checking smithi204.front.sepia.ceph.com 2023-11-13T13:33:44.456 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-13T13:33:44.481 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: set os type and version on server 2023-11-13T13:33:44.482 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-11-13T13:33:44.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-13T13:33:44.568 DEBUG:teuthology.orchestra.run.smithi125:> true 2023-11-13T13:33:44.732 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-11-13T13:33:44.733 DEBUG:teuthology.orchestra.run.smithi125:> uname -m 2023-11-13T13:33:44.786 INFO:teuthology.orchestra.run.smithi125.stdout:x86_64 2023-11-13T13:33:44.787 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2023-11-13T13:33:44.841 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="CentOS Stream" 2023-11-13T13:33:44.842 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="9" 2023-11-13T13:33:44.842 INFO:teuthology.orchestra.run.smithi125.stdout:ID="centos" 2023-11-13T13:33:44.842 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="rhel fedora" 2023-11-13T13:33:44.842 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="9" 2023-11-13T13:33:44.842 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el9" 2023-11-13T13:33:44.843 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-13T13:33:44.843 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31" 2023-11-13T13:33:44.843 INFO:teuthology.orchestra.run.smithi125.stdout:LOGO="fedora-logo-icon" 2023-11-13T13:33:44.843 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-13T13:33:44.843 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://centos.org/" 2023-11-13T13:33:44.844 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-13T13:33:44.844 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-13T13:33:44.844 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-13T13:33:44.844 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2023-11-13T13:33:44.864 INFO:teuthology.lock.ops:Updating [smithi204.front.sepia.ceph.com]: set os type and version on server 2023-11-13T13:33:44.864 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2023-11-13T13:33:44.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-13T13:33:44.945 DEBUG:teuthology.orchestra.run.smithi204:> true 2023-11-13T13:33:45.014 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com' 2023-11-13T13:33:45.014 DEBUG:teuthology.orchestra.run.smithi204:> uname -m 2023-11-13T13:33:45.071 INFO:teuthology.orchestra.run.smithi204.stdout:x86_64 2023-11-13T13:33:45.071 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release 2023-11-13T13:33:45.126 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="CentOS Stream" 2023-11-13T13:33:45.127 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="9" 2023-11-13T13:33:45.127 INFO:teuthology.orchestra.run.smithi204.stdout:ID="centos" 2023-11-13T13:33:45.127 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE="rhel fedora" 2023-11-13T13:33:45.127 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="9" 2023-11-13T13:33:45.128 INFO:teuthology.orchestra.run.smithi204.stdout:PLATFORM_ID="platform:el9" 2023-11-13T13:33:45.128 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-13T13:33:45.128 INFO:teuthology.orchestra.run.smithi204.stdout:ANSI_COLOR="0;31" 2023-11-13T13:33:45.128 INFO:teuthology.orchestra.run.smithi204.stdout:LOGO="fedora-logo-icon" 2023-11-13T13:33:45.128 INFO:teuthology.orchestra.run.smithi204.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-13T13:33:45.128 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://centos.org/" 2023-11-13T13:33:45.129 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-13T13:33:45.129 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-13T13:33:45.129 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-13T13:33:45.129 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2023-11-13T13:33:45.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-13T13:33:45.241 INFO:teuthology.dispatcher.supervisor:Running job 7456401 2023-11-13T13:33:45.241 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_aemerson@teuthology --archive /home/teuthworker/archive/aemerson-2023-11-13_13:26:38-rbd-main-distro-default-smithi/7456401 --name aemerson-2023-11-13_13:26:38-rbd-main-distro-default-smithi --description rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_latest} workloads/rbd-mirror-journal-stress-workunit} -- /home/teuthworker/archive/aemerson-2023-11-13_13:26:38-rbd-main-distro-default-smithi/7456401/orig.config.yaml 2023-11-13T13:33:45.245 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/aemerson-2023-11-13_13:26:38-rbd-main-distro-default-smithi/7456401 2023-11-13T13:33:45.246 INFO:teuthology.dispatcher.supervisor:Job PID: 1314186 2023-11-13T13:33:45.246 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-13T13:35:45.289 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-13T13:37:45.456 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-13T13:39:45.630 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-13T13:41:45.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-13T13:43:45.936 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-13T13:45:46.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-13T13:47:46.177 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-13T13:49:46.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-13T13:51:46.498 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-13T13:51:46.568 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-13T13:51:46.678 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-13T13:51:46.679 INFO:teuthology.nuke:Checking targets against current locks 2023-11-13T13:51:46.728 DEBUG:teuthology.nuke:shortname: smithi125 2023-11-13T13:51:46.729 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-13T13:51:46.752 DEBUG:teuthology.nuke:shortname: smithi204 2023-11-13T13:51:46.752 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-13T13:51:46.756 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi125.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/aemerson-2023-11-13_13:26:38-rbd-main-distro-default-smithi/7456401', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-13 13:28:32.029547', 'locked_by': 'scheduled_aemerson@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPz1oMAXynPmcdjQPk8ll9DjvWqnPgtLVoJrzE5axbnv76ytIqlcRE+dzUVRJA3F0+ln9+7K32cwW0DlMP1FcxU='} 2023-11-13T13:51:46.777 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi204.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/aemerson-2023-11-13_13:26:38-rbd-main-distro-default-smithi/7456401', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-13 13:28:32.028210', 'locked_by': 'scheduled_aemerson@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDVVwuJRyt5x6Vnhg28MBFm5/ochEBX77qR+NAbV+exGjv/BFzTiO9EICfuWMu2yCLNRq62Tads2M7eIriL8178='} 2023-11-13T13:51:46.806 INFO:teuthology.orchestra.console.smithi125:Power off 2023-11-13T13:51:46.806 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-13T13:51:46.828 DEBUG:teuthology.orchestra.console.smithi125:power off output: Chassis Power Control: Down/Off 2023-11-13T13:51:46.829 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-13T13:51:46.842 INFO:teuthology.orchestra.console.smithi204:Power off 2023-11-13T13:51:46.843 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-13T13:51:46.851 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2023-11-13T13:51:46.864 DEBUG:teuthology.orchestra.console.smithi204:power off output: Chassis Power Control: Down/Off 2023-11-13T13:51:46.864 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-13T13:51:46.884 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off 2023-11-13T13:51:46.952 INFO:teuthology.orchestra.console.smithi125:Power off completed 2023-11-13T13:51:46.986 INFO:teuthology.orchestra.console.smithi204:Power off completed 2023-11-13T13:51:47.100 INFO:teuthology.lock.ops:unlocked: smithi125.front.sepia.ceph.com 2023-11-13T13:51:47.133 INFO:teuthology.lock.ops:unlocked: smithi204.front.sepia.ceph.com