2023-10-13T18:42:21.513 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-13T18:42:21.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T18:42:21.652 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f438110c670>, signals=[15]) 2023-10-13T18:42:21.653 INFO:teuthology.lock.ops:Start node 'smithi124.front.sepia.ceph.com' reimaging 2023-10-13T18:42:21.654 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: reset os type and version on server 2023-10-13T18:42:21.654 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2023-10-13T18:42:21.675 INFO:teuthology.lock.ops:Start node 'smithi183.front.sepia.ceph.com' reimaging 2023-10-13T18:42:21.676 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: reset os type and version on server 2023-10-13T18:42:21.676 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2023-10-13T18:42:21.678 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /host {"name": "smithi124"} 2023-10-13T18:42:21.701 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /host {"name": "smithi183"} 2023-10-13T18:42:21.755 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-13T18:42:21.770 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-13T18:42:21.798 DEBUG:teuthology.provision.fog.smithi124:Requesting image smithi_centos_9.stream (ID 10) 2023-10-13T18:42:21.798 DEBUG:teuthology.provision.fog.smithi124:FOG request: PUT /host/229 {"imageID": 10} 2023-10-13T18:42:21.819 DEBUG:teuthology.provision.fog.smithi183:Requesting image smithi_centos_9.stream (ID 10) 2023-10-13T18:42:21.819 DEBUG:teuthology.provision.fog.smithi183:FOG request: PUT /host/288 {"imageID": 10} 2023-10-13T18:42:21.852 INFO:teuthology.provision.fog.smithi124:Scheduling deploy of centos 9.stream 2023-10-13T18:42:21.852 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-13T18:42:21.862 INFO:teuthology.provision.fog.smithi183:Scheduling deploy of centos 9.stream 2023-10-13T18:42:21.863 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-13T18:42:21.904 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /tasktype {"name": "deploy"} 2023-10-13T18:42:21.908 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /tasktype {"name": "deploy"} 2023-10-13T18:42:21.940 DEBUG:teuthology.provision.fog.smithi183:FOG request: POST /host/288/task {"taskTypeID": 1} 2023-10-13T18:42:21.946 DEBUG:teuthology.provision.fog.smithi124:FOG request: POST /host/229/task {"taskTypeID": 1} 2023-10-13T18:42:22.072 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-13T18:42:22.082 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-13T18:42:22.157 INFO:teuthology.orchestra.console.smithi183:Power off 2023-10-13T18:42:22.158 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-13T18:42:22.171 INFO:teuthology.orchestra.console.smithi124:Power off 2023-10-13T18:42:22.171 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-13T18:42:22.183 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off 2023-10-13T18:42:22.184 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-13T18:42:22.193 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off 2023-10-13T18:42:22.194 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-13T18:42:22.208 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-10-13T18:42:22.215 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-10-13T18:42:26.210 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-13T18:42:26.218 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-13T18:42:26.320 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-10-13T18:42:26.326 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-10-13T18:42:30.322 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-13T18:42:30.330 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-13T18:42:30.432 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-10-13T18:42:30.438 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-10-13T18:42:34.435 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-13T18:42:34.442 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-13T18:42:34.544 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-10-13T18:42:34.552 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-10-13T18:42:34.645 INFO:teuthology.orchestra.console.smithi183:Power off completed 2023-10-13T18:42:34.653 INFO:teuthology.orchestra.console.smithi124:Power off completed 2023-10-13T18:42:34.747 INFO:teuthology.orchestra.console.smithi183:Power on 2023-10-13T18:42:34.747 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-13T18:42:34.754 INFO:teuthology.orchestra.console.smithi124:Power on 2023-10-13T18:42:34.754 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-13T18:42:34.768 DEBUG:teuthology.orchestra.console.smithi183:power on output: Chassis Power Control: Up/On 2023-10-13T18:42:34.768 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-13T18:42:34.777 DEBUG:teuthology.orchestra.console.smithi124:power on output: Chassis Power Control: Up/On 2023-10-13T18:42:34.778 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-13T18:42:34.789 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-10-13T18:42:34.798 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-10-13T18:42:38.794 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-13T18:42:38.801 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-13T18:42:38.903 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-10-13T18:42:38.910 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-10-13T18:42:39.005 INFO:teuthology.orchestra.console.smithi183:Power on completed 2023-10-13T18:42:39.106 INFO:teuthology.provision.fog.smithi183:Waiting for deploy to finish 2023-10-13T18:42:39.106 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-13T18:42:42.914 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-13T18:42:43.022 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-10-13T18:42:43.123 INFO:teuthology.orchestra.console.smithi124:Power on completed 2023-10-13T18:42:43.224 INFO:teuthology.provision.fog.smithi124:Waiting for deploy to finish 2023-10-13T18:42:43.225 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-13T18:42:54.174 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-13T18:42:58.286 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-13T18:43:09.248 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-13T18:43:13.371 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-13T18:43:24.350 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-13T18:43:28.446 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-13T18:43:39.422 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-13T18:43:43.534 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-13T18:43:54.507 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-13T18:43:58.618 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-13T18:44:09.584 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-13T18:44:13.702 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-13T18:44:24.662 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-13T18:44:28.774 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-13T18:44:39.738 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-13T18:44:43.846 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-13T18:44:54.822 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-13T18:44:58.925 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-13T18:45:09.898 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-13T18:45:09.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-13T18:45:14.002 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-13T18:45:14.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-13T18:45:28.314 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-10-13T18:45:32.410 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-13T18:45:34.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-13T18:45:37.370 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-10-13T18:45:38.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-13T18:45:41.470 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-13T18:45:43.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-13T18:45:46.426 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-10-13T18:45:47.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-13T18:45:50.554 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-13T18:45:52.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-13T18:45:55.486 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-10-13T18:45:56.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-13T18:45:59.610 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-13T18:46:01.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-13T18:46:04.573 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-10-13T18:46:05.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-13T18:46:08.666 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-13T18:46:10.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-13T18:46:14.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-13T18:47:10.623 WARNING:teuthology.provision.fog.smithi183:timed out 2023-10-13T18:47:14.676 WARNING:teuthology.provision.fog.smithi124:timed out 2023-10-13T18:47:16.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-13T18:47:16.944 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-13T18:47:16.945 DEBUG:teuthology.orchestra.run.smithi183:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-13T18:47:17.261 INFO:teuthology.provision.fog.smithi183:Node is ready 2023-10-13T18:47:17.261 DEBUG:teuthology.orchestra.run.smithi183:> hostname 2023-10-13T18:47:17.276 INFO:teuthology.orchestra.run.smithi183.stdout:smithi183.front.sepia.ceph.com 2023-10-13T18:47:17.277 DEBUG:teuthology.orchestra.run.smithi183:> grep smithi183.front.sepia.ceph.com /etc/hosts 2023-10-13T18:47:17.332 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.15.183 smithi183.front.sepia.ceph.com smithi183 2023-10-13T18:47:17.333 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183 2023-10-13T18:47:17.436 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi183.front.sepia.ceph.com/smithi183/g' /etc/hosts 2023-10-13T18:47:17.465 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/172.21.15.183/172.21.15.183/g' /etc/hosts 2023-10-13T18:47:17.532 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi183.front.sepia.ceph.com/smithi183/g' /etc/hostname 2023-10-13T18:47:17.600 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183 2023-10-13T18:47:17.666 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2023-10-13T18:47:17.720 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="CentOS Stream" 2023-10-13T18:47:17.720 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="9" 2023-10-13T18:47:17.720 INFO:teuthology.orchestra.run.smithi183.stdout:ID="centos" 2023-10-13T18:47:17.721 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="rhel fedora" 2023-10-13T18:47:17.721 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="9" 2023-10-13T18:47:17.721 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el9" 2023-10-13T18:47:17.721 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-13T18:47:17.721 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31" 2023-10-13T18:47:17.722 INFO:teuthology.orchestra.run.smithi183.stdout:LOGO="fedora-logo-icon" 2023-10-13T18:47:17.722 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-13T18:47:17.722 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://centos.org/" 2023-10-13T18:47:17.722 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-13T18:47:17.722 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-13T18:47:17.723 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-13T18:47:17.723 INFO:teuthology.provision.fog.smithi183:Deploy complete! 2023-10-13T18:47:17.724 DEBUG:teuthology.parallel:result is None 2023-10-13T18:47:20.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-13T18:47:20.984 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-13T18:47:20.985 DEBUG:teuthology.orchestra.run.smithi124:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-13T18:47:21.322 INFO:teuthology.provision.fog.smithi124:Node is ready 2023-10-13T18:47:21.322 DEBUG:teuthology.orchestra.run.smithi124:> hostname 2023-10-13T18:47:21.336 INFO:teuthology.orchestra.run.smithi124.stdout:smithi124.front.sepia.ceph.com 2023-10-13T18:47:21.337 DEBUG:teuthology.orchestra.run.smithi124:> grep smithi124.front.sepia.ceph.com /etc/hosts 2023-10-13T18:47:21.391 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.15.124 smithi124.front.sepia.ceph.com smithi124 2023-10-13T18:47:21.391 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124 2023-10-13T18:47:21.505 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hosts 2023-10-13T18:47:21.533 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/172.21.15.124/172.21.15.124/g' /etc/hosts 2023-10-13T18:47:21.600 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hostname 2023-10-13T18:47:21.667 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124 2023-10-13T18:47:21.733 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2023-10-13T18:47:21.786 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="CentOS Stream" 2023-10-13T18:47:21.787 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="9" 2023-10-13T18:47:21.787 INFO:teuthology.orchestra.run.smithi124.stdout:ID="centos" 2023-10-13T18:47:21.787 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="rhel fedora" 2023-10-13T18:47:21.787 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="9" 2023-10-13T18:47:21.787 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el9" 2023-10-13T18:47:21.788 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-13T18:47:21.788 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31" 2023-10-13T18:47:21.788 INFO:teuthology.orchestra.run.smithi124.stdout:LOGO="fedora-logo-icon" 2023-10-13T18:47:21.788 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-13T18:47:21.788 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://centos.org/" 2023-10-13T18:47:21.788 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-13T18:47:21.789 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-13T18:47:21.789 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-13T18:47:21.789 INFO:teuthology.provision.fog.smithi124:Deploy complete! 2023-10-13T18:47:21.790 DEBUG:teuthology.parallel:result is None 2023-10-13T18:47:21.952 INFO:teuthology.lock.ops:Checking smithi124.front.sepia.ceph.com 2023-10-13T18:47:21.952 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-13T18:47:21.981 INFO:teuthology.lock.ops:Checking smithi183.front.sepia.ceph.com 2023-10-13T18:47:21.981 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-13T18:47:21.998 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: set os type and version on server 2023-10-13T18:47:21.999 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-13T18:47:22.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-13T18:47:22.081 DEBUG:teuthology.orchestra.run.smithi124:> true 2023-10-13T18:47:22.105 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-13T18:47:22.105 DEBUG:teuthology.orchestra.run.smithi124:> uname -m 2023-10-13T18:47:22.159 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64 2023-10-13T18:47:22.160 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2023-10-13T18:47:22.213 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="CentOS Stream" 2023-10-13T18:47:22.214 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="9" 2023-10-13T18:47:22.214 INFO:teuthology.orchestra.run.smithi124.stdout:ID="centos" 2023-10-13T18:47:22.214 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="rhel fedora" 2023-10-13T18:47:22.214 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="9" 2023-10-13T18:47:22.214 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el9" 2023-10-13T18:47:22.215 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-13T18:47:22.215 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31" 2023-10-13T18:47:22.215 INFO:teuthology.orchestra.run.smithi124.stdout:LOGO="fedora-logo-icon" 2023-10-13T18:47:22.215 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-13T18:47:22.215 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://centos.org/" 2023-10-13T18:47:22.216 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-13T18:47:22.216 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-13T18:47:22.216 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-13T18:47:22.217 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2023-10-13T18:47:22.239 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: set os type and version on server 2023-10-13T18:47:22.239 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-10-13T18:47:22.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-13T18:47:22.322 DEBUG:teuthology.orchestra.run.smithi183:> true 2023-10-13T18:47:22.390 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-10-13T18:47:22.391 DEBUG:teuthology.orchestra.run.smithi183:> uname -m 2023-10-13T18:47:22.447 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64 2023-10-13T18:47:22.448 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2023-10-13T18:47:22.504 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="CentOS Stream" 2023-10-13T18:47:22.504 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="9" 2023-10-13T18:47:22.504 INFO:teuthology.orchestra.run.smithi183.stdout:ID="centos" 2023-10-13T18:47:22.505 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="rhel fedora" 2023-10-13T18:47:22.505 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="9" 2023-10-13T18:47:22.505 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el9" 2023-10-13T18:47:22.505 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-13T18:47:22.505 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31" 2023-10-13T18:47:22.506 INFO:teuthology.orchestra.run.smithi183.stdout:LOGO="fedora-logo-icon" 2023-10-13T18:47:22.506 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-13T18:47:22.506 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://centos.org/" 2023-10-13T18:47:22.506 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-13T18:47:22.506 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-13T18:47:22.507 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-13T18:47:22.507 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2023-10-13T18:47:22.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T18:47:22.622 INFO:teuthology.dispatcher.supervisor:Running job 7424388 2023-10-13T18:47:22.623 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-13_14:47:03-rbd-wip-neorados-learning-from-experience-distro-default-smithi/7424388 --name yuriw-2023-10-13_14:47:03-rbd-wip-neorados-learning-from-experience-distro-default-smithi --description rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_latest} workloads/rbd-mirror-ha-workunit} -- /home/teuthworker/archive/yuriw-2023-10-13_14:47:03-rbd-wip-neorados-learning-from-experience-distro-default-smithi/7424388/orig.config.yaml 2023-10-13T18:47:22.626 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-13_14:47:03-rbd-wip-neorados-learning-from-experience-distro-default-smithi/7424388 2023-10-13T18:47:22.626 INFO:teuthology.dispatcher.supervisor:Job PID: 2611238 2023-10-13T18:47:22.627 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-13T18:49:22.636 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T18:51:22.798 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T18:53:22.976 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T18:55:23.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T18:57:23.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T18:59:23.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T19:01:23.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T19:03:23.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T19:05:23.976 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T19:07:24.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T19:09:24.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T19:11:24.441 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T19:13:24.606 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T19:15:24.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T19:17:24.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T19:19:25.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T19:21:25.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T19:23:25.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T19:25:25.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T19:27:25.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T19:29:25.913 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T19:29:25.978 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-13T19:29:26.125 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-13T19:29:26.126 INFO:teuthology.nuke:Checking targets against current locks 2023-10-13T19:29:26.176 DEBUG:teuthology.nuke:shortname: smithi124 2023-10-13T19:29:26.176 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-13T19:29:26.190 DEBUG:teuthology.nuke:shortname: smithi183 2023-10-13T19:29:26.190 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-13T19:29:26.208 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-13_14:47:03-rbd-wip-neorados-learning-from-experience-distro-default-smithi/7424388', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-13 18:42:20.682976', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBFu/9BYoOVkCtb7Rxq19rG0ev5F9YpAPeSOaBBxbd6j6/y4nYv+C44gKpIfAv4SeKdY2LSu7hLTQM/VTiZx41s='} 2023-10-13T19:29:26.211 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi124.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-13_14:47:03-rbd-wip-neorados-learning-from-experience-distro-default-smithi/7424388', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-13 18:42:20.681519', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNSRYIRHx97HnuMucssPn0W4Wb6/b7twlYtiz6uGjUiaz8nqCJvipSWl8aPL7TfVkSfgLd2z54M2visLXIrJERY='} 2023-10-13T19:29:26.255 INFO:teuthology.orchestra.console.smithi124:Power off 2023-10-13T19:29:26.255 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-13T19:29:26.269 INFO:teuthology.orchestra.console.smithi183:Power off 2023-10-13T19:29:26.270 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-13T19:29:26.280 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off 2023-10-13T19:29:26.280 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-13T19:29:26.289 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off 2023-10-13T19:29:26.290 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-13T19:29:26.300 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-10-13T19:29:26.311 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-10-13T19:29:26.401 INFO:teuthology.orchestra.console.smithi124:Power off completed 2023-10-13T19:29:26.412 INFO:teuthology.orchestra.console.smithi183:Power off completed 2023-10-13T19:29:26.563 INFO:teuthology.lock.ops:unlocked: smithi183.front.sepia.ceph.com 2023-10-13T19:29:26.569 INFO:teuthology.lock.ops:unlocked: smithi124.front.sepia.ceph.com