2023-10-05T17:10:49.591 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-05T17:10:49.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T17:10:49.757 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f907282c670>, signals=[15]) 2023-10-05T17:10:49.757 INFO:teuthology.lock.ops:Start node 'smithi027.front.sepia.ceph.com' reimaging 2023-10-05T17:10:49.758 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: reset os type and version on server 2023-10-05T17:10:49.758 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2023-10-05T17:10:49.787 INFO:teuthology.lock.ops:Start node 'smithi123.front.sepia.ceph.com' reimaging 2023-10-05T17:10:49.787 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: reset os type and version on server 2023-10-05T17:10:49.787 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-10-05T17:10:49.789 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /host {"name": "smithi027"} 2023-10-05T17:10:49.810 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /host {"name": "smithi123"} 2023-10-05T17:10:49.852 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-05T17:10:49.875 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-05T17:10:49.891 DEBUG:teuthology.provision.fog.smithi027:Requesting image smithi_centos_9.stream (ID 10) 2023-10-05T17:10:49.892 DEBUG:teuthology.provision.fog.smithi027:FOG request: PUT /host/132 {"imageID": 10} 2023-10-05T17:10:49.916 DEBUG:teuthology.provision.fog.smithi123:Requesting image smithi_centos_9.stream (ID 10) 2023-10-05T17:10:49.916 DEBUG:teuthology.provision.fog.smithi123:FOG request: PUT /host/228 {"imageID": 10} 2023-10-05T17:10:49.936 INFO:teuthology.provision.fog.smithi027:Scheduling deploy of centos 9.stream 2023-10-05T17:10:49.936 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-10-05T17:10:49.957 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of centos 9.stream 2023-10-05T17:10:49.958 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-05T17:10:49.992 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /tasktype {"name": "deploy"} 2023-10-05T17:10:50.008 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /tasktype {"name": "deploy"} 2023-10-05T17:10:50.025 DEBUG:teuthology.provision.fog.smithi027:FOG request: POST /host/132/task {"taskTypeID": 1} 2023-10-05T17:10:50.047 DEBUG:teuthology.provision.fog.smithi123:FOG request: POST /host/228/task {"taskTypeID": 1} 2023-10-05T17:10:50.086 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-10-05T17:10:50.121 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-05T17:10:50.185 INFO:teuthology.orchestra.console.smithi027:Power off 2023-10-05T17:10:50.186 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-05T17:10:50.209 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off 2023-10-05T17:10:50.209 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T17:10:50.227 INFO:teuthology.orchestra.console.smithi123:Power off 2023-10-05T17:10:50.227 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-05T17:10:50.235 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2023-10-05T17:10:50.248 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off 2023-10-05T17:10:50.248 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T17:10:50.269 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2023-10-05T17:10:54.238 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T17:10:54.270 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T17:10:54.346 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2023-10-05T17:10:54.378 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2023-10-05T17:10:58.350 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T17:10:58.379 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T17:10:58.459 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2023-10-05T17:10:58.489 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-10-05T17:10:58.561 INFO:teuthology.orchestra.console.smithi027:Power off completed 2023-10-05T17:10:58.590 INFO:teuthology.orchestra.console.smithi123:Power off completed 2023-10-05T17:10:58.662 INFO:teuthology.orchestra.console.smithi027:Power on 2023-10-05T17:10:58.662 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-05T17:10:58.688 DEBUG:teuthology.orchestra.console.smithi027:power on output: Chassis Power Control: Up/On 2023-10-05T17:10:58.688 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T17:10:58.695 INFO:teuthology.orchestra.console.smithi123:Power on 2023-10-05T17:10:58.695 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-05T17:10:58.710 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2023-10-05T17:10:58.717 DEBUG:teuthology.orchestra.console.smithi123:power on output: Chassis Power Control: Up/On 2023-10-05T17:10:58.717 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T17:10:58.737 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-10-05T17:11:02.714 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T17:11:02.739 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T17:11:02.825 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2023-10-05T17:11:02.848 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2023-10-05T17:11:02.948 INFO:teuthology.orchestra.console.smithi123:Power on completed 2023-10-05T17:11:03.049 INFO:teuthology.provision.fog.smithi123:Waiting for deploy to finish 2023-10-05T17:11:03.049 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-05T17:11:06.827 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T17:11:06.936 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2023-10-05T17:11:07.037 INFO:teuthology.orchestra.console.smithi027:Power on completed 2023-10-05T17:11:07.137 INFO:teuthology.provision.fog.smithi027:Waiting for deploy to finish 2023-10-05T17:11:07.137 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-10-05T17:11:18.138 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-05T17:11:22.230 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-10-05T17:11:33.218 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-05T17:11:37.330 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-10-05T17:11:48.314 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-05T17:11:52.417 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-10-05T17:12:03.405 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-05T17:12:07.510 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-10-05T17:12:18.496 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-05T17:12:22.602 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-10-05T17:12:33.586 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-05T17:12:37.686 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-10-05T17:12:48.678 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-05T17:12:52.786 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-10-05T17:13:03.774 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-05T17:13:07.882 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-10-05T17:13:18.874 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-05T17:13:22.958 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-10-05T17:13:33.962 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-05T17:13:38.034 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-10-05T17:13:49.050 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-05T17:13:49.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T17:13:53.110 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-10-05T17:14:07.615 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-10-05T17:14:08.199 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-10-05T17:14:13.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T17:14:16.698 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-10-05T17:14:22.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T17:14:23.285 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-10-05T17:14:23.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T17:14:25.754 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-10-05T17:14:31.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T17:14:34.810 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-10-05T17:14:40.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T17:14:41.914 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-10-05T17:14:47.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T17:14:50.974 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-10-05T17:14:56.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T17:15:00.065 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-10-05T17:15:06.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T17:15:09.146 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-10-05T17:15:15.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T17:15:18.206 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-10-05T17:15:24.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T17:15:27.290 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-10-05T17:15:33.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T17:15:36.346 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-10-05T17:15:40.818 WARNING:teuthology.provision.fog.smithi123:timed out 2023-10-05T17:15:42.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T17:15:45.410 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-10-05T17:15:46.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T17:15:47.021 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-05T17:15:47.022 DEBUG:teuthology.orchestra.run.smithi123:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-05T17:15:47.361 INFO:teuthology.provision.fog.smithi123:Node is ready 2023-10-05T17:15:47.362 DEBUG:teuthology.orchestra.run.smithi123:> hostname 2023-10-05T17:15:47.378 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123.front.sepia.ceph.com 2023-10-05T17:15:47.379 DEBUG:teuthology.orchestra.run.smithi123:> grep smithi123.front.sepia.ceph.com /etc/hosts 2023-10-05T17:15:47.436 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123 smithi123.front.sepia.ceph.com smithi123 2023-10-05T17:15:47.437 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123 2023-10-05T17:15:47.541 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hosts 2023-10-05T17:15:47.573 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/172.21.15.123/172.21.15.123/g' /etc/hosts 2023-10-05T17:15:47.646 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hostname 2023-10-05T17:15:47.718 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123 2023-10-05T17:15:47.788 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2023-10-05T17:15:47.844 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="CentOS Stream" 2023-10-05T17:15:47.844 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="9" 2023-10-05T17:15:47.845 INFO:teuthology.orchestra.run.smithi123.stdout:ID="centos" 2023-10-05T17:15:47.845 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="rhel fedora" 2023-10-05T17:15:47.845 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="9" 2023-10-05T17:15:47.845 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el9" 2023-10-05T17:15:47.845 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-05T17:15:47.845 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2023-10-05T17:15:47.845 INFO:teuthology.orchestra.run.smithi123.stdout:LOGO="fedora-logo-icon" 2023-10-05T17:15:47.845 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-05T17:15:47.845 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://centos.org/" 2023-10-05T17:15:47.845 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-05T17:15:47.845 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-05T17:15:47.846 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-05T17:15:47.846 INFO:teuthology.provision.fog.smithi123:Deploy complete! 2023-10-05T17:15:47.847 DEBUG:teuthology.parallel:result is None 2023-10-05T17:15:51.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T17:15:54.490 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-10-05T17:16:00.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T17:17:00.557 WARNING:teuthology.provision.fog.smithi027:timed out 2023-10-05T17:17:06.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T17:17:06.846 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-05T17:17:06.846 DEBUG:teuthology.orchestra.run.smithi027:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-05T17:17:07.173 INFO:teuthology.provision.fog.smithi027:Node is ready 2023-10-05T17:17:07.174 DEBUG:teuthology.orchestra.run.smithi027:> hostname 2023-10-05T17:17:07.188 INFO:teuthology.orchestra.run.smithi027.stdout:smithi027.front.sepia.ceph.com 2023-10-05T17:17:07.189 DEBUG:teuthology.orchestra.run.smithi027:> grep smithi027.front.sepia.ceph.com /etc/hosts 2023-10-05T17:17:07.245 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27 smithi027.front.sepia.ceph.com smithi027 2023-10-05T17:17:07.245 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027 2023-10-05T17:17:07.362 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hosts 2023-10-05T17:17:07.394 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/172.21.15.27/172.21.15.27/g' /etc/hosts 2023-10-05T17:17:07.465 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hostname 2023-10-05T17:17:07.535 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027 2023-10-05T17:17:07.605 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release 2023-10-05T17:17:07.661 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="CentOS Stream" 2023-10-05T17:17:07.661 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="9" 2023-10-05T17:17:07.661 INFO:teuthology.orchestra.run.smithi027.stdout:ID="centos" 2023-10-05T17:17:07.661 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="rhel fedora" 2023-10-05T17:17:07.661 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="9" 2023-10-05T17:17:07.661 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el9" 2023-10-05T17:17:07.661 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-05T17:17:07.661 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31" 2023-10-05T17:17:07.661 INFO:teuthology.orchestra.run.smithi027.stdout:LOGO="fedora-logo-icon" 2023-10-05T17:17:07.661 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-05T17:17:07.662 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://centos.org/" 2023-10-05T17:17:07.662 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-05T17:17:07.662 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-05T17:17:07.662 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-05T17:17:07.662 INFO:teuthology.provision.fog.smithi027:Deploy complete! 2023-10-05T17:17:07.663 DEBUG:teuthology.parallel:result is None 2023-10-05T17:17:07.835 INFO:teuthology.lock.ops:Checking smithi027.front.sepia.ceph.com 2023-10-05T17:17:07.835 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-05T17:17:07.864 INFO:teuthology.lock.ops:Checking smithi123.front.sepia.ceph.com 2023-10-05T17:17:07.865 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-05T17:17:07.882 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: set os type and version on server 2023-10-05T17:17:07.883 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-10-05T17:17:07.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T17:17:07.979 DEBUG:teuthology.orchestra.run.smithi027:> true 2023-10-05T17:17:08.045 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-10-05T17:17:08.045 DEBUG:teuthology.orchestra.run.smithi027:> uname -m 2023-10-05T17:17:08.100 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64 2023-10-05T17:17:08.101 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release 2023-10-05T17:17:08.158 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="CentOS Stream" 2023-10-05T17:17:08.159 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="9" 2023-10-05T17:17:08.159 INFO:teuthology.orchestra.run.smithi027.stdout:ID="centos" 2023-10-05T17:17:08.159 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="rhel fedora" 2023-10-05T17:17:08.159 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="9" 2023-10-05T17:17:08.159 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el9" 2023-10-05T17:17:08.159 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-05T17:17:08.159 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31" 2023-10-05T17:17:08.159 INFO:teuthology.orchestra.run.smithi027.stdout:LOGO="fedora-logo-icon" 2023-10-05T17:17:08.159 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-05T17:17:08.159 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://centos.org/" 2023-10-05T17:17:08.159 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-05T17:17:08.160 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-05T17:17:08.160 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-05T17:17:08.161 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2023-10-05T17:17:08.183 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: set os type and version on server 2023-10-05T17:17:08.183 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-10-05T17:17:08.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T17:17:08.268 DEBUG:teuthology.orchestra.run.smithi123:> true 2023-10-05T17:17:08.454 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-10-05T17:17:08.454 DEBUG:teuthology.orchestra.run.smithi123:> uname -m 2023-10-05T17:17:08.511 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2023-10-05T17:17:08.511 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2023-10-05T17:17:08.568 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="CentOS Stream" 2023-10-05T17:17:08.568 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="9" 2023-10-05T17:17:08.568 INFO:teuthology.orchestra.run.smithi123.stdout:ID="centos" 2023-10-05T17:17:08.568 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="rhel fedora" 2023-10-05T17:17:08.568 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="9" 2023-10-05T17:17:08.568 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el9" 2023-10-05T17:17:08.568 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-05T17:17:08.569 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2023-10-05T17:17:08.569 INFO:teuthology.orchestra.run.smithi123.stdout:LOGO="fedora-logo-icon" 2023-10-05T17:17:08.569 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-05T17:17:08.569 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://centos.org/" 2023-10-05T17:17:08.569 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-05T17:17:08.569 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-05T17:17:08.569 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-05T17:17:08.570 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-10-05T17:17:08.590 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T17:17:08.679 INFO:teuthology.dispatcher.supervisor:Running job 7411602 2023-10-05T17:17:08.679 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-05_14:23:09-rados-wip-yuri6-testing-2023-10-04-0901-distro-default-smithi/7411602 --name yuriw-2023-10-05_14:23:09-rados-wip-yuri6-testing-2023-10-04-0901-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} -- /home/teuthworker/archive/yuriw-2023-10-05_14:23:09-rados-wip-yuri6-testing-2023-10-04-0901-distro-default-smithi/7411602/orig.config.yaml 2023-10-05T17:17:08.682 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-05_14:23:09-rados-wip-yuri6-testing-2023-10-04-0901-distro-default-smithi/7411602 2023-10-05T17:17:08.683 INFO:teuthology.dispatcher.supervisor:Job PID: 3677567 2023-10-05T17:17:08.683 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-05T17:19:08.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T17:21:08.948 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T17:23:09.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T17:25:09.281 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T17:27:09.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T17:29:09.638 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T17:31:09.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T17:33:09.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T17:35:10.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T17:37:10.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T17:39:10.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T17:41:10.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T17:43:10.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T17:45:11.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T17:47:11.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T17:49:11.432 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T17:51:11.594 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T17:53:11.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T17:55:11.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T17:57:12.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T17:59:12.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T17:59:12.318 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-10-05T17:59:12.487 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-05T17:59:12.488 INFO:teuthology.nuke:Checking targets against current locks 2023-10-05T17:59:12.533 DEBUG:teuthology.nuke:shortname: smithi027 2023-10-05T17:59:12.533 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-05T17:59:12.557 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi027.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_14:23:09-rados-wip-yuri6-testing-2023-10-04-0901-distro-default-smithi/7411602', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-05 17:10:48.783734', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO6p6a3HtAPa9KWalPhCJYGR3UfpvUepjV/E5Bol2ZKfmGPElTypSEOXtPnDkVyvrxToAs3oJ8VQl0arO6932jc='} 2023-10-05T17:59:12.560 DEBUG:teuthology.nuke:shortname: smithi123 2023-10-05T17:59:12.561 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-05T17:59:12.584 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_14:23:09-rados-wip-yuri6-testing-2023-10-04-0901-distro-default-smithi/7411602', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-05 17:10:48.785778', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIcTkXY6Rn/GL3TkYP/cfVbIIJoCcCifEMKvsGhUg7KXjvYItYjOboSj+GJH1chWFwrUS2OWWJNFXcE7csu7CYI='} 2023-10-05T17:59:12.611 INFO:teuthology.orchestra.console.smithi027:Power off 2023-10-05T17:59:12.611 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-05T17:59:12.632 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off 2023-10-05T17:59:12.632 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T17:59:12.647 INFO:teuthology.orchestra.console.smithi123:Power off 2023-10-05T17:59:12.647 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-05T17:59:12.656 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2023-10-05T17:59:12.668 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off 2023-10-05T17:59:12.668 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T17:59:12.692 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-10-05T17:59:12.757 INFO:teuthology.orchestra.console.smithi027:Power off completed 2023-10-05T17:59:12.793 INFO:teuthology.orchestra.console.smithi123:Power off completed 2023-10-05T17:59:12.909 INFO:teuthology.lock.ops:unlocked: smithi027.front.sepia.ceph.com 2023-10-05T17:59:12.942 INFO:teuthology.lock.ops:unlocked: smithi123.front.sepia.ceph.com