2023-08-30T18:28:46.856 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556 2023-08-30T18:28:46.858 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T18:28:46.990 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdf35ab0670>, signals=[15]) 2023-08-30T18:28:46.992 INFO:teuthology.lock.ops:Start node 'smithi098.front.sepia.ceph.com' reimaging 2023-08-30T18:28:46.992 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: reset os type and version on server 2023-08-30T18:28:46.993 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2023-08-30T18:28:47.013 INFO:teuthology.lock.ops:Start node 'smithi124.front.sepia.ceph.com' reimaging 2023-08-30T18:28:47.013 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: reset os type and version on server 2023-08-30T18:28:47.014 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2023-08-30T18:28:47.015 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /host {"name": "smithi098"} 2023-08-30T18:28:47.038 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /host {"name": "smithi124"} 2023-08-30T18:28:47.082 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-30T18:28:47.106 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-30T18:28:47.116 DEBUG:teuthology.provision.fog.smithi098:Requesting image smithi_centos_9.stream (ID 10) 2023-08-30T18:28:47.117 DEBUG:teuthology.provision.fog.smithi098:FOG request: PUT /host/203 {"imageID": 10} 2023-08-30T18:28:47.148 DEBUG:teuthology.provision.fog.smithi124:Requesting image smithi_centos_9.stream (ID 10) 2023-08-30T18:28:47.148 DEBUG:teuthology.provision.fog.smithi124:FOG request: PUT /host/229 {"imageID": 10} 2023-08-30T18:28:47.169 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of centos 9.stream 2023-08-30T18:28:47.169 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-30T18:28:47.190 INFO:teuthology.provision.fog.smithi124:Scheduling deploy of centos 9.stream 2023-08-30T18:28:47.190 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-30T18:28:47.264 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /tasktype {"name": "deploy"} 2023-08-30T18:28:47.288 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /tasktype {"name": "deploy"} 2023-08-30T18:28:47.304 DEBUG:teuthology.provision.fog.smithi098:FOG request: POST /host/203/task {"taskTypeID": 1} 2023-08-30T18:28:47.335 DEBUG:teuthology.provision.fog.smithi124:FOG request: POST /host/229/task {"taskTypeID": 1} 2023-08-30T18:28:47.386 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-30T18:28:47.399 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-30T18:28:47.559 INFO:teuthology.orchestra.console.smithi098:Power off 2023-08-30T18:28:47.560 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T18:28:47.572 INFO:teuthology.orchestra.console.smithi124:Power off 2023-08-30T18:28:47.573 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T18:28:47.581 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off 2023-08-30T18:28:47.581 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T18:28:47.593 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off 2023-08-30T18:28:47.594 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T18:28:47.605 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-08-30T18:28:47.615 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-08-30T18:28:47.706 INFO:teuthology.orchestra.console.smithi098:Power off completed 2023-08-30T18:28:47.716 INFO:teuthology.orchestra.console.smithi124:Power off completed 2023-08-30T18:28:47.808 INFO:teuthology.orchestra.console.smithi098:Power on 2023-08-30T18:28:47.809 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-30T18:28:47.817 INFO:teuthology.orchestra.console.smithi124:Power on 2023-08-30T18:28:47.818 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-30T18:28:47.830 DEBUG:teuthology.orchestra.console.smithi098:power on output: Chassis Power Control: Up/On 2023-08-30T18:28:47.830 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T18:28:47.838 DEBUG:teuthology.orchestra.console.smithi124:power on output: Chassis Power Control: Up/On 2023-08-30T18:28:47.838 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T18:28:47.850 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-08-30T18:28:47.858 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-08-30T18:28:51.854 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T18:28:51.861 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T18:28:51.963 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-08-30T18:28:51.969 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-08-30T18:28:55.966 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T18:28:55.973 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T18:28:56.075 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2023-08-30T18:28:56.081 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-08-30T18:28:56.176 INFO:teuthology.orchestra.console.smithi098:Power on completed 2023-08-30T18:28:56.182 INFO:teuthology.orchestra.console.smithi124:Power on completed 2023-08-30T18:28:56.278 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish 2023-08-30T18:28:56.278 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-30T18:28:56.283 INFO:teuthology.provision.fog.smithi124:Waiting for deploy to finish 2023-08-30T18:28:56.284 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-30T18:29:11.418 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-30T18:29:11.420 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-30T18:29:26.562 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-30T18:29:26.563 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-30T18:29:41.718 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-30T18:29:41.719 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-30T18:29:56.887 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-30T18:29:56.897 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-30T18:30:12.046 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-30T18:30:12.048 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-30T18:30:27.198 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-30T18:30:27.199 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-30T18:30:42.370 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-30T18:30:42.372 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-30T18:30:57.594 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-30T18:30:57.596 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-30T18:31:12.762 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-30T18:31:12.763 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-30T18:31:27.911 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-30T18:31:27.912 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-30T18:31:28.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:31:28.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:31:31.102 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-08-30T18:31:31.103 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-08-30T18:31:37.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:31:37.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:31:40.186 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-08-30T18:31:40.190 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-08-30T18:31:46.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:31:46.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:31:49.246 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-08-30T18:31:49.278 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-08-30T18:31:55.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:31:55.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:31:58.330 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-08-30T18:31:58.330 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-08-30T18:32:04.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:32:04.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:32:07.390 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-08-30T18:32:07.391 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-08-30T18:32:13.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:32:13.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:32:16.474 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-08-30T18:32:16.474 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-08-30T18:32:22.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:32:22.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:32:25.566 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-08-30T18:32:25.566 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-08-30T18:32:31.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:32:31.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:33:03.406 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-30T18:33:03.407 DEBUG:teuthology.orchestra.run.smithi124:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-30T18:33:24.175 INFO:teuthology.provision.fog.smithi124:Node is ready 2023-08-30T18:33:24.175 DEBUG:teuthology.orchestra.run.smithi124:> hostname 2023-08-30T18:33:24.196 INFO:teuthology.orchestra.run.smithi124.stdout:smithi197 2023-08-30T18:33:24.197 DEBUG:teuthology.orchestra.run.smithi124:> grep smithi197 /etc/hosts 2023-08-30T18:33:24.254 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.15.197 smithi197.front.sepia.ceph.com smithi197 2023-08-30T18:33:24.254 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124 2023-08-30T18:33:24.383 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi197/smithi124/g' /etc/hosts 2023-08-30T18:33:24.415 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/172.21.15.197/172.21.15.124/g' /etc/hosts 2023-08-30T18:33:24.485 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi197/smithi124/g' /etc/hostname 2023-08-30T18:33:24.555 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124 2023-08-30T18:33:24.623 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2023-08-30T18:33:24.678 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="CentOS Stream" 2023-08-30T18:33:24.679 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="9" 2023-08-30T18:33:24.679 INFO:teuthology.orchestra.run.smithi124.stdout:ID="centos" 2023-08-30T18:33:24.679 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="rhel fedora" 2023-08-30T18:33:24.679 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="9" 2023-08-30T18:33:24.679 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el9" 2023-08-30T18:33:24.680 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-30T18:33:24.680 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31" 2023-08-30T18:33:24.680 INFO:teuthology.orchestra.run.smithi124.stdout:LOGO="fedora-logo-icon" 2023-08-30T18:33:24.680 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-30T18:33:24.680 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://centos.org/" 2023-08-30T18:33:24.681 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T18:33:24.681 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-30T18:33:24.681 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T18:33:24.682 INFO:teuthology.provision.fog.smithi124:Deploy complete! 2023-08-30T18:33:24.683 DEBUG:teuthology.parallel:result is None 2023-08-30T18:33:31.582 WARNING:teuthology.provision.fog.smithi098:timed out 2023-08-30T18:33:37.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:33:37.808 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-30T18:33:37.808 DEBUG:teuthology.orchestra.run.smithi098:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-30T18:33:38.128 INFO:teuthology.provision.fog.smithi098:Node is ready 2023-08-30T18:33:38.128 DEBUG:teuthology.orchestra.run.smithi098:> hostname 2023-08-30T18:33:38.143 INFO:teuthology.orchestra.run.smithi098.stdout:smithi098.front.sepia.ceph.com 2023-08-30T18:33:38.143 DEBUG:teuthology.orchestra.run.smithi098:> grep smithi098.front.sepia.ceph.com /etc/hosts 2023-08-30T18:33:38.197 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98 smithi098.front.sepia.ceph.com smithi098 2023-08-30T18:33:38.198 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2023-08-30T18:33:38.308 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hosts 2023-08-30T18:33:38.435 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/172.21.15.98/172.21.15.98/g' /etc/hosts 2023-08-30T18:33:38.502 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hostname 2023-08-30T18:33:38.569 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2023-08-30T18:33:38.635 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2023-08-30T18:33:38.692 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2023-08-30T18:33:38.692 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="9" 2023-08-30T18:33:38.693 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2023-08-30T18:33:38.693 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2023-08-30T18:33:38.693 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="9" 2023-08-30T18:33:38.693 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el9" 2023-08-30T18:33:38.693 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-30T18:33:38.694 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2023-08-30T18:33:38.694 INFO:teuthology.orchestra.run.smithi098.stdout:LOGO="fedora-logo-icon" 2023-08-30T18:33:38.694 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-30T18:33:38.694 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2023-08-30T18:33:38.694 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T18:33:38.695 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-30T18:33:38.695 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T18:33:38.695 INFO:teuthology.provision.fog.smithi098:Deploy complete! 2023-08-30T18:33:38.696 DEBUG:teuthology.parallel:result is None 2023-08-30T18:33:38.894 INFO:teuthology.lock.ops:Checking smithi098.front.sepia.ceph.com 2023-08-30T18:33:38.895 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-30T18:33:38.920 INFO:teuthology.lock.ops:Checking smithi124.front.sepia.ceph.com 2023-08-30T18:33:38.920 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-30T18:33:38.938 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: set os type and version on server 2023-08-30T18:33:38.938 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-08-30T18:33:38.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:33:39.060 DEBUG:teuthology.orchestra.run.smithi098:> true 2023-08-30T18:33:39.084 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-08-30T18:33:39.084 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2023-08-30T18:33:39.139 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2023-08-30T18:33:39.140 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2023-08-30T18:33:39.196 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2023-08-30T18:33:39.197 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="9" 2023-08-30T18:33:39.197 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2023-08-30T18:33:39.197 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2023-08-30T18:33:39.198 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="9" 2023-08-30T18:33:39.198 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el9" 2023-08-30T18:33:39.198 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-30T18:33:39.198 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2023-08-30T18:33:39.198 INFO:teuthology.orchestra.run.smithi098.stdout:LOGO="fedora-logo-icon" 2023-08-30T18:33:39.199 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-30T18:33:39.199 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2023-08-30T18:33:39.199 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T18:33:39.199 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-30T18:33:39.199 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T18:33:39.200 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2023-08-30T18:33:39.234 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: set os type and version on server 2023-08-30T18:33:39.234 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-08-30T18:33:39.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:33:39.340 DEBUG:teuthology.orchestra.run.smithi124:> true 2023-08-30T18:33:39.508 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-08-30T18:33:39.508 DEBUG:teuthology.orchestra.run.smithi124:> uname -m 2023-08-30T18:33:39.565 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64 2023-08-30T18:33:39.565 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2023-08-30T18:33:39.619 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="CentOS Stream" 2023-08-30T18:33:39.619 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="9" 2023-08-30T18:33:39.620 INFO:teuthology.orchestra.run.smithi124.stdout:ID="centos" 2023-08-30T18:33:39.620 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="rhel fedora" 2023-08-30T18:33:39.620 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="9" 2023-08-30T18:33:39.620 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el9" 2023-08-30T18:33:39.620 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-30T18:33:39.621 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31" 2023-08-30T18:33:39.621 INFO:teuthology.orchestra.run.smithi124.stdout:LOGO="fedora-logo-icon" 2023-08-30T18:33:39.621 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-30T18:33:39.621 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://centos.org/" 2023-08-30T18:33:39.621 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T18:33:39.622 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-30T18:33:39.622 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T18:33:39.623 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2023-08-30T18:33:39.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T18:33:39.741 INFO:teuthology.dispatcher.supervisor:Running job 7384579 2023-08-30T18:33:39.742 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-30_18:17:27-rados-wip-yuri6-testing-2023-08-28-1308-distro-default-smithi/7384579 --name yuriw-2023-08-30_18:17:27-rados-wip-yuri6-testing-2023-08-28-1308-distro-default-smithi --description rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} -- /home/teuthworker/archive/yuriw-2023-08-30_18:17:27-rados-wip-yuri6-testing-2023-08-28-1308-distro-default-smithi/7384579/orig.config.yaml 2023-08-30T18:33:39.745 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-30_18:17:27-rados-wip-yuri6-testing-2023-08-28-1308-distro-default-smithi/7384579 2023-08-30T18:33:39.746 INFO:teuthology.dispatcher.supervisor:Job PID: 1944235 2023-08-30T18:33:39.746 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-30T18:35:39.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T18:35:39.912 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-30T18:35:40.026 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-30T18:35:40.027 INFO:teuthology.nuke:Checking targets against current locks 2023-08-30T18:35:40.073 DEBUG:teuthology.nuke:shortname: smithi098 2023-08-30T18:35:40.074 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-30T18:35:40.096 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-30_18:17:27-rados-wip-yuri6-testing-2023-08-28-1308-distro-default-smithi/7384579', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 18:28:46.069512', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBICD2+5CECQTGyk+x4EkqErJcCgmd8NwLLJ3IJ8B8FIjqSHr4LUS8lAnEaEDs04vHTWIUAv90nm5l2t0wM0PHBw='} 2023-08-30T18:35:40.100 DEBUG:teuthology.nuke:shortname: smithi124 2023-08-30T18:35:40.101 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-30T18:35:40.128 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi124.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-30_18:17:27-rados-wip-yuri6-testing-2023-08-28-1308-distro-default-smithi/7384579', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 18:28:46.071020', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMTGmRHWqgOcMy/A2Di2mkgVHvMYdUIx3inz24XD0FXQN5n+leuvsmIWm4ieRdZHZn2mLvM9psNkPf9Ld1vOgCQ='} 2023-08-30T18:35:40.155 INFO:teuthology.orchestra.console.smithi098:Power off 2023-08-30T18:35:40.156 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T18:35:40.177 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off 2023-08-30T18:35:40.178 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T18:35:40.194 INFO:teuthology.orchestra.console.smithi124:Power off 2023-08-30T18:35:40.198 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T18:35:40.207 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-08-30T18:35:40.219 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off 2023-08-30T18:35:40.219 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T18:35:40.246 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-08-30T18:35:40.309 INFO:teuthology.orchestra.console.smithi098:Power off completed 2023-08-30T18:35:40.348 INFO:teuthology.orchestra.console.smithi124:Power off completed 2023-08-30T18:35:40.460 INFO:teuthology.lock.ops:unlocked: smithi098.front.sepia.ceph.com 2023-08-30T18:35:40.495 INFO:teuthology.lock.ops:unlocked: smithi124.front.sepia.ceph.com