2023-08-10T03:30:43.839 INFO:root:teuthology version: 0.0.1.dev181+g7fda959 2023-08-10T03:30:43.842 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T03:30:43.987 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2df5588f70>, signals=[15]) 2023-08-10T03:30:43.989 INFO:teuthology.lock.ops:Start node 'smithi069.front.sepia.ceph.com' reimaging 2023-08-10T03:30:43.989 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: reset os type and version on server 2023-08-10T03:30:43.990 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2023-08-10T03:30:44.012 INFO:teuthology.lock.ops:Start node 'smithi179.front.sepia.ceph.com' reimaging 2023-08-10T03:30:44.012 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: reset os type and version on server 2023-08-10T03:30:44.012 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2023-08-10T03:30:44.014 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /host {"name": "smithi069"} 2023-08-10T03:30:44.037 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /host {"name": "smithi179"} 2023-08-10T03:30:44.104 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-10T03:30:44.115 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-10T03:30:44.147 DEBUG:teuthology.provision.fog.smithi069:Requesting image smithi_centos_8.stream (ID 3) 2023-08-10T03:30:44.147 DEBUG:teuthology.provision.fog.smithi069:FOG request: PUT /host/174 {"imageID": 3} 2023-08-10T03:30:44.157 DEBUG:teuthology.provision.fog.smithi179:Requesting image smithi_centos_8.stream (ID 3) 2023-08-10T03:30:44.157 DEBUG:teuthology.provision.fog.smithi179:FOG request: PUT /host/284 {"imageID": 3} 2023-08-10T03:30:44.193 INFO:teuthology.provision.fog.smithi069:Scheduling deploy of centos 8.stream 2023-08-10T03:30:44.193 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-10T03:30:44.205 INFO:teuthology.provision.fog.smithi179:Scheduling deploy of centos 8.stream 2023-08-10T03:30:44.205 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-10T03:30:44.249 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /tasktype {"name": "deploy"} 2023-08-10T03:30:44.258 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /tasktype {"name": "deploy"} 2023-08-10T03:30:44.284 DEBUG:teuthology.provision.fog.smithi069:FOG request: POST /host/174/task {"taskTypeID": 1} 2023-08-10T03:30:44.297 DEBUG:teuthology.provision.fog.smithi179:FOG request: POST /host/284/task {"taskTypeID": 1} 2023-08-10T03:30:44.342 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-10T03:30:44.364 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-10T03:30:44.428 INFO:teuthology.orchestra.console.smithi069:Power off 2023-08-10T03:30:44.429 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-10T03:30:44.449 INFO:teuthology.orchestra.console.smithi179:Power off 2023-08-10T03:30:44.450 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-10T03:30:44.458 DEBUG:teuthology.orchestra.console.smithi069:power off output: Chassis Power Control: Down/Off 2023-08-10T03:30:44.459 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T03:30:44.471 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2023-08-10T03:30:44.472 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T03:30:44.483 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-08-10T03:30:44.494 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2023-08-10T03:30:48.484 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T03:30:48.495 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T03:30:48.597 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-08-10T03:30:48.606 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2023-08-10T03:30:52.600 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T03:30:52.611 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T03:30:52.713 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-08-10T03:30:52.722 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-08-10T03:30:52.822 INFO:teuthology.orchestra.console.smithi179:Power off completed 2023-08-10T03:30:52.923 INFO:teuthology.orchestra.console.smithi179:Power on 2023-08-10T03:30:52.924 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-10T03:30:52.948 DEBUG:teuthology.orchestra.console.smithi179:power on output: Chassis Power Control: Up/On 2023-08-10T03:30:52.949 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T03:30:52.971 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-08-10T03:30:56.716 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T03:30:56.827 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-08-10T03:30:56.929 INFO:teuthology.orchestra.console.smithi069:Power off completed 2023-08-10T03:30:56.973 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T03:30:57.030 INFO:teuthology.orchestra.console.smithi069:Power on 2023-08-10T03:30:57.032 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-10T03:30:57.060 DEBUG:teuthology.orchestra.console.smithi069:power on output: Chassis Power Control: Up/On 2023-08-10T03:30:57.061 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T03:30:57.082 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-08-10T03:30:57.083 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-08-10T03:31:01.084 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T03:31:01.093 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T03:31:01.205 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-08-10T03:31:01.258 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2023-08-10T03:31:01.359 INFO:teuthology.orchestra.console.smithi179:Power on completed 2023-08-10T03:31:01.459 INFO:teuthology.provision.fog.smithi179:Waiting for deploy to finish 2023-08-10T03:31:01.460 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-10T03:31:05.208 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T03:31:05.319 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-08-10T03:31:05.420 INFO:teuthology.orchestra.console.smithi069:Power on completed 2023-08-10T03:31:05.521 INFO:teuthology.provision.fog.smithi069:Waiting for deploy to finish 2023-08-10T03:31:05.521 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-10T03:31:16.528 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-10T03:31:20.584 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-10T03:31:31.598 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-10T03:31:35.646 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-10T03:31:46.664 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-10T03:31:50.708 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-10T03:32:01.724 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-10T03:32:05.769 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-10T03:32:16.784 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-10T03:32:20.820 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-10T03:32:31.852 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-10T03:32:35.876 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-10T03:32:46.925 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-10T03:32:50.928 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-10T03:33:01.988 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-10T03:33:06.002 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-10T03:33:17.061 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-10T03:33:21.058 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-10T03:33:32.120 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-10T03:33:36.116 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-10T03:33:36.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:33:36.647 ERROR:teuthology.orchestra.connection:Error authenticating with smithi069.front.sepia.ceph.com: Authentication failed. 2023-08-10T03:33:36.649 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-10T03:33:36.649 DEBUG:teuthology.orchestra.run.smithi069:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-10T03:33:36.651 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-10T03:33:47.175 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-10T03:33:47.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:33:50.288 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-08-10T03:33:56.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:33:59.344 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-08-10T03:34:05.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:34:08.400 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-08-10T03:34:14.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:34:17.460 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-08-10T03:34:23.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:34:26.512 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-08-10T03:34:32.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:34:35.568 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-08-10T03:34:41.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:35:13.206 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-10T03:35:13.207 DEBUG:teuthology.orchestra.run.smithi179:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-10T03:35:38.602 INFO:teuthology.provision.fog.smithi179:Node is ready 2023-08-10T03:35:38.602 DEBUG:teuthology.orchestra.run.smithi179:> hostname 2023-08-10T03:35:38.667 INFO:teuthology.orchestra.run.smithi179.stdout:smithi179.front.sepia.ceph.com 2023-08-10T03:35:38.667 DEBUG:teuthology.orchestra.run.smithi179:> grep smithi179.front.sepia.ceph.com /etc/hosts 2023-08-10T03:35:38.727 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.15.179 smithi179.front.sepia.ceph.com smithi179 2023-08-10T03:35:38.728 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179 2023-08-10T03:35:38.857 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179.front.sepia.ceph.com/smithi179/g' /etc/hosts 2023-08-10T03:35:38.889 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/172.21.15.179/172.21.15.179/g' /etc/hosts 2023-08-10T03:35:38.959 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179.front.sepia.ceph.com/smithi179/g' /etc/hostname 2023-08-10T03:35:39.029 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179 2023-08-10T03:35:39.096 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2023-08-10T03:35:39.155 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="CentOS Stream" 2023-08-10T03:35:39.156 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="8" 2023-08-10T03:35:39.156 INFO:teuthology.orchestra.run.smithi179.stdout:ID="centos" 2023-08-10T03:35:39.156 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="rhel fedora" 2023-08-10T03:35:39.156 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="8" 2023-08-10T03:35:39.156 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el8" 2023-08-10T03:35:39.156 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-10T03:35:39.157 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2023-08-10T03:35:39.157 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-10T03:35:39.157 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://centos.org/" 2023-08-10T03:35:39.157 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-10T03:35:39.157 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-10T03:35:39.157 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-10T03:35:39.158 INFO:teuthology.provision.fog.smithi179:Deploy complete! 2023-08-10T03:35:39.159 DEBUG:teuthology.parallel:result is None 2023-08-10T03:36:31.601 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-08-10T03:36:31.602 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi069 2023-08-10T03:36:40.603 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-08-10T03:36:40.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:36:40.866 DEBUG:teuthology.orchestra.run.smithi069:> true 2023-08-10T03:36:41.135 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-08-10T03:36:41.135 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-10T03:36:41.136 DEBUG:teuthology.orchestra.run.smithi069:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-10T03:36:41.155 INFO:teuthology.provision.fog.smithi069:Node is ready 2023-08-10T03:36:41.155 DEBUG:teuthology.orchestra.run.smithi069:> hostname 2023-08-10T03:36:41.214 INFO:teuthology.orchestra.run.smithi069.stdout:smithi069.front.sepia.ceph.com 2023-08-10T03:36:41.214 DEBUG:teuthology.orchestra.run.smithi069:> grep smithi069.front.sepia.ceph.com /etc/hosts 2023-08-10T03:36:41.273 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69 smithi069.front.sepia.ceph.com smithi069 2023-08-10T03:36:41.273 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname smithi069 2023-08-10T03:36:41.390 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/smithi069.front.sepia.ceph.com/smithi069/g' /etc/hosts 2023-08-10T03:36:41.422 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/172.21.15.69/172.21.15.69/g' /etc/hosts 2023-08-10T03:36:41.492 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/smithi069.front.sepia.ceph.com/smithi069/g' /etc/hostname 2023-08-10T03:36:41.561 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname smithi069 2023-08-10T03:36:41.629 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2023-08-10T03:36:41.687 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="CentOS Stream" 2023-08-10T03:36:41.688 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="8" 2023-08-10T03:36:41.688 INFO:teuthology.orchestra.run.smithi069.stdout:ID="centos" 2023-08-10T03:36:41.688 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="rhel fedora" 2023-08-10T03:36:41.689 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="8" 2023-08-10T03:36:41.689 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el8" 2023-08-10T03:36:41.689 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-10T03:36:41.689 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31" 2023-08-10T03:36:41.689 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-10T03:36:41.690 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://centos.org/" 2023-08-10T03:36:41.690 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-10T03:36:41.690 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-10T03:36:41.690 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-10T03:36:41.690 INFO:teuthology.provision.fog.smithi069:Deploy complete! 2023-08-10T03:36:41.691 DEBUG:teuthology.parallel:result is None 2023-08-10T03:36:41.863 INFO:teuthology.lock.ops:Checking smithi069.front.sepia.ceph.com 2023-08-10T03:36:41.864 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-10T03:36:41.887 INFO:teuthology.lock.ops:Checking smithi179.front.sepia.ceph.com 2023-08-10T03:36:41.888 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-10T03:36:41.918 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: set os type and version on server 2023-08-10T03:36:41.919 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-08-10T03:36:41.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:36:41.988 DEBUG:teuthology.orchestra.run.smithi069:> true 2023-08-10T03:36:42.013 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-08-10T03:36:42.014 DEBUG:teuthology.orchestra.run.smithi069:> uname -m 2023-08-10T03:36:42.071 INFO:teuthology.orchestra.run.smithi069.stdout:x86_64 2023-08-10T03:36:42.072 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2023-08-10T03:36:42.130 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="CentOS Stream" 2023-08-10T03:36:42.130 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="8" 2023-08-10T03:36:42.130 INFO:teuthology.orchestra.run.smithi069.stdout:ID="centos" 2023-08-10T03:36:42.130 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="rhel fedora" 2023-08-10T03:36:42.130 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="8" 2023-08-10T03:36:42.131 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el8" 2023-08-10T03:36:42.131 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-10T03:36:42.131 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31" 2023-08-10T03:36:42.131 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-10T03:36:42.131 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://centos.org/" 2023-08-10T03:36:42.131 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-10T03:36:42.132 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-10T03:36:42.134 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-10T03:36:42.134 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2023-08-10T03:36:42.155 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: set os type and version on server 2023-08-10T03:36:42.156 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-08-10T03:36:42.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:36:42.225 DEBUG:teuthology.orchestra.run.smithi179:> true 2023-08-10T03:36:42.299 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-08-10T03:36:42.299 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2023-08-10T03:36:42.359 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2023-08-10T03:36:42.359 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2023-08-10T03:36:42.418 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="CentOS Stream" 2023-08-10T03:36:42.419 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="8" 2023-08-10T03:36:42.419 INFO:teuthology.orchestra.run.smithi179.stdout:ID="centos" 2023-08-10T03:36:42.419 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="rhel fedora" 2023-08-10T03:36:42.419 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="8" 2023-08-10T03:36:42.419 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el8" 2023-08-10T03:36:42.420 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-10T03:36:42.420 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2023-08-10T03:36:42.420 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-10T03:36:42.420 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://centos.org/" 2023-08-10T03:36:42.420 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-10T03:36:42.420 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-10T03:36:42.420 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-10T03:36:42.421 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2023-08-10T03:36:42.445 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T03:36:42.536 INFO:teuthology.dispatcher.supervisor:Running job 7362316 2023-08-10T03:36:42.536 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/bin/teuthology -v --owner scheduled_amathuri@teuthology --archive /home/teuthworker/archive/amathuri-2023-08-07_14:27:31-rados:thrash-main-distro-default-smithi/7362316 --name amathuri-2023-08-07_14:27:31-rados:thrash-main-distro-default-smithi --description rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-agent-big} -- /home/teuthworker/archive/amathuri-2023-08-07_14:27:31-rados:thrash-main-distro-default-smithi/7362316/orig.config.yaml 2023-08-10T03:36:42.541 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/amathuri-2023-08-07_14:27:31-rados:thrash-main-distro-default-smithi/7362316 2023-08-10T03:36:42.541 INFO:teuthology.dispatcher.supervisor:Job PID: 18685 2023-08-10T03:36:42.542 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-10T03:38:42.642 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T03:40:42.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T03:42:42.989 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T03:44:43.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T03:46:43.321 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T03:48:43.485 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T03:50:43.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T03:52:43.812 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T03:52:43.879 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-10T03:52:44.007 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-10T03:52:44.007 INFO:teuthology.nuke:Checking targets against current locks 2023-08-10T03:52:44.059 DEBUG:teuthology.nuke:shortname: smithi069 2023-08-10T03:52:44.060 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-10T03:52:44.087 DEBUG:teuthology.nuke:shortname: smithi179 2023-08-10T03:52:44.087 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-10T03:52:44.090 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi069.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/amathuri-2023-08-07_14:27:31-rados:thrash-main-distro-default-smithi/7362316', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-10 03:30:43.058140', 'locked_by': 'scheduled_amathuri@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNg2T4W5PzE6mbZS/6PjL6odYYU7NNuSc7K2KS7OLKCDkQ4CsD8yPC6OCkeSMyXjazItwnHsOqdjMfzICScc3LA='} 2023-08-10T03:52:44.111 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/amathuri-2023-08-07_14:27:31-rados:thrash-main-distro-default-smithi/7362316', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-10 03:30:43.059798', 'locked_by': 'scheduled_amathuri@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGw3nFANJ4EX6CGTDhxOZ9S+qa28K7qf+BfqliR7owJY/wdjd9Q97ITuaDm0KLAVZsXVJjBbzFyrU6wQeqOTAzc='} 2023-08-10T03:52:44.145 INFO:teuthology.orchestra.console.smithi069:Power off 2023-08-10T03:52:44.146 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-10T03:52:44.170 DEBUG:teuthology.orchestra.console.smithi069:power off output: Chassis Power Control: Down/Off 2023-08-10T03:52:44.171 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T03:52:44.192 INFO:teuthology.orchestra.console.smithi179:Power off 2023-08-10T03:52:44.194 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-10T03:52:44.204 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-08-10T03:52:44.215 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2023-08-10T03:52:44.215 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T03:52:44.238 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-08-10T03:52:44.306 INFO:teuthology.orchestra.console.smithi069:Power off completed 2023-08-10T03:52:44.341 INFO:teuthology.orchestra.console.smithi179:Power off completed 2023-08-10T03:52:44.454 INFO:teuthology.lock.ops:unlocked: smithi069.front.sepia.ceph.com 2023-08-10T03:52:44.487 INFO:teuthology.lock.ops:unlocked: smithi179.front.sepia.ceph.com