2023-08-10T03:23:39.310 INFO:root:teuthology version: 0.0.1.dev181+g7fda959 2023-08-10T03:23:39.312 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T03:23:39.463 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7efffb56b280>, signals=[15]) 2023-08-10T03:23:39.465 INFO:teuthology.lock.ops:Start node 'smithi081.front.sepia.ceph.com' reimaging 2023-08-10T03:23:39.465 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: reset os type and version on server 2023-08-10T03:23:39.465 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2023-08-10T03:23:39.489 INFO:teuthology.lock.ops:Start node 'smithi119.front.sepia.ceph.com' reimaging 2023-08-10T03:23:39.490 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: reset os type and version on server 2023-08-10T03:23:39.490 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2023-08-10T03:23:39.491 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /host {"name": "smithi081"} 2023-08-10T03:23:39.515 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /host {"name": "smithi119"} 2023-08-10T03:23:39.562 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-10T03:23:39.584 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-10T03:23:39.602 DEBUG:teuthology.provision.fog.smithi081:Requesting image smithi_centos_8.stream (ID 3) 2023-08-10T03:23:39.602 DEBUG:teuthology.provision.fog.smithi081:FOG request: PUT /host/186 {"imageID": 3} 2023-08-10T03:23:39.625 DEBUG:teuthology.provision.fog.smithi119:Requesting image smithi_centos_8.stream (ID 3) 2023-08-10T03:23:39.626 DEBUG:teuthology.provision.fog.smithi119:FOG request: PUT /host/224 {"imageID": 3} 2023-08-10T03:23:39.658 INFO:teuthology.provision.fog.smithi081:Scheduling deploy of centos 8.stream 2023-08-10T03:23:39.659 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-08-10T03:23:39.675 INFO:teuthology.provision.fog.smithi119:Scheduling deploy of centos 8.stream 2023-08-10T03:23:39.676 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-08-10T03:23:39.719 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /tasktype {"name": "deploy"} 2023-08-10T03:23:39.726 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /tasktype {"name": "deploy"} 2023-08-10T03:23:39.756 DEBUG:teuthology.provision.fog.smithi119:FOG request: POST /host/224/task {"taskTypeID": 1} 2023-08-10T03:23:39.762 DEBUG:teuthology.provision.fog.smithi081:FOG request: POST /host/186/task {"taskTypeID": 1} 2023-08-10T03:23:39.805 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-08-10T03:23:39.811 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-08-10T03:23:39.904 INFO:teuthology.orchestra.console.smithi119:Power off 2023-08-10T03:23:39.905 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-10T03:23:39.920 INFO:teuthology.orchestra.console.smithi081:Power off 2023-08-10T03:23:39.920 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-10T03:23:39.930 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off 2023-08-10T03:23:39.931 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T03:23:39.942 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off 2023-08-10T03:23:39.943 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T03:23:39.953 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2023-08-10T03:23:39.965 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-08-10T03:23:40.054 INFO:teuthology.orchestra.console.smithi119:Power off completed 2023-08-10T03:23:40.067 INFO:teuthology.orchestra.console.smithi081:Power off completed 2023-08-10T03:23:40.155 INFO:teuthology.orchestra.console.smithi119:Power on 2023-08-10T03:23:40.156 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-10T03:23:40.168 INFO:teuthology.orchestra.console.smithi081:Power on 2023-08-10T03:23:40.169 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-10T03:23:40.178 DEBUG:teuthology.orchestra.console.smithi119:power on output: Chassis Power Control: Up/On 2023-08-10T03:23:40.179 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T03:23:40.189 DEBUG:teuthology.orchestra.console.smithi081:power on output: Chassis Power Control: Up/On 2023-08-10T03:23:40.190 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T03:23:40.201 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2023-08-10T03:23:40.211 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-08-10T03:23:44.204 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T03:23:44.214 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T03:23:44.316 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2023-08-10T03:23:44.324 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-08-10T03:23:44.418 INFO:teuthology.orchestra.console.smithi119:Power on completed 2023-08-10T03:23:44.518 INFO:teuthology.provision.fog.smithi119:Waiting for deploy to finish 2023-08-10T03:23:44.519 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-08-10T03:23:48.328 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T03:23:48.438 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2023-08-10T03:23:48.539 INFO:teuthology.orchestra.console.smithi081:Power on completed 2023-08-10T03:23:48.640 INFO:teuthology.provision.fog.smithi081:Waiting for deploy to finish 2023-08-10T03:23:48.640 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-08-10T03:23:59.600 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-08-10T03:24:03.712 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-08-10T03:24:14.678 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-08-10T03:24:18.799 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-08-10T03:24:29.756 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-08-10T03:24:33.882 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-08-10T03:24:44.836 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-08-10T03:24:48.965 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-08-10T03:24:59.908 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-08-10T03:25:04.040 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-08-10T03:25:14.984 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-08-10T03:25:19.120 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-08-10T03:25:30.056 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-08-10T03:25:34.200 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-08-10T03:25:45.126 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-08-10T03:25:49.276 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-08-10T03:26:00.200 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-08-10T03:26:04.340 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-08-10T03:26:15.268 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-08-10T03:26:19.405 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-08-10T03:26:19.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:26:22.544 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-08-10T03:26:28.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:26:30.330 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-08-10T03:26:30.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:26:31.600 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-08-10T03:26:33.456 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-08-10T03:26:37.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:26:39.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:26:40.656 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-08-10T03:26:42.512 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-08-10T03:26:46.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:26:48.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:26:49.712 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-08-10T03:26:51.572 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-08-10T03:26:55.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:26:57.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:26:58.768 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-08-10T03:27:00.656 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-08-10T03:27:04.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:27:06.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:27:07.824 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-08-10T03:27:09.712 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-08-10T03:27:13.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:27:15.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:27:16.884 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-08-10T03:27:18.768 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-08-10T03:27:22.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:27:24.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:27:43.220 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-08-10T03:27:49.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:27:52.304 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-08-10T03:27:54.705 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-10T03:27:54.706 DEBUG:teuthology.orchestra.run.smithi081:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-10T03:27:58.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:27:58.980 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-10T03:27:58.980 DEBUG:teuthology.orchestra.run.smithi119:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-10T03:28:20.202 INFO:teuthology.provision.fog.smithi081:Node is ready 2023-08-10T03:28:20.203 DEBUG:teuthology.orchestra.run.smithi081:> hostname 2023-08-10T03:28:20.226 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081.front.sepia.ceph.com 2023-08-10T03:28:20.227 DEBUG:teuthology.orchestra.run.smithi081:> grep smithi081.front.sepia.ceph.com /etc/hosts 2023-08-10T03:28:20.287 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81 smithi081.front.sepia.ceph.com smithi081 2023-08-10T03:28:20.288 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081 2023-08-10T03:28:20.404 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hosts 2023-08-10T03:28:20.435 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/172.21.15.81/172.21.15.81/g' /etc/hosts 2023-08-10T03:28:20.505 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hostname 2023-08-10T03:28:20.575 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081 2023-08-10T03:28:20.642 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2023-08-10T03:28:20.700 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream" 2023-08-10T03:28:20.701 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8" 2023-08-10T03:28:20.701 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos" 2023-08-10T03:28:20.701 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora" 2023-08-10T03:28:20.701 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8" 2023-08-10T03:28:20.701 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8" 2023-08-10T03:28:20.702 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-10T03:28:20.702 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2023-08-10T03:28:20.702 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-10T03:28:20.702 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/" 2023-08-10T03:28:20.702 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-10T03:28:20.702 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-10T03:28:20.702 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-10T03:28:20.703 INFO:teuthology.provision.fog.smithi081:Deploy complete! 2023-08-10T03:28:20.704 DEBUG:teuthology.parallel:result is None 2023-08-10T03:28:23.993 INFO:teuthology.provision.fog.smithi119:Node is ready 2023-08-10T03:28:23.993 DEBUG:teuthology.orchestra.run.smithi119:> hostname 2023-08-10T03:28:24.016 INFO:teuthology.orchestra.run.smithi119.stdout:smithi119.front.sepia.ceph.com 2023-08-10T03:28:24.017 DEBUG:teuthology.orchestra.run.smithi119:> grep smithi119.front.sepia.ceph.com /etc/hosts 2023-08-10T03:28:24.077 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119 smithi119.front.sepia.ceph.com smithi119 2023-08-10T03:28:24.077 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119 2023-08-10T03:28:24.199 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119.front.sepia.ceph.com/smithi119/g' /etc/hosts 2023-08-10T03:28:24.230 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/172.21.15.119/172.21.15.119/g' /etc/hosts 2023-08-10T03:28:24.300 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119.front.sepia.ceph.com/smithi119/g' /etc/hostname 2023-08-10T03:28:24.368 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119 2023-08-10T03:28:24.434 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2023-08-10T03:28:24.492 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream" 2023-08-10T03:28:24.492 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="8" 2023-08-10T03:28:24.492 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos" 2023-08-10T03:28:24.492 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora" 2023-08-10T03:28:24.493 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="8" 2023-08-10T03:28:24.493 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el8" 2023-08-10T03:28:24.493 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-10T03:28:24.493 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2023-08-10T03:28:24.493 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-10T03:28:24.493 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/" 2023-08-10T03:28:24.493 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-10T03:28:24.494 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-10T03:28:24.494 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-10T03:28:24.494 INFO:teuthology.provision.fog.smithi119:Deploy complete! 2023-08-10T03:28:24.494 DEBUG:teuthology.parallel:result is None 2023-08-10T03:28:24.635 INFO:teuthology.lock.ops:Checking smithi081.front.sepia.ceph.com 2023-08-10T03:28:24.635 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-10T03:28:24.657 INFO:teuthology.lock.ops:Checking smithi119.front.sepia.ceph.com 2023-08-10T03:28:24.657 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-10T03:28:24.684 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: set os type and version on server 2023-08-10T03:28:24.684 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-08-10T03:28:24.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:28:24.753 DEBUG:teuthology.orchestra.run.smithi081:> true 2023-08-10T03:28:24.825 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-08-10T03:28:24.825 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2023-08-10T03:28:24.886 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2023-08-10T03:28:24.886 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2023-08-10T03:28:24.946 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream" 2023-08-10T03:28:24.946 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8" 2023-08-10T03:28:24.946 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos" 2023-08-10T03:28:24.947 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora" 2023-08-10T03:28:24.947 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8" 2023-08-10T03:28:24.947 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8" 2023-08-10T03:28:24.947 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-10T03:28:24.947 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2023-08-10T03:28:24.948 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-10T03:28:24.948 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/" 2023-08-10T03:28:24.948 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-10T03:28:24.948 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-10T03:28:24.948 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-10T03:28:24.949 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2023-08-10T03:28:24.974 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: set os type and version on server 2023-08-10T03:28:24.974 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-08-10T03:28:24.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:28:25.041 DEBUG:teuthology.orchestra.run.smithi119:> true 2023-08-10T03:28:25.109 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-08-10T03:28:25.110 DEBUG:teuthology.orchestra.run.smithi119:> uname -m 2023-08-10T03:28:25.168 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2023-08-10T03:28:25.168 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2023-08-10T03:28:25.225 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream" 2023-08-10T03:28:25.225 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="8" 2023-08-10T03:28:25.225 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos" 2023-08-10T03:28:25.226 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora" 2023-08-10T03:28:25.226 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="8" 2023-08-10T03:28:25.226 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el8" 2023-08-10T03:28:25.226 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-10T03:28:25.226 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2023-08-10T03:28:25.226 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-10T03:28:25.226 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/" 2023-08-10T03:28:25.226 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-10T03:28:25.227 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-10T03:28:25.227 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-10T03:28:25.227 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2023-08-10T03:28:25.249 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T03:28:25.340 INFO:teuthology.dispatcher.supervisor:Running job 7362306 2023-08-10T03:28:25.341 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/bin/teuthology -v --owner scheduled_amathuri@teuthology --archive /home/teuthworker/archive/amathuri-2023-08-07_14:27:31-rados:thrash-main-distro-default-smithi/7362306 --name amathuri-2023-08-07_14:27:31-rados:thrash-main-distro-default-smithi --description rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-agent-big} -- /home/teuthworker/archive/amathuri-2023-08-07_14:27:31-rados:thrash-main-distro-default-smithi/7362306/orig.config.yaml 2023-08-10T03:28:25.344 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/amathuri-2023-08-07_14:27:31-rados:thrash-main-distro-default-smithi/7362306 2023-08-10T03:28:25.345 INFO:teuthology.dispatcher.supervisor:Job PID: 730 2023-08-10T03:28:25.345 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-10T03:30:25.444 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T03:32:25.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T03:34:25.773 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T03:36:25.937 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T03:38:26.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T03:40:26.285 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T03:42:26.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T03:44:26.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T03:44:26.709 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-10T03:44:26.882 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-10T03:44:26.883 INFO:teuthology.nuke:Checking targets against current locks 2023-08-10T03:44:26.935 DEBUG:teuthology.nuke:shortname: smithi081 2023-08-10T03:44:26.935 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-10T03:44:26.953 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/amathuri-2023-08-07_14:27:31-rados:thrash-main-distro-default-smithi/7362306', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-10 03:23:38.491213', 'locked_by': 'scheduled_amathuri@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDdDRsJn8JkR0PF9ugSwyasGX3c3RlSF6lLzDdsOz9CtCUKcBqkc+6F4x2ZNS157xdzUtiNFK8SfyiD7mxPgOU7XbdXgpPZlbLxAE86hy+fkqiaH4v9CcCDmiPSRfstX80Q5fwL/z7YwVSGNqlyITO2oEWL0tUykdjc2goz0j4DhDNStIwqcV0PHLU7DSIjS2rdofCLLlzubKFDnyQ3llmkvT4/y90DK5m+kw1/bdC/z6QHiKxnZ5VxDrMjJgPU6t9WoF08b5Q9RLYrvRNGc9m0G9wBy5G9Qgj8iO4kEnqs55eaRhfjZYwDFqroHQ8pmPWAPUJezc8sNfZjww/hqyWhYauB4url/Xgk9OiorZcQ9XCHba0OL3TYSTtDmu6UEhyXh5HouGVpEGt/p3Awq3Qo3Gqso+lOcRo9L3cvrfsMW4jDehOCKwdjNPVVWqchSZLS8GknuPSdRoPzUwSyYzTNTM1AwyBRKNBWOvJOKoywSyaZhOjj8vQXmTAsM+Ki2vk='} 2023-08-10T03:44:26.957 DEBUG:teuthology.nuke:shortname: smithi119 2023-08-10T03:44:26.957 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-10T03:44:26.980 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/amathuri-2023-08-07_14:27:31-rados:thrash-main-distro-default-smithi/7362306', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-10 03:23:38.492677', 'locked_by': 'scheduled_amathuri@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJq2/cXYMLKECDop5KK7zqzhaMrA9ADZdbIL94nZYzKdgcjy7GocqO7XA09c5fjcmuoRVjIwBbNbuAlursfoW9w='} 2023-08-10T03:44:26.997 INFO:teuthology.orchestra.console.smithi081:Power off 2023-08-10T03:44:26.998 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-10T03:44:27.022 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off 2023-08-10T03:44:27.022 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T03:44:27.044 INFO:teuthology.orchestra.console.smithi119:Power off 2023-08-10T03:44:27.045 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-10T03:44:27.055 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-08-10T03:44:27.068 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off 2023-08-10T03:44:27.068 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T03:44:27.091 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2023-08-10T03:44:27.158 INFO:teuthology.orchestra.console.smithi081:Power off completed 2023-08-10T03:44:27.193 INFO:teuthology.orchestra.console.smithi119:Power off completed 2023-08-10T03:44:27.306 INFO:teuthology.lock.ops:unlocked: smithi081.front.sepia.ceph.com 2023-08-10T03:44:27.340 INFO:teuthology.lock.ops:unlocked: smithi119.front.sepia.ceph.com