2023-11-12T08:51:19.856 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-12T08:51:19.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-12T08:51:19.996 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1a57f0ab80>, signals=[15]) 2023-11-12T08:51:19.997 INFO:teuthology.lock.ops:Start node 'smithi023.front.sepia.ceph.com' reimaging 2023-11-12T08:51:19.998 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: reset os type and version on server 2023-11-12T08:51:19.998 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server 2023-11-12T08:51:20.021 INFO:teuthology.lock.ops:Start node 'smithi188.front.sepia.ceph.com' reimaging 2023-11-12T08:51:20.022 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: reset os type and version on server 2023-11-12T08:51:20.022 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2023-11-12T08:51:20.023 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /host {"name": "smithi023"} 2023-11-12T08:51:20.046 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /host {"name": "smithi188"} 2023-11-12T08:51:20.098 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-11-12T08:51:20.108 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-11-12T08:51:20.145 DEBUG:teuthology.provision.fog.smithi023:Requesting image smithi_centos_9.stream (ID 10) 2023-11-12T08:51:20.146 DEBUG:teuthology.provision.fog.smithi023:FOG request: PUT /host/129 {"imageID": 10} 2023-11-12T08:51:20.148 DEBUG:teuthology.provision.fog.smithi188:Requesting image smithi_centos_9.stream (ID 10) 2023-11-12T08:51:20.149 DEBUG:teuthology.provision.fog.smithi188:FOG request: PUT /host/293 {"imageID": 10} 2023-11-12T08:51:20.191 INFO:teuthology.provision.fog.smithi188:Scheduling deploy of centos 9.stream 2023-11-12T08:51:20.192 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-11-12T08:51:20.194 INFO:teuthology.provision.fog.smithi023:Scheduling deploy of centos 9.stream 2023-11-12T08:51:20.195 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-12T08:51:20.250 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /tasktype {"name": "deploy"} 2023-11-12T08:51:20.254 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /tasktype {"name": "deploy"} 2023-11-12T08:51:20.285 DEBUG:teuthology.provision.fog.smithi023:FOG request: POST /host/129/task {"taskTypeID": 1} 2023-11-12T08:51:20.290 DEBUG:teuthology.provision.fog.smithi188:FOG request: POST /host/293/task {"taskTypeID": 1} 2023-11-12T08:51:20.334 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-12T08:51:20.339 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-11-12T08:51:20.421 INFO:teuthology.orchestra.console.smithi023:Power off 2023-11-12T08:51:20.422 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-12T08:51:20.434 INFO:teuthology.orchestra.console.smithi188:Power off 2023-11-12T08:51:20.435 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-12T08:51:20.443 DEBUG:teuthology.orchestra.console.smithi023:power off output: Chassis Power Control: Down/Off 2023-11-12T08:51:20.444 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-12T08:51:20.455 DEBUG:teuthology.orchestra.console.smithi188:power off output: Chassis Power Control: Down/Off 2023-11-12T08:51:20.456 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-12T08:51:20.464 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is on 2023-11-12T08:51:20.476 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2023-11-12T08:51:24.470 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-12T08:51:24.477 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-12T08:51:24.578 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is on 2023-11-12T08:51:24.585 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2023-11-12T08:51:28.584 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-12T08:51:28.590 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-12T08:51:28.693 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is on 2023-11-12T08:51:28.699 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2023-11-12T08:51:32.698 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-12T08:51:32.706 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-12T08:51:32.808 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off 2023-11-12T08:51:32.815 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2023-11-12T08:51:32.910 INFO:teuthology.orchestra.console.smithi023:Power off completed 2023-11-12T08:51:32.916 INFO:teuthology.orchestra.console.smithi188:Power off completed 2023-11-12T08:51:33.011 INFO:teuthology.orchestra.console.smithi023:Power on 2023-11-12T08:51:33.012 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-12T08:51:33.021 INFO:teuthology.orchestra.console.smithi188:Power on 2023-11-12T08:51:33.021 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-12T08:51:33.037 DEBUG:teuthology.orchestra.console.smithi023:power on output: Chassis Power Control: Up/On 2023-11-12T08:51:33.038 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-12T08:51:33.046 DEBUG:teuthology.orchestra.console.smithi188:power on output: Chassis Power Control: Up/On 2023-11-12T08:51:33.047 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-12T08:51:33.060 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off 2023-11-12T08:51:33.068 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2023-11-12T08:51:37.065 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-12T08:51:37.073 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-12T08:51:37.175 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is on 2023-11-12T08:51:37.184 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2023-11-12T08:51:37.277 INFO:teuthology.orchestra.console.smithi023:Power on completed 2023-11-12T08:51:37.285 INFO:teuthology.orchestra.console.smithi188:Power on completed 2023-11-12T08:51:37.378 INFO:teuthology.provision.fog.smithi023:Waiting for deploy to finish 2023-11-12T08:51:37.378 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-12T08:51:37.386 INFO:teuthology.provision.fog.smithi188:Waiting for deploy to finish 2023-11-12T08:51:37.386 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-11-12T08:51:52.454 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-12T08:51:52.456 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-11-12T08:52:07.532 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-12T08:52:07.534 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-11-12T08:52:22.612 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-11-12T08:52:22.614 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-12T08:52:37.689 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-11-12T08:52:37.691 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-12T08:52:52.758 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-11-12T08:52:52.770 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-12T08:53:07.848 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-11-12T08:53:07.851 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-12T08:53:22.916 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-12T08:53:22.924 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-11-12T08:53:37.995 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-12T08:53:37.997 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-11-12T08:53:53.073 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-11-12T08:53:53.075 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-12T08:54:08.148 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-11-12T08:54:08.150 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-12T08:54:23.218 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-12T08:54:23.220 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-11-12T08:54:23.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-12T08:54:38.295 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-12T08:54:41.788 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-11-12T08:54:47.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-12T08:54:50.874 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-11-12T08:54:53.349 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-12T08:54:53.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-12T08:54:56.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-12T08:54:59.935 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-11-12T08:55:05.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-12T08:55:09.019 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-11-12T08:55:11.738 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2023-11-12T08:55:15.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-12T08:55:17.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-12T08:55:20.794 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2023-11-12T08:55:26.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-12T08:55:29.883 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2023-11-12T08:55:35.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-12T08:55:38.970 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2023-11-12T08:55:44.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-12T08:55:48.059 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2023-11-12T08:55:54.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-12T08:55:57.146 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2023-11-12T08:56:03.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-12T08:56:06.234 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2023-11-12T08:56:12.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-12T08:56:15.032 WARNING:teuthology.provision.fog.smithi188:timed out 2023-11-12T08:56:15.322 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2023-11-12T08:56:21.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-12T08:56:21.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-12T08:56:21.444 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-12T08:56:21.445 DEBUG:teuthology.orchestra.run.smithi188:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-12T08:56:21.766 INFO:teuthology.provision.fog.smithi188:Node is ready 2023-11-12T08:56:21.767 DEBUG:teuthology.orchestra.run.smithi188:> hostname 2023-11-12T08:56:21.782 INFO:teuthology.orchestra.run.smithi188.stdout:smithi188.front.sepia.ceph.com 2023-11-12T08:56:21.782 DEBUG:teuthology.orchestra.run.smithi188:> grep smithi188.front.sepia.ceph.com /etc/hosts 2023-11-12T08:56:21.836 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.15.188 smithi188.front.sepia.ceph.com smithi188 2023-11-12T08:56:21.837 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188 2023-11-12T08:56:21.953 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188.front.sepia.ceph.com/smithi188/g' /etc/hosts 2023-11-12T08:56:21.979 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/172.21.15.188/172.21.15.188/g' /etc/hosts 2023-11-12T08:56:22.046 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188.front.sepia.ceph.com/smithi188/g' /etc/hostname 2023-11-12T08:56:22.113 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188 2023-11-12T08:56:22.178 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2023-11-12T08:56:22.233 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="CentOS Stream" 2023-11-12T08:56:22.233 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="9" 2023-11-12T08:56:22.233 INFO:teuthology.orchestra.run.smithi188.stdout:ID="centos" 2023-11-12T08:56:22.233 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="rhel fedora" 2023-11-12T08:56:22.234 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="9" 2023-11-12T08:56:22.234 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el9" 2023-11-12T08:56:22.234 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-12T08:56:22.234 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31" 2023-11-12T08:56:22.234 INFO:teuthology.orchestra.run.smithi188.stdout:LOGO="fedora-logo-icon" 2023-11-12T08:56:22.234 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-12T08:56:22.235 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://centos.org/" 2023-11-12T08:56:22.235 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-12T08:56:22.235 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-12T08:56:22.235 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-12T08:56:22.236 INFO:teuthology.provision.fog.smithi188:Deploy complete! 2023-11-12T08:56:22.237 DEBUG:teuthology.parallel:result is None 2023-11-12T08:57:21.350 WARNING:teuthology.provision.fog.smithi023:timed out 2023-11-12T08:57:27.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-12T08:57:27.623 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-12T08:57:27.624 DEBUG:teuthology.orchestra.run.smithi023:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-12T08:57:27.950 INFO:teuthology.provision.fog.smithi023:Node is ready 2023-11-12T08:57:27.950 DEBUG:teuthology.orchestra.run.smithi023:> hostname 2023-11-12T08:57:27.966 INFO:teuthology.orchestra.run.smithi023.stdout:smithi023.front.sepia.ceph.com 2023-11-12T08:57:27.966 DEBUG:teuthology.orchestra.run.smithi023:> grep smithi023.front.sepia.ceph.com /etc/hosts 2023-11-12T08:57:28.021 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23 smithi023.front.sepia.ceph.com smithi023 2023-11-12T08:57:28.021 DEBUG:teuthology.orchestra.run.smithi023:> sudo hostname smithi023 2023-11-12T08:57:28.133 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/smithi023.front.sepia.ceph.com/smithi023/g' /etc/hosts 2023-11-12T08:57:28.164 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/172.21.15.23/172.21.15.23/g' /etc/hosts 2023-11-12T08:57:28.235 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/smithi023.front.sepia.ceph.com/smithi023/g' /etc/hostname 2023-11-12T08:57:28.305 DEBUG:teuthology.orchestra.run.smithi023:> sudo hostname smithi023 2023-11-12T08:57:28.375 DEBUG:teuthology.orchestra.run.smithi023:> cat /etc/os-release 2023-11-12T08:57:28.430 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="CentOS Stream" 2023-11-12T08:57:28.430 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="9" 2023-11-12T08:57:28.430 INFO:teuthology.orchestra.run.smithi023.stdout:ID="centos" 2023-11-12T08:57:28.430 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE="rhel fedora" 2023-11-12T08:57:28.430 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="9" 2023-11-12T08:57:28.431 INFO:teuthology.orchestra.run.smithi023.stdout:PLATFORM_ID="platform:el9" 2023-11-12T08:57:28.431 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-12T08:57:28.431 INFO:teuthology.orchestra.run.smithi023.stdout:ANSI_COLOR="0;31" 2023-11-12T08:57:28.431 INFO:teuthology.orchestra.run.smithi023.stdout:LOGO="fedora-logo-icon" 2023-11-12T08:57:28.431 INFO:teuthology.orchestra.run.smithi023.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-12T08:57:28.432 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://centos.org/" 2023-11-12T08:57:28.432 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-12T08:57:28.432 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-12T08:57:28.432 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-12T08:57:28.432 INFO:teuthology.provision.fog.smithi023:Deploy complete! 2023-11-12T08:57:28.433 DEBUG:teuthology.parallel:result is None 2023-11-12T08:57:28.596 INFO:teuthology.lock.ops:Checking smithi023.front.sepia.ceph.com 2023-11-12T08:57:28.597 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-12T08:57:28.626 INFO:teuthology.lock.ops:Checking smithi188.front.sepia.ceph.com 2023-11-12T08:57:28.626 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-12T08:57:28.643 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: set os type and version on server 2023-11-12T08:57:28.643 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com' 2023-11-12T08:57:28.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-12T08:57:28.740 DEBUG:teuthology.orchestra.run.smithi023:> true 2023-11-12T08:57:28.804 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi023.front.sepia.ceph.com' 2023-11-12T08:57:28.805 DEBUG:teuthology.orchestra.run.smithi023:> uname -m 2023-11-12T08:57:28.858 INFO:teuthology.orchestra.run.smithi023.stdout:x86_64 2023-11-12T08:57:28.859 DEBUG:teuthology.orchestra.run.smithi023:> cat /etc/os-release 2023-11-12T08:57:28.914 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="CentOS Stream" 2023-11-12T08:57:28.914 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="9" 2023-11-12T08:57:28.914 INFO:teuthology.orchestra.run.smithi023.stdout:ID="centos" 2023-11-12T08:57:28.915 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE="rhel fedora" 2023-11-12T08:57:28.915 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="9" 2023-11-12T08:57:28.915 INFO:teuthology.orchestra.run.smithi023.stdout:PLATFORM_ID="platform:el9" 2023-11-12T08:57:28.915 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-12T08:57:28.915 INFO:teuthology.orchestra.run.smithi023.stdout:ANSI_COLOR="0;31" 2023-11-12T08:57:28.916 INFO:teuthology.orchestra.run.smithi023.stdout:LOGO="fedora-logo-icon" 2023-11-12T08:57:28.916 INFO:teuthology.orchestra.run.smithi023.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-12T08:57:28.916 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://centos.org/" 2023-11-12T08:57:28.916 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-12T08:57:28.916 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-12T08:57:28.917 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-12T08:57:28.917 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server 2023-11-12T08:57:28.942 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: set os type and version on server 2023-11-12T08:57:28.943 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-11-12T08:57:28.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-12T08:57:29.025 DEBUG:teuthology.orchestra.run.smithi188:> true 2023-11-12T08:57:29.192 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-11-12T08:57:29.193 DEBUG:teuthology.orchestra.run.smithi188:> uname -m 2023-11-12T08:57:29.248 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64 2023-11-12T08:57:29.248 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2023-11-12T08:57:29.303 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="CentOS Stream" 2023-11-12T08:57:29.303 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="9" 2023-11-12T08:57:29.303 INFO:teuthology.orchestra.run.smithi188.stdout:ID="centos" 2023-11-12T08:57:29.304 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="rhel fedora" 2023-11-12T08:57:29.304 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="9" 2023-11-12T08:57:29.304 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el9" 2023-11-12T08:57:29.304 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-12T08:57:29.305 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31" 2023-11-12T08:57:29.305 INFO:teuthology.orchestra.run.smithi188.stdout:LOGO="fedora-logo-icon" 2023-11-12T08:57:29.305 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-12T08:57:29.305 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://centos.org/" 2023-11-12T08:57:29.306 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-12T08:57:29.306 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-12T08:57:29.306 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-12T08:57:29.307 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2023-11-12T08:57:29.326 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-12T08:57:29.409 INFO:teuthology.dispatcher.supervisor:Running job 7456027 2023-11-12T08:57:29.409 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_nmordech@teuthology --archive /home/teuthworker/archive/nmordech-2023-11-12_08:50:05-rados:thrash-dedup-main-distro-default-smithi/7456027 --name nmordech-2023-11-12_08:50:05-rados:thrash-dedup-main-distro-default-smithi --description rados:thrash-dedup/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest overrides} thrashers/default thrashosds-health workloads/dedup-io-mixed} -- /home/teuthworker/archive/nmordech-2023-11-12_08:50:05-rados:thrash-dedup-main-distro-default-smithi/7456027/orig.config.yaml 2023-11-12T08:57:29.412 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/nmordech-2023-11-12_08:50:05-rados:thrash-dedup-main-distro-default-smithi/7456027 2023-11-12T08:57:29.413 INFO:teuthology.dispatcher.supervisor:Job PID: 2020675 2023-11-12T08:57:29.413 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-12T08:59:29.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-12T09:01:29.533 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-12T09:03:29.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-12T09:05:29.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-12T09:07:29.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-12T09:09:30.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-12T09:11:30.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-12T09:13:30.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-12T09:15:30.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-12T09:17:30.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-12T09:19:30.776 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-12T09:21:30.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-12T09:23:31.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-12T09:25:31.158 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-12T09:27:31.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-12T09:29:31.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-12T09:29:31.540 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-12T09:29:31.649 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-12T09:29:31.649 INFO:teuthology.nuke:Checking targets against current locks 2023-11-12T09:29:31.696 DEBUG:teuthology.nuke:shortname: smithi023 2023-11-12T09:29:31.696 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-12T09:29:31.721 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi023.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/nmordech-2023-11-12_08:50:05-rados:thrash-dedup-main-distro-default-smithi/7456027', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-12 08:51:19.062840', 'locked_by': 'scheduled_nmordech@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMlK86wjH+kzEKnQjY11J3xr3FvmTjMtoCZQNqc8XD4cxr/45XP3b3YzVwG8/AXYYuhLuoORp9bICQ7KpoutCnk='} 2023-11-12T09:29:31.725 DEBUG:teuthology.nuke:shortname: smithi188 2023-11-12T09:29:31.725 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-12T09:29:31.750 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi188.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/nmordech-2023-11-12_08:50:05-rados:thrash-dedup-main-distro-default-smithi/7456027', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-12 08:51:19.064742', 'locked_by': 'scheduled_nmordech@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBoXxsQt3VrvRJz9r43/jnWKjrpd9kIracN/+VjyR+/o3IID9inqRTPDkW6OX4kQCbwWB1GPQZnf9jtF/Sb6b3Q='} 2023-11-12T09:29:31.771 INFO:teuthology.orchestra.console.smithi023:Power off 2023-11-12T09:29:31.771 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-12T09:29:31.793 DEBUG:teuthology.orchestra.console.smithi023:power off output: Chassis Power Control: Down/Off 2023-11-12T09:29:31.793 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-12T09:29:31.808 INFO:teuthology.orchestra.console.smithi188:Power off 2023-11-12T09:29:31.809 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-12T09:29:31.818 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off 2023-11-12T09:29:31.831 DEBUG:teuthology.orchestra.console.smithi188:power off output: Chassis Power Control: Down/Off 2023-11-12T09:29:31.832 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-12T09:29:31.853 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2023-11-12T09:29:31.919 INFO:teuthology.orchestra.console.smithi023:Power off completed 2023-11-12T09:29:31.954 INFO:teuthology.orchestra.console.smithi188:Power off completed 2023-11-12T09:29:32.073 INFO:teuthology.lock.ops:unlocked: smithi023.front.sepia.ceph.com 2023-11-12T09:29:32.107 INFO:teuthology.lock.ops:unlocked: smithi188.front.sepia.ceph.com