2023-10-10T10:55:48.206 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-10T10:55:48.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T10:55:48.346 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f24b2a2b670>, signals=[15]) 2023-10-10T10:55:48.347 INFO:teuthology.lock.ops:Start node 'smithi045.front.sepia.ceph.com' reimaging 2023-10-10T10:55:48.348 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: reset os type and version on server 2023-10-10T10:55:48.348 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2023-10-10T10:55:48.368 INFO:teuthology.lock.ops:Start node 'smithi102.front.sepia.ceph.com' reimaging 2023-10-10T10:55:48.368 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: reset os type and version on server 2023-10-10T10:55:48.369 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2023-10-10T10:55:48.370 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /host {"name": "smithi045"} 2023-10-10T10:55:48.393 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /host {"name": "smithi102"} 2023-10-10T10:55:48.453 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-10T10:55:48.473 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-10T10:55:48.517 DEBUG:teuthology.provision.fog.smithi045:Requesting image smithi_centos_8.stream (ID 3) 2023-10-10T10:55:48.517 DEBUG:teuthology.provision.fog.smithi045:FOG request: PUT /host/150 {"imageID": 3} 2023-10-10T10:55:48.521 DEBUG:teuthology.provision.fog.smithi102:Requesting image smithi_centos_8.stream (ID 3) 2023-10-10T10:55:48.521 DEBUG:teuthology.provision.fog.smithi102:FOG request: PUT /host/207 {"imageID": 3} 2023-10-10T10:55:48.565 INFO:teuthology.provision.fog.smithi102:Scheduling deploy of centos 8.stream 2023-10-10T10:55:48.566 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-10-10T10:55:48.570 INFO:teuthology.provision.fog.smithi045:Scheduling deploy of centos 8.stream 2023-10-10T10:55:48.570 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-10T10:55:48.644 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /tasktype {"name": "deploy"} 2023-10-10T10:55:48.648 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /tasktype {"name": "deploy"} 2023-10-10T10:55:48.684 DEBUG:teuthology.provision.fog.smithi045:FOG request: POST /host/150/task {"taskTypeID": 1} 2023-10-10T10:55:48.688 DEBUG:teuthology.provision.fog.smithi102:FOG request: POST /host/207/task {"taskTypeID": 1} 2023-10-10T10:55:48.751 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-10-10T10:55:48.754 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-10T10:55:48.861 INFO:teuthology.orchestra.console.smithi102:Power off 2023-10-10T10:55:48.862 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-10T10:55:48.875 INFO:teuthology.orchestra.console.smithi045:Power off 2023-10-10T10:55:48.875 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-10T10:55:48.884 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off 2023-10-10T10:55:48.885 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T10:55:48.895 DEBUG:teuthology.orchestra.console.smithi045:power off output: Chassis Power Control: Down/Off 2023-10-10T10:55:48.896 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T10:55:48.907 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-10-10T10:55:48.921 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off 2023-10-10T10:55:49.009 INFO:teuthology.orchestra.console.smithi102:Power off completed 2023-10-10T10:55:49.023 INFO:teuthology.orchestra.console.smithi045:Power off completed 2023-10-10T10:55:49.110 INFO:teuthology.orchestra.console.smithi102:Power on 2023-10-10T10:55:49.111 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-10T10:55:49.124 INFO:teuthology.orchestra.console.smithi045:Power on 2023-10-10T10:55:49.124 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-10T10:55:49.137 DEBUG:teuthology.orchestra.console.smithi102:power on output: Chassis Power Control: Up/On 2023-10-10T10:55:49.138 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T10:55:49.146 DEBUG:teuthology.orchestra.console.smithi045:power on output: Chassis Power Control: Up/On 2023-10-10T10:55:49.147 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T10:55:49.158 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-10-10T10:55:49.168 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off 2023-10-10T10:55:53.162 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T10:55:53.169 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T10:55:53.271 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2023-10-10T10:55:53.278 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2023-10-10T10:55:53.373 INFO:teuthology.orchestra.console.smithi102:Power on completed 2023-10-10T10:55:53.379 INFO:teuthology.orchestra.console.smithi045:Power on completed 2023-10-10T10:55:53.474 INFO:teuthology.provision.fog.smithi102:Waiting for deploy to finish 2023-10-10T10:55:53.474 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-10-10T10:55:53.480 INFO:teuthology.provision.fog.smithi045:Waiting for deploy to finish 2023-10-10T10:55:53.481 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-10T10:56:08.574 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-10T10:56:08.576 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-10-10T10:56:23.665 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-10T10:56:23.666 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-10-10T10:56:38.750 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-10T10:56:38.752 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-10-10T10:56:53.842 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-10T10:56:53.843 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-10-10T10:57:08.917 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-10-10T10:57:08.919 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-10T10:57:24.010 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-10T10:57:24.012 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-10-10T10:57:39.102 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-10T10:57:39.103 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-10-10T10:57:54.206 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-10-10T10:57:54.208 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-10T10:58:09.294 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-10T10:58:09.296 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-10-10T10:58:24.375 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-10-10T10:58:24.376 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-10T10:58:24.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:58:39.466 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-10-10T10:58:39.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:58:42.938 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-10-10T10:58:48.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:58:51.994 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-10-10T10:58:57.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:58:58.042 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-10-10T10:59:01.054 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-10-10T10:59:04.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:59:07.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:59:07.102 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-10-10T10:59:10.138 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-10-10T10:59:13.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:59:16.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:59:16.190 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-10-10T10:59:22.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:59:25.278 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-10-10T10:59:31.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:59:34.362 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-10-10T10:59:40.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T11:00:16.178 WARNING:teuthology.provision.fog.smithi045:timed out 2023-10-10T11:00:22.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T11:00:22.431 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-10T11:00:22.432 DEBUG:teuthology.orchestra.run.smithi045:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-10T11:00:22.648 INFO:teuthology.provision.fog.smithi045:Node is ready 2023-10-10T11:00:22.649 DEBUG:teuthology.orchestra.run.smithi045:> hostname 2023-10-10T11:00:22.709 INFO:teuthology.orchestra.run.smithi045.stdout:smithi045.front.sepia.ceph.com 2023-10-10T11:00:22.710 DEBUG:teuthology.orchestra.run.smithi045:> grep smithi045.front.sepia.ceph.com /etc/hosts 2023-10-10T11:00:22.770 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45 smithi045.front.sepia.ceph.com smithi045 2023-10-10T11:00:22.770 DEBUG:teuthology.orchestra.run.smithi045:> sudo hostname smithi045 2023-10-10T11:00:22.884 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/smithi045.front.sepia.ceph.com/smithi045/g' /etc/hosts 2023-10-10T11:00:22.917 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/172.21.15.45/172.21.15.45/g' /etc/hosts 2023-10-10T11:00:22.986 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/smithi045.front.sepia.ceph.com/smithi045/g' /etc/hostname 2023-10-10T11:00:23.056 DEBUG:teuthology.orchestra.run.smithi045:> sudo hostname smithi045 2023-10-10T11:00:23.125 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release 2023-10-10T11:00:23.184 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="CentOS Stream" 2023-10-10T11:00:23.184 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="8" 2023-10-10T11:00:23.184 INFO:teuthology.orchestra.run.smithi045.stdout:ID="centos" 2023-10-10T11:00:23.185 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="rhel fedora" 2023-10-10T11:00:23.185 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="8" 2023-10-10T11:00:23.185 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el8" 2023-10-10T11:00:23.185 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-10T11:00:23.185 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31" 2023-10-10T11:00:23.185 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-10T11:00:23.186 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://centos.org/" 2023-10-10T11:00:23.186 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-10T11:00:23.186 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-10T11:00:23.186 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-10T11:00:23.187 INFO:teuthology.provision.fog.smithi045:Deploy complete! 2023-10-10T11:00:23.188 DEBUG:teuthology.parallel:result is None 2023-10-10T11:00:40.386 WARNING:teuthology.provision.fog.smithi102:timed out 2023-10-10T11:00:46.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T11:00:46.786 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-10T11:00:46.786 DEBUG:teuthology.orchestra.run.smithi102:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-10T11:00:47.031 INFO:teuthology.provision.fog.smithi102:Node is ready 2023-10-10T11:00:47.031 DEBUG:teuthology.orchestra.run.smithi102:> hostname 2023-10-10T11:00:47.052 INFO:teuthology.orchestra.run.smithi102.stdout:smithi102.front.sepia.ceph.com 2023-10-10T11:00:47.052 DEBUG:teuthology.orchestra.run.smithi102:> grep smithi102.front.sepia.ceph.com /etc/hosts 2023-10-10T11:00:47.114 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102 smithi102.front.sepia.ceph.com smithi102 2023-10-10T11:00:47.114 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102 2023-10-10T11:00:47.223 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hosts 2023-10-10T11:00:47.259 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/172.21.15.102/172.21.15.102/g' /etc/hosts 2023-10-10T11:00:47.333 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hostname 2023-10-10T11:00:47.403 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102 2023-10-10T11:00:47.473 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2023-10-10T11:00:47.533 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream" 2023-10-10T11:00:47.534 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="8" 2023-10-10T11:00:47.534 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos" 2023-10-10T11:00:47.534 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora" 2023-10-10T11:00:47.535 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="8" 2023-10-10T11:00:47.535 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el8" 2023-10-10T11:00:47.535 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-10T11:00:47.535 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2023-10-10T11:00:47.536 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-10T11:00:47.536 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/" 2023-10-10T11:00:47.536 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-10T11:00:47.536 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-10T11:00:47.537 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-10T11:00:47.537 INFO:teuthology.provision.fog.smithi102:Deploy complete! 2023-10-10T11:00:47.538 DEBUG:teuthology.parallel:result is None 2023-10-10T11:00:47.691 INFO:teuthology.lock.ops:Checking smithi045.front.sepia.ceph.com 2023-10-10T11:00:47.692 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-10T11:00:47.717 INFO:teuthology.lock.ops:Checking smithi102.front.sepia.ceph.com 2023-10-10T11:00:47.717 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-10T11:00:47.735 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: set os type and version on server 2023-10-10T11:00:47.736 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-10-10T11:00:47.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T11:00:47.806 DEBUG:teuthology.orchestra.run.smithi045:> true 2023-10-10T11:00:47.941 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-10-10T11:00:47.942 DEBUG:teuthology.orchestra.run.smithi045:> uname -m 2023-10-10T11:00:48.001 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64 2023-10-10T11:00:48.001 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release 2023-10-10T11:00:48.060 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="CentOS Stream" 2023-10-10T11:00:48.061 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="8" 2023-10-10T11:00:48.061 INFO:teuthology.orchestra.run.smithi045.stdout:ID="centos" 2023-10-10T11:00:48.061 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="rhel fedora" 2023-10-10T11:00:48.061 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="8" 2023-10-10T11:00:48.062 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el8" 2023-10-10T11:00:48.062 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-10T11:00:48.062 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31" 2023-10-10T11:00:48.062 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-10T11:00:48.062 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://centos.org/" 2023-10-10T11:00:48.063 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-10T11:00:48.063 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-10T11:00:48.063 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-10T11:00:48.064 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2023-10-10T11:00:48.085 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: set os type and version on server 2023-10-10T11:00:48.085 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-10-10T11:00:48.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T11:00:48.153 DEBUG:teuthology.orchestra.run.smithi102:> true 2023-10-10T11:00:48.223 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-10-10T11:00:48.224 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2023-10-10T11:00:48.283 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2023-10-10T11:00:48.283 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2023-10-10T11:00:48.342 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream" 2023-10-10T11:00:48.343 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="8" 2023-10-10T11:00:48.343 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos" 2023-10-10T11:00:48.343 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora" 2023-10-10T11:00:48.343 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="8" 2023-10-10T11:00:48.343 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el8" 2023-10-10T11:00:48.344 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-10T11:00:48.344 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2023-10-10T11:00:48.344 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-10T11:00:48.344 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/" 2023-10-10T11:00:48.344 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-10T11:00:48.345 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-10T11:00:48.345 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-10T11:00:48.345 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2023-10-10T11:00:48.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T11:00:48.456 INFO:teuthology.dispatcher.supervisor:Running job 7419852 2023-10-10T11:00:48.457 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_matan@teuthology --archive /home/teuthworker/archive/matan-2023-10-10_10:41:37-rados:thrash-wip-matanb-reset_purged_snaps_last-test-distro-default-smithi/7419852 --name matan-2023-10-10_10:41:37-rados:thrash-wip-matanb-reset_purged_snaps_last-test-distro-default-smithi --description rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-snaps-balanced} -- /home/teuthworker/archive/matan-2023-10-10_10:41:37-rados:thrash-wip-matanb-reset_purged_snaps_last-test-distro-default-smithi/7419852/orig.config.yaml 2023-10-10T11:00:48.459 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/matan-2023-10-10_10:41:37-rados:thrash-wip-matanb-reset_purged_snaps_last-test-distro-default-smithi/7419852 2023-10-10T11:00:48.460 INFO:teuthology.dispatcher.supervisor:Job PID: 1572901 2023-10-10T11:00:48.460 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-10T11:02:48.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T11:04:48.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T11:06:48.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T11:08:49.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T11:10:49.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T11:12:49.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T11:14:49.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T11:16:49.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T11:16:49.788 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-10T11:16:49.920 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-10T11:16:49.921 INFO:teuthology.nuke:Checking targets against current locks 2023-10-10T11:16:49.969 DEBUG:teuthology.nuke:shortname: smithi045 2023-10-10T11:16:49.970 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-10T11:16:49.986 DEBUG:teuthology.nuke:shortname: smithi102 2023-10-10T11:16:49.986 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-10T11:16:49.989 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-10-10_10:41:37-rados:thrash-wip-matanb-reset_purged_snaps_last-test-distro-default-smithi/7419852', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-10 10:55:47.415353', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAU1daUdWLJd4S+PhSnHrX32V4QG+WLuoWChoiJ49w78w9dyZznPo5btGRrburf07P4GXl+f4PZcb5mc2eHNLaw='} 2023-10-10T11:16:50.006 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-10-10_10:41:37-rados:thrash-wip-matanb-reset_purged_snaps_last-test-distro-default-smithi/7419852', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-10 10:55:47.417340', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOjg26a4xG2bmxQWniX0SlTL/78p/SyfcYWNA9QqAPfeoyAHw1AdsuLfW2BGC15CnKZ3oM5dAVJCB1svs4Tn9Qw='} 2023-10-10T11:16:50.043 INFO:teuthology.orchestra.console.smithi045:Power off 2023-10-10T11:16:50.044 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-10T11:16:50.068 DEBUG:teuthology.orchestra.console.smithi045:power off output: Chassis Power Control: Down/Off 2023-10-10T11:16:50.068 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T11:16:50.083 INFO:teuthology.orchestra.console.smithi102:Power off 2023-10-10T11:16:50.084 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-10T11:16:50.092 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off 2023-10-10T11:16:50.104 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off 2023-10-10T11:16:50.105 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T11:16:50.128 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-10-10T11:16:50.194 INFO:teuthology.orchestra.console.smithi045:Power off completed 2023-10-10T11:16:50.230 INFO:teuthology.orchestra.console.smithi102:Power off completed 2023-10-10T11:16:50.343 INFO:teuthology.lock.ops:unlocked: smithi045.front.sepia.ceph.com 2023-10-10T11:16:50.376 INFO:teuthology.lock.ops:unlocked: smithi102.front.sepia.ceph.com