2024-01-13T06:32:02.424 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-13T06:32:02.425 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T06:32:02.570 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f81f09c4c10>, signals=[15]) 2024-01-13T06:32:02.571 INFO:teuthology.lock.ops:Start node 'smithi080.front.sepia.ceph.com' reimaging 2024-01-13T06:32:02.571 INFO:teuthology.lock.ops:Updating [smithi080.front.sepia.ceph.com]: reset os type and version on server 2024-01-13T06:32:02.571 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2024-01-13T06:32:02.593 INFO:teuthology.lock.ops:Start node 'smithi105.front.sepia.ceph.com' reimaging 2024-01-13T06:32:02.593 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: reset os type and version on server 2024-01-13T06:32:02.593 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2024-01-13T06:32:02.722 DEBUG:teuthology.provision.fog.smithi080:Requesting image smithi_centos_8.stream (ID 3) 2024-01-13T06:32:02.730 DEBUG:teuthology.provision.fog.smithi105:Requesting image smithi_centos_8.stream (ID 3) 2024-01-13T06:32:02.768 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of centos 8.stream 2024-01-13T06:32:02.771 INFO:teuthology.provision.fog.smithi080:Scheduling deploy of centos 8.stream 2024-01-13T06:32:03.014 INFO:teuthology.orchestra.console.smithi105:Power off 2024-01-13T06:32:03.014 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T06:32:03.026 INFO:teuthology.orchestra.console.smithi080:Power off 2024-01-13T06:32:03.026 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T06:32:03.035 DEBUG:teuthology.orchestra.console.smithi105:power off output: Chassis Power Control: Down/Off 2024-01-13T06:32:03.035 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T06:32:03.048 DEBUG:teuthology.orchestra.console.smithi080:power off output: Chassis Power Control: Down/Off 2024-01-13T06:32:03.048 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T06:32:03.056 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2024-01-13T06:32:03.079 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on 2024-01-13T06:32:07.061 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T06:32:07.080 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T06:32:07.171 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2024-01-13T06:32:07.190 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on 2024-01-13T06:32:11.176 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T06:32:11.191 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T06:32:11.290 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2024-01-13T06:32:11.300 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off 2024-01-13T06:32:11.392 INFO:teuthology.orchestra.console.smithi105:Power off completed 2024-01-13T06:32:11.401 INFO:teuthology.orchestra.console.smithi080:Power off completed 2024-01-13T06:32:11.493 INFO:teuthology.orchestra.console.smithi105:Power on 2024-01-13T06:32:11.493 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-13T06:32:11.503 INFO:teuthology.orchestra.console.smithi080:Power on 2024-01-13T06:32:11.503 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-13T06:32:11.517 DEBUG:teuthology.orchestra.console.smithi105:power on output: Chassis Power Control: Up/On 2024-01-13T06:32:11.518 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T06:32:11.526 DEBUG:teuthology.orchestra.console.smithi080:power on output: Chassis Power Control: Up/On 2024-01-13T06:32:11.526 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T06:32:11.540 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2024-01-13T06:32:11.548 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off 2024-01-13T06:32:15.544 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T06:32:15.550 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T06:32:15.653 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2024-01-13T06:32:15.659 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off 2024-01-13T06:32:19.656 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T06:32:19.663 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T06:32:19.772 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on 2024-01-13T06:32:19.817 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2024-01-13T06:32:19.873 INFO:teuthology.orchestra.console.smithi080:Power on completed 2024-01-13T06:32:19.918 INFO:teuthology.orchestra.console.smithi105:Power on completed 2024-01-13T06:32:19.974 INFO:teuthology.provision.fog.smithi080:Waiting for deploy to finish 2024-01-13T06:32:20.019 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish 2024-01-13T06:35:06.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T06:35:06.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T06:35:09.116 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-01-13T06:35:09.116 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-01-13T06:35:15.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T06:35:15.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T06:35:18.204 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-01-13T06:35:18.205 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-01-13T06:35:24.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T06:35:24.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T06:35:27.260 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-01-13T06:35:27.260 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-01-13T06:35:33.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T06:35:33.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T06:35:36.316 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-01-13T06:35:36.348 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-01-13T06:35:42.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T06:35:42.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T06:35:45.404 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-01-13T06:35:45.404 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-01-13T06:35:51.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T06:35:51.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T06:35:54.463 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-01-13T06:36:00.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T06:36:18.876 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-01-13T06:36:24.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T06:36:27.932 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-01-13T06:36:33.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T06:36:35.717 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-13T06:36:35.717 DEBUG:teuthology.orchestra.run.smithi105:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-13T06:36:51.412 WARNING:teuthology.provision.fog.smithi080:timed out 2024-01-13T06:36:57.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T06:36:57.658 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-13T06:36:57.658 DEBUG:teuthology.orchestra.run.smithi080:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-13T06:36:57.909 INFO:teuthology.provision.fog.smithi080:Node is ready 2024-01-13T06:36:57.909 DEBUG:teuthology.orchestra.run.smithi080:> hostname 2024-01-13T06:36:57.928 INFO:teuthology.orchestra.run.smithi080.stdout:smithi080.front.sepia.ceph.com 2024-01-13T06:36:57.929 DEBUG:teuthology.orchestra.run.smithi080:> grep smithi080.front.sepia.ceph.com /etc/hosts 2024-01-13T06:36:57.987 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80 smithi080.front.sepia.ceph.com smithi080 2024-01-13T06:36:57.987 DEBUG:teuthology.orchestra.run.smithi080:> sudo hostname smithi080 2024-01-13T06:36:58.080 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/smithi080.front.sepia.ceph.com/smithi080/g' /etc/hosts 2024-01-13T06:36:58.111 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/172.21.15.80/172.21.15.80/g' /etc/hosts 2024-01-13T06:36:58.181 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/smithi080.front.sepia.ceph.com/smithi080/g' /etc/hostname 2024-01-13T06:36:58.251 DEBUG:teuthology.orchestra.run.smithi080:> sudo hostname smithi080 2024-01-13T06:36:58.316 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release 2024-01-13T06:36:58.374 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="CentOS Stream" 2024-01-13T06:36:58.374 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="8" 2024-01-13T06:36:58.374 INFO:teuthology.orchestra.run.smithi080.stdout:ID="centos" 2024-01-13T06:36:58.374 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="rhel fedora" 2024-01-13T06:36:58.374 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="8" 2024-01-13T06:36:58.375 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM_ID="platform:el8" 2024-01-13T06:36:58.375 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-13T06:36:58.375 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31" 2024-01-13T06:36:58.375 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-13T06:36:58.375 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://centos.org/" 2024-01-13T06:36:58.375 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T06:36:58.375 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-13T06:36:58.375 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-13T06:36:58.376 INFO:teuthology.provision.fog.smithi080:Deploy complete! 2024-01-13T06:36:58.377 DEBUG:teuthology.parallel:result is None 2024-01-13T06:37:01.110 INFO:teuthology.provision.fog.smithi105:Node is ready 2024-01-13T06:37:01.111 DEBUG:teuthology.orchestra.run.smithi105:> hostname 2024-01-13T06:37:01.135 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105.front.sepia.ceph.com 2024-01-13T06:37:01.135 DEBUG:teuthology.orchestra.run.smithi105:> grep smithi105.front.sepia.ceph.com /etc/hosts 2024-01-13T06:37:01.196 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105.front.sepia.ceph.com smithi105 2024-01-13T06:37:01.196 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2024-01-13T06:37:01.324 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hosts 2024-01-13T06:37:01.355 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/172.21.15.105/172.21.15.105/g' /etc/hosts 2024-01-13T06:37:01.425 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hostname 2024-01-13T06:37:01.494 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2024-01-13T06:37:01.562 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2024-01-13T06:37:01.621 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream" 2024-01-13T06:37:01.621 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8" 2024-01-13T06:37:01.621 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2024-01-13T06:37:01.621 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2024-01-13T06:37:01.621 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8" 2024-01-13T06:37:01.621 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8" 2024-01-13T06:37:01.621 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-13T06:37:01.621 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2024-01-13T06:37:01.621 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-13T06:37:01.622 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/" 2024-01-13T06:37:01.622 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T06:37:01.622 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-13T06:37:01.622 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-13T06:37:01.622 INFO:teuthology.provision.fog.smithi105:Deploy complete! 2024-01-13T06:37:01.623 DEBUG:teuthology.parallel:result is None 2024-01-13T06:37:01.806 INFO:teuthology.lock.ops:Checking smithi080.front.sepia.ceph.com 2024-01-13T06:37:01.806 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-13T06:37:01.820 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com 2024-01-13T06:37:01.821 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-13T06:37:01.847 INFO:teuthology.lock.ops:Updating [smithi080.front.sepia.ceph.com]: set os type and version on server 2024-01-13T06:37:01.847 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-01-13T06:37:01.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T06:37:01.921 DEBUG:teuthology.orchestra.run.smithi080:> true 2024-01-13T06:37:01.994 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-01-13T06:37:01.994 DEBUG:teuthology.orchestra.run.smithi080:> uname -m 2024-01-13T06:37:02.055 INFO:teuthology.orchestra.run.smithi080.stdout:x86_64 2024-01-13T06:37:02.055 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release 2024-01-13T06:37:02.115 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="CentOS Stream" 2024-01-13T06:37:02.115 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="8" 2024-01-13T06:37:02.116 INFO:teuthology.orchestra.run.smithi080.stdout:ID="centos" 2024-01-13T06:37:02.116 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="rhel fedora" 2024-01-13T06:37:02.116 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="8" 2024-01-13T06:37:02.116 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM_ID="platform:el8" 2024-01-13T06:37:02.116 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-13T06:37:02.116 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31" 2024-01-13T06:37:02.116 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-13T06:37:02.116 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://centos.org/" 2024-01-13T06:37:02.116 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T06:37:02.116 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-13T06:37:02.116 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-13T06:37:02.117 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2024-01-13T06:37:02.138 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server 2024-01-13T06:37:02.138 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-01-13T06:37:02.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T06:37:02.252 DEBUG:teuthology.orchestra.run.smithi105:> true 2024-01-13T06:37:02.324 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-01-13T06:37:02.324 DEBUG:teuthology.orchestra.run.smithi105:> uname -m 2024-01-13T06:37:02.384 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2024-01-13T06:37:02.384 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2024-01-13T06:37:02.443 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream" 2024-01-13T06:37:02.443 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8" 2024-01-13T06:37:02.443 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2024-01-13T06:37:02.443 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2024-01-13T06:37:02.443 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8" 2024-01-13T06:37:02.444 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8" 2024-01-13T06:37:02.444 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-13T06:37:02.444 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2024-01-13T06:37:02.444 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-13T06:37:02.444 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/" 2024-01-13T06:37:02.444 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T06:37:02.444 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-13T06:37:02.444 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-13T06:37:02.444 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2024-01-13T06:37:02.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T06:37:02.568 INFO:teuthology.dispatcher.supervisor:Running job 7515471 2024-01-13T06:37:02.568 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7515471 --name yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi --description rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects-balanced} -- /home/teuthworker/archive/yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7515471/orig.config.yaml 2024-01-13T06:37:02.571 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7515471 2024-01-13T06:37:02.571 INFO:teuthology.dispatcher.supervisor:Job PID: 3193489 2024-01-13T06:37:02.571 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-13T06:39:02.669 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T06:41:02.842 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T06:43:03.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T06:45:03.177 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T06:47:03.344 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T06:49:03.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T06:51:03.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T06:51:03.887 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-13T06:51:04.005 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-13T06:51:04.005 INFO:teuthology.nuke:Checking targets against current locks 2024-01-13T06:51:04.059 DEBUG:teuthology.nuke:shortname: smithi080 2024-01-13T06:51:04.059 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-13T06:51:04.081 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi080.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7515471', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-13 06:32:01.400791', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOIgNJkf/VptGlDKJsCUDcdF8UHESQCm9/ebjo1qvBOwmO3CjKF15AayEgjUKstDXbPAdR7kQ/COxrPLEdoJYi0='} 2024-01-13T06:51:04.085 DEBUG:teuthology.nuke:shortname: smithi105 2024-01-13T06:51:04.085 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-13T06:51:04.111 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi105.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7515471', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-13 06:32:01.399436', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJSxPrcsYjXf1rfUPzk8qMpDd7RL7UkNBwreFt36bdMF3Jq1yqqJaPVc2vM4caZsLE8IiZkyApMdujnk0oFPU7Q='} 2024-01-13T06:51:04.140 INFO:teuthology.orchestra.console.smithi080:Power off 2024-01-13T06:51:04.141 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T06:51:04.168 DEBUG:teuthology.orchestra.console.smithi080:power off output: Chassis Power Control: Down/Off 2024-01-13T06:51:04.168 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T06:51:04.181 INFO:teuthology.orchestra.console.smithi105:Power off 2024-01-13T06:51:04.182 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T06:51:04.192 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off 2024-01-13T06:51:04.203 DEBUG:teuthology.orchestra.console.smithi105:power off output: Chassis Power Control: Down/Off 2024-01-13T06:51:04.203 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T06:51:04.226 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2024-01-13T06:51:04.293 INFO:teuthology.orchestra.console.smithi080:Power off completed 2024-01-13T06:51:04.327 INFO:teuthology.orchestra.console.smithi105:Power off completed 2024-01-13T06:51:04.450 INFO:teuthology.lock.ops:unlocked: smithi080.front.sepia.ceph.com 2024-01-13T06:51:04.474 INFO:teuthology.lock.ops:unlocked: smithi105.front.sepia.ceph.com