2024-01-13T04:51:17.322 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-13T04:51:17.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T04:51:17.477 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f46e4cdcc10>, signals=[15]) 2024-01-13T04:51:17.477 INFO:teuthology.lock.ops:Start node 'smithi088.front.sepia.ceph.com' reimaging 2024-01-13T04:51:17.478 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: reset os type and version on server 2024-01-13T04:51:17.478 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2024-01-13T04:51:17.500 INFO:teuthology.lock.ops:Start node 'smithi107.front.sepia.ceph.com' reimaging 2024-01-13T04:51:17.500 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: reset os type and version on server 2024-01-13T04:51:17.500 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2024-01-13T04:51:17.613 DEBUG:teuthology.provision.fog.smithi088:Requesting image smithi_centos_8.stream (ID 3) 2024-01-13T04:51:17.656 DEBUG:teuthology.provision.fog.smithi107:Requesting image smithi_centos_8.stream (ID 3) 2024-01-13T04:51:17.679 INFO:teuthology.provision.fog.smithi088:Scheduling deploy of centos 8.stream 2024-01-13T04:51:17.700 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of centos 8.stream 2024-01-13T04:51:17.927 INFO:teuthology.orchestra.console.smithi107:Power off 2024-01-13T04:51:17.927 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T04:51:17.941 INFO:teuthology.orchestra.console.smithi088:Power off 2024-01-13T04:51:17.941 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T04:51:17.949 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off 2024-01-13T04:51:17.950 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T04:51:17.961 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off 2024-01-13T04:51:17.961 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T04:51:17.970 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2024-01-13T04:51:17.983 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2024-01-13T04:51:18.083 INFO:teuthology.orchestra.console.smithi088:Power off completed 2024-01-13T04:51:18.184 INFO:teuthology.orchestra.console.smithi088:Power on 2024-01-13T04:51:18.184 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-13T04:51:18.209 DEBUG:teuthology.orchestra.console.smithi088:power on output: Chassis Power Control: Up/On 2024-01-13T04:51:18.209 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T04:51:18.231 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2024-01-13T04:51:21.973 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T04:51:22.082 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2024-01-13T04:51:22.232 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T04:51:22.342 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2024-01-13T04:51:22.442 INFO:teuthology.orchestra.console.smithi088:Power on completed 2024-01-13T04:51:22.543 INFO:teuthology.provision.fog.smithi088:Waiting for deploy to finish 2024-01-13T04:51:26.086 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T04:51:26.195 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2024-01-13T04:51:26.295 INFO:teuthology.orchestra.console.smithi107:Power off completed 2024-01-13T04:51:26.396 INFO:teuthology.orchestra.console.smithi107:Power on 2024-01-13T04:51:26.396 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-13T04:51:26.417 DEBUG:teuthology.orchestra.console.smithi107:power on output: Chassis Power Control: Up/On 2024-01-13T04:51:26.417 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T04:51:26.438 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2024-01-13T04:51:30.440 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T04:51:30.548 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2024-01-13T04:51:30.649 INFO:teuthology.orchestra.console.smithi107:Power on completed 2024-01-13T04:51:30.750 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish 2024-01-13T04:54:16.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:54:19.708 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-01-13T04:54:23.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:54:25.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:54:26.560 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-01-13T04:54:28.764 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-01-13T04:54:32.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:54:34.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:54:35.644 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-01-13T04:54:37.820 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-01-13T04:54:41.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:54:43.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:54:44.704 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-01-13T04:54:46.880 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-01-13T04:54:50.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:54:52.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:54:53.792 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-01-13T04:54:55.964 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-01-13T04:54:59.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:55:01.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:55:02.880 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-01-13T04:55:05.020 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-01-13T04:55:08.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:55:11.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:55:11.964 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-01-13T04:55:14.080 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-01-13T04:55:17.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:55:20.083 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:55:21.020 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-01-13T04:55:27.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:55:30.076 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-01-13T04:55:36.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:55:54.432 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-01-13T04:56:00.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:56:03.488 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-01-13T04:56:09.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:56:10.746 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-13T04:56:10.746 DEBUG:teuthology.orchestra.run.smithi088:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-13T04:56:20.085 WARNING:teuthology.provision.fog.smithi107:timed out 2024-01-13T04:56:26.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:56:26.328 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-13T04:56:26.328 DEBUG:teuthology.orchestra.run.smithi107:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-13T04:56:26.572 INFO:teuthology.provision.fog.smithi107:Node is ready 2024-01-13T04:56:26.572 DEBUG:teuthology.orchestra.run.smithi107:> hostname 2024-01-13T04:56:26.591 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107.front.sepia.ceph.com 2024-01-13T04:56:26.591 DEBUG:teuthology.orchestra.run.smithi107:> grep smithi107.front.sepia.ceph.com /etc/hosts 2024-01-13T04:56:26.650 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107 smithi107.front.sepia.ceph.com smithi107 2024-01-13T04:56:26.651 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2024-01-13T04:56:26.752 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hosts 2024-01-13T04:56:26.781 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/172.21.15.107/172.21.15.107/g' /etc/hosts 2024-01-13T04:56:26.851 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hostname 2024-01-13T04:56:26.920 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2024-01-13T04:56:26.988 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2024-01-13T04:56:27.046 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream" 2024-01-13T04:56:27.046 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="8" 2024-01-13T04:56:27.046 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos" 2024-01-13T04:56:27.046 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora" 2024-01-13T04:56:27.046 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="8" 2024-01-13T04:56:27.046 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el8" 2024-01-13T04:56:27.047 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-13T04:56:27.047 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2024-01-13T04:56:27.047 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-13T04:56:27.047 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/" 2024-01-13T04:56:27.047 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T04:56:27.047 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-13T04:56:27.047 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-13T04:56:27.048 INFO:teuthology.provision.fog.smithi107:Deploy complete! 2024-01-13T04:56:27.049 DEBUG:teuthology.parallel:result is None 2024-01-13T04:56:36.041 INFO:teuthology.provision.fog.smithi088:Node is ready 2024-01-13T04:56:36.041 DEBUG:teuthology.orchestra.run.smithi088:> hostname 2024-01-13T04:56:36.065 INFO:teuthology.orchestra.run.smithi088.stdout:smithi088.front.sepia.ceph.com 2024-01-13T04:56:36.066 DEBUG:teuthology.orchestra.run.smithi088:> grep smithi088.front.sepia.ceph.com /etc/hosts 2024-01-13T04:56:36.126 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88 smithi088.front.sepia.ceph.com smithi088 2024-01-13T04:56:36.126 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088 2024-01-13T04:56:36.236 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hosts 2024-01-13T04:56:36.268 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/172.21.15.88/172.21.15.88/g' /etc/hosts 2024-01-13T04:56:36.337 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hostname 2024-01-13T04:56:36.405 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088 2024-01-13T04:56:36.472 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2024-01-13T04:56:36.530 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream" 2024-01-13T04:56:36.530 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8" 2024-01-13T04:56:36.530 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos" 2024-01-13T04:56:36.530 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora" 2024-01-13T04:56:36.530 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8" 2024-01-13T04:56:36.530 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8" 2024-01-13T04:56:36.530 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-13T04:56:36.531 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2024-01-13T04:56:36.531 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-13T04:56:36.531 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/" 2024-01-13T04:56:36.531 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T04:56:36.531 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-13T04:56:36.531 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-13T04:56:36.531 INFO:teuthology.provision.fog.smithi088:Deploy complete! 2024-01-13T04:56:36.532 DEBUG:teuthology.parallel:result is None 2024-01-13T04:56:36.682 INFO:teuthology.lock.ops:Checking smithi088.front.sepia.ceph.com 2024-01-13T04:56:36.682 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-13T04:56:36.706 INFO:teuthology.lock.ops:Checking smithi107.front.sepia.ceph.com 2024-01-13T04:56:36.706 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-13T04:56:36.724 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: set os type and version on server 2024-01-13T04:56:36.725 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-01-13T04:56:36.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:56:36.796 DEBUG:teuthology.orchestra.run.smithi088:> true 2024-01-13T04:56:36.862 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-01-13T04:56:36.862 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2024-01-13T04:56:36.920 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2024-01-13T04:56:36.920 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2024-01-13T04:56:36.977 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream" 2024-01-13T04:56:36.978 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8" 2024-01-13T04:56:36.978 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos" 2024-01-13T04:56:36.978 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora" 2024-01-13T04:56:36.978 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8" 2024-01-13T04:56:36.978 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8" 2024-01-13T04:56:36.978 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-13T04:56:36.978 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2024-01-13T04:56:36.978 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-13T04:56:36.978 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/" 2024-01-13T04:56:36.978 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T04:56:36.978 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-13T04:56:36.979 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-13T04:56:36.979 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2024-01-13T04:56:36.997 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: set os type and version on server 2024-01-13T04:56:36.997 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-01-13T04:56:36.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:56:37.074 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-01-13T04:56:37.103 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-01-13T04:56:37.103 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2024-01-13T04:56:37.164 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2024-01-13T04:56:37.164 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2024-01-13T04:56:37.225 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream" 2024-01-13T04:56:37.225 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="8" 2024-01-13T04:56:37.225 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos" 2024-01-13T04:56:37.226 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora" 2024-01-13T04:56:37.226 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="8" 2024-01-13T04:56:37.226 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el8" 2024-01-13T04:56:37.226 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-13T04:56:37.226 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2024-01-13T04:56:37.226 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-13T04:56:37.227 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/" 2024-01-13T04:56:37.227 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T04:56:37.227 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-13T04:56:37.227 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-13T04:56:37.227 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2024-01-13T04:56:37.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T04:56:37.372 INFO:teuthology.dispatcher.supervisor:Running job 7515241 2024-01-13T04:56:37.373 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7515241 --name yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi --description rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} -- /home/teuthworker/archive/yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7515241/orig.config.yaml 2024-01-13T04:56:37.375 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7515241 2024-01-13T04:56:37.376 INFO:teuthology.dispatcher.supervisor:Job PID: 2420536 2024-01-13T04:56:37.376 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-13T04:58:37.476 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T05:00:37.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T05:02:37.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T05:04:38.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T05:06:38.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T05:08:38.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T05:10:38.538 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T05:10:38.604 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-13T05:10:38.744 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-13T05:10:38.744 INFO:teuthology.nuke:Checking targets against current locks 2024-01-13T05:10:38.793 DEBUG:teuthology.nuke:shortname: smithi088 2024-01-13T05:10:38.794 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-13T05:10:38.813 DEBUG:teuthology.nuke:shortname: smithi107 2024-01-13T05:10:38.813 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-13T05:10:38.817 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7515241', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-13 04:51:16.338498', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI3Ji6ADfvFcEfqYn0KFgO6pbFmsqb/HSFjWhQ6UI61JVEp5Afz0EdvHJGZGPWE8vSHIvUayzZpLlhevBqjy0ac='} 2024-01-13T05:10:38.838 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7515241', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-13 04:51:16.339809', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBESQyn37SC9OxBu8x3TEpagNF0JLuUnP6eUDJzQyqCfDblFnTECzrw28cF1D0FhASrwO+AmHOqAYLsqvvBx5MWY='} 2024-01-13T05:10:38.870 INFO:teuthology.orchestra.console.smithi088:Power off 2024-01-13T05:10:38.871 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T05:10:38.893 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off 2024-01-13T05:10:38.893 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T05:10:38.907 INFO:teuthology.orchestra.console.smithi107:Power off 2024-01-13T05:10:38.907 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T05:10:38.917 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2024-01-13T05:10:38.928 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off 2024-01-13T05:10:38.928 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T05:10:38.950 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2024-01-13T05:10:39.018 INFO:teuthology.orchestra.console.smithi088:Power off completed 2024-01-13T05:10:39.051 INFO:teuthology.orchestra.console.smithi107:Power off completed 2024-01-13T05:10:39.162 INFO:teuthology.lock.ops:unlocked: smithi088.front.sepia.ceph.com 2024-01-13T05:10:39.195 INFO:teuthology.lock.ops:unlocked: smithi107.front.sepia.ceph.com