2023-12-19T16:08:37.699 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-19T16:08:37.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T16:08:37.852 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8f4f24c940>, signals=[15]) 2023-12-19T16:08:37.853 INFO:teuthology.lock.ops:Start node 'smithi116.front.sepia.ceph.com' reimaging 2023-12-19T16:08:37.853 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T16:08:37.853 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2023-12-19T16:08:37.876 INFO:teuthology.lock.ops:Start node 'smithi142.front.sepia.ceph.com' reimaging 2023-12-19T16:08:37.877 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T16:08:37.877 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2023-12-19T16:08:38.015 DEBUG:teuthology.provision.fog.smithi116:Requesting image smithi_centos_8.stream (ID 3) 2023-12-19T16:08:38.029 DEBUG:teuthology.provision.fog.smithi142:Requesting image smithi_centos_8.stream (ID 3) 2023-12-19T16:08:38.077 INFO:teuthology.provision.fog.smithi116:Scheduling deploy of centos 8.stream 2023-12-19T16:08:38.081 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of centos 8.stream 2023-12-19T16:08:38.371 INFO:teuthology.orchestra.console.smithi116:Power off 2023-12-19T16:08:38.371 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T16:08:38.388 INFO:teuthology.orchestra.console.smithi142:Power off 2023-12-19T16:08:38.388 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T16:08:38.397 DEBUG:teuthology.orchestra.console.smithi116:power off output: Chassis Power Control: Down/Off 2023-12-19T16:08:38.397 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T16:08:38.409 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off 2023-12-19T16:08:38.410 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T16:08:38.419 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2023-12-19T16:08:38.430 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2023-12-19T16:08:42.424 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T16:08:42.432 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T16:08:42.533 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2023-12-19T16:08:42.540 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2023-12-19T16:08:46.537 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T16:08:46.544 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T16:08:46.646 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2023-12-19T16:08:46.655 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2023-12-19T16:08:46.756 INFO:teuthology.orchestra.console.smithi142:Power off completed 2023-12-19T16:08:46.856 INFO:teuthology.orchestra.console.smithi142:Power on 2023-12-19T16:08:46.857 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T16:08:46.877 DEBUG:teuthology.orchestra.console.smithi142:power on output: Chassis Power Control: Up/On 2023-12-19T16:08:46.878 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T16:08:46.899 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2023-12-19T16:08:50.649 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T16:08:50.759 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2023-12-19T16:08:50.860 INFO:teuthology.orchestra.console.smithi116:Power off completed 2023-12-19T16:08:50.900 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T16:08:50.961 INFO:teuthology.orchestra.console.smithi116:Power on 2023-12-19T16:08:50.962 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T16:08:50.986 DEBUG:teuthology.orchestra.console.smithi116:power on output: Chassis Power Control: Up/On 2023-12-19T16:08:50.987 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T16:08:51.009 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2023-12-19T16:08:51.010 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2023-12-19T16:08:55.014 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T16:08:55.023 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T16:08:55.131 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2023-12-19T16:08:55.232 INFO:teuthology.orchestra.console.smithi116:Power on completed 2023-12-19T16:08:55.242 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2023-12-19T16:08:55.333 INFO:teuthology.provision.fog.smithi116:Waiting for deploy to finish 2023-12-19T16:08:55.343 INFO:teuthology.orchestra.console.smithi142:Power on completed 2023-12-19T16:08:55.444 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish 2023-12-19T16:11:41.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:11:41.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:11:44.401 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-12-19T16:11:44.402 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-12-19T16:11:50.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:11:50.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:11:53.457 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-12-19T16:11:53.461 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-12-19T16:11:59.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:11:59.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:12:02.513 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-12-19T16:12:02.545 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-12-19T16:12:08.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:12:08.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:12:11.569 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-12-19T16:12:11.601 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-12-19T16:12:17.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:12:17.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:12:20.626 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-12-19T16:12:20.657 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-12-19T16:12:26.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:12:26.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:12:29.713 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-12-19T16:12:29.717 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-12-19T16:12:35.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:12:35.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:12:38.769 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-12-19T16:12:44.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:12:47.825 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-12-19T16:12:53.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:12:56.913 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-12-19T16:13:02.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:13:05.973 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-12-19T16:13:11.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:13:15.057 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-12-19T16:13:21.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:13:24.113 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-12-19T16:13:30.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:13:33.173 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-12-19T16:13:35.725 WARNING:teuthology.provision.fog.smithi116:timed out 2023-12-19T16:13:39.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:13:41.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:13:41.959 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T16:13:41.959 DEBUG:teuthology.orchestra.run.smithi116:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T16:13:42.212 INFO:teuthology.provision.fog.smithi116:Node is ready 2023-12-19T16:13:42.212 DEBUG:teuthology.orchestra.run.smithi116:> hostname 2023-12-19T16:13:42.230 INFO:teuthology.orchestra.run.smithi116.stdout:smithi116 2023-12-19T16:13:42.231 DEBUG:teuthology.orchestra.run.smithi116:> grep smithi116 /etc/hosts 2023-12-19T16:13:42.290 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.15.116 smithi116.front.sepia.ceph.com smithi116 2023-12-19T16:13:42.290 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname smithi116 2023-12-19T16:13:42.383 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/smithi116/smithi116/g' /etc/hosts 2023-12-19T16:13:42.411 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/172.21.15.116/172.21.15.116/g' /etc/hosts 2023-12-19T16:13:42.478 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/smithi116/smithi116/g' /etc/hostname 2023-12-19T16:13:42.546 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname smithi116 2023-12-19T16:13:42.612 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2023-12-19T16:13:42.670 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Stream" 2023-12-19T16:13:42.670 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="8" 2023-12-19T16:13:42.671 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos" 2023-12-19T16:13:42.671 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora" 2023-12-19T16:13:42.671 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="8" 2023-12-19T16:13:42.671 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el8" 2023-12-19T16:13:42.671 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-19T16:13:42.671 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2023-12-19T16:13:42.671 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-19T16:13:42.671 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://centos.org/" 2023-12-19T16:13:42.671 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T16:13:42.671 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T16:13:42.671 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-19T16:13:42.672 INFO:teuthology.provision.fog.smithi116:Deploy complete! 2023-12-19T16:13:42.673 DEBUG:teuthology.parallel:result is None 2023-12-19T16:14:39.234 WARNING:teuthology.provision.fog.smithi142:timed out 2023-12-19T16:14:45.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:14:45.497 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T16:14:45.498 DEBUG:teuthology.orchestra.run.smithi142:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T16:14:45.756 INFO:teuthology.provision.fog.smithi142:Node is ready 2023-12-19T16:14:45.757 DEBUG:teuthology.orchestra.run.smithi142:> hostname 2023-12-19T16:14:45.775 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142.front.sepia.ceph.com 2023-12-19T16:14:45.775 DEBUG:teuthology.orchestra.run.smithi142:> grep smithi142.front.sepia.ceph.com /etc/hosts 2023-12-19T16:14:45.835 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142 2023-12-19T16:14:45.835 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142 2023-12-19T16:14:45.939 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hosts 2023-12-19T16:14:45.968 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/172.21.15.142/172.21.15.142/g' /etc/hosts 2023-12-19T16:14:46.035 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hostname 2023-12-19T16:14:46.103 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142 2023-12-19T16:14:46.169 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2023-12-19T16:14:46.227 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2023-12-19T16:14:46.228 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8" 2023-12-19T16:14:46.228 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2023-12-19T16:14:46.228 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2023-12-19T16:14:46.228 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8" 2023-12-19T16:14:46.228 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8" 2023-12-19T16:14:46.228 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-19T16:14:46.228 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2023-12-19T16:14:46.228 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-19T16:14:46.228 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2023-12-19T16:14:46.228 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T16:14:46.228 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T16:14:46.228 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-19T16:14:46.229 INFO:teuthology.provision.fog.smithi142:Deploy complete! 2023-12-19T16:14:46.229 DEBUG:teuthology.parallel:result is None 2023-12-19T16:14:46.383 INFO:teuthology.lock.ops:Checking smithi116.front.sepia.ceph.com 2023-12-19T16:14:46.383 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T16:14:46.406 INFO:teuthology.lock.ops:Checking smithi142.front.sepia.ceph.com 2023-12-19T16:14:46.406 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T16:14:46.423 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: set os type and version on server 2023-12-19T16:14:46.423 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-12-19T16:14:46.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:14:46.491 DEBUG:teuthology.orchestra.run.smithi116:> true 2023-12-19T16:14:46.582 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-12-19T16:14:46.582 DEBUG:teuthology.orchestra.run.smithi116:> uname -m 2023-12-19T16:14:46.640 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2023-12-19T16:14:46.641 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2023-12-19T16:14:46.698 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Stream" 2023-12-19T16:14:46.699 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="8" 2023-12-19T16:14:46.699 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos" 2023-12-19T16:14:46.699 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora" 2023-12-19T16:14:46.699 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="8" 2023-12-19T16:14:46.699 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el8" 2023-12-19T16:14:46.699 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-19T16:14:46.699 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2023-12-19T16:14:46.699 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-19T16:14:46.699 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://centos.org/" 2023-12-19T16:14:46.699 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T16:14:46.699 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T16:14:46.699 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-19T16:14:46.700 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2023-12-19T16:14:46.725 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: set os type and version on server 2023-12-19T16:14:46.725 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-12-19T16:14:46.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:14:46.793 DEBUG:teuthology.orchestra.run.smithi142:> true 2023-12-19T16:14:46.859 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-12-19T16:14:46.859 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2023-12-19T16:14:46.916 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2023-12-19T16:14:46.917 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2023-12-19T16:14:46.974 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2023-12-19T16:14:46.974 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8" 2023-12-19T16:14:46.974 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2023-12-19T16:14:46.974 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2023-12-19T16:14:46.975 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8" 2023-12-19T16:14:46.975 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8" 2023-12-19T16:14:46.975 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-19T16:14:46.975 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2023-12-19T16:14:46.975 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-19T16:14:46.975 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2023-12-19T16:14:46.975 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T16:14:46.975 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T16:14:46.975 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-19T16:14:46.975 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2023-12-19T16:14:46.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T16:14:47.088 INFO:teuthology.dispatcher.supervisor:Running job 7497102 2023-12-19T16:14:47.088 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497102 --name vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/scrub} -- /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497102/orig.config.yaml 2023-12-19T16:14:47.092 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497102 2023-12-19T16:14:47.093 INFO:teuthology.dispatcher.supervisor:Job PID: 3941006 2023-12-19T16:14:47.093 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-19T16:16:47.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T16:18:47.362 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T16:20:47.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T16:22:47.698 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T16:24:47.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T16:26:48.042 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T16:28:48.210 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T16:30:48.374 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T16:32:48.542 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T16:32:48.608 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-19T16:32:48.732 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-19T16:32:48.733 INFO:teuthology.nuke:Checking targets against current locks 2023-12-19T16:32:48.788 DEBUG:teuthology.nuke:shortname: smithi116 2023-12-19T16:32:48.788 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T16:32:48.810 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497102', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 16:08:36.831331', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP3w6MKycKw/x2D3JpzDc6fogVxAdInO9O5UgyGGNtIHUTXnquEMDFwjx6sJ38w4BfE0ZiUH0xD23tJ7Erprt4I='} 2023-12-19T16:32:48.813 DEBUG:teuthology.nuke:shortname: smithi142 2023-12-19T16:32:48.814 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T16:32:48.832 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497102', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 16:08:36.833351', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAvZfT2OjbmHM38o1OI1GdXmd2hJbUvZvxD89/4NBKfLAicVIrzvSAD+/GqENs27aO9FOSZ39hFquuqOv3htiqQ='} 2023-12-19T16:32:48.865 INFO:teuthology.orchestra.console.smithi116:Power off 2023-12-19T16:32:48.866 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T16:32:48.887 DEBUG:teuthology.orchestra.console.smithi116:power off output: Chassis Power Control: Down/Off 2023-12-19T16:32:48.888 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T16:32:48.900 INFO:teuthology.orchestra.console.smithi142:Power off 2023-12-19T16:32:48.901 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T16:32:48.909 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2023-12-19T16:32:48.922 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off 2023-12-19T16:32:48.922 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T16:32:48.945 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2023-12-19T16:32:49.010 INFO:teuthology.orchestra.console.smithi116:Power off completed 2023-12-19T16:32:49.046 INFO:teuthology.orchestra.console.smithi142:Power off completed 2023-12-19T16:32:49.156 INFO:teuthology.lock.ops:unlocked: smithi116.front.sepia.ceph.com 2023-12-19T16:32:49.189 INFO:teuthology.lock.ops:unlocked: smithi142.front.sepia.ceph.com