2023-11-23T12:57:40.605 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-23T12:57:40.606 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T12:57:40.729 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1ab27ac670>, signals=[15]) 2023-11-23T12:57:40.729 INFO:teuthology.lock.ops:Start node 'smithi143.front.sepia.ceph.com' reimaging 2023-11-23T12:57:40.730 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: reset os type and version on server 2023-11-23T12:57:40.730 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2023-11-23T12:57:40.749 INFO:teuthology.lock.ops:Start node 'smithi188.front.sepia.ceph.com' reimaging 2023-11-23T12:57:40.749 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: reset os type and version on server 2023-11-23T12:57:40.750 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2023-11-23T12:57:40.871 DEBUG:teuthology.provision.fog.smithi143:Requesting image smithi_centos_9.stream (ID 10) 2023-11-23T12:57:40.874 DEBUG:teuthology.provision.fog.smithi188:Requesting image smithi_centos_9.stream (ID 10) 2023-11-23T12:57:40.913 INFO:teuthology.provision.fog.smithi188:Scheduling deploy of centos 9.stream 2023-11-23T12:57:40.916 INFO:teuthology.provision.fog.smithi143:Scheduling deploy of centos 9.stream 2023-11-23T12:57:41.162 INFO:teuthology.orchestra.console.smithi188:Power off 2023-11-23T12:57:41.163 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-23T12:57:41.174 INFO:teuthology.orchestra.console.smithi143:Power off 2023-11-23T12:57:41.175 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-23T12:57:41.185 DEBUG:teuthology.orchestra.console.smithi188:power off output: Chassis Power Control: Down/Off 2023-11-23T12:57:41.185 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T12:57:41.196 DEBUG:teuthology.orchestra.console.smithi143:power off output: Chassis Power Control: Down/Off 2023-11-23T12:57:41.196 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T12:57:41.206 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2023-11-23T12:57:41.216 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on 2023-11-23T12:57:45.210 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T12:57:45.217 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T12:57:45.320 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2023-11-23T12:57:45.325 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on 2023-11-23T12:57:49.325 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T12:57:49.333 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T12:57:49.435 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2023-11-23T12:57:49.441 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on 2023-11-23T12:57:53.438 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T12:57:53.445 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T12:57:53.547 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2023-11-23T12:57:53.554 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-11-23T12:57:53.648 INFO:teuthology.orchestra.console.smithi188:Power off completed 2023-11-23T12:57:53.655 INFO:teuthology.orchestra.console.smithi143:Power off completed 2023-11-23T12:57:53.749 INFO:teuthology.orchestra.console.smithi188:Power on 2023-11-23T12:57:53.749 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-23T12:57:53.756 INFO:teuthology.orchestra.console.smithi143:Power on 2023-11-23T12:57:53.756 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-23T12:57:53.768 DEBUG:teuthology.orchestra.console.smithi188:power on output: Chassis Power Control: Up/On 2023-11-23T12:57:53.769 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T12:57:53.775 DEBUG:teuthology.orchestra.console.smithi143:power on output: Chassis Power Control: Up/On 2023-11-23T12:57:53.775 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T12:57:53.788 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2023-11-23T12:57:53.795 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-11-23T12:57:57.791 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T12:57:57.797 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T12:57:57.899 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2023-11-23T12:57:57.905 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on 2023-11-23T12:57:58.006 INFO:teuthology.orchestra.console.smithi143:Power on completed 2023-11-23T12:57:58.106 INFO:teuthology.provision.fog.smithi143:Waiting for deploy to finish 2023-11-23T12:58:01.904 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T12:58:02.013 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2023-11-23T12:58:02.114 INFO:teuthology.orchestra.console.smithi188:Power on completed 2023-11-23T12:58:02.214 INFO:teuthology.provision.fog.smithi188:Waiting for deploy to finish 2023-11-23T13:00:43.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T13:00:48.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T13:01:02.434 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-11-23T13:01:06.530 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-11-23T13:01:08.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T13:01:11.491 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-11-23T13:01:12.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T13:01:15.586 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-11-23T13:01:17.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T13:01:20.546 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-11-23T13:01:21.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T13:01:24.642 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-11-23T13:01:26.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T13:01:29.602 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-11-23T13:01:30.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T13:01:33.699 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-11-23T13:01:35.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T13:01:39.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T13:01:58.242 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-11-23T13:02:04.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T13:02:07.298 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-11-23T13:02:13.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T13:02:16.354 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-11-23T13:02:22.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T13:02:22.694 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-23T13:02:22.695 DEBUG:teuthology.orchestra.run.smithi188:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-23T13:02:35.608 WARNING:teuthology.provision.fog.smithi143:timed out 2023-11-23T13:02:38.045 INFO:teuthology.provision.fog.smithi188:Node is ready 2023-11-23T13:02:38.046 DEBUG:teuthology.orchestra.run.smithi188:> hostname 2023-11-23T13:02:38.104 INFO:teuthology.orchestra.run.smithi188.stdout:smithi046 2023-11-23T13:02:38.104 DEBUG:teuthology.orchestra.run.smithi188:> grep smithi046 /etc/hosts 2023-11-23T13:02:38.161 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2023-11-23T13:02:38.162 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188 2023-11-23T13:02:38.315 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi046/smithi188/g' /etc/hosts 2023-11-23T13:02:38.346 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/172.21.15.46/172.21.15.188/g' /etc/hosts 2023-11-23T13:02:38.417 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi046/smithi188/g' /etc/hostname 2023-11-23T13:02:38.487 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188 2023-11-23T13:02:38.563 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2023-11-23T13:02:38.618 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="CentOS Stream" 2023-11-23T13:02:38.618 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="9" 2023-11-23T13:02:38.618 INFO:teuthology.orchestra.run.smithi188.stdout:ID="centos" 2023-11-23T13:02:38.619 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="rhel fedora" 2023-11-23T13:02:38.619 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="9" 2023-11-23T13:02:38.619 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el9" 2023-11-23T13:02:38.619 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-23T13:02:38.619 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31" 2023-11-23T13:02:38.619 INFO:teuthology.orchestra.run.smithi188.stdout:LOGO="fedora-logo-icon" 2023-11-23T13:02:38.619 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-23T13:02:38.619 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://centos.org/" 2023-11-23T13:02:38.620 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-23T13:02:38.620 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-23T13:02:38.620 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-23T13:02:38.620 INFO:teuthology.provision.fog.smithi188:Deploy complete! 2023-11-23T13:02:38.622 DEBUG:teuthology.parallel:result is None 2023-11-23T13:02:41.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T13:02:41.914 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-23T13:02:41.914 DEBUG:teuthology.orchestra.run.smithi143:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-23T13:02:42.240 INFO:teuthology.provision.fog.smithi143:Node is ready 2023-11-23T13:02:42.240 DEBUG:teuthology.orchestra.run.smithi143:> hostname 2023-11-23T13:02:42.256 INFO:teuthology.orchestra.run.smithi143.stdout:smithi143.front.sepia.ceph.com 2023-11-23T13:02:42.256 DEBUG:teuthology.orchestra.run.smithi143:> grep smithi143.front.sepia.ceph.com /etc/hosts 2023-11-23T13:02:42.312 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.15.143 smithi143.front.sepia.ceph.com smithi143 2023-11-23T13:02:42.312 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143 2023-11-23T13:02:42.410 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi143.front.sepia.ceph.com/smithi143/g' /etc/hosts 2023-11-23T13:02:42.438 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/172.21.15.143/172.21.15.143/g' /etc/hosts 2023-11-23T13:02:42.505 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi143.front.sepia.ceph.com/smithi143/g' /etc/hostname 2023-11-23T13:02:42.572 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143 2023-11-23T13:02:42.639 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2023-11-23T13:02:42.693 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="CentOS Stream" 2023-11-23T13:02:42.693 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="9" 2023-11-23T13:02:42.693 INFO:teuthology.orchestra.run.smithi143.stdout:ID="centos" 2023-11-23T13:02:42.693 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="rhel fedora" 2023-11-23T13:02:42.693 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="9" 2023-11-23T13:02:42.693 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el9" 2023-11-23T13:02:42.693 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-23T13:02:42.694 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31" 2023-11-23T13:02:42.694 INFO:teuthology.orchestra.run.smithi143.stdout:LOGO="fedora-logo-icon" 2023-11-23T13:02:42.694 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-23T13:02:42.694 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://centos.org/" 2023-11-23T13:02:42.694 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-23T13:02:42.694 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-23T13:02:42.694 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-23T13:02:42.694 INFO:teuthology.provision.fog.smithi143:Deploy complete! 2023-11-23T13:02:42.695 DEBUG:teuthology.parallel:result is None 2023-11-23T13:02:42.853 INFO:teuthology.lock.ops:Checking smithi143.front.sepia.ceph.com 2023-11-23T13:02:42.853 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-23T13:02:42.881 INFO:teuthology.lock.ops:Checking smithi188.front.sepia.ceph.com 2023-11-23T13:02:42.881 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-23T13:02:42.899 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: set os type and version on server 2023-11-23T13:02:42.899 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-11-23T13:02:42.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T13:02:42.980 DEBUG:teuthology.orchestra.run.smithi143:> true 2023-11-23T13:02:43.044 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-11-23T13:02:43.044 DEBUG:teuthology.orchestra.run.smithi143:> uname -m 2023-11-23T13:02:43.099 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64 2023-11-23T13:02:43.099 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2023-11-23T13:02:43.154 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="CentOS Stream" 2023-11-23T13:02:43.154 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="9" 2023-11-23T13:02:43.154 INFO:teuthology.orchestra.run.smithi143.stdout:ID="centos" 2023-11-23T13:02:43.154 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="rhel fedora" 2023-11-23T13:02:43.154 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="9" 2023-11-23T13:02:43.154 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el9" 2023-11-23T13:02:43.154 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-23T13:02:43.154 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31" 2023-11-23T13:02:43.154 INFO:teuthology.orchestra.run.smithi143.stdout:LOGO="fedora-logo-icon" 2023-11-23T13:02:43.155 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-23T13:02:43.155 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://centos.org/" 2023-11-23T13:02:43.155 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-23T13:02:43.155 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-23T13:02:43.155 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-23T13:02:43.155 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2023-11-23T13:02:43.174 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: set os type and version on server 2023-11-23T13:02:43.174 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-11-23T13:02:43.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T13:02:43.256 DEBUG:teuthology.orchestra.run.smithi188:> true 2023-11-23T13:02:43.327 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-11-23T13:02:43.327 DEBUG:teuthology.orchestra.run.smithi188:> uname -m 2023-11-23T13:02:43.383 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64 2023-11-23T13:02:43.384 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2023-11-23T13:02:43.441 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="CentOS Stream" 2023-11-23T13:02:43.441 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="9" 2023-11-23T13:02:43.441 INFO:teuthology.orchestra.run.smithi188.stdout:ID="centos" 2023-11-23T13:02:43.441 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="rhel fedora" 2023-11-23T13:02:43.441 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="9" 2023-11-23T13:02:43.441 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el9" 2023-11-23T13:02:43.441 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-23T13:02:43.441 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31" 2023-11-23T13:02:43.441 INFO:teuthology.orchestra.run.smithi188.stdout:LOGO="fedora-logo-icon" 2023-11-23T13:02:43.441 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-23T13:02:43.441 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://centos.org/" 2023-11-23T13:02:43.442 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-23T13:02:43.442 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-23T13:02:43.442 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-23T13:02:43.442 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2023-11-23T13:02:43.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T13:02:43.544 INFO:teuthology.dispatcher.supervisor:Running job 7464776 2023-11-23T13:02:43.544 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/bin/teuthology -v --owner mchangir --archive /home/teuthworker/archive/mchangir-2023-11-23_12:56:09-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7464776 --name mchangir-2023-11-23_12:56:09-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} -- /home/teuthworker/archive/mchangir-2023-11-23_12:56:09-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7464776/orig.config.yaml 2023-11-23T13:02:43.546 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mchangir-2023-11-23_12:56:09-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7464776 2023-11-23T13:02:43.546 INFO:teuthology.dispatcher.supervisor:Job PID: 3013375 2023-11-23T13:02:43.547 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-23T13:04:43.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T13:06:43.808 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T13:08:43.972 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T13:10:44.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T13:12:44.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T13:14:44.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T13:16:44.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T13:18:44.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T13:20:44.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T13:22:44.988 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T13:24:45.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T13:26:45.213 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T13:28:45.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T13:30:45.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T13:32:45.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T13:34:45.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T13:36:45.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T13:38:46.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T13:40:46.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T13:42:46.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T13:44:46.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T13:46:46.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T13:48:47.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T13:50:47.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T13:52:47.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T13:54:47.616 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T13:56:47.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T13:58:47.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T14:00:48.084 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T14:02:48.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T14:04:48.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T14:06:48.538 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T14:08:48.738 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T14:10:48.806 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T14:12:50.877 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T14:14:51.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T14:16:51.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T14:18:51.348 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T14:20:51.501 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T14:22:51.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T14:24:52.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T14:26:52.464 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T14:28:52.636 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T14:30:52.794 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T14:32:52.962 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T14:34:53.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T14:36:53.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T14:38:53.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T14:40:53.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T14:42:53.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T14:44:54.030 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T14:46:54.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T14:48:54.273 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T14:50:54.441 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T14:52:54.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T14:54:54.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T14:54:54.972 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-11-23T14:54:55.168 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-23T14:54:55.168 INFO:teuthology.nuke:Checking targets against current locks 2023-11-23T14:54:55.210 DEBUG:teuthology.nuke:shortname: smithi143 2023-11-23T14:54:55.210 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-23T14:54:55.230 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi143.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-11-23_12:56:09-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7464776', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-23 12:57:39.844881', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCFMcERvUH6Sl2fadb3tfyfxu7UHX0M77tSkvEBzPAEsd/FmiOP8d6Ht3yui/B+YOaFTMCnd8/fxdK6cnFVeiDo='} 2023-11-23T14:54:55.234 DEBUG:teuthology.nuke:shortname: smithi188 2023-11-23T14:54:55.235 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-23T14:54:55.256 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi188.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-11-23_12:56:09-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7464776', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-23 12:57:39.843591', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHJaAEuk9EAKveLX3yUESFMPOLBQACyJjC/zF09XuTPnKDACPeOnxrRYVEB3BJAaStE+lMAGlyZkxHSX/gaq4l4='} 2023-11-23T14:54:55.273 INFO:teuthology.orchestra.console.smithi143:Power off 2023-11-23T14:54:55.273 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-23T14:54:55.293 DEBUG:teuthology.orchestra.console.smithi143:power off output: Chassis Power Control: Down/Off 2023-11-23T14:54:55.294 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T14:54:55.311 INFO:teuthology.orchestra.console.smithi188:Power off 2023-11-23T14:54:55.311 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-23T14:54:55.319 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-11-23T14:54:55.333 DEBUG:teuthology.orchestra.console.smithi188:power off output: Chassis Power Control: Down/Off 2023-11-23T14:54:55.333 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T14:54:55.354 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2023-11-23T14:54:55.420 INFO:teuthology.orchestra.console.smithi143:Power off completed 2023-11-23T14:54:55.455 INFO:teuthology.orchestra.console.smithi188:Power off completed 2023-11-23T14:54:55.570 INFO:teuthology.lock.ops:unlocked: smithi143.front.sepia.ceph.com 2023-11-23T14:54:55.604 INFO:teuthology.lock.ops:unlocked: smithi188.front.sepia.ceph.com