2023-12-19T13:56:03.639 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-19T13:56:03.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:56:03.784 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fafd4caf940>, signals=[15]) 2023-12-19T13:56:03.785 INFO:teuthology.lock.ops:Start node 'smithi115.front.sepia.ceph.com' reimaging 2023-12-19T13:56:03.785 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T13:56:03.785 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2023-12-19T13:56:03.802 INFO:teuthology.lock.ops:Start node 'smithi156.front.sepia.ceph.com' reimaging 2023-12-19T13:56:03.802 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T13:56:03.802 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2023-12-19T13:56:03.908 DEBUG:teuthology.provision.fog.smithi115:Requesting image smithi_centos_8.stream (ID 3) 2023-12-19T13:56:03.935 DEBUG:teuthology.provision.fog.smithi156:Requesting image smithi_centos_8.stream (ID 3) 2023-12-19T13:56:03.967 INFO:teuthology.provision.fog.smithi115:Scheduling deploy of centos 8.stream 2023-12-19T13:56:03.988 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of centos 8.stream 2023-12-19T13:56:04.303 INFO:teuthology.orchestra.console.smithi115:Power off 2023-12-19T13:56:04.303 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T13:56:04.323 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off 2023-12-19T13:56:04.324 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:56:04.338 INFO:teuthology.orchestra.console.smithi156:Power off 2023-12-19T13:56:04.338 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T13:56:04.347 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2023-12-19T13:56:04.359 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2023-12-19T13:56:04.359 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:56:04.379 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-12-19T13:56:04.448 INFO:teuthology.orchestra.console.smithi115:Power off completed 2023-12-19T13:56:04.481 INFO:teuthology.orchestra.console.smithi156:Power off completed 2023-12-19T13:56:04.549 INFO:teuthology.orchestra.console.smithi115:Power on 2023-12-19T13:56:04.549 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T13:56:04.580 DEBUG:teuthology.orchestra.console.smithi115:power on output: Chassis Power Control: Up/On 2023-12-19T13:56:04.581 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:56:04.588 INFO:teuthology.orchestra.console.smithi156:Power on 2023-12-19T13:56:04.589 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T13:56:04.604 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2023-12-19T13:56:04.612 DEBUG:teuthology.orchestra.console.smithi156:power on output: Chassis Power Control: Up/On 2023-12-19T13:56:04.612 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:56:04.643 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-12-19T13:56:08.606 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:56:08.644 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:56:08.716 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2023-12-19T13:56:08.754 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-12-19T13:56:08.817 INFO:teuthology.orchestra.console.smithi115:Power on completed 2023-12-19T13:56:08.855 INFO:teuthology.orchestra.console.smithi156:Power on completed 2023-12-19T13:56:08.918 INFO:teuthology.provision.fog.smithi115:Waiting for deploy to finish 2023-12-19T13:56:08.955 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish 2023-12-19T13:58:55.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:58:55.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:58:58.194 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-12-19T13:58:58.194 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-12-19T13:59:04.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:59:04.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:59:07.249 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-12-19T13:59:07.281 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-12-19T13:59:13.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:59:13.283 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:59:16.305 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-12-19T13:59:16.337 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-12-19T13:59:22.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:59:22.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:59:25.365 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-12-19T13:59:25.393 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-12-19T13:59:31.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:59:31.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:59:34.454 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-12-19T13:59:34.454 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-12-19T13:59:40.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:59:40.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:59:43.541 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-12-19T13:59:43.542 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-12-19T13:59:49.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:59:49.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:59:52.625 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-12-19T13:59:52.626 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-12-19T13:59:58.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:59:58.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T14:00:17.174 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-12-19T14:00:17.174 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-12-19T14:00:23.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T14:00:23.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T14:00:26.258 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-12-19T14:00:26.258 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-12-19T14:00:32.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T14:00:32.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T14:00:35.317 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-12-19T14:00:35.556 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T14:00:35.556 DEBUG:teuthology.orchestra.run.smithi115:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T14:00:41.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T14:00:41.577 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T14:00:41.577 DEBUG:teuthology.orchestra.run.smithi156:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T14:01:01.259 INFO:teuthology.provision.fog.smithi115:Node is ready 2023-12-19T14:01:01.260 DEBUG:teuthology.orchestra.run.smithi115:> hostname 2023-12-19T14:01:01.283 INFO:teuthology.orchestra.run.smithi115.stdout:smithi115.front.sepia.ceph.com 2023-12-19T14:01:01.284 DEBUG:teuthology.orchestra.run.smithi115:> grep smithi115.front.sepia.ceph.com /etc/hosts 2023-12-19T14:01:01.345 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115 smithi115.front.sepia.ceph.com smithi115 2023-12-19T14:01:01.346 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115 2023-12-19T14:01:01.461 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hosts 2023-12-19T14:01:01.492 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/172.21.15.115/172.21.15.115/g' /etc/hosts 2023-12-19T14:01:01.562 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hostname 2023-12-19T14:01:01.631 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115 2023-12-19T14:01:01.700 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2023-12-19T14:01:01.758 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream" 2023-12-19T14:01:01.758 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="8" 2023-12-19T14:01:01.758 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos" 2023-12-19T14:01:01.758 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora" 2023-12-19T14:01:01.758 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="8" 2023-12-19T14:01:01.758 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el8" 2023-12-19T14:01:01.759 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-19T14:01:01.759 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2023-12-19T14:01:01.759 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-19T14:01:01.759 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/" 2023-12-19T14:01:01.759 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T14:01:01.759 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T14:01:01.759 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-19T14:01:01.760 INFO:teuthology.provision.fog.smithi115:Deploy complete! 2023-12-19T14:01:01.761 DEBUG:teuthology.parallel:result is None 2023-12-19T14:01:02.108 INFO:teuthology.provision.fog.smithi156:Node is ready 2023-12-19T14:01:02.108 DEBUG:teuthology.orchestra.run.smithi156:> hostname 2023-12-19T14:01:02.132 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com 2023-12-19T14:01:02.132 DEBUG:teuthology.orchestra.run.smithi156:> grep smithi156.front.sepia.ceph.com /etc/hosts 2023-12-19T14:01:02.194 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156 2023-12-19T14:01:02.194 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2023-12-19T14:01:02.334 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hosts 2023-12-19T14:01:02.366 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/172.21.15.156/172.21.15.156/g' /etc/hosts 2023-12-19T14:01:02.435 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hostname 2023-12-19T14:01:02.505 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2023-12-19T14:01:02.573 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2023-12-19T14:01:02.632 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream" 2023-12-19T14:01:02.632 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="8" 2023-12-19T14:01:02.632 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos" 2023-12-19T14:01:02.632 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora" 2023-12-19T14:01:02.632 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="8" 2023-12-19T14:01:02.632 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el8" 2023-12-19T14:01:02.632 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-19T14:01:02.632 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2023-12-19T14:01:02.632 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-19T14:01:02.633 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/" 2023-12-19T14:01:02.633 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T14:01:02.633 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T14:01:02.633 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-19T14:01:02.633 INFO:teuthology.provision.fog.smithi156:Deploy complete! 2023-12-19T14:01:02.633 DEBUG:teuthology.parallel:result is None 2023-12-19T14:01:02.831 INFO:teuthology.lock.ops:Checking smithi115.front.sepia.ceph.com 2023-12-19T14:01:02.831 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T14:01:02.853 INFO:teuthology.lock.ops:Checking smithi156.front.sepia.ceph.com 2023-12-19T14:01:02.853 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T14:01:02.870 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: set os type and version on server 2023-12-19T14:01:02.870 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-12-19T14:01:02.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T14:01:02.941 DEBUG:teuthology.orchestra.run.smithi115:> true 2023-12-19T14:01:03.014 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-12-19T14:01:03.014 DEBUG:teuthology.orchestra.run.smithi115:> uname -m 2023-12-19T14:01:03.074 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2023-12-19T14:01:03.074 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2023-12-19T14:01:03.133 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream" 2023-12-19T14:01:03.134 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="8" 2023-12-19T14:01:03.134 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos" 2023-12-19T14:01:03.134 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora" 2023-12-19T14:01:03.134 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="8" 2023-12-19T14:01:03.134 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el8" 2023-12-19T14:01:03.134 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-19T14:01:03.134 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2023-12-19T14:01:03.134 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-19T14:01:03.134 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/" 2023-12-19T14:01:03.134 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T14:01:03.134 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T14:01:03.134 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-19T14:01:03.135 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2023-12-19T14:01:03.153 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: set os type and version on server 2023-12-19T14:01:03.153 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-12-19T14:01:03.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T14:01:03.221 DEBUG:teuthology.orchestra.run.smithi156:> true 2023-12-19T14:01:03.292 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-12-19T14:01:03.293 DEBUG:teuthology.orchestra.run.smithi156:> uname -m 2023-12-19T14:01:03.351 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2023-12-19T14:01:03.352 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2023-12-19T14:01:03.409 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream" 2023-12-19T14:01:03.409 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="8" 2023-12-19T14:01:03.409 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos" 2023-12-19T14:01:03.409 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora" 2023-12-19T14:01:03.409 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="8" 2023-12-19T14:01:03.410 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el8" 2023-12-19T14:01:03.410 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-19T14:01:03.410 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2023-12-19T14:01:03.410 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-19T14:01:03.410 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/" 2023-12-19T14:01:03.410 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T14:01:03.410 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T14:01:03.410 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-19T14:01:03.411 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2023-12-19T14:01:03.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T14:01:03.519 INFO:teuthology.dispatcher.supervisor:Running job 7496834 2023-12-19T14:01:03.519 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496834 --name rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/asok_dump_tree} -- /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496834/orig.config.yaml 2023-12-19T14:01:03.523 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496834 2023-12-19T14:01:03.523 INFO:teuthology.dispatcher.supervisor:Job PID: 1590287 2023-12-19T14:01:03.523 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-19T14:03:03.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T14:05:03.790 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T14:07:03.962 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T14:09:04.126 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T14:11:04.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T14:13:04.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T14:15:04.634 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T14:17:04.802 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T14:19:04.966 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T14:21:05.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T14:23:05.310 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T14:25:05.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T14:27:05.650 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T14:29:05.806 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T14:31:05.974 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T14:33:06.142 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T14:35:06.318 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T14:37:06.494 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T14:39:06.670 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T14:41:06.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T14:43:07.002 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T14:45:07.166 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T14:47:07.336 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T14:49:07.510 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T14:51:07.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T14:51:07.761 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-19T14:51:07.902 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-19T14:51:07.902 INFO:teuthology.nuke:Checking targets against current locks 2023-12-19T14:51:07.950 DEBUG:teuthology.nuke:shortname: smithi115 2023-12-19T14:51:07.950 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T14:51:07.975 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496834', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 13:56:02.832226', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGxGBStsHxjYBGItxot6aU5KsII6XW78nSMvtVVruqDsvPjupEtYXz4xdDRy7bK7BBvwu5Yy6oipH/0IQTBi0Z0='} 2023-12-19T14:51:07.978 DEBUG:teuthology.nuke:shortname: smithi156 2023-12-19T14:51:07.978 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T14:51:08.003 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496834', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 13:56:02.830821', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLfTDMORY9KVdcGVCB0FDCwhhcvSqYbrCYJyMsZEfSDQGo/GbTeDbeWkrPQ5HafwkH4y+nwFkFDBN6MnZIKDv9k='} 2023-12-19T14:51:08.032 INFO:teuthology.orchestra.console.smithi115:Power off 2023-12-19T14:51:08.032 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T14:51:08.056 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off 2023-12-19T14:51:08.057 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T14:51:08.071 INFO:teuthology.orchestra.console.smithi156:Power off 2023-12-19T14:51:08.071 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T14:51:08.083 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2023-12-19T14:51:08.094 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2023-12-19T14:51:08.094 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T14:51:08.122 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-12-19T14:51:08.185 INFO:teuthology.orchestra.console.smithi115:Power off completed 2023-12-19T14:51:08.223 INFO:teuthology.orchestra.console.smithi156:Power off completed 2023-12-19T14:51:08.327 INFO:teuthology.lock.ops:unlocked: smithi115.front.sepia.ceph.com 2023-12-19T14:51:08.368 INFO:teuthology.lock.ops:unlocked: smithi156.front.sepia.ceph.com