2024-01-22T00:37:57.504 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-01-22T00:37:57.504 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T00:37:57.658 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7ff364f1ff70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7ff365f85c10>, signals=[15])
2024-01-22T00:37:57.658 INFO:teuthology.lock.ops:Start node 'smithi088.front.sepia.ceph.com' reimaging
2024-01-22T00:37:57.658 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: reset os type and version on server
2024-01-22T00:37:57.658 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server
2024-01-22T00:37:57.683 INFO:teuthology.lock.ops:Start node 'smithi115.front.sepia.ceph.com' reimaging
2024-01-22T00:37:57.683 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: reset os type and version on server
2024-01-22T00:37:57.683 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server
2024-01-22T00:37:57.805 DEBUG:teuthology.provision.fog.smithi088:Requesting image smithi_centos_8.stream (ID 3)
2024-01-22T00:37:57.808 DEBUG:teuthology.provision.fog.smithi115:Requesting image smithi_centos_8.stream (ID 3)
2024-01-22T00:37:57.847 INFO:teuthology.provision.fog.smithi115:Scheduling deploy of centos 8.stream
2024-01-22T00:37:57.854 INFO:teuthology.provision.fog.smithi088:Scheduling deploy of centos 8.stream
2024-01-22T00:37:58.121 INFO:teuthology.orchestra.console.smithi115:Power off
2024-01-22T00:37:58.121 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-22T00:37:58.135 INFO:teuthology.orchestra.console.smithi088:Power off
2024-01-22T00:37:58.135 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-22T00:37:58.145 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off
2024-01-22T00:37:58.145 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-22T00:37:58.156 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off
2024-01-22T00:37:58.156 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-22T00:37:58.166 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on
2024-01-22T00:37:58.176 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on
2024-01-22T00:38:02.168 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-22T00:38:02.177 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-22T00:38:02.277 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on
2024-01-22T00:38:02.285 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on
2024-01-22T00:38:06.282 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-22T00:38:06.290 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-22T00:38:06.392 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on
2024-01-22T00:38:06.400 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on
2024-01-22T00:38:10.396 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-22T00:38:10.404 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-22T00:38:10.507 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off
2024-01-22T00:38:10.513 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off
2024-01-22T00:38:10.609 INFO:teuthology.orchestra.console.smithi115:Power off completed
2024-01-22T00:38:10.614 INFO:teuthology.orchestra.console.smithi088:Power off completed
2024-01-22T00:38:10.710 INFO:teuthology.orchestra.console.smithi115:Power on
2024-01-22T00:38:10.710 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-22T00:38:10.718 INFO:teuthology.orchestra.console.smithi088:Power on
2024-01-22T00:38:10.718 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-22T00:38:10.731 DEBUG:teuthology.orchestra.console.smithi115:power on output: Chassis Power Control: Up/On
2024-01-22T00:38:10.732 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-22T00:38:10.743 DEBUG:teuthology.orchestra.console.smithi088:power on output: Chassis Power Control: Up/On
2024-01-22T00:38:10.743 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-22T00:38:10.755 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off
2024-01-22T00:38:10.794 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off
2024-01-22T00:38:14.760 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-22T00:38:14.795 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-22T00:38:14.869 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on
2024-01-22T00:38:14.904 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off
2024-01-22T00:38:14.970 INFO:teuthology.orchestra.console.smithi115:Power on completed
2024-01-22T00:38:15.071 INFO:teuthology.provision.fog.smithi115:Waiting for deploy to finish
2024-01-22T00:38:18.908 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-22T00:38:19.111 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on
2024-01-22T00:38:19.212 INFO:teuthology.orchestra.console.smithi088:Power on completed
2024-01-22T00:38:19.313 INFO:teuthology.provision.fog.smithi088:Waiting for deploy to finish
2024-01-22T00:41:01.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-22T00:41:19.676 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2024-01-22T00:41:20.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-22T00:41:25.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-22T00:41:28.732 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2024-01-22T00:41:34.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-22T00:41:37.792 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2024-01-22T00:41:38.876 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2024-01-22T00:41:43.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-22T00:41:44.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-22T00:41:46.876 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2024-01-22T00:41:47.932 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2024-01-22T00:41:52.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-22T00:41:53.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-22T00:41:55.932 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2024-01-22T00:41:56.988 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2024-01-22T00:42:01.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-22T00:42:02.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-22T00:42:04.988 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2024-01-22T00:42:06.048 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2024-01-22T00:42:10.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-22T00:42:12.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-22T00:42:15.136 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2024-01-22T00:42:21.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-22T00:42:24.224 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2024-01-22T00:42:30.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-22T00:43:11.032 WARNING:teuthology.provision.fog.smithi115:timed out
2024-01-22T00:43:17.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-22T00:43:17.297 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-22T00:43:17.298 DEBUG:teuthology.orchestra.run.smithi115:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-22T00:43:17.558 INFO:teuthology.provision.fog.smithi115:Node is ready
2024-01-22T00:43:17.558 DEBUG:teuthology.orchestra.run.smithi115:> hostname
2024-01-22T00:43:17.577 INFO:teuthology.orchestra.run.smithi115.stdout:smithi115.front.sepia.ceph.com
2024-01-22T00:43:17.578 DEBUG:teuthology.orchestra.run.smithi115:> grep smithi115.front.sepia.ceph.com /etc/hosts
2024-01-22T00:43:17.637 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115 smithi115.front.sepia.ceph.com smithi115
2024-01-22T00:43:17.638 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115
2024-01-22T00:43:17.742 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hosts
2024-01-22T00:43:17.773 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/172.21.15.115/172.21.15.115/g' /etc/hosts
2024-01-22T00:43:17.842 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hostname
2024-01-22T00:43:17.910 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115
2024-01-22T00:43:17.977 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release
2024-01-22T00:43:18.035 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream"
2024-01-22T00:43:18.035 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="8"
2024-01-22T00:43:18.035 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos"
2024-01-22T00:43:18.035 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora"
2024-01-22T00:43:18.035 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="8"
2024-01-22T00:43:18.035 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el8"
2024-01-22T00:43:18.035 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 8"
2024-01-22T00:43:18.036 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31"
2024-01-22T00:43:18.036 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-01-22T00:43:18.036 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/"
2024-01-22T00:43:18.036 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-22T00:43:18.036 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-22T00:43:18.036 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-22T00:43:18.037 INFO:teuthology.provision.fog.smithi115:Deploy complete!
2024-01-22T00:43:18.038 DEBUG:teuthology.parallel:result is None
2024-01-22T00:43:30.240 WARNING:teuthology.provision.fog.smithi088:timed out
2024-01-22T00:43:36.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-22T00:43:36.484 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-22T00:43:36.485 DEBUG:teuthology.orchestra.run.smithi088:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-22T00:43:36.753 INFO:teuthology.provision.fog.smithi088:Node is ready
2024-01-22T00:43:36.754 DEBUG:teuthology.orchestra.run.smithi088:> hostname
2024-01-22T00:43:36.814 INFO:teuthology.orchestra.run.smithi088.stdout:smithi088.front.sepia.ceph.com
2024-01-22T00:43:36.814 DEBUG:teuthology.orchestra.run.smithi088:> grep smithi088.front.sepia.ceph.com /etc/hosts
2024-01-22T00:43:36.873 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88 smithi088.front.sepia.ceph.com smithi088
2024-01-22T00:43:36.874 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088
2024-01-22T00:43:36.988 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hosts
2024-01-22T00:43:37.025 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/172.21.15.88/172.21.15.88/g' /etc/hosts
2024-01-22T00:43:37.097 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hostname
2024-01-22T00:43:37.174 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088
2024-01-22T00:43:37.245 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release
2024-01-22T00:43:37.307 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream"
2024-01-22T00:43:37.308 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8"
2024-01-22T00:43:37.308 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos"
2024-01-22T00:43:37.308 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora"
2024-01-22T00:43:37.308 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8"
2024-01-22T00:43:37.308 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8"
2024-01-22T00:43:37.308 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 8"
2024-01-22T00:43:37.308 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31"
2024-01-22T00:43:37.308 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-01-22T00:43:37.308 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/"
2024-01-22T00:43:37.308 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-22T00:43:37.308 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-22T00:43:37.308 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-22T00:43:37.309 INFO:teuthology.provision.fog.smithi088:Deploy complete!
2024-01-22T00:43:37.309 DEBUG:teuthology.parallel:result is None
2024-01-22T00:43:37.516 INFO:teuthology.lock.ops:Checking smithi088.front.sepia.ceph.com
2024-01-22T00:43:37.517 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-22T00:43:37.543 INFO:teuthology.lock.ops:Checking smithi115.front.sepia.ceph.com
2024-01-22T00:43:37.544 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-22T00:43:37.561 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: set os type and version on server
2024-01-22T00:43:37.561 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com'
2024-01-22T00:43:37.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-22T00:43:37.635 DEBUG:teuthology.orchestra.run.smithi088:> true
2024-01-22T00:43:37.702 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com'
2024-01-22T00:43:37.702 DEBUG:teuthology.orchestra.run.smithi088:> uname -m
2024-01-22T00:43:37.760 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64
2024-01-22T00:43:37.760 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release
2024-01-22T00:43:37.818 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream"
2024-01-22T00:43:37.818 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8"
2024-01-22T00:43:37.818 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos"
2024-01-22T00:43:37.818 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora"
2024-01-22T00:43:37.818 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8"
2024-01-22T00:43:37.818 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8"
2024-01-22T00:43:37.818 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 8"
2024-01-22T00:43:37.819 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31"
2024-01-22T00:43:37.819 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-01-22T00:43:37.819 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/"
2024-01-22T00:43:37.819 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-22T00:43:37.819 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-22T00:43:37.819 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-22T00:43:37.819 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server
2024-01-22T00:43:37.845 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: set os type and version on server
2024-01-22T00:43:37.845 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com'
2024-01-22T00:43:37.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-22T00:43:37.919 DEBUG:teuthology.orchestra.run.smithi115:> true
2024-01-22T00:43:38.051 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com'
2024-01-22T00:43:38.051 DEBUG:teuthology.orchestra.run.smithi115:> uname -m
2024-01-22T00:43:38.110 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64
2024-01-22T00:43:38.111 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release
2024-01-22T00:43:38.170 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream"
2024-01-22T00:43:38.171 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="8"
2024-01-22T00:43:38.171 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos"
2024-01-22T00:43:38.171 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora"
2024-01-22T00:43:38.171 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="8"
2024-01-22T00:43:38.171 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el8"
2024-01-22T00:43:38.171 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 8"
2024-01-22T00:43:38.172 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31"
2024-01-22T00:43:38.172 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-01-22T00:43:38.172 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/"
2024-01-22T00:43:38.172 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-22T00:43:38.172 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-22T00:43:38.173 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-22T00:43:38.173 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server
2024-01-22T00:43:38.194 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T00:43:38.300 INFO:teuthology.dispatcher.supervisor:Running job 7523529
2024-01-22T00:43:38.301 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi/7523529 --name vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi/7523529/orig.config.yaml
2024-01-22T00:43:38.304 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi/7523529
2024-01-22T00:43:38.305 INFO:teuthology.dispatcher.supervisor:Job PID: 2190248
2024-01-22T00:43:38.305 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-22T00:45:38.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T00:47:38.584 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T00:49:38.753 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T00:51:38.920 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T00:53:39.086 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T00:55:39.252 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T00:57:39.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T00:59:39.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T01:01:39.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T01:03:39.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T01:05:40.088 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T01:07:40.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T01:09:40.421 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T01:11:40.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T01:13:40.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T01:15:40.908 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T01:17:41.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T01:19:41.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T01:21:41.396 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T01:23:41.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T01:25:41.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T01:27:41.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T01:29:42.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T01:31:42.233 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T01:33:42.358 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T01:35:42.521 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T01:37:42.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T01:39:42.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T01:41:43.026 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T01:43:43.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T01:45:43.369 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T01:47:43.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T01:49:43.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T01:51:43.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T01:53:44.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T01:55:44.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T01:57:44.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T01:59:44.448 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T02:01:44.616 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T02:03:44.796 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T02:05:44.926 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T02:07:45.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T02:09:45.269 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T02:11:45.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T02:13:45.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T02:15:45.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T02:17:45.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T02:19:46.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T02:21:46.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T02:23:46.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T02:25:46.600 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T02:27:46.773 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T02:29:46.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T02:31:47.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T02:33:47.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T02:35:47.420 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T02:37:47.586 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T02:39:47.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T02:41:47.924 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T02:43:48.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T02:45:48.244 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T02:47:48.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T02:49:48.440 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T02:51:48.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T02:53:48.758 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T02:55:48.930 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T02:57:49.098 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T02:59:49.260 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T03:01:49.360 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T03:03:49.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T03:05:49.696 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T03:07:49.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T03:09:49.976 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T03:11:50.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T03:13:50.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T03:15:50.445 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T03:17:50.616 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T03:19:50.788 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T03:21:50.962 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T03:23:51.146 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T03:25:51.318 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T03:27:51.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T03:29:51.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T03:31:51.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T03:33:52.016 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T03:35:52.192 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T03:37:52.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T03:39:52.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T03:41:52.705 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T03:43:52.877 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T03:45:53.044 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T03:47:53.194 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T03:49:53.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T03:51:53.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T03:53:53.704 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T03:55:53.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T03:57:54.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T03:59:54.217 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T04:01:54.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T04:03:54.488 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T04:05:54.708 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T04:07:55.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T04:09:55.406 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T04:11:55.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-22T04:11:55.636 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-22T04:11:55.843 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-22T04:11:55.844 INFO:teuthology.nuke:Checking targets against current locks
2024-01-22T04:11:55.897 DEBUG:teuthology.nuke:shortname: smithi088
2024-01-22T04:11:55.897 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-22T04:11:55.919 DEBUG:teuthology.nuke:shortname: smithi115
2024-01-22T04:11:55.919 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-22T04:11:55.920 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi/7523529', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-22 00:37:56.449900', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNbVde+Kfp1Q0Hww9ufQkS0YGpnLOvtAAbFob24znU1oF7GSVPceH3uFYw7z+ycRbzfkTLw1QWguwCJskiCyecA='}
2024-01-22T04:11:55.951 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-19_15:47:44-fs-wip-vshankar-testing-pacific-020240119.072505-testing-default-smithi/7523529', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-22 00:37:56.451364', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHQZMzNhSKWmUgquBTg/hoSSuqzb59dsLEAZ//grZ1sjXE5DQHaEyLQqaDrMx69XxZm7nviLOWeavRV9rgRxV0U='}
2024-01-22T04:11:55.981 INFO:teuthology.orchestra.console.smithi088:Power off
2024-01-22T04:11:55.981 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-22T04:11:56.001 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off
2024-01-22T04:11:56.001 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-22T04:11:56.016 INFO:teuthology.orchestra.console.smithi115:Power off
2024-01-22T04:11:56.017 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-22T04:11:56.025 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off
2024-01-22T04:11:56.038 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off
2024-01-22T04:11:56.038 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-22T04:11:56.059 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off
2024-01-22T04:11:56.127 INFO:teuthology.orchestra.console.smithi088:Power off completed
2024-01-22T04:11:56.160 INFO:teuthology.orchestra.console.smithi115:Power off completed
2024-01-22T04:11:56.278 INFO:teuthology.lock.ops:unlocked: smithi088.front.sepia.ceph.com
2024-01-22T04:11:56.304 INFO:teuthology.lock.ops:unlocked: smithi115.front.sepia.ceph.com