2023-12-16T05:17:07.012 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e
2023-12-16T05:17:07.012 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:17:07.162 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f4e7a49d310>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f4e7b3f8940>, signals=[15])
2023-12-16T05:17:07.162 INFO:teuthology.lock.ops:Start node 'smithi149.front.sepia.ceph.com' reimaging
2023-12-16T05:17:07.162 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: reset os type and version on server
2023-12-16T05:17:07.163 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server
2023-12-16T05:17:07.185 INFO:teuthology.lock.ops:Start node 'smithi203.front.sepia.ceph.com' reimaging
2023-12-16T05:17:07.185 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: reset os type and version on server
2023-12-16T05:17:07.185 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server
2023-12-16T05:17:07.304 DEBUG:teuthology.provision.fog.smithi149:Requesting image smithi_centos_8.stream (ID 3)
2023-12-16T05:17:07.338 DEBUG:teuthology.provision.fog.smithi203:Requesting image smithi_centos_8.stream (ID 3)
2023-12-16T05:17:07.363 INFO:teuthology.provision.fog.smithi149:Scheduling deploy of centos 8.stream
2023-12-16T05:17:07.384 INFO:teuthology.provision.fog.smithi203:Scheduling deploy of centos 8.stream
2023-12-16T05:17:07.606 INFO:teuthology.orchestra.console.smithi149:Power off
2023-12-16T05:17:07.607 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-16T05:17:07.620 INFO:teuthology.orchestra.console.smithi203:Power off
2023-12-16T05:17:07.620 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-16T05:17:07.629 DEBUG:teuthology.orchestra.console.smithi149:power off output: Chassis Power Control: Down/Off
2023-12-16T05:17:07.629 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-16T05:17:07.644 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off
2023-12-16T05:17:07.644 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-16T05:17:07.655 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on
2023-12-16T05:17:07.669 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on
2023-12-16T05:17:11.660 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-16T05:17:11.669 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-16T05:17:11.769 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on
2023-12-16T05:17:11.778 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on
2023-12-16T05:17:15.773 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-16T05:17:15.781 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-16T05:17:15.883 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off
2023-12-16T05:17:15.890 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on
2023-12-16T05:17:15.984 INFO:teuthology.orchestra.console.smithi149:Power off completed
2023-12-16T05:17:16.085 INFO:teuthology.orchestra.console.smithi149:Power on
2023-12-16T05:17:16.085 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-16T05:17:16.112 DEBUG:teuthology.orchestra.console.smithi149:power on output: Chassis Power Control: Up/On
2023-12-16T05:17:16.113 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-16T05:17:16.138 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off
2023-12-16T05:17:19.893 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-16T05:17:20.003 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off
2023-12-16T05:17:20.103 INFO:teuthology.orchestra.console.smithi203:Power off completed
2023-12-16T05:17:20.139 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-16T05:17:20.205 INFO:teuthology.orchestra.console.smithi203:Power on
2023-12-16T05:17:20.205 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-16T05:17:20.229 DEBUG:teuthology.orchestra.console.smithi203:power on output: Chassis Power Control: Up/On
2023-12-16T05:17:20.229 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-16T05:17:20.249 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off
2023-12-16T05:17:20.251 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off
2023-12-16T05:17:24.253 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-16T05:17:24.261 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-16T05:17:24.369 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on
2023-12-16T05:17:24.459 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on
2023-12-16T05:17:24.470 INFO:teuthology.orchestra.console.smithi203:Power on completed
2023-12-16T05:17:24.560 INFO:teuthology.orchestra.console.smithi149:Power on completed
2023-12-16T05:17:24.572 INFO:teuthology.provision.fog.smithi203:Waiting for deploy to finish
2023-12-16T05:17:24.661 INFO:teuthology.provision.fog.smithi149:Waiting for deploy to finish
2023-12-16T05:20:10.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T05:20:10.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T05:20:13.490 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-12-16T05:20:13.490 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2023-12-16T05:20:19.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T05:20:19.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T05:20:22.545 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-12-16T05:20:22.546 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2023-12-16T05:20:28.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T05:20:28.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T05:20:31.633 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-12-16T05:20:31.634 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2023-12-16T05:20:37.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T05:20:37.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T05:20:40.721 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-12-16T05:20:40.722 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2023-12-16T05:20:46.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T05:20:46.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T05:20:49.777 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-12-16T05:20:49.778 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2023-12-16T05:20:55.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T05:20:55.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T05:20:58.865 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-12-16T05:20:58.866 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2023-12-16T05:21:04.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T05:21:04.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T05:21:07.921 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-12-16T05:21:07.922 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2023-12-16T05:21:13.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T05:21:13.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T05:22:13.989 WARNING:teuthology.provision.fog.smithi203:timed out
2023-12-16T05:22:13.990 WARNING:teuthology.provision.fog.smithi149:timed out
2023-12-16T05:22:19.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T05:22:19.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T05:22:20.261 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-16T05:22:20.261 DEBUG:teuthology.orchestra.run.smithi203:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-16T05:22:20.268 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-16T05:22:20.269 DEBUG:teuthology.orchestra.run.smithi149:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-16T05:22:20.501 INFO:teuthology.provision.fog.smithi203:Node is ready
2023-12-16T05:22:20.502 DEBUG:teuthology.orchestra.run.smithi203:> hostname
2023-12-16T05:22:20.521 INFO:teuthology.orchestra.run.smithi203.stdout:smithi203.front.sepia.ceph.com
2023-12-16T05:22:20.521 DEBUG:teuthology.orchestra.run.smithi203:> grep smithi203.front.sepia.ceph.com /etc/hosts
2023-12-16T05:22:20.524 INFO:teuthology.provision.fog.smithi149:Node is ready
2023-12-16T05:22:20.524 DEBUG:teuthology.orchestra.run.smithi149:> hostname
2023-12-16T05:22:20.542 INFO:teuthology.orchestra.run.smithi149.stdout:smithi149.front.sepia.ceph.com
2023-12-16T05:22:20.542 DEBUG:teuthology.orchestra.run.smithi149:> grep smithi149.front.sepia.ceph.com /etc/hosts
2023-12-16T05:22:20.581 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.15.203 smithi203.front.sepia.ceph.com smithi203
2023-12-16T05:22:20.581 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203
2023-12-16T05:22:20.600 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.149 smithi149.front.sepia.ceph.com smithi149
2023-12-16T05:22:20.601 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149
2023-12-16T05:22:20.690 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hosts
2023-12-16T05:22:20.705 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hosts
2023-12-16T05:22:20.721 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/172.21.15.203/172.21.15.203/g' /etc/hosts
2023-12-16T05:22:20.734 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/172.21.15.149/172.21.15.149/g' /etc/hosts
2023-12-16T05:22:20.790 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hostname
2023-12-16T05:22:20.802 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hostname
2023-12-16T05:22:20.861 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203
2023-12-16T05:22:20.870 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149
2023-12-16T05:22:20.929 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release
2023-12-16T05:22:20.936 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release
2023-12-16T05:22:20.988 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream"
2023-12-16T05:22:20.988 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="8"
2023-12-16T05:22:20.988 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos"
2023-12-16T05:22:20.988 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora"
2023-12-16T05:22:20.989 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="8"
2023-12-16T05:22:20.989 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el8"
2023-12-16T05:22:20.989 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 8"
2023-12-16T05:22:20.989 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31"
2023-12-16T05:22:20.989 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-12-16T05:22:20.989 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/"
2023-12-16T05:22:20.989 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-16T05:22:20.989 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-16T05:22:20.989 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-16T05:22:20.990 INFO:teuthology.provision.fog.smithi203:Deploy complete!
2023-12-16T05:22:20.991 DEBUG:teuthology.parallel:result is None
2023-12-16T05:22:20.994 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream"
2023-12-16T05:22:20.994 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="8"
2023-12-16T05:22:20.994 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos"
2023-12-16T05:22:20.994 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora"
2023-12-16T05:22:20.994 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="8"
2023-12-16T05:22:20.994 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el8"
2023-12-16T05:22:20.994 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 8"
2023-12-16T05:22:20.994 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31"
2023-12-16T05:22:20.994 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-12-16T05:22:20.995 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/"
2023-12-16T05:22:20.995 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-16T05:22:20.995 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-16T05:22:20.995 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-16T05:22:20.995 INFO:teuthology.provision.fog.smithi149:Deploy complete!
2023-12-16T05:22:20.995 DEBUG:teuthology.parallel:result is None
2023-12-16T05:22:21.135 INFO:teuthology.lock.ops:Checking smithi149.front.sepia.ceph.com
2023-12-16T05:22:21.135 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-16T05:22:21.163 INFO:teuthology.lock.ops:Checking smithi203.front.sepia.ceph.com
2023-12-16T05:22:21.163 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-16T05:22:21.181 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: set os type and version on server
2023-12-16T05:22:21.181 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com'
2023-12-16T05:22:21.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T05:22:21.248 DEBUG:teuthology.orchestra.run.smithi149:> true
2023-12-16T05:22:21.315 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com'
2023-12-16T05:22:21.315 DEBUG:teuthology.orchestra.run.smithi149:> uname -m
2023-12-16T05:22:21.373 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64
2023-12-16T05:22:21.374 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release
2023-12-16T05:22:21.431 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream"
2023-12-16T05:22:21.431 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="8"
2023-12-16T05:22:21.431 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos"
2023-12-16T05:22:21.431 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora"
2023-12-16T05:22:21.431 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="8"
2023-12-16T05:22:21.431 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el8"
2023-12-16T05:22:21.431 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 8"
2023-12-16T05:22:21.431 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31"
2023-12-16T05:22:21.431 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-12-16T05:22:21.431 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/"
2023-12-16T05:22:21.431 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-16T05:22:21.432 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-16T05:22:21.432 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-16T05:22:21.432 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server
2023-12-16T05:22:21.463 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: set os type and version on server
2023-12-16T05:22:21.463 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com'
2023-12-16T05:22:21.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T05:22:21.531 DEBUG:teuthology.orchestra.run.smithi203:> true
2023-12-16T05:22:21.599 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com'
2023-12-16T05:22:21.600 DEBUG:teuthology.orchestra.run.smithi203:> uname -m
2023-12-16T05:22:21.658 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64
2023-12-16T05:22:21.658 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release
2023-12-16T05:22:21.716 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream"
2023-12-16T05:22:21.716 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="8"
2023-12-16T05:22:21.716 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos"
2023-12-16T05:22:21.716 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora"
2023-12-16T05:22:21.716 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="8"
2023-12-16T05:22:21.716 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el8"
2023-12-16T05:22:21.716 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 8"
2023-12-16T05:22:21.716 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31"
2023-12-16T05:22:21.716 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-12-16T05:22:21.716 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/"
2023-12-16T05:22:21.716 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-16T05:22:21.717 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-16T05:22:21.717 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-16T05:22:21.717 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server
2023-12-16T05:22:21.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:22:21.832 INFO:teuthology.dispatcher.supervisor:Running job 7493641
2023-12-16T05:22:21.832 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-16_00:10:43-orch-main-distro-default-smithi/7493641 --name yuriw-2023-12-16_00:10:43-orch-main-distro-default-smithi --description orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/yuriw-2023-12-16_00:10:43-orch-main-distro-default-smithi/7493641/orig.config.yaml
2023-12-16T05:22:21.835 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-16_00:10:43-orch-main-distro-default-smithi/7493641
2023-12-16T05:22:21.836 INFO:teuthology.dispatcher.supervisor:Job PID: 862996
2023-12-16T05:22:21.836 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-16T05:24:21.888 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:26:22.024 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:28:22.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:30:22.362 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:32:22.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:34:22.718 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:36:22.882 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:38:23.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:40:23.230 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:42:23.406 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:44:23.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:46:23.746 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:48:23.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:50:24.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:52:24.258 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:54:24.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:56:24.606 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:58:24.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T06:00:24.942 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T06:02:25.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T06:04:25.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T06:06:25.490 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T06:08:25.650 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T06:08:25.791 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-16T06:08:25.957 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-16T06:08:25.958 INFO:teuthology.nuke:Checking targets against current locks
2023-12-16T06:08:26.006 DEBUG:teuthology.nuke:shortname: smithi149
2023-12-16T06:08:26.006 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-16T06:08:26.026 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_00:10:43-orch-main-distro-default-smithi/7493641', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 05:17:06.157292', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDdVHWNLY9pHthCKTJBOcNy6stysg6aCPlYXuqUnjM12GJ8v5HUxomQI0knZD8OQ/LoVjK1Ia2Jo80PCwYJU6Tc='}
2023-12-16T06:08:26.029 DEBUG:teuthology.nuke:shortname: smithi203
2023-12-16T06:08:26.029 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-16T06:08:26.052 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_00:10:43-orch-main-distro-default-smithi/7493641', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 05:17:06.156055', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNNvSCGlnV9iyQqVwta3ukvR5aUAFUiYKDyVwxDmm0n8nQa01bvpFU/RrIO2OnIlIApfto12sLx80eK8WtLvBF0='}
2023-12-16T06:08:26.076 INFO:teuthology.orchestra.console.smithi149:Power off
2023-12-16T06:08:26.077 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-16T06:08:26.100 DEBUG:teuthology.orchestra.console.smithi149:power off output: Chassis Power Control: Down/Off
2023-12-16T06:08:26.100 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-16T06:08:26.114 INFO:teuthology.orchestra.console.smithi203:Power off
2023-12-16T06:08:26.114 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-16T06:08:26.122 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off
2023-12-16T06:08:26.137 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off
2023-12-16T06:08:26.137 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-16T06:08:26.163 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off
2023-12-16T06:08:26.223 INFO:teuthology.orchestra.console.smithi149:Power off completed
2023-12-16T06:08:26.265 INFO:teuthology.orchestra.console.smithi203:Power off completed
2023-12-16T06:08:26.375 INFO:teuthology.lock.ops:unlocked: smithi149.front.sepia.ceph.com
2023-12-16T06:08:26.407 INFO:teuthology.lock.ops:unlocked: smithi203.front.sepia.ceph.com