2023-12-16T04:33:28.131 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e
2023-12-16T04:33:28.132 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T04:33:28.282 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fd69cbf8310>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fd69db55940>, signals=[15])
2023-12-16T04:33:28.283 INFO:teuthology.lock.ops:Start node 'smithi155.front.sepia.ceph.com' reimaging
2023-12-16T04:33:28.283 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: reset os type and version on server
2023-12-16T04:33:28.283 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server
2023-12-16T04:33:28.315 INFO:teuthology.lock.ops:Start node 'smithi156.front.sepia.ceph.com' reimaging
2023-12-16T04:33:28.315 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: reset os type and version on server
2023-12-16T04:33:28.315 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server
2023-12-16T04:33:28.446 DEBUG:teuthology.provision.fog.smithi155:Requesting image smithi_centos_8.stream (ID 3)
2023-12-16T04:33:28.455 DEBUG:teuthology.provision.fog.smithi156:Requesting image smithi_centos_8.stream (ID 3)
2023-12-16T04:33:28.493 INFO:teuthology.provision.fog.smithi155:Scheduling deploy of centos 8.stream
2023-12-16T04:33:28.502 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of centos 8.stream
2023-12-16T04:33:28.735 INFO:teuthology.orchestra.console.smithi155:Power off
2023-12-16T04:33:28.735 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-16T04:33:28.748 INFO:teuthology.orchestra.console.smithi156:Power off
2023-12-16T04:33:28.748 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-16T04:33:28.757 DEBUG:teuthology.orchestra.console.smithi155:power off output: Chassis Power Control: Down/Off
2023-12-16T04:33:28.757 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-16T04:33:28.769 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off
2023-12-16T04:33:28.770 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-16T04:33:28.782 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on
2023-12-16T04:33:28.794 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on
2023-12-16T04:33:32.785 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-16T04:33:32.795 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-16T04:33:32.896 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on
2023-12-16T04:33:32.903 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on
2023-12-16T04:33:36.897 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-16T04:33:36.905 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-16T04:33:37.007 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on
2023-12-16T04:33:37.013 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off
2023-12-16T04:33:37.114 INFO:teuthology.orchestra.console.smithi156:Power off completed
2023-12-16T04:33:37.214 INFO:teuthology.orchestra.console.smithi156:Power on
2023-12-16T04:33:37.214 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-16T04:33:37.236 DEBUG:teuthology.orchestra.console.smithi156:power on output: Chassis Power Control: Up/On
2023-12-16T04:33:37.237 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-16T04:33:37.259 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off
2023-12-16T04:33:41.009 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-16T04:33:41.118 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off
2023-12-16T04:33:41.218 INFO:teuthology.orchestra.console.smithi155:Power off completed
2023-12-16T04:33:41.260 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-16T04:33:41.320 INFO:teuthology.orchestra.console.smithi155:Power on
2023-12-16T04:33:41.320 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-16T04:33:41.343 DEBUG:teuthology.orchestra.console.smithi155:power on output: Chassis Power Control: Up/On
2023-12-16T04:33:41.343 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-16T04:33:41.363 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off
2023-12-16T04:33:41.368 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off
2023-12-16T04:33:45.368 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-16T04:33:45.375 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-16T04:33:45.477 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off
2023-12-16T04:33:45.483 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on
2023-12-16T04:33:45.583 INFO:teuthology.orchestra.console.smithi156:Power on completed
2023-12-16T04:33:45.684 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish
2023-12-16T04:33:49.481 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-16T04:33:49.592 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on
2023-12-16T04:33:49.692 INFO:teuthology.orchestra.console.smithi155:Power on completed
2023-12-16T04:33:49.793 INFO:teuthology.provision.fog.smithi155:Waiting for deploy to finish
2023-12-16T04:36:31.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T04:36:34.673 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2023-12-16T04:36:35.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T04:36:38.705 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2023-12-16T04:36:40.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T04:36:43.733 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2023-12-16T04:36:44.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T04:36:47.765 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2023-12-16T04:36:49.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T04:36:52.817 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2023-12-16T04:36:53.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T04:36:56.853 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2023-12-16T04:36:58.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T04:37:01.873 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2023-12-16T04:37:02.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T04:37:05.905 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2023-12-16T04:37:07.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T04:37:10.934 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2023-12-16T04:37:11.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T04:37:14.961 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2023-12-16T04:37:16.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T04:37:20.017 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2023-12-16T04:37:20.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T04:37:24.021 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2023-12-16T04:37:26.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T04:37:29.073 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2023-12-16T04:37:30.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T04:37:33.105 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2023-12-16T04:37:35.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T04:37:39.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T04:37:42.161 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2023-12-16T04:37:48.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T04:38:35.120 WARNING:teuthology.provision.fog.smithi156:timed out
2023-12-16T04:38:41.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T04:38:41.424 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-16T04:38:41.424 DEBUG:teuthology.orchestra.run.smithi156:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-16T04:38:41.675 INFO:teuthology.provision.fog.smithi156:Node is ready
2023-12-16T04:38:41.675 DEBUG:teuthology.orchestra.run.smithi156:> hostname
2023-12-16T04:38:41.693 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com
2023-12-16T04:38:41.694 DEBUG:teuthology.orchestra.run.smithi156:> grep smithi156.front.sepia.ceph.com /etc/hosts
2023-12-16T04:38:41.753 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156
2023-12-16T04:38:41.753 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156
2023-12-16T04:38:41.859 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hosts
2023-12-16T04:38:41.888 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/172.21.15.156/172.21.15.156/g' /etc/hosts
2023-12-16T04:38:41.956 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hostname
2023-12-16T04:38:42.025 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156
2023-12-16T04:38:42.092 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release
2023-12-16T04:38:42.150 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream"
2023-12-16T04:38:42.150 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="8"
2023-12-16T04:38:42.150 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos"
2023-12-16T04:38:42.150 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora"
2023-12-16T04:38:42.150 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="8"
2023-12-16T04:38:42.150 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el8"
2023-12-16T04:38:42.150 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 8"
2023-12-16T04:38:42.151 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31"
2023-12-16T04:38:42.151 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-12-16T04:38:42.151 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/"
2023-12-16T04:38:42.151 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-16T04:38:42.151 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-16T04:38:42.151 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-16T04:38:42.151 INFO:teuthology.provision.fog.smithi156:Deploy complete!
2023-12-16T04:38:42.153 DEBUG:teuthology.parallel:result is None
2023-12-16T04:38:48.169 WARNING:teuthology.provision.fog.smithi155:timed out
2023-12-16T04:38:54.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T04:38:54.429 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-16T04:38:54.429 DEBUG:teuthology.orchestra.run.smithi155:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-16T04:38:54.691 INFO:teuthology.provision.fog.smithi155:Node is ready
2023-12-16T04:38:54.691 DEBUG:teuthology.orchestra.run.smithi155:> hostname
2023-12-16T04:38:54.710 INFO:teuthology.orchestra.run.smithi155.stdout:smithi155.front.sepia.ceph.com
2023-12-16T04:38:54.710 DEBUG:teuthology.orchestra.run.smithi155:> grep smithi155.front.sepia.ceph.com /etc/hosts
2023-12-16T04:38:54.769 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155 smithi155.front.sepia.ceph.com smithi155
2023-12-16T04:38:54.769 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname smithi155
2023-12-16T04:38:54.870 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/smithi155.front.sepia.ceph.com/smithi155/g' /etc/hosts
2023-12-16T04:38:54.899 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/172.21.15.155/172.21.15.155/g' /etc/hosts
2023-12-16T04:38:54.969 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/smithi155.front.sepia.ceph.com/smithi155/g' /etc/hostname
2023-12-16T04:38:55.037 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname smithi155
2023-12-16T04:38:55.103 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release
2023-12-16T04:38:55.162 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Stream"
2023-12-16T04:38:55.162 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="8"
2023-12-16T04:38:55.162 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos"
2023-12-16T04:38:55.162 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora"
2023-12-16T04:38:55.162 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="8"
2023-12-16T04:38:55.162 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el8"
2023-12-16T04:38:55.162 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Stream 8"
2023-12-16T04:38:55.162 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31"
2023-12-16T04:38:55.162 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-12-16T04:38:55.162 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/"
2023-12-16T04:38:55.162 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-16T04:38:55.162 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-16T04:38:55.162 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-16T04:38:55.163 INFO:teuthology.provision.fog.smithi155:Deploy complete!
2023-12-16T04:38:55.163 DEBUG:teuthology.parallel:result is None
2023-12-16T04:38:55.314 INFO:teuthology.lock.ops:Checking smithi155.front.sepia.ceph.com
2023-12-16T04:38:55.314 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-16T04:38:55.342 INFO:teuthology.lock.ops:Checking smithi156.front.sepia.ceph.com
2023-12-16T04:38:55.342 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-16T04:38:55.360 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: set os type and version on server
2023-12-16T04:38:55.361 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com'
2023-12-16T04:38:55.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T04:38:55.428 DEBUG:teuthology.orchestra.run.smithi155:> true
2023-12-16T04:38:55.499 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com'
2023-12-16T04:38:55.499 DEBUG:teuthology.orchestra.run.smithi155:> uname -m
2023-12-16T04:38:55.556 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64
2023-12-16T04:38:55.557 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release
2023-12-16T04:38:55.614 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Stream"
2023-12-16T04:38:55.614 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="8"
2023-12-16T04:38:55.615 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos"
2023-12-16T04:38:55.615 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora"
2023-12-16T04:38:55.615 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="8"
2023-12-16T04:38:55.615 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el8"
2023-12-16T04:38:55.615 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Stream 8"
2023-12-16T04:38:55.615 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31"
2023-12-16T04:38:55.615 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-12-16T04:38:55.615 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/"
2023-12-16T04:38:55.615 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-16T04:38:55.615 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-16T04:38:55.615 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-16T04:38:55.616 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server
2023-12-16T04:38:55.641 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: set os type and version on server
2023-12-16T04:38:55.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com'
2023-12-16T04:38:55.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-16T04:38:55.707 DEBUG:teuthology.orchestra.run.smithi156:> true
2023-12-16T04:38:55.841 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com'
2023-12-16T04:38:55.841 DEBUG:teuthology.orchestra.run.smithi156:> uname -m
2023-12-16T04:38:55.901 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64
2023-12-16T04:38:55.901 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release
2023-12-16T04:38:55.960 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream"
2023-12-16T04:38:55.960 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="8"
2023-12-16T04:38:55.960 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos"
2023-12-16T04:38:55.960 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora"
2023-12-16T04:38:55.960 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="8"
2023-12-16T04:38:55.960 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el8"
2023-12-16T04:38:55.961 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 8"
2023-12-16T04:38:55.961 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31"
2023-12-16T04:38:55.961 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-12-16T04:38:55.961 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/"
2023-12-16T04:38:55.961 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-16T04:38:55.961 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-16T04:38:55.961 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-16T04:38:55.961 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server
2023-12-16T04:38:55.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T04:38:56.077 INFO:teuthology.dispatcher.supervisor:Running job 7493606
2023-12-16T04:38:56.077 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-16_00:10:43-orch-main-distro-default-smithi/7493606 --name yuriw-2023-12-16_00:10:43-orch-main-distro-default-smithi --description orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/yuriw-2023-12-16_00:10:43-orch-main-distro-default-smithi/7493606/orig.config.yaml
2023-12-16T04:38:56.080 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-16_00:10:43-orch-main-distro-default-smithi/7493606
2023-12-16T04:38:56.080 INFO:teuthology.dispatcher.supervisor:Job PID: 492065
2023-12-16T04:38:56.080 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-16T04:40:56.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T04:42:56.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T04:44:56.518 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T04:46:56.681 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T04:48:56.854 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T04:50:57.018 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T04:52:57.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T04:54:57.344 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T04:56:57.526 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T04:58:57.702 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:00:57.874 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:02:58.038 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:04:58.216 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:06:58.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:08:58.546 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:10:58.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:12:58.886 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:14:59.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:16:59.214 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:18:59.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:20:59.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:22:59.705 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:24:59.869 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:27:00.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:29:00.198 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:31:00.362 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:33:00.526 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:35:00.677 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:37:00.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:39:01.018 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:41:01.210 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:43:01.374 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:45:01.542 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:47:01.714 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:49:01.900 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:51:02.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:53:02.202 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:55:02.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:57:02.526 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T05:59:02.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T06:01:02.866 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T06:03:03.042 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T06:05:03.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T06:07:03.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-16T06:07:03.448 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-16T06:07:03.643 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-16T06:07:03.643 INFO:teuthology.nuke:Checking targets against current locks
2023-12-16T06:07:03.695 DEBUG:teuthology.nuke:shortname: smithi155
2023-12-16T06:07:03.696 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-16T06:07:03.720 DEBUG:teuthology.nuke:shortname: smithi156
2023-12-16T06:07:03.721 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-16T06:07:03.724 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_00:10:43-orch-main-distro-default-smithi/7493606', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 04:33:27.292889', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOMkydQCkJLkBa3m7klGd46IeIMkjeyvjvTeGZaZ66uu3Ervpm1istTNbW7PasmJLW5qfbgJKI858l9uG+J+MEE='}
2023-12-16T06:07:03.743 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_00:10:43-orch-main-distro-default-smithi/7493606', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 04:33:27.294423', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCBKXIbLQws+ln0RSxAZ9MqXuxsUCmPuqqdUJts1uv1ysq9nfXJI01FfCJNfpdeqKKADLLHmDzdSV8IPjYAzKaQ='}
2023-12-16T06:07:03.773 INFO:teuthology.orchestra.console.smithi155:Power off
2023-12-16T06:07:03.774 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-16T06:07:03.785 INFO:teuthology.orchestra.console.smithi156:Power off
2023-12-16T06:07:03.786 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-16T06:07:03.795 DEBUG:teuthology.orchestra.console.smithi155:power off output: Chassis Power Control: Down/Off
2023-12-16T06:07:03.795 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-16T06:07:03.806 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off
2023-12-16T06:07:03.806 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-16T06:07:03.815 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off
2023-12-16T06:07:03.827 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off
2023-12-16T06:07:03.916 INFO:teuthology.orchestra.console.smithi155:Power off completed
2023-12-16T06:07:03.929 INFO:teuthology.orchestra.console.smithi156:Power off completed
2023-12-16T06:07:04.071 INFO:teuthology.lock.ops:unlocked: smithi155.front.sepia.ceph.com
2023-12-16T06:07:04.080 INFO:teuthology.lock.ops:unlocked: smithi156.front.sepia.ceph.com