2024-01-27T14:57:33.240 INFO:root:teuthology version: 0.0.1.dev251+gc856e0f
2024-01-27T14:57:33.240 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T14:57:33.403 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fb5fb9ebf10>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fb5fc951c10>, signals=[15])
2024-01-27T14:57:33.403 INFO:teuthology.lock.ops:Start node 'smithi017.front.sepia.ceph.com' reimaging
2024-01-27T14:57:33.404 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: reset os type and version on server
2024-01-27T14:57:33.404 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server
2024-01-27T14:57:33.431 INFO:teuthology.lock.ops:Start node 'smithi053.front.sepia.ceph.com' reimaging
2024-01-27T14:57:33.431 INFO:teuthology.lock.ops:Updating [smithi053.front.sepia.ceph.com]: reset os type and version on server
2024-01-27T14:57:33.431 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server
2024-01-27T14:57:33.456 INFO:teuthology.lock.ops:Start node 'smithi113.front.sepia.ceph.com' reimaging
2024-01-27T14:57:33.456 INFO:teuthology.lock.ops:Updating [smithi113.front.sepia.ceph.com]: reset os type and version on server
2024-01-27T14:57:33.456 INFO:teuthology.lock.ops:Updating smithi113.front.sepia.ceph.com on lock server
2024-01-27T14:57:33.561 DEBUG:teuthology.provision.fog.smithi017:Requesting image smithi_centos_8.stream (ID 3)
2024-01-27T14:57:33.573 DEBUG:teuthology.provision.fog.smithi053:Requesting image smithi_centos_8.stream (ID 3)
2024-01-27T14:57:33.583 DEBUG:teuthology.provision.fog.smithi113:Requesting image smithi_centos_8.stream (ID 3)
2024-01-27T14:57:33.609 INFO:teuthology.provision.fog.smithi017:Scheduling deploy of centos 8.stream
2024-01-27T14:57:33.618 INFO:teuthology.provision.fog.smithi053:Scheduling deploy of centos 8.stream
2024-01-27T14:57:33.633 INFO:teuthology.provision.fog.smithi113:Scheduling deploy of centos 8.stream
2024-01-27T14:57:33.875 INFO:teuthology.orchestra.console.smithi017:Power off
2024-01-27T14:57:33.875 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-27T14:57:33.888 INFO:teuthology.orchestra.console.smithi113:Power off
2024-01-27T14:57:33.888 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-27T14:57:33.899 INFO:teuthology.orchestra.console.smithi053:Power off
2024-01-27T14:57:33.899 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-27T14:57:33.907 DEBUG:teuthology.orchestra.console.smithi017:power off output: Chassis Power Control: Down/Off
2024-01-27T14:57:33.907 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T14:57:33.916 DEBUG:teuthology.orchestra.console.smithi113:power off output: Chassis Power Control: Down/Off
2024-01-27T14:57:33.916 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T14:57:33.924 DEBUG:teuthology.orchestra.console.smithi053:power off output: Chassis Power Control: Down/Off
2024-01-27T14:57:33.925 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T14:57:33.932 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off
2024-01-27T14:57:33.941 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off
2024-01-27T14:57:33.946 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on
2024-01-27T14:57:34.033 INFO:teuthology.orchestra.console.smithi017:Power off completed
2024-01-27T14:57:34.042 INFO:teuthology.orchestra.console.smithi113:Power off completed
2024-01-27T14:57:34.134 INFO:teuthology.orchestra.console.smithi017:Power on
2024-01-27T14:57:34.135 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-27T14:57:34.145 INFO:teuthology.orchestra.console.smithi113:Power on
2024-01-27T14:57:34.145 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-27T14:57:34.162 DEBUG:teuthology.orchestra.console.smithi017:power on output: Chassis Power Control: Up/On
2024-01-27T14:57:34.163 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T14:57:34.171 DEBUG:teuthology.orchestra.console.smithi113:power on output: Chassis Power Control: Up/On
2024-01-27T14:57:34.172 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T14:57:34.184 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off
2024-01-27T14:57:34.192 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off
2024-01-27T14:57:37.950 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T14:57:38.059 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on
2024-01-27T14:57:38.185 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T14:57:38.192 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T14:57:38.294 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on
2024-01-27T14:57:38.300 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off
2024-01-27T14:57:38.396 INFO:teuthology.orchestra.console.smithi017:Power on completed
2024-01-27T14:57:38.496 INFO:teuthology.provision.fog.smithi017:Waiting for deploy to finish
2024-01-27T14:57:42.062 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T14:57:42.173 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off
2024-01-27T14:57:42.274 INFO:teuthology.orchestra.console.smithi053:Power off completed
2024-01-27T14:57:42.301 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T14:57:42.375 INFO:teuthology.orchestra.console.smithi053:Power on
2024-01-27T14:57:42.375 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-27T14:57:42.399 DEBUG:teuthology.orchestra.console.smithi053:power on output: Chassis Power Control: Up/On
2024-01-27T14:57:42.399 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T14:57:42.411 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on
2024-01-27T14:57:42.422 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off
2024-01-27T14:57:42.512 INFO:teuthology.orchestra.console.smithi113:Power on completed
2024-01-27T14:57:42.613 INFO:teuthology.provision.fog.smithi113:Waiting for deploy to finish
2024-01-27T14:57:46.424 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T14:57:46.534 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off
2024-01-27T14:57:50.538 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T14:57:50.647 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on
2024-01-27T14:57:50.747 INFO:teuthology.orchestra.console.smithi053:Power on completed
2024-01-27T14:57:50.848 INFO:teuthology.provision.fog.smithi053:Waiting for deploy to finish
2024-01-27T15:00:06.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T15:00:06.705 ERROR:teuthology.orchestra.connection:Error authenticating with smithi053.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-01-27T15:00:09.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T15:00:27.836 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17
2024-01-27T15:00:33.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T15:00:36.896 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17
2024-01-27T15:00:42.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T15:00:43.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T15:00:45.244 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53
2024-01-27T15:00:45.952 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17
2024-01-27T15:00:46.592 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-27T15:00:51.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T15:00:51.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T15:00:52.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T15:00:54.300 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53
2024-01-27T15:00:55.004 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17
2024-01-27T15:00:55.648 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-27T15:01:00.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T15:01:01.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T15:01:01.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T15:01:04.700 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-27T15:01:10.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T15:01:13.756 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-27T15:01:19.757 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T15:01:22.812 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-27T15:01:28.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T15:01:31.868 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-27T15:01:37.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T15:01:40.928 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-27T15:01:46.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T15:02:00.304 WARNING:teuthology.provision.fog.smithi053:timed out
2024-01-27T15:02:01.008 WARNING:teuthology.provision.fog.smithi017:timed out
2024-01-27T15:02:06.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T15:02:06.532 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-27T15:02:06.533 DEBUG:teuthology.orchestra.run.smithi053:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-27T15:02:06.766 INFO:teuthology.provision.fog.smithi053:Node is ready
2024-01-27T15:02:06.767 DEBUG:teuthology.orchestra.run.smithi053:> hostname
2024-01-27T15:02:06.786 INFO:teuthology.orchestra.run.smithi053.stdout:smithi053.front.sepia.ceph.com
2024-01-27T15:02:06.786 DEBUG:teuthology.orchestra.run.smithi053:> grep smithi053.front.sepia.ceph.com /etc/hosts
2024-01-27T15:02:06.847 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53 smithi053.front.sepia.ceph.com smithi053
2024-01-27T15:02:06.847 DEBUG:teuthology.orchestra.run.smithi053:> sudo hostname smithi053
2024-01-27T15:02:06.956 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/smithi053.front.sepia.ceph.com/smithi053/g' /etc/hosts
2024-01-27T15:02:06.987 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/172.21.15.53/172.21.15.53/g' /etc/hosts
2024-01-27T15:02:07.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T15:02:07.057 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/smithi053.front.sepia.ceph.com/smithi053/g' /etc/hostname
2024-01-27T15:02:07.139 DEBUG:teuthology.orchestra.run.smithi053:> sudo hostname smithi053
2024-01-27T15:02:07.208 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release
2024-01-27T15:02:07.267 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="CentOS Stream"
2024-01-27T15:02:07.268 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="8"
2024-01-27T15:02:07.268 INFO:teuthology.orchestra.run.smithi053.stdout:ID="centos"
2024-01-27T15:02:07.268 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="rhel fedora"
2024-01-27T15:02:07.268 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="8"
2024-01-27T15:02:07.268 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el8"
2024-01-27T15:02:07.268 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="CentOS Stream 8"
2024-01-27T15:02:07.268 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31"
2024-01-27T15:02:07.268 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-01-27T15:02:07.268 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://centos.org/"
2024-01-27T15:02:07.268 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-27T15:02:07.268 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-27T15:02:07.268 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-27T15:02:07.269 INFO:teuthology.provision.fog.smithi053:Deploy complete!
2024-01-27T15:02:07.270 DEBUG:teuthology.parallel:result is None
2024-01-27T15:02:07.298 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-27T15:02:07.299 DEBUG:teuthology.orchestra.run.smithi017:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-27T15:02:07.550 INFO:teuthology.provision.fog.smithi017:Node is ready
2024-01-27T15:02:07.550 DEBUG:teuthology.orchestra.run.smithi017:> hostname
2024-01-27T15:02:07.571 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017.front.sepia.ceph.com
2024-01-27T15:02:07.572 DEBUG:teuthology.orchestra.run.smithi017:> grep smithi017.front.sepia.ceph.com /etc/hosts
2024-01-27T15:02:07.632 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17 smithi017.front.sepia.ceph.com smithi017
2024-01-27T15:02:07.632 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname smithi017
2024-01-27T15:02:07.751 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/smithi017.front.sepia.ceph.com/smithi017/g' /etc/hosts
2024-01-27T15:02:07.784 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/172.21.15.17/172.21.15.17/g' /etc/hosts
2024-01-27T15:02:07.853 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/smithi017.front.sepia.ceph.com/smithi017/g' /etc/hostname
2024-01-27T15:02:07.922 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname smithi017
2024-01-27T15:02:07.991 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release
2024-01-27T15:02:08.049 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream"
2024-01-27T15:02:08.049 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="8"
2024-01-27T15:02:08.049 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos"
2024-01-27T15:02:08.049 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora"
2024-01-27T15:02:08.050 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="8"
2024-01-27T15:02:08.050 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el8"
2024-01-27T15:02:08.050 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 8"
2024-01-27T15:02:08.050 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31"
2024-01-27T15:02:08.050 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-01-27T15:02:08.050 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/"
2024-01-27T15:02:08.050 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-27T15:02:08.050 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-27T15:02:08.050 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-27T15:02:08.050 INFO:teuthology.provision.fog.smithi017:Deploy complete!
2024-01-27T15:02:08.051 DEBUG:teuthology.parallel:result is None
2024-01-27T15:02:46.932 WARNING:teuthology.provision.fog.smithi113:timed out
2024-01-27T15:02:52.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T15:02:53.143 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-27T15:02:53.144 DEBUG:teuthology.orchestra.run.smithi113:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-27T15:02:53.394 INFO:teuthology.provision.fog.smithi113:Node is ready
2024-01-27T15:02:53.395 DEBUG:teuthology.orchestra.run.smithi113:> hostname
2024-01-27T15:02:53.455 INFO:teuthology.orchestra.run.smithi113.stdout:smithi113.front.sepia.ceph.com
2024-01-27T15:02:53.455 DEBUG:teuthology.orchestra.run.smithi113:> grep smithi113.front.sepia.ceph.com /etc/hosts
2024-01-27T15:02:53.515 INFO:teuthology.orchestra.run.smithi113.stdout:172.21.15.113 smithi113.front.sepia.ceph.com smithi113
2024-01-27T15:02:53.516 DEBUG:teuthology.orchestra.run.smithi113:> sudo hostname smithi113
2024-01-27T15:02:53.606 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/smithi113.front.sepia.ceph.com/smithi113/g' /etc/hosts
2024-01-27T15:02:53.636 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/172.21.15.113/172.21.15.113/g' /etc/hosts
2024-01-27T15:02:53.706 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/smithi113.front.sepia.ceph.com/smithi113/g' /etc/hostname
2024-01-27T15:02:53.775 DEBUG:teuthology.orchestra.run.smithi113:> sudo hostname smithi113
2024-01-27T15:02:53.843 DEBUG:teuthology.orchestra.run.smithi113:> cat /etc/os-release
2024-01-27T15:02:53.902 INFO:teuthology.orchestra.run.smithi113.stdout:NAME="CentOS Stream"
2024-01-27T15:02:53.902 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION="8"
2024-01-27T15:02:53.902 INFO:teuthology.orchestra.run.smithi113.stdout:ID="centos"
2024-01-27T15:02:53.902 INFO:teuthology.orchestra.run.smithi113.stdout:ID_LIKE="rhel fedora"
2024-01-27T15:02:53.902 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_ID="8"
2024-01-27T15:02:53.902 INFO:teuthology.orchestra.run.smithi113.stdout:PLATFORM_ID="platform:el8"
2024-01-27T15:02:53.902 INFO:teuthology.orchestra.run.smithi113.stdout:PRETTY_NAME="CentOS Stream 8"
2024-01-27T15:02:53.902 INFO:teuthology.orchestra.run.smithi113.stdout:ANSI_COLOR="0;31"
2024-01-27T15:02:53.902 INFO:teuthology.orchestra.run.smithi113.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-01-27T15:02:53.902 INFO:teuthology.orchestra.run.smithi113.stdout:HOME_URL="https://centos.org/"
2024-01-27T15:02:53.902 INFO:teuthology.orchestra.run.smithi113.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-27T15:02:53.903 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-27T15:02:53.903 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-27T15:02:53.903 INFO:teuthology.provision.fog.smithi113:Deploy complete!
2024-01-27T15:02:53.904 DEBUG:teuthology.parallel:result is None
2024-01-27T15:02:54.126 INFO:teuthology.lock.ops:Checking smithi017.front.sepia.ceph.com
2024-01-27T15:02:54.127 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-27T15:02:54.157 INFO:teuthology.lock.ops:Checking smithi053.front.sepia.ceph.com
2024-01-27T15:02:54.157 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-27T15:02:54.182 INFO:teuthology.lock.ops:Checking smithi113.front.sepia.ceph.com
2024-01-27T15:02:54.182 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-27T15:02:54.200 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: set os type and version on server
2024-01-27T15:02:54.200 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com'
2024-01-27T15:02:54.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T15:02:54.280 DEBUG:teuthology.orchestra.run.smithi017:> true
2024-01-27T15:02:54.420 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com'
2024-01-27T15:02:54.420 DEBUG:teuthology.orchestra.run.smithi017:> uname -m
2024-01-27T15:02:54.479 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64
2024-01-27T15:02:54.480 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release
2024-01-27T15:02:54.539 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream"
2024-01-27T15:02:54.540 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="8"
2024-01-27T15:02:54.540 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos"
2024-01-27T15:02:54.540 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora"
2024-01-27T15:02:54.540 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="8"
2024-01-27T15:02:54.540 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el8"
2024-01-27T15:02:54.540 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 8"
2024-01-27T15:02:54.540 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31"
2024-01-27T15:02:54.540 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-01-27T15:02:54.540 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/"
2024-01-27T15:02:54.540 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-27T15:02:54.540 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-27T15:02:54.540 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-27T15:02:54.541 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server
2024-01-27T15:02:54.567 INFO:teuthology.lock.ops:Updating [smithi053.front.sepia.ceph.com]: set os type and version on server
2024-01-27T15:02:54.567 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com'
2024-01-27T15:02:54.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T15:02:54.641 DEBUG:teuthology.orchestra.run.smithi053:> true
2024-01-27T15:02:54.779 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com'
2024-01-27T15:02:54.779 DEBUG:teuthology.orchestra.run.smithi053:> uname -m
2024-01-27T15:02:54.839 INFO:teuthology.orchestra.run.smithi053.stdout:x86_64
2024-01-27T15:02:54.840 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release
2024-01-27T15:02:54.899 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="CentOS Stream"
2024-01-27T15:02:54.899 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="8"
2024-01-27T15:02:54.899 INFO:teuthology.orchestra.run.smithi053.stdout:ID="centos"
2024-01-27T15:02:54.899 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="rhel fedora"
2024-01-27T15:02:54.899 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="8"
2024-01-27T15:02:54.899 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el8"
2024-01-27T15:02:54.900 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="CentOS Stream 8"
2024-01-27T15:02:54.900 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31"
2024-01-27T15:02:54.900 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-01-27T15:02:54.900 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://centos.org/"
2024-01-27T15:02:54.900 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-27T15:02:54.900 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-27T15:02:54.901 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-27T15:02:54.901 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server
2024-01-27T15:02:54.924 INFO:teuthology.lock.ops:Updating [smithi113.front.sepia.ceph.com]: set os type and version on server
2024-01-27T15:02:54.924 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi113.front.sepia.ceph.com'
2024-01-27T15:02:54.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T15:02:54.996 DEBUG:teuthology.orchestra.run.smithi113:> true
2024-01-27T15:02:55.071 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi113.front.sepia.ceph.com'
2024-01-27T15:02:55.071 DEBUG:teuthology.orchestra.run.smithi113:> uname -m
2024-01-27T15:02:55.135 INFO:teuthology.orchestra.run.smithi113.stdout:x86_64
2024-01-27T15:02:55.135 DEBUG:teuthology.orchestra.run.smithi113:> cat /etc/os-release
2024-01-27T15:02:55.198 INFO:teuthology.orchestra.run.smithi113.stdout:NAME="CentOS Stream"
2024-01-27T15:02:55.198 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION="8"
2024-01-27T15:02:55.198 INFO:teuthology.orchestra.run.smithi113.stdout:ID="centos"
2024-01-27T15:02:55.198 INFO:teuthology.orchestra.run.smithi113.stdout:ID_LIKE="rhel fedora"
2024-01-27T15:02:55.198 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_ID="8"
2024-01-27T15:02:55.198 INFO:teuthology.orchestra.run.smithi113.stdout:PLATFORM_ID="platform:el8"
2024-01-27T15:02:55.198 INFO:teuthology.orchestra.run.smithi113.stdout:PRETTY_NAME="CentOS Stream 8"
2024-01-27T15:02:55.198 INFO:teuthology.orchestra.run.smithi113.stdout:ANSI_COLOR="0;31"
2024-01-27T15:02:55.198 INFO:teuthology.orchestra.run.smithi113.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-01-27T15:02:55.198 INFO:teuthology.orchestra.run.smithi113.stdout:HOME_URL="https://centos.org/"
2024-01-27T15:02:55.198 INFO:teuthology.orchestra.run.smithi113.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-27T15:02:55.198 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-27T15:02:55.199 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-27T15:02:55.199 INFO:teuthology.lock.ops:Updating smithi113.front.sepia.ceph.com on lock server
2024-01-27T15:02:55.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T15:02:55.323 INFO:teuthology.dispatcher.supervisor:Running job 7534593
2024-01-27T15:02:55.323 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi/7534593 --name yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi --description fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} -- /home/teuthworker/archive/yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi/7534593/orig.config.yaml
2024-01-27T15:02:55.327 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi/7534593
2024-01-27T15:02:55.327 INFO:teuthology.dispatcher.supervisor:Job PID: 584694
2024-01-27T15:02:55.328 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-27T15:04:55.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T15:06:55.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T15:08:55.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T15:10:55.550 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T15:12:55.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T15:14:55.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T15:16:55.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T15:18:55.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T15:20:55.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T15:22:55.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T15:24:56.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T15:26:56.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T15:28:56.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T15:28:56.255 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-27T15:28:56.462 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-27T15:28:56.462 INFO:teuthology.nuke:Checking targets against current locks
2024-01-27T15:28:56.511 DEBUG:teuthology.nuke:shortname: smithi017
2024-01-27T15:28:56.511 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-27T15:28:56.532 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi/7534593', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-27 14:57:32.144712', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMox2CgAhmVXoZZnqyTEshyJ9OxSnMVRIQsDLJ9JAehxOLki+iwCCVg3wy80omnPXe1LIovXtkuDH4HmCwFp6so='}
2024-01-27T15:28:56.535 DEBUG:teuthology.nuke:shortname: smithi053
2024-01-27T15:28:56.535 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-27T15:28:56.552 DEBUG:teuthology.nuke:shortname: smithi113
2024-01-27T15:28:56.553 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-27T15:28:56.555 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi053.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi/7534593', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-27 14:57:32.141218', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIqHEYZU19Off1OfsEgozEmwgTbmpOrTZIfVFIWuE5rhLs9AJLomdF+Q+1KT8X1QkhBqwWtHeUju0EGeQcobqkE='}
2024-01-27T15:28:56.574 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi113.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi/7534593', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-27 14:57:32.143093', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ7nmJexEzDy6uPbkKva/nbcHHYXq1ZcE2OybaV5R86jAcMAIWqkUs3YRosL+tbgEqN76qfM9CjVar1dWTGvDw0='}
2024-01-27T15:28:56.582 INFO:teuthology.orchestra.console.smithi017:Power off
2024-01-27T15:28:56.582 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-27T15:28:56.602 DEBUG:teuthology.orchestra.console.smithi017:power off output: Chassis Power Control: Down/Off
2024-01-27T15:28:56.602 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T15:28:56.618 INFO:teuthology.orchestra.console.smithi053:Power off
2024-01-27T15:28:56.619 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-27T15:28:56.626 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off
2024-01-27T15:28:56.637 DEBUG:teuthology.orchestra.console.smithi053:power off output: Chassis Power Control: Down/Off
2024-01-27T15:28:56.637 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T15:28:56.649 INFO:teuthology.orchestra.console.smithi113:Power off
2024-01-27T15:28:56.649 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-27T15:28:56.658 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off
2024-01-27T15:28:56.668 DEBUG:teuthology.orchestra.console.smithi113:power off output: Chassis Power Control: Down/Off
2024-01-27T15:28:56.668 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T15:28:56.689 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off
2024-01-27T15:28:56.727 INFO:teuthology.orchestra.console.smithi017:Power off completed
2024-01-27T15:28:56.759 INFO:teuthology.orchestra.console.smithi053:Power off completed
2024-01-27T15:28:56.790 INFO:teuthology.orchestra.console.smithi113:Power off completed
2024-01-27T15:28:56.878 INFO:teuthology.lock.ops:unlocked: smithi017.front.sepia.ceph.com
2024-01-27T15:28:56.903 INFO:teuthology.lock.ops:unlocked: smithi053.front.sepia.ceph.com
2024-01-27T15:28:56.938 INFO:teuthology.lock.ops:unlocked: smithi113.front.sepia.ceph.com