2024-03-07T06:57:55.418 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-07T06:57:55.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T06:57:55.589 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fbb61bacf40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fbb62c0dc10>, signals=[15])
2024-03-07T06:57:55.589 INFO:teuthology.lock.ops:Start node 'smithi002.front.sepia.ceph.com' reimaging
2024-03-07T06:57:55.589 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: reset os type and version on server
2024-03-07T06:57:55.589 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server
2024-03-07T06:57:55.608 INFO:teuthology.lock.ops:Start node 'smithi066.front.sepia.ceph.com' reimaging
2024-03-07T06:57:55.608 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: reset os type and version on server
2024-03-07T06:57:55.608 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server
2024-03-07T06:57:55.633 INFO:teuthology.lock.ops:Start node 'smithi129.front.sepia.ceph.com' reimaging
2024-03-07T06:57:55.633 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: reset os type and version on server
2024-03-07T06:57:55.634 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server
2024-03-07T06:57:55.733 DEBUG:teuthology.provision.fog.smithi002:Requesting image smithi_centos_8.stream (ID 3)
2024-03-07T06:57:55.738 DEBUG:teuthology.provision.fog.smithi066:Requesting image smithi_centos_8.stream (ID 3)
2024-03-07T06:57:55.768 DEBUG:teuthology.provision.fog.smithi129:Requesting image smithi_centos_8.stream (ID 3)
2024-03-07T06:57:55.775 INFO:teuthology.provision.fog.smithi066:Scheduling deploy of centos 8.stream
2024-03-07T06:57:55.784 INFO:teuthology.provision.fog.smithi002:Scheduling deploy of centos 8.stream
2024-03-07T06:57:55.814 INFO:teuthology.provision.fog.smithi129:Scheduling deploy of centos 8.stream
2024-03-07T06:57:56.014 INFO:teuthology.orchestra.console.smithi002:Power off
2024-03-07T06:57:56.014 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-07T06:57:56.028 INFO:teuthology.orchestra.console.smithi066:Power off
2024-03-07T06:57:56.028 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-07T06:57:56.040 DEBUG:teuthology.orchestra.console.smithi002:power off output: Chassis Power Control: Down/Off
2024-03-07T06:57:56.040 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T06:57:56.050 DEBUG:teuthology.orchestra.console.smithi066:power off output: Chassis Power Control: Down/Off
2024-03-07T06:57:56.051 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T06:57:56.063 INFO:teuthology.orchestra.console.smithi129:Power off
2024-03-07T06:57:56.063 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-07T06:57:56.071 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on
2024-03-07T06:57:56.072 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on
2024-03-07T06:57:56.085 DEBUG:teuthology.orchestra.console.smithi129:power off output: Chassis Power Control: Down/Off
2024-03-07T06:57:56.085 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T06:57:56.109 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on
2024-03-07T06:58:00.076 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T06:58:00.084 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T06:58:00.109 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T06:58:00.186 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on
2024-03-07T06:58:00.192 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on
2024-03-07T06:58:00.219 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on
2024-03-07T06:58:04.191 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T06:58:04.198 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T06:58:04.220 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T06:58:04.300 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off
2024-03-07T06:58:04.306 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on
2024-03-07T06:58:04.328 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on
2024-03-07T06:58:04.401 INFO:teuthology.orchestra.console.smithi002:Power off completed
2024-03-07T06:58:04.502 INFO:teuthology.orchestra.console.smithi002:Power on
2024-03-07T06:58:04.502 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-07T06:58:04.524 DEBUG:teuthology.orchestra.console.smithi002:power on output: Chassis Power Control: Up/On
2024-03-07T06:58:04.525 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T06:58:04.546 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off
2024-03-07T06:58:08.311 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T06:58:08.329 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T06:58:08.420 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off
2024-03-07T06:58:08.437 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off
2024-03-07T06:58:08.521 INFO:teuthology.orchestra.console.smithi066:Power off completed
2024-03-07T06:58:08.538 INFO:teuthology.orchestra.console.smithi129:Power off completed
2024-03-07T06:58:08.547 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T06:58:08.622 INFO:teuthology.orchestra.console.smithi066:Power on
2024-03-07T06:58:08.622 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-07T06:58:08.639 INFO:teuthology.orchestra.console.smithi129:Power on
2024-03-07T06:58:08.640 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-07T06:58:08.648 DEBUG:teuthology.orchestra.console.smithi066:power on output: Chassis Power Control: Up/On
2024-03-07T06:58:08.649 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T06:58:08.657 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off
2024-03-07T06:58:08.662 DEBUG:teuthology.orchestra.console.smithi129:power on output: Chassis Power Control: Up/On
2024-03-07T06:58:08.662 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T06:58:08.670 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off
2024-03-07T06:58:08.683 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off
2024-03-07T06:58:12.660 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T06:58:12.671 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T06:58:12.683 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T06:58:12.771 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on
2024-03-07T06:58:12.779 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off
2024-03-07T06:58:12.793 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off
2024-03-07T06:58:12.872 INFO:teuthology.orchestra.console.smithi002:Power on completed
2024-03-07T06:58:12.972 INFO:teuthology.provision.fog.smithi002:Waiting for deploy to finish
2024-03-07T06:58:16.783 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T06:58:16.795 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T06:58:16.893 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on
2024-03-07T06:58:16.904 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on
2024-03-07T06:58:16.994 INFO:teuthology.orchestra.console.smithi066:Power on completed
2024-03-07T06:58:17.005 INFO:teuthology.orchestra.console.smithi129:Power on completed
2024-03-07T06:58:17.095 INFO:teuthology.provision.fog.smithi066:Waiting for deploy to finish
2024-03-07T06:58:17.106 INFO:teuthology.provision.fog.smithi129:Waiting for deploy to finish
2024-03-07T07:00:43.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T07:00:44.236 ERROR:teuthology.orchestra.connection:Error authenticating with smithi002.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-07T07:01:02.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T07:01:05.948 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129
2024-03-07T07:01:11.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T07:01:15.004 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129
2024-03-07T07:01:21.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T07:01:24.060 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129
2024-03-07T07:01:30.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T07:01:33.116 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129
2024-03-07T07:01:39.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T07:01:42.172 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129
2024-03-07T07:01:48.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T07:01:48.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T07:01:48.239 WARNING:teuthology.provision.fog.smithi002:timed out
2024-03-07T07:01:51.132 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-07T07:01:54.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T07:01:57.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T07:01:57.308 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2
2024-03-07T07:02:00.188 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-07T07:02:03.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T07:02:06.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T07:02:06.364 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2
2024-03-07T07:02:09.244 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-07T07:02:12.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T07:02:15.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T07:02:15.420 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2
2024-03-07T07:02:18.304 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-07T07:02:21.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T07:02:21.642 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-07T07:02:21.643 DEBUG:teuthology.orchestra.run.smithi002:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-07T07:02:24.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T07:02:27.356 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-07T07:02:33.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T07:02:36.412 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-07T07:02:36.877 INFO:teuthology.provision.fog.smithi002:Node is ready
2024-03-07T07:02:36.877 DEBUG:teuthology.orchestra.run.smithi002:> hostname
2024-03-07T07:02:36.901 INFO:teuthology.orchestra.run.smithi002.stdout:smithi193
2024-03-07T07:02:36.901 DEBUG:teuthology.orchestra.run.smithi002:> grep smithi193 /etc/hosts
2024-03-07T07:02:36.964 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.193 smithi193.front.sepia.ceph.com smithi193
2024-03-07T07:02:36.964 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname smithi002
2024-03-07T07:02:37.078 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/smithi193/smithi002/g' /etc/hosts
2024-03-07T07:02:37.111 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/172.21.15.193/172.21.15.2/g' /etc/hosts
2024-03-07T07:02:37.186 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/smithi193/smithi002/g' /etc/hostname
2024-03-07T07:02:37.271 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname smithi002
2024-03-07T07:02:37.300 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release
2024-03-07T07:02:37.359 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream"
2024-03-07T07:02:37.359 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="8"
2024-03-07T07:02:37.359 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos"
2024-03-07T07:02:37.359 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora"
2024-03-07T07:02:37.359 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="8"
2024-03-07T07:02:37.360 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el8"
2024-03-07T07:02:37.360 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-07T07:02:37.360 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31"
2024-03-07T07:02:37.360 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-07T07:02:37.360 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/"
2024-03-07T07:02:37.360 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-07T07:02:37.360 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-07T07:02:37.360 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-07T07:02:37.361 INFO:teuthology.provision.fog.smithi002:Deploy complete!
2024-03-07T07:02:37.362 DEBUG:teuthology.parallel:result is None
2024-03-07T07:02:42.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T07:02:45.468 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-07T07:02:48.176 WARNING:teuthology.provision.fog.smithi129:timed out
2024-03-07T07:02:51.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T07:02:54.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T07:02:54.421 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-07T07:02:54.422 DEBUG:teuthology.orchestra.run.smithi129:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-07T07:02:54.524 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-07T07:02:54.691 INFO:teuthology.provision.fog.smithi129:Node is ready
2024-03-07T07:02:54.692 DEBUG:teuthology.orchestra.run.smithi129:> hostname
2024-03-07T07:02:54.710 INFO:teuthology.orchestra.run.smithi129.stdout:smithi129.front.sepia.ceph.com
2024-03-07T07:02:54.710 DEBUG:teuthology.orchestra.run.smithi129:> grep smithi129.front.sepia.ceph.com /etc/hosts
2024-03-07T07:02:54.769 INFO:teuthology.orchestra.run.smithi129.stdout:172.21.15.129 smithi129.front.sepia.ceph.com smithi129
2024-03-07T07:02:54.769 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname smithi129
2024-03-07T07:02:54.880 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi129.front.sepia.ceph.com/smithi129/g' /etc/hosts
2024-03-07T07:02:54.909 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/172.21.15.129/172.21.15.129/g' /etc/hosts
2024-03-07T07:02:54.977 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi129.front.sepia.ceph.com/smithi129/g' /etc/hostname
2024-03-07T07:02:55.044 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname smithi129
2024-03-07T07:02:55.111 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release
2024-03-07T07:02:55.169 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream"
2024-03-07T07:02:55.169 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="8"
2024-03-07T07:02:55.169 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos"
2024-03-07T07:02:55.169 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora"
2024-03-07T07:02:55.169 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="8"
2024-03-07T07:02:55.169 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el8"
2024-03-07T07:02:55.169 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-07T07:02:55.170 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31"
2024-03-07T07:02:55.170 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-07T07:02:55.170 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/"
2024-03-07T07:02:55.171 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-07T07:02:55.172 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-07T07:02:55.172 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-07T07:02:55.172 INFO:teuthology.provision.fog.smithi129:Deploy complete!
2024-03-07T07:02:55.173 DEBUG:teuthology.parallel:result is None
2024-03-07T07:03:00.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T07:03:03.584 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-07T07:03:09.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T07:03:12.640 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-07T07:03:18.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T07:04:18.644 WARNING:teuthology.provision.fog.smithi066:timed out
2024-03-07T07:04:24.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T07:04:24.919 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-07T07:04:24.919 DEBUG:teuthology.orchestra.run.smithi066:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-07T07:04:25.172 INFO:teuthology.provision.fog.smithi066:Node is ready
2024-03-07T07:04:25.172 DEBUG:teuthology.orchestra.run.smithi066:> hostname
2024-03-07T07:04:25.192 INFO:teuthology.orchestra.run.smithi066.stdout:smithi066.front.sepia.ceph.com
2024-03-07T07:04:25.193 DEBUG:teuthology.orchestra.run.smithi066:> grep smithi066.front.sepia.ceph.com /etc/hosts
2024-03-07T07:04:25.253 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66 smithi066.front.sepia.ceph.com smithi066
2024-03-07T07:04:25.253 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname smithi066
2024-03-07T07:04:25.353 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi066.front.sepia.ceph.com/smithi066/g' /etc/hosts
2024-03-07T07:04:25.384 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/172.21.15.66/172.21.15.66/g' /etc/hosts
2024-03-07T07:04:25.456 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi066.front.sepia.ceph.com/smithi066/g' /etc/hostname
2024-03-07T07:04:25.526 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname smithi066
2024-03-07T07:04:25.596 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release
2024-03-07T07:04:25.655 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Stream"
2024-03-07T07:04:25.655 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="8"
2024-03-07T07:04:25.655 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos"
2024-03-07T07:04:25.655 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora"
2024-03-07T07:04:25.655 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="8"
2024-03-07T07:04:25.655 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el8"
2024-03-07T07:04:25.655 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-07T07:04:25.655 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31"
2024-03-07T07:04:25.655 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-07T07:04:25.655 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://centos.org/"
2024-03-07T07:04:25.655 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-07T07:04:25.656 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-07T07:04:25.656 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-07T07:04:25.656 INFO:teuthology.provision.fog.smithi066:Deploy complete!
2024-03-07T07:04:25.657 DEBUG:teuthology.parallel:result is None
2024-03-07T07:04:25.855 INFO:teuthology.lock.ops:Checking smithi002.front.sepia.ceph.com
2024-03-07T07:04:25.855 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-07T07:04:25.879 INFO:teuthology.lock.ops:Checking smithi066.front.sepia.ceph.com
2024-03-07T07:04:25.879 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-07T07:04:25.904 INFO:teuthology.lock.ops:Checking smithi129.front.sepia.ceph.com
2024-03-07T07:04:25.904 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-07T07:04:25.923 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: set os type and version on server
2024-03-07T07:04:25.923 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com'
2024-03-07T07:04:25.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T07:04:26.002 DEBUG:teuthology.orchestra.run.smithi002:> true
2024-03-07T07:04:26.139 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com'
2024-03-07T07:04:26.140 DEBUG:teuthology.orchestra.run.smithi002:> uname -m
2024-03-07T07:04:26.199 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64
2024-03-07T07:04:26.199 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release
2024-03-07T07:04:26.258 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream"
2024-03-07T07:04:26.258 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="8"
2024-03-07T07:04:26.258 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos"
2024-03-07T07:04:26.258 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora"
2024-03-07T07:04:26.258 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="8"
2024-03-07T07:04:26.258 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el8"
2024-03-07T07:04:26.258 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-07T07:04:26.258 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31"
2024-03-07T07:04:26.259 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-07T07:04:26.259 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/"
2024-03-07T07:04:26.259 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-07T07:04:26.259 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-07T07:04:26.259 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-07T07:04:26.259 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server
2024-03-07T07:04:26.289 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: set os type and version on server
2024-03-07T07:04:26.289 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com'
2024-03-07T07:04:26.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T07:04:26.366 DEBUG:teuthology.orchestra.run.smithi066:> true
2024-03-07T07:04:26.437 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com'
2024-03-07T07:04:26.437 DEBUG:teuthology.orchestra.run.smithi066:> uname -m
2024-03-07T07:04:26.498 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64
2024-03-07T07:04:26.498 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release
2024-03-07T07:04:26.558 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Stream"
2024-03-07T07:04:26.558 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="8"
2024-03-07T07:04:26.558 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos"
2024-03-07T07:04:26.558 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora"
2024-03-07T07:04:26.558 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="8"
2024-03-07T07:04:26.559 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el8"
2024-03-07T07:04:26.559 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-07T07:04:26.559 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31"
2024-03-07T07:04:26.559 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-07T07:04:26.559 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://centos.org/"
2024-03-07T07:04:26.559 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-07T07:04:26.559 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-07T07:04:26.559 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-07T07:04:26.559 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server
2024-03-07T07:04:26.588 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: set os type and version on server
2024-03-07T07:04:26.588 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com'
2024-03-07T07:04:26.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T07:04:26.660 DEBUG:teuthology.orchestra.run.smithi129:> true
2024-03-07T07:04:26.795 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com'
2024-03-07T07:04:26.795 DEBUG:teuthology.orchestra.run.smithi129:> uname -m
2024-03-07T07:04:26.855 INFO:teuthology.orchestra.run.smithi129.stdout:x86_64
2024-03-07T07:04:26.855 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release
2024-03-07T07:04:26.914 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream"
2024-03-07T07:04:26.914 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="8"
2024-03-07T07:04:26.915 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos"
2024-03-07T07:04:26.915 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora"
2024-03-07T07:04:26.915 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="8"
2024-03-07T07:04:26.915 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el8"
2024-03-07T07:04:26.915 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-07T07:04:26.915 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31"
2024-03-07T07:04:26.915 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-07T07:04:26.915 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/"
2024-03-07T07:04:26.915 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-07T07:04:26.915 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-07T07:04:26.915 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-07T07:04:26.916 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server
2024-03-07T07:04:26.938 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T07:04:27.034 INFO:teuthology.dispatcher.supervisor:Running job 7583954
2024-03-07T07:04:27.034 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_leonidus@teuthology --archive /home/teuthworker/archive/leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi/7583954 --name leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi --description fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} -- /home/teuthworker/archive/leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi/7583954/orig.config.yaml
2024-03-07T07:04:27.037 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi/7583954
2024-03-07T07:04:27.038 INFO:teuthology.dispatcher.supervisor:Job PID: 2800509
2024-03-07T07:04:27.038 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-07T07:06:27.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T07:08:27.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T07:10:27.217 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T07:12:27.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T07:14:27.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T07:16:27.450 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T07:18:27.526 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T07:20:27.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T07:22:27.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T07:24:27.740 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T07:26:27.804 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T07:28:27.876 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T07:30:27.940 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T07:32:28.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T07:34:28.074 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T07:36:28.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T07:38:28.240 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T07:40:28.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T07:42:28.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T07:44:28.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T07:46:28.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T07:48:28.610 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T07:50:28.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T07:52:28.754 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T07:54:28.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T07:56:28.920 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T07:58:28.980 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T08:00:29.044 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T08:02:29.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T08:02:29.203 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1