2024-03-18T00:37:45.492 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-18T00:37:45.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T00:37:45.660 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f8034d25f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f8035d86c10>, signals=[15])
2024-03-18T00:37:45.660 INFO:teuthology.lock.ops:Start node 'smithi005.front.sepia.ceph.com' reimaging
2024-03-18T00:37:45.661 INFO:teuthology.lock.ops:Updating [smithi005.front.sepia.ceph.com]: reset os type and version on server
2024-03-18T00:37:45.661 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server
2024-03-18T00:37:45.677 INFO:teuthology.lock.ops:Start node 'smithi132.front.sepia.ceph.com' reimaging
2024-03-18T00:37:45.677 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: reset os type and version on server
2024-03-18T00:37:45.677 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server
2024-03-18T00:37:45.702 INFO:teuthology.lock.ops:Start node 'smithi157.front.sepia.ceph.com' reimaging
2024-03-18T00:37:45.702 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: reset os type and version on server
2024-03-18T00:37:45.702 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server
2024-03-18T00:37:45.794 DEBUG:teuthology.provision.fog.smithi005:Requesting image smithi_centos_8.stream (ID 3)
2024-03-18T00:37:45.807 DEBUG:teuthology.provision.fog.smithi132:Requesting image smithi_centos_8.stream (ID 3)
2024-03-18T00:37:45.822 DEBUG:teuthology.provision.fog.smithi157:Requesting image smithi_centos_8.stream (ID 3)
2024-03-18T00:37:45.843 INFO:teuthology.provision.fog.smithi005:Scheduling deploy of centos 8.stream
2024-03-18T00:37:45.848 INFO:teuthology.provision.fog.smithi132:Scheduling deploy of centos 8.stream
2024-03-18T00:37:45.865 INFO:teuthology.provision.fog.smithi157:Scheduling deploy of centos 8.stream
2024-03-18T00:37:46.137 INFO:teuthology.orchestra.console.smithi005:Power off
2024-03-18T00:37:46.137 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-18T00:37:46.155 INFO:teuthology.orchestra.console.smithi132:Power off
2024-03-18T00:37:46.155 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-18T00:37:46.174 INFO:teuthology.orchestra.console.smithi157:Power off
2024-03-18T00:37:46.175 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-18T00:37:46.183 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off
2024-03-18T00:37:46.183 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-18T00:37:46.191 DEBUG:teuthology.orchestra.console.smithi005:power off output: Chassis Power Control: Down/Off
2024-03-18T00:37:46.191 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-18T00:37:46.199 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off
2024-03-18T00:37:46.199 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-18T00:37:46.208 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off
2024-03-18T00:37:46.215 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on
2024-03-18T00:37:46.219 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off
2024-03-18T00:37:46.309 INFO:teuthology.orchestra.console.smithi132:Power off completed
2024-03-18T00:37:46.320 INFO:teuthology.orchestra.console.smithi157:Power off completed
2024-03-18T00:37:46.410 INFO:teuthology.orchestra.console.smithi132:Power on
2024-03-18T00:37:46.410 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-18T00:37:46.422 INFO:teuthology.orchestra.console.smithi157:Power on
2024-03-18T00:37:46.422 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-18T00:37:46.434 DEBUG:teuthology.orchestra.console.smithi132:power on output: Chassis Power Control: Up/On
2024-03-18T00:37:46.435 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-18T00:37:46.446 DEBUG:teuthology.orchestra.console.smithi157:power on output: Chassis Power Control: Up/On
2024-03-18T00:37:46.446 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-18T00:37:46.459 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off
2024-03-18T00:37:46.467 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off
2024-03-18T00:37:50.218 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-18T00:37:50.331 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on
2024-03-18T00:37:50.460 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-18T00:37:50.467 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-18T00:37:50.569 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off
2024-03-18T00:37:50.575 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off
2024-03-18T00:37:54.334 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-18T00:37:54.444 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on
2024-03-18T00:37:54.571 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-18T00:37:54.579 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-18T00:37:54.681 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on
2024-03-18T00:37:54.687 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on
2024-03-18T00:37:54.782 INFO:teuthology.orchestra.console.smithi132:Power on completed
2024-03-18T00:37:54.788 INFO:teuthology.orchestra.console.smithi157:Power on completed
2024-03-18T00:37:54.883 INFO:teuthology.provision.fog.smithi132:Waiting for deploy to finish
2024-03-18T00:37:54.889 INFO:teuthology.provision.fog.smithi157:Waiting for deploy to finish
2024-03-18T00:37:58.446 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-18T00:37:58.555 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off
2024-03-18T00:37:58.656 INFO:teuthology.orchestra.console.smithi005:Power off completed
2024-03-18T00:37:58.757 INFO:teuthology.orchestra.console.smithi005:Power on
2024-03-18T00:37:58.757 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-18T00:37:58.779 DEBUG:teuthology.orchestra.console.smithi005:power on output: Chassis Power Control: Up/On
2024-03-18T00:37:58.779 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-18T00:37:58.801 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off
2024-03-18T00:38:02.803 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-18T00:38:02.912 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on
2024-03-18T00:38:03.012 INFO:teuthology.orchestra.console.smithi005:Power on completed
2024-03-18T00:38:03.113 INFO:teuthology.provision.fog.smithi005:Waiting for deploy to finish
2024-03-18T00:40:34.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T00:40:37.214 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5
2024-03-18T00:40:41.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T00:40:43.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T00:40:44.126 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132
2024-03-18T00:40:46.274 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5
2024-03-18T00:40:50.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T00:40:52.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T00:40:53.182 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132
2024-03-18T00:40:55.326 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5
2024-03-18T00:40:59.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T00:41:01.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T00:41:02.238 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132
2024-03-18T00:41:04.386 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5
2024-03-18T00:41:08.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T00:41:10.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T00:41:11.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T00:41:11.299 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132
2024-03-18T00:41:13.470 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5
2024-03-18T00:41:14.238 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-03-18T00:41:17.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T00:41:19.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T00:41:20.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T00:41:20.382 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132
2024-03-18T00:41:22.526 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5
2024-03-18T00:41:23.294 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-03-18T00:41:26.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T00:41:28.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T00:41:29.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T00:41:32.354 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-03-18T00:41:38.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T00:41:41.442 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-03-18T00:41:47.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T00:41:50.527 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-03-18T00:41:56.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T00:41:59.614 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-03-18T00:42:05.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T00:42:08.702 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-03-18T00:42:14.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T00:42:17.790 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-03-18T00:42:23.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T00:42:26.390 WARNING:teuthology.provision.fog.smithi132:timed out
2024-03-18T00:42:26.879 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-03-18T00:42:28.534 WARNING:teuthology.provision.fog.smithi005:timed out
2024-03-18T00:42:32.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T00:42:32.628 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-18T00:42:32.629 DEBUG:teuthology.orchestra.run.smithi132:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-18T00:42:32.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T00:42:32.882 INFO:teuthology.provision.fog.smithi132:Node is ready
2024-03-18T00:42:32.882 DEBUG:teuthology.orchestra.run.smithi132:> hostname
2024-03-18T00:42:32.901 INFO:teuthology.orchestra.run.smithi132.stdout:smithi132.front.sepia.ceph.com
2024-03-18T00:42:32.901 DEBUG:teuthology.orchestra.run.smithi132:> grep smithi132.front.sepia.ceph.com /etc/hosts
2024-03-18T00:42:32.960 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.15.132 smithi132.front.sepia.ceph.com smithi132
2024-03-18T00:42:32.961 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132
2024-03-18T00:42:33.067 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hosts
2024-03-18T00:42:33.097 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/172.21.15.132/172.21.15.132/g' /etc/hosts
2024-03-18T00:42:33.166 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hostname
2024-03-18T00:42:33.235 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132
2024-03-18T00:42:33.302 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release
2024-03-18T00:42:33.360 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream"
2024-03-18T00:42:33.360 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8"
2024-03-18T00:42:33.360 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos"
2024-03-18T00:42:33.360 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora"
2024-03-18T00:42:33.360 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8"
2024-03-18T00:42:33.360 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8"
2024-03-18T00:42:33.360 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-18T00:42:33.360 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31"
2024-03-18T00:42:33.360 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-18T00:42:33.360 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/"
2024-03-18T00:42:33.361 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-18T00:42:33.361 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-18T00:42:33.361 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-18T00:42:33.361 INFO:teuthology.provision.fog.smithi132:Deploy complete!
2024-03-18T00:42:33.363 DEBUG:teuthology.parallel:result is None
2024-03-18T00:42:34.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T00:42:34.786 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-18T00:42:34.786 DEBUG:teuthology.orchestra.run.smithi005:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-18T00:42:35.061 INFO:teuthology.provision.fog.smithi005:Node is ready
2024-03-18T00:42:35.061 DEBUG:teuthology.orchestra.run.smithi005:> hostname
2024-03-18T00:42:35.081 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005.front.sepia.ceph.com
2024-03-18T00:42:35.081 DEBUG:teuthology.orchestra.run.smithi005:> grep smithi005.front.sepia.ceph.com /etc/hosts
2024-03-18T00:42:35.142 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5 smithi005.front.sepia.ceph.com smithi005
2024-03-18T00:42:35.143 DEBUG:teuthology.orchestra.run.smithi005:> sudo hostname smithi005
2024-03-18T00:42:35.260 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/smithi005.front.sepia.ceph.com/smithi005/g' /etc/hosts
2024-03-18T00:42:35.291 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/172.21.15.5/172.21.15.5/g' /etc/hosts
2024-03-18T00:42:35.361 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/smithi005.front.sepia.ceph.com/smithi005/g' /etc/hostname
2024-03-18T00:42:35.431 DEBUG:teuthology.orchestra.run.smithi005:> sudo hostname smithi005
2024-03-18T00:42:35.501 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release
2024-03-18T00:42:35.561 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="CentOS Stream"
2024-03-18T00:42:35.561 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="8"
2024-03-18T00:42:35.561 INFO:teuthology.orchestra.run.smithi005.stdout:ID="centos"
2024-03-18T00:42:35.561 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="rhel fedora"
2024-03-18T00:42:35.561 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="8"
2024-03-18T00:42:35.561 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el8"
2024-03-18T00:42:35.561 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-18T00:42:35.561 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31"
2024-03-18T00:42:35.561 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-18T00:42:35.561 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://centos.org/"
2024-03-18T00:42:35.561 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-18T00:42:35.561 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-18T00:42:35.562 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-18T00:42:35.562 INFO:teuthology.provision.fog.smithi005:Deploy complete!
2024-03-18T00:42:35.562 DEBUG:teuthology.parallel:result is None
2024-03-18T00:43:32.940 WARNING:teuthology.provision.fog.smithi157:timed out
2024-03-18T00:43:38.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T00:43:39.282 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-18T00:43:39.283 DEBUG:teuthology.orchestra.run.smithi157:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-18T00:43:39.533 INFO:teuthology.provision.fog.smithi157:Node is ready
2024-03-18T00:43:39.533 DEBUG:teuthology.orchestra.run.smithi157:> hostname
2024-03-18T00:43:39.552 INFO:teuthology.orchestra.run.smithi157.stdout:smithi157.front.sepia.ceph.com
2024-03-18T00:43:39.552 DEBUG:teuthology.orchestra.run.smithi157:> grep smithi157.front.sepia.ceph.com /etc/hosts
2024-03-18T00:43:39.612 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.15.157 smithi157.front.sepia.ceph.com smithi157
2024-03-18T00:43:39.612 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157
2024-03-18T00:43:39.727 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hosts
2024-03-18T00:43:39.756 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/172.21.15.157/172.21.15.157/g' /etc/hosts
2024-03-18T00:43:39.825 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hostname
2024-03-18T00:43:39.893 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157
2024-03-18T00:43:39.961 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release
2024-03-18T00:43:40.019 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="CentOS Stream"
2024-03-18T00:43:40.019 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8"
2024-03-18T00:43:40.019 INFO:teuthology.orchestra.run.smithi157.stdout:ID="centos"
2024-03-18T00:43:40.020 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="rhel fedora"
2024-03-18T00:43:40.020 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8"
2024-03-18T00:43:40.020 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8"
2024-03-18T00:43:40.020 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-18T00:43:40.020 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31"
2024-03-18T00:43:40.020 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-18T00:43:40.021 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://centos.org/"
2024-03-18T00:43:40.021 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-18T00:43:40.021 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-18T00:43:40.021 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-18T00:43:40.022 INFO:teuthology.provision.fog.smithi157:Deploy complete!
2024-03-18T00:43:40.023 DEBUG:teuthology.parallel:result is None
2024-03-18T00:43:40.223 INFO:teuthology.lock.ops:Checking smithi005.front.sepia.ceph.com
2024-03-18T00:43:40.224 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-18T00:43:40.246 INFO:teuthology.lock.ops:Checking smithi132.front.sepia.ceph.com
2024-03-18T00:43:40.246 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-18T00:43:40.262 INFO:teuthology.lock.ops:Checking smithi157.front.sepia.ceph.com
2024-03-18T00:43:40.262 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-18T00:43:40.288 INFO:teuthology.lock.ops:Updating [smithi005.front.sepia.ceph.com]: set os type and version on server
2024-03-18T00:43:40.289 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com'
2024-03-18T00:43:40.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T00:43:40.361 DEBUG:teuthology.orchestra.run.smithi005:> true
2024-03-18T00:43:40.502 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com'
2024-03-18T00:43:40.502 DEBUG:teuthology.orchestra.run.smithi005:> uname -m
2024-03-18T00:43:40.562 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64
2024-03-18T00:43:40.563 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release
2024-03-18T00:43:40.623 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="CentOS Stream"
2024-03-18T00:43:40.623 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="8"
2024-03-18T00:43:40.623 INFO:teuthology.orchestra.run.smithi005.stdout:ID="centos"
2024-03-18T00:43:40.623 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="rhel fedora"
2024-03-18T00:43:40.623 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="8"
2024-03-18T00:43:40.623 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el8"
2024-03-18T00:43:40.623 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-18T00:43:40.623 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31"
2024-03-18T00:43:40.623 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-18T00:43:40.624 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://centos.org/"
2024-03-18T00:43:40.624 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-18T00:43:40.624 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-18T00:43:40.624 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-18T00:43:40.624 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server
2024-03-18T00:43:40.646 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: set os type and version on server
2024-03-18T00:43:40.646 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com'
2024-03-18T00:43:40.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T00:43:40.717 DEBUG:teuthology.orchestra.run.smithi132:> true
2024-03-18T00:43:40.853 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com'
2024-03-18T00:43:40.853 DEBUG:teuthology.orchestra.run.smithi132:> uname -m
2024-03-18T00:43:40.911 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64
2024-03-18T00:43:40.911 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release
2024-03-18T00:43:40.970 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream"
2024-03-18T00:43:40.971 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8"
2024-03-18T00:43:40.971 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos"
2024-03-18T00:43:40.971 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora"
2024-03-18T00:43:40.971 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8"
2024-03-18T00:43:40.971 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8"
2024-03-18T00:43:40.971 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-18T00:43:40.971 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31"
2024-03-18T00:43:40.971 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-18T00:43:40.971 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/"
2024-03-18T00:43:40.971 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-18T00:43:40.971 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-18T00:43:40.971 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-18T00:43:40.972 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server
2024-03-18T00:43:40.996 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: set os type and version on server
2024-03-18T00:43:40.996 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com'
2024-03-18T00:43:40.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T00:43:41.065 DEBUG:teuthology.orchestra.run.smithi157:> true
2024-03-18T00:43:41.134 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com'
2024-03-18T00:43:41.134 DEBUG:teuthology.orchestra.run.smithi157:> uname -m
2024-03-18T00:43:41.194 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64
2024-03-18T00:43:41.194 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release
2024-03-18T00:43:41.252 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="CentOS Stream"
2024-03-18T00:43:41.252 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8"
2024-03-18T00:43:41.253 INFO:teuthology.orchestra.run.smithi157.stdout:ID="centos"
2024-03-18T00:43:41.253 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="rhel fedora"
2024-03-18T00:43:41.253 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8"
2024-03-18T00:43:41.253 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8"
2024-03-18T00:43:41.253 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-18T00:43:41.253 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31"
2024-03-18T00:43:41.253 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-18T00:43:41.253 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://centos.org/"
2024-03-18T00:43:41.253 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-18T00:43:41.253 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-18T00:43:41.253 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-18T00:43:41.253 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server
2024-03-18T00:43:41.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T00:43:41.361 INFO:teuthology.dispatcher.supervisor:Running job 7608555
2024-03-18T00:43:41.361 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608555 --name pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi --description fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} -- /home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608555/orig.config.yaml
2024-03-18T00:43:41.363 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608555
2024-03-18T00:43:41.364 INFO:teuthology.dispatcher.supervisor:Job PID: 1237548
2024-03-18T00:43:41.364 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-18T00:45:41.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T00:47:41.621 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T00:49:41.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T00:51:41.966 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T00:53:42.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T00:55:42.258 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T00:57:42.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T00:59:42.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T01:01:42.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T01:03:42.928 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T01:05:43.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T01:07:43.368 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T01:09:43.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T01:09:43.603 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1