2024-03-04T07:54:34.222 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55
2024-03-04T07:54:34.222 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-04T07:54:34.393 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f35a0d43f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f35a1da4c10>, signals=[15])
2024-03-04T07:54:34.394 INFO:teuthology.lock.ops:Start node 'smithi027.front.sepia.ceph.com' reimaging
2024-03-04T07:54:34.394 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: reset os type and version on server
2024-03-04T07:54:34.394 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server
2024-03-04T07:54:34.418 INFO:teuthology.lock.ops:Start node 'smithi063.front.sepia.ceph.com' reimaging
2024-03-04T07:54:34.418 INFO:teuthology.lock.ops:Updating [smithi063.front.sepia.ceph.com]: reset os type and version on server
2024-03-04T07:54:34.418 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server
2024-03-04T07:54:34.434 INFO:teuthology.lock.ops:Start node 'smithi175.front.sepia.ceph.com' reimaging
2024-03-04T07:54:34.434 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: reset os type and version on server
2024-03-04T07:54:34.434 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server
2024-03-04T07:54:34.539 DEBUG:teuthology.provision.fog.smithi027:Requesting image smithi_centos_8.stream (ID 3)
2024-03-04T07:54:34.545 DEBUG:teuthology.provision.fog.smithi063:Requesting image smithi_centos_8.stream (ID 3)
2024-03-04T07:54:34.568 DEBUG:teuthology.provision.fog.smithi175:Requesting image smithi_centos_8.stream (ID 3)
2024-03-04T07:54:34.590 INFO:teuthology.provision.fog.smithi063:Scheduling deploy of centos 8.stream
2024-03-04T07:54:34.595 INFO:teuthology.provision.fog.smithi027:Scheduling deploy of centos 8.stream
2024-03-04T07:54:34.623 INFO:teuthology.provision.fog.smithi175:Scheduling deploy of centos 8.stream
2024-03-04T07:54:34.813 INFO:teuthology.orchestra.console.smithi027:Power off
2024-03-04T07:54:34.813 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-04T07:54:34.827 INFO:teuthology.orchestra.console.smithi063:Power off
2024-03-04T07:54:34.828 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-04T07:54:34.838 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off
2024-03-04T07:54:34.838 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-04T07:54:34.849 DEBUG:teuthology.orchestra.console.smithi063:power off output: Chassis Power Control: Down/Off
2024-03-04T07:54:34.851 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-04T07:54:34.859 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on
2024-03-04T07:54:34.871 INFO:teuthology.orchestra.console.smithi175:Power off
2024-03-04T07:54:34.872 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-04T07:54:34.880 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on
2024-03-04T07:54:34.892 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off
2024-03-04T07:54:34.893 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-04T07:54:34.914 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on
2024-03-04T07:54:38.864 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-04T07:54:38.881 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-04T07:54:38.916 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-04T07:54:38.975 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on
2024-03-04T07:54:38.989 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on
2024-03-04T07:54:39.024 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on
2024-03-04T07:54:42.977 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-04T07:54:42.990 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-04T07:54:43.025 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-04T07:54:43.088 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on
2024-03-04T07:54:43.099 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on
2024-03-04T07:54:43.133 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off
2024-03-04T07:54:43.234 INFO:teuthology.orchestra.console.smithi175:Power off completed
2024-03-04T07:54:43.334 INFO:teuthology.orchestra.console.smithi175:Power on
2024-03-04T07:54:43.335 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-04T07:54:43.357 DEBUG:teuthology.orchestra.console.smithi175:power on output: Chassis Power Control: Up/On
2024-03-04T07:54:43.357 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-04T07:54:43.379 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off
2024-03-04T07:54:47.092 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-04T07:54:47.100 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-04T07:54:47.201 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off
2024-03-04T07:54:47.208 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is off
2024-03-04T07:54:47.302 INFO:teuthology.orchestra.console.smithi027:Power off completed
2024-03-04T07:54:47.309 INFO:teuthology.orchestra.console.smithi063:Power off completed
2024-03-04T07:54:47.380 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-04T07:54:47.403 INFO:teuthology.orchestra.console.smithi027:Power on
2024-03-04T07:54:47.403 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-04T07:54:47.409 INFO:teuthology.orchestra.console.smithi063:Power on
2024-03-04T07:54:47.410 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-04T07:54:47.424 DEBUG:teuthology.orchestra.console.smithi027:power on output: Chassis Power Control: Up/On
2024-03-04T07:54:47.424 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-04T07:54:47.432 DEBUG:teuthology.orchestra.console.smithi063:power on output: Chassis Power Control: Up/On
2024-03-04T07:54:47.432 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-04T07:54:47.445 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off
2024-03-04T07:54:47.451 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is off
2024-03-04T07:54:47.489 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off
2024-03-04T07:54:51.448 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-04T07:54:51.455 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-04T07:54:51.490 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-04T07:54:51.557 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off
2024-03-04T07:54:51.564 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is off
2024-03-04T07:54:51.598 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on
2024-03-04T07:54:51.698 INFO:teuthology.orchestra.console.smithi175:Power on completed
2024-03-04T07:54:51.799 INFO:teuthology.provision.fog.smithi175:Waiting for deploy to finish
2024-03-04T07:54:55.560 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-04T07:54:55.568 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-04T07:54:55.670 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on
2024-03-04T07:54:55.677 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on
2024-03-04T07:54:55.772 INFO:teuthology.orchestra.console.smithi027:Power on completed
2024-03-04T07:54:55.778 INFO:teuthology.orchestra.console.smithi063:Power on completed
2024-03-04T07:54:55.873 INFO:teuthology.provision.fog.smithi027:Waiting for deploy to finish
2024-03-04T07:54:55.879 INFO:teuthology.provision.fog.smithi063:Waiting for deploy to finish
2024-03-04T07:57:22.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-04T07:57:25.724 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-03-04T07:57:31.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-04T07:57:34.812 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-03-04T07:57:40.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-04T07:57:41.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-04T07:57:43.872 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-03-04T07:57:44.764 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2024-03-04T07:57:49.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-04T07:57:50.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-04T07:57:52.956 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-03-04T07:57:53.820 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2024-03-04T07:57:58.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-04T07:57:59.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-04T07:58:02.012 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-03-04T07:58:02.876 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2024-03-04T07:58:08.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-04T07:58:08.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-04T07:58:11.068 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-03-04T07:58:11.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-04T07:58:11.932 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2024-03-04T07:58:14.908 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-03-04T07:58:17.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-04T07:58:17.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-04T07:58:20.160 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-03-04T07:58:20.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-04T07:58:20.992 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2024-03-04T07:58:23.968 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-03-04T07:58:26.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-04T07:58:26.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-04T07:58:29.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-04T07:58:30.048 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2024-03-04T07:58:33.056 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-03-04T07:58:36.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-04T07:58:39.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-04T07:58:39.132 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2024-03-04T07:58:42.112 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-03-04T07:58:45.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-04T07:58:48.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-04T07:58:51.200 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-03-04T07:58:57.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-04T07:59:00.287 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-03-04T07:59:06.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-04T07:59:09.376 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-03-04T07:59:15.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-04T07:59:18.460 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-03-04T07:59:24.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-04T07:59:26.168 WARNING:teuthology.provision.fog.smithi175:timed out
2024-03-04T07:59:27.516 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-03-04T07:59:32.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-04T07:59:32.434 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-04T07:59:32.435 DEBUG:teuthology.orchestra.run.smithi175:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-04T07:59:32.704 INFO:teuthology.provision.fog.smithi175:Node is ready
2024-03-04T07:59:32.704 DEBUG:teuthology.orchestra.run.smithi175:> hostname
2024-03-04T07:59:32.724 INFO:teuthology.orchestra.run.smithi175.stdout:smithi175.front.sepia.ceph.com
2024-03-04T07:59:32.724 DEBUG:teuthology.orchestra.run.smithi175:> grep smithi175.front.sepia.ceph.com /etc/hosts
2024-03-04T07:59:32.785 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.175 smithi175.front.sepia.ceph.com smithi175
2024-03-04T07:59:32.785 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175
2024-03-04T07:59:32.890 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175.front.sepia.ceph.com/smithi175/g' /etc/hosts
2024-03-04T07:59:32.919 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/172.21.15.175/172.21.15.175/g' /etc/hosts
2024-03-04T07:59:32.988 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175.front.sepia.ceph.com/smithi175/g' /etc/hostname
2024-03-04T07:59:33.057 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175
2024-03-04T07:59:33.123 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release
2024-03-04T07:59:33.182 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream"
2024-03-04T07:59:33.182 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="8"
2024-03-04T07:59:33.182 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos"
2024-03-04T07:59:33.182 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora"
2024-03-04T07:59:33.182 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="8"
2024-03-04T07:59:33.182 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el8"
2024-03-04T07:59:33.182 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-04T07:59:33.182 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31"
2024-03-04T07:59:33.182 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-04T07:59:33.183 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/"
2024-03-04T07:59:33.183 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-04T07:59:33.183 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-04T07:59:33.183 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-04T07:59:33.184 INFO:teuthology.provision.fog.smithi175:Deploy complete!
2024-03-04T07:59:33.185 DEBUG:teuthology.parallel:result is None
2024-03-04T07:59:33.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-04T07:59:45.152 WARNING:teuthology.provision.fog.smithi063:timed out
2024-03-04T07:59:51.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-04T07:59:51.377 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-04T07:59:51.377 DEBUG:teuthology.orchestra.run.smithi063:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-04T07:59:51.629 INFO:teuthology.provision.fog.smithi063:Node is ready
2024-03-04T07:59:51.629 DEBUG:teuthology.orchestra.run.smithi063:> hostname
2024-03-04T07:59:51.649 INFO:teuthology.orchestra.run.smithi063.stdout:smithi063.front.sepia.ceph.com
2024-03-04T07:59:51.649 DEBUG:teuthology.orchestra.run.smithi063:> grep smithi063.front.sepia.ceph.com /etc/hosts
2024-03-04T07:59:51.709 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63 smithi063.front.sepia.ceph.com smithi063
2024-03-04T07:59:51.710 DEBUG:teuthology.orchestra.run.smithi063:> sudo hostname smithi063
2024-03-04T07:59:51.812 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i -e 's/smithi063.front.sepia.ceph.com/smithi063/g' /etc/hosts
2024-03-04T07:59:51.841 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i -e 's/172.21.15.63/172.21.15.63/g' /etc/hosts
2024-03-04T07:59:51.911 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i -e 's/smithi063.front.sepia.ceph.com/smithi063/g' /etc/hostname
2024-03-04T07:59:51.980 DEBUG:teuthology.orchestra.run.smithi063:> sudo hostname smithi063
2024-03-04T07:59:52.049 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release
2024-03-04T07:59:52.109 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="CentOS Stream"
2024-03-04T07:59:52.109 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="8"
2024-03-04T07:59:52.109 INFO:teuthology.orchestra.run.smithi063.stdout:ID="centos"
2024-03-04T07:59:52.109 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE="rhel fedora"
2024-03-04T07:59:52.109 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="8"
2024-03-04T07:59:52.109 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM_ID="platform:el8"
2024-03-04T07:59:52.109 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-04T07:59:52.109 INFO:teuthology.orchestra.run.smithi063.stdout:ANSI_COLOR="0;31"
2024-03-04T07:59:52.109 INFO:teuthology.orchestra.run.smithi063.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-04T07:59:52.110 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://centos.org/"
2024-03-04T07:59:52.110 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-04T07:59:52.110 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-04T07:59:52.110 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-04T07:59:52.110 INFO:teuthology.provision.fog.smithi063:Deploy complete!
2024-03-04T07:59:52.111 DEBUG:teuthology.parallel:result is None
2024-03-04T08:00:33.560 WARNING:teuthology.provision.fog.smithi027:timed out
2024-03-04T08:00:39.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-04T08:00:39.795 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-04T08:00:39.796 DEBUG:teuthology.orchestra.run.smithi027:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-04T08:00:40.064 INFO:teuthology.provision.fog.smithi027:Node is ready
2024-03-04T08:00:40.065 DEBUG:teuthology.orchestra.run.smithi027:> hostname
2024-03-04T08:00:40.085 INFO:teuthology.orchestra.run.smithi027.stdout:smithi027.front.sepia.ceph.com
2024-03-04T08:00:40.085 DEBUG:teuthology.orchestra.run.smithi027:> grep smithi027.front.sepia.ceph.com /etc/hosts
2024-03-04T08:00:40.145 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27 smithi027.front.sepia.ceph.com smithi027
2024-03-04T08:00:40.146 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027
2024-03-04T08:00:40.261 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hosts
2024-03-04T08:00:40.292 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/172.21.15.27/172.21.15.27/g' /etc/hosts
2024-03-04T08:00:40.362 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hostname
2024-03-04T08:00:40.432 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027
2024-03-04T08:00:40.501 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release
2024-03-04T08:00:40.562 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="CentOS Stream"
2024-03-04T08:00:40.562 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="8"
2024-03-04T08:00:40.562 INFO:teuthology.orchestra.run.smithi027.stdout:ID="centos"
2024-03-04T08:00:40.562 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="rhel fedora"
2024-03-04T08:00:40.562 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="8"
2024-03-04T08:00:40.562 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el8"
2024-03-04T08:00:40.562 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-04T08:00:40.562 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31"
2024-03-04T08:00:40.562 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-04T08:00:40.562 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://centos.org/"
2024-03-04T08:00:40.562 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-04T08:00:40.563 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-04T08:00:40.563 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-04T08:00:40.563 INFO:teuthology.provision.fog.smithi027:Deploy complete!
2024-03-04T08:00:40.564 DEBUG:teuthology.parallel:result is None
2024-03-04T08:00:40.766 INFO:teuthology.lock.ops:Checking smithi027.front.sepia.ceph.com
2024-03-04T08:00:40.767 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-04T08:00:40.787 INFO:teuthology.lock.ops:Checking smithi063.front.sepia.ceph.com
2024-03-04T08:00:40.787 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-04T08:00:40.811 INFO:teuthology.lock.ops:Checking smithi175.front.sepia.ceph.com
2024-03-04T08:00:40.812 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-04T08:00:40.829 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: set os type and version on server
2024-03-04T08:00:40.829 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com'
2024-03-04T08:00:40.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-04T08:00:40.905 DEBUG:teuthology.orchestra.run.smithi027:> true
2024-03-04T08:00:40.974 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com'
2024-03-04T08:00:40.975 DEBUG:teuthology.orchestra.run.smithi027:> uname -m
2024-03-04T08:00:41.033 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64
2024-03-04T08:00:41.033 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release
2024-03-04T08:00:41.093 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="CentOS Stream"
2024-03-04T08:00:41.093 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="8"
2024-03-04T08:00:41.093 INFO:teuthology.orchestra.run.smithi027.stdout:ID="centos"
2024-03-04T08:00:41.094 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="rhel fedora"
2024-03-04T08:00:41.094 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="8"
2024-03-04T08:00:41.094 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el8"
2024-03-04T08:00:41.094 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-04T08:00:41.094 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31"
2024-03-04T08:00:41.094 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-04T08:00:41.094 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://centos.org/"
2024-03-04T08:00:41.094 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-04T08:00:41.094 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-04T08:00:41.094 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-04T08:00:41.095 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server
2024-03-04T08:00:41.120 INFO:teuthology.lock.ops:Updating [smithi063.front.sepia.ceph.com]: set os type and version on server
2024-03-04T08:00:41.120 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com'
2024-03-04T08:00:41.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-04T08:00:41.233 DEBUG:teuthology.orchestra.run.smithi063:> true
2024-03-04T08:00:41.376 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com'
2024-03-04T08:00:41.376 DEBUG:teuthology.orchestra.run.smithi063:> uname -m
2024-03-04T08:00:41.436 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64
2024-03-04T08:00:41.436 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release
2024-03-04T08:00:41.495 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="CentOS Stream"
2024-03-04T08:00:41.495 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="8"
2024-03-04T08:00:41.496 INFO:teuthology.orchestra.run.smithi063.stdout:ID="centos"
2024-03-04T08:00:41.496 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE="rhel fedora"
2024-03-04T08:00:41.496 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="8"
2024-03-04T08:00:41.496 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM_ID="platform:el8"
2024-03-04T08:00:41.496 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-04T08:00:41.496 INFO:teuthology.orchestra.run.smithi063.stdout:ANSI_COLOR="0;31"
2024-03-04T08:00:41.496 INFO:teuthology.orchestra.run.smithi063.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-04T08:00:41.496 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://centos.org/"
2024-03-04T08:00:41.496 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-04T08:00:41.496 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-04T08:00:41.496 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-04T08:00:41.497 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server
2024-03-04T08:00:41.520 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: set os type and version on server
2024-03-04T08:00:41.520 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com'
2024-03-04T08:00:41.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-04T08:00:41.598 DEBUG:teuthology.orchestra.run.smithi175:> true
2024-03-04T08:00:41.736 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com'
2024-03-04T08:00:41.737 DEBUG:teuthology.orchestra.run.smithi175:> uname -m
2024-03-04T08:00:41.796 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64
2024-03-04T08:00:41.797 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release
2024-03-04T08:00:41.859 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream"
2024-03-04T08:00:41.859 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="8"
2024-03-04T08:00:41.859 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos"
2024-03-04T08:00:41.859 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora"
2024-03-04T08:00:41.859 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="8"
2024-03-04T08:00:41.860 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el8"
2024-03-04T08:00:41.860 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-04T08:00:41.860 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31"
2024-03-04T08:00:41.860 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-04T08:00:41.860 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/"
2024-03-04T08:00:41.860 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-04T08:00:41.860 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-04T08:00:41.860 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-04T08:00:41.861 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server
2024-03-04T08:00:41.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-04T08:00:41.979 INFO:teuthology.dispatcher.supervisor:Running job 7580757
2024-03-04T08:00:41.979 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_leonidus@teuthology --archive /home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580757 --name leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi --description fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} -- /home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580757/orig.config.yaml
2024-03-04T08:00:41.982 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580757
2024-03-04T08:00:41.983 INFO:teuthology.dispatcher.supervisor:Job PID: 2291118
2024-03-04T08:00:41.983 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-04T08:02:42.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-04T08:04:42.234 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-04T08:06:42.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-04T08:08:42.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-04T08:10:42.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-04T08:12:42.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-04T08:14:43.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-04T08:16:43.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-04T08:18:43.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-04T08:20:43.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-04T08:22:43.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-04T08:24:43.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-04T08:26:44.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-04T08:26:44.182 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1