2024-04-14T10:01:38.595 INFO:root:teuthology version: 0.0.1.dev265+gd7d6e60
2024-04-14T10:01:38.596 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-14T10:01:38.760 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f616d7b4f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f616e815c10>, signals=[15])
2024-04-14T10:01:38.760 INFO:teuthology.lock.ops:Start node 'smithi086.front.sepia.ceph.com' reimaging
2024-04-14T10:01:38.761 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: reset os type and version on server
2024-04-14T10:01:38.761 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server
2024-04-14T10:01:38.778 INFO:teuthology.lock.ops:Start node 'smithi176.front.sepia.ceph.com' reimaging
2024-04-14T10:01:38.778 INFO:teuthology.lock.ops:Updating [smithi176.front.sepia.ceph.com]: reset os type and version on server
2024-04-14T10:01:38.778 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server
2024-04-14T10:01:38.805 INFO:teuthology.lock.ops:Start node 'smithi178.front.sepia.ceph.com' reimaging
2024-04-14T10:01:38.805 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: reset os type and version on server
2024-04-14T10:01:38.805 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server
2024-04-14T10:01:38.897 DEBUG:teuthology.provision.fog.smithi086:Requesting image smithi_centos_9.stream (ID 10)
2024-04-14T10:01:38.922 DEBUG:teuthology.provision.fog.smithi176:Requesting image smithi_centos_9.stream (ID 10)
2024-04-14T10:01:38.933 DEBUG:teuthology.provision.fog.smithi178:Requesting image smithi_centos_9.stream (ID 10)
2024-04-14T10:01:38.958 INFO:teuthology.provision.fog.smithi086:Scheduling deploy of centos 9.stream
2024-04-14T10:01:38.963 INFO:teuthology.provision.fog.smithi176:Scheduling deploy of centos 9.stream
2024-04-14T10:01:38.978 INFO:teuthology.provision.fog.smithi178:Scheduling deploy of centos 9.stream
2024-04-14T10:01:39.215 INFO:teuthology.orchestra.console.smithi178:Power off
2024-04-14T10:01:39.216 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-14T10:01:39.232 INFO:teuthology.orchestra.console.smithi086:Power off
2024-04-14T10:01:39.232 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-14T10:01:39.246 INFO:teuthology.orchestra.console.smithi176:Power off
2024-04-14T10:01:39.246 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-14T10:01:39.257 DEBUG:teuthology.orchestra.console.smithi086:power off output: Chassis Power Control: Down/Off
2024-04-14T10:01:39.257 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T10:01:39.267 DEBUG:teuthology.orchestra.console.smithi178:power off output: Chassis Power Control: Down/Off
2024-04-14T10:01:39.267 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T10:01:39.279 DEBUG:teuthology.orchestra.console.smithi176:power off output: Chassis Power Control: Down/Off
2024-04-14T10:01:39.280 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T10:01:39.289 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on
2024-04-14T10:01:39.292 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on
2024-04-14T10:01:39.303 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on
2024-04-14T10:01:43.290 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T10:01:43.298 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T10:01:43.305 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T10:01:43.401 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on
2024-04-14T10:01:43.407 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on
2024-04-14T10:01:43.413 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on
2024-04-14T10:01:47.405 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T10:01:47.413 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T10:01:47.419 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T10:01:47.516 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on
2024-04-14T10:01:47.521 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off
2024-04-14T10:01:47.527 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is off
2024-04-14T10:01:47.622 INFO:teuthology.orchestra.console.smithi178:Power off completed
2024-04-14T10:01:47.628 INFO:teuthology.orchestra.console.smithi176:Power off completed
2024-04-14T10:01:47.723 INFO:teuthology.orchestra.console.smithi178:Power on
2024-04-14T10:01:47.723 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-14T10:01:47.731 INFO:teuthology.orchestra.console.smithi176:Power on
2024-04-14T10:01:47.731 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-14T10:01:47.745 DEBUG:teuthology.orchestra.console.smithi178:power on output: Chassis Power Control: Up/On
2024-04-14T10:01:47.745 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T10:01:47.756 DEBUG:teuthology.orchestra.console.smithi176:power on output: Chassis Power Control: Up/On
2024-04-14T10:01:47.757 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T10:01:47.771 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off
2024-04-14T10:01:47.783 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is off
2024-04-14T10:01:51.519 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T10:01:51.629 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off
2024-04-14T10:01:51.730 INFO:teuthology.orchestra.console.smithi086:Power off completed
2024-04-14T10:01:51.772 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T10:01:51.784 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T10:01:51.830 INFO:teuthology.orchestra.console.smithi086:Power on
2024-04-14T10:01:51.831 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-14T10:01:51.854 DEBUG:teuthology.orchestra.console.smithi086:power on output: Chassis Power Control: Up/On
2024-04-14T10:01:51.855 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T10:01:51.879 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off
2024-04-14T10:01:51.881 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off
2024-04-14T10:01:51.894 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is off
2024-04-14T10:01:55.882 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T10:01:55.891 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T10:01:55.900 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T10:01:55.994 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off
2024-04-14T10:01:56.002 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on
2024-04-14T10:01:56.008 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on
2024-04-14T10:01:56.103 INFO:teuthology.orchestra.console.smithi178:Power on completed
2024-04-14T10:01:56.109 INFO:teuthology.orchestra.console.smithi176:Power on completed
2024-04-14T10:01:56.204 INFO:teuthology.provision.fog.smithi178:Waiting for deploy to finish
2024-04-14T10:01:56.210 INFO:teuthology.provision.fog.smithi176:Waiting for deploy to finish
2024-04-14T10:01:59.998 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T10:02:00.109 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on
2024-04-14T10:02:00.210 INFO:teuthology.orchestra.console.smithi086:Power on completed
2024-04-14T10:02:00.310 INFO:teuthology.provision.fog.smithi086:Waiting for deploy to finish
2024-04-14T10:04:27.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T10:04:30.238 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176
2024-04-14T10:04:31.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T10:04:34.274 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86
2024-04-14T10:04:36.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T10:04:39.294 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176
2024-04-14T10:04:40.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T10:04:42.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T10:04:43.330 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86
2024-04-14T10:04:45.278 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2024-04-14T10:04:45.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T10:04:48.350 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176
2024-04-14T10:04:49.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T10:04:51.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T10:04:52.382 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86
2024-04-14T10:04:54.334 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2024-04-14T10:04:54.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T10:04:57.410 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176
2024-04-14T10:04:58.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T10:05:00.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T10:05:01.438 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86
2024-04-14T10:05:03.390 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2024-04-14T10:05:03.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T10:05:06.462 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176
2024-04-14T10:05:07.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T10:05:09.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T10:05:10.498 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86
2024-04-14T10:05:12.446 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2024-04-14T10:05:12.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T10:05:15.518 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176
2024-04-14T10:05:16.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T10:05:18.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T10:05:19.586 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86
2024-04-14T10:05:21.502 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2024-04-14T10:05:21.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T10:05:25.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T10:05:27.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T10:05:30.558 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2024-04-14T10:05:36.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T10:05:39.618 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2024-04-14T10:05:45.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T10:06:21.555 WARNING:teuthology.provision.fog.smithi176:timed out
2024-04-14T10:06:25.595 WARNING:teuthology.provision.fog.smithi086:timed out
2024-04-14T10:06:27.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T10:06:27.841 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-14T10:06:27.841 DEBUG:teuthology.orchestra.run.smithi176:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-14T10:06:28.182 INFO:teuthology.provision.fog.smithi176:Node is ready
2024-04-14T10:06:28.183 DEBUG:teuthology.orchestra.run.smithi176:> hostname
2024-04-14T10:06:28.197 INFO:teuthology.orchestra.run.smithi176.stdout:smithi176.front.sepia.ceph.com
2024-04-14T10:06:28.198 DEBUG:teuthology.orchestra.run.smithi176:> grep smithi176.front.sepia.ceph.com /etc/hosts
2024-04-14T10:06:28.253 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.15.176 smithi176.front.sepia.ceph.com smithi176
2024-04-14T10:06:28.253 DEBUG:teuthology.orchestra.run.smithi176:> sudo hostname smithi176
2024-04-14T10:06:28.362 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i -e 's/smithi176.front.sepia.ceph.com/smithi176/g' /etc/hosts
2024-04-14T10:06:28.391 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i -e 's/172.21.15.176/172.21.15.176/g' /etc/hosts
2024-04-14T10:06:28.459 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i -e 's/smithi176.front.sepia.ceph.com/smithi176/g' /etc/hostname
2024-04-14T10:06:28.528 DEBUG:teuthology.orchestra.run.smithi176:> sudo hostname smithi176
2024-04-14T10:06:28.596 DEBUG:teuthology.orchestra.run.smithi176:> cat /etc/os-release
2024-04-14T10:06:28.650 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="CentOS Stream"
2024-04-14T10:06:28.650 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="9"
2024-04-14T10:06:28.650 INFO:teuthology.orchestra.run.smithi176.stdout:ID="centos"
2024-04-14T10:06:28.650 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE="rhel fedora"
2024-04-14T10:06:28.651 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="9"
2024-04-14T10:06:28.651 INFO:teuthology.orchestra.run.smithi176.stdout:PLATFORM_ID="platform:el9"
2024-04-14T10:06:28.651 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-14T10:06:28.651 INFO:teuthology.orchestra.run.smithi176.stdout:ANSI_COLOR="0;31"
2024-04-14T10:06:28.651 INFO:teuthology.orchestra.run.smithi176.stdout:LOGO="fedora-logo-icon"
2024-04-14T10:06:28.651 INFO:teuthology.orchestra.run.smithi176.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-14T10:06:28.651 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://centos.org/"
2024-04-14T10:06:28.651 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-14T10:06:28.651 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-14T10:06:28.651 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-14T10:06:28.652 INFO:teuthology.provision.fog.smithi176:Deploy complete!
2024-04-14T10:06:28.653 DEBUG:teuthology.parallel:result is None
2024-04-14T10:06:31.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T10:06:31.842 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-14T10:06:31.842 DEBUG:teuthology.orchestra.run.smithi086:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-14T10:06:32.169 INFO:teuthology.provision.fog.smithi086:Node is ready
2024-04-14T10:06:32.169 DEBUG:teuthology.orchestra.run.smithi086:> hostname
2024-04-14T10:06:32.183 INFO:teuthology.orchestra.run.smithi086.stdout:smithi086.front.sepia.ceph.com
2024-04-14T10:06:32.184 DEBUG:teuthology.orchestra.run.smithi086:> grep smithi086.front.sepia.ceph.com /etc/hosts
2024-04-14T10:06:32.239 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86 smithi086.front.sepia.ceph.com smithi086
2024-04-14T10:06:32.239 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname smithi086
2024-04-14T10:06:32.340 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/smithi086.front.sepia.ceph.com/smithi086/g' /etc/hosts
2024-04-14T10:06:32.367 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/172.21.15.86/172.21.15.86/g' /etc/hosts
2024-04-14T10:06:32.434 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/smithi086.front.sepia.ceph.com/smithi086/g' /etc/hostname
2024-04-14T10:06:32.501 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname smithi086
2024-04-14T10:06:32.567 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release
2024-04-14T10:06:32.622 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="CentOS Stream"
2024-04-14T10:06:32.622 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="9"
2024-04-14T10:06:32.622 INFO:teuthology.orchestra.run.smithi086.stdout:ID="centos"
2024-04-14T10:06:32.622 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="rhel fedora"
2024-04-14T10:06:32.622 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="9"
2024-04-14T10:06:32.622 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el9"
2024-04-14T10:06:32.622 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-14T10:06:32.622 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31"
2024-04-14T10:06:32.623 INFO:teuthology.orchestra.run.smithi086.stdout:LOGO="fedora-logo-icon"
2024-04-14T10:06:32.623 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-14T10:06:32.623 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://centos.org/"
2024-04-14T10:06:32.623 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-14T10:06:32.623 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-14T10:06:32.623 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-14T10:06:32.623 INFO:teuthology.provision.fog.smithi086:Deploy complete!
2024-04-14T10:06:32.624 DEBUG:teuthology.parallel:result is None
2024-04-14T10:06:45.634 WARNING:teuthology.provision.fog.smithi178:timed out
2024-04-14T10:06:51.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T10:06:51.926 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-14T10:06:51.926 DEBUG:teuthology.orchestra.run.smithi178:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-14T10:06:52.265 INFO:teuthology.provision.fog.smithi178:Node is ready
2024-04-14T10:06:52.265 DEBUG:teuthology.orchestra.run.smithi178:> hostname
2024-04-14T10:06:52.279 INFO:teuthology.orchestra.run.smithi178.stdout:smithi178.front.sepia.ceph.com
2024-04-14T10:06:52.280 DEBUG:teuthology.orchestra.run.smithi178:> grep smithi178.front.sepia.ceph.com /etc/hosts
2024-04-14T10:06:52.336 INFO:teuthology.orchestra.run.smithi178.stdout:172.21.15.178 smithi178.front.sepia.ceph.com smithi178
2024-04-14T10:06:52.336 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname smithi178
2024-04-14T10:06:52.451 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/smithi178.front.sepia.ceph.com/smithi178/g' /etc/hosts
2024-04-14T10:06:52.479 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/172.21.15.178/172.21.15.178/g' /etc/hosts
2024-04-14T10:06:52.547 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/smithi178.front.sepia.ceph.com/smithi178/g' /etc/hostname
2024-04-14T10:06:52.614 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname smithi178
2024-04-14T10:06:52.680 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release
2024-04-14T10:06:52.735 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="CentOS Stream"
2024-04-14T10:06:52.736 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="9"
2024-04-14T10:06:52.736 INFO:teuthology.orchestra.run.smithi178.stdout:ID="centos"
2024-04-14T10:06:52.736 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="rhel fedora"
2024-04-14T10:06:52.736 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="9"
2024-04-14T10:06:52.736 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el9"
2024-04-14T10:06:52.736 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-14T10:06:52.736 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31"
2024-04-14T10:06:52.736 INFO:teuthology.orchestra.run.smithi178.stdout:LOGO="fedora-logo-icon"
2024-04-14T10:06:52.736 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-14T10:06:52.736 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://centos.org/"
2024-04-14T10:06:52.736 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-14T10:06:52.736 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-14T10:06:52.736 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-14T10:06:52.737 INFO:teuthology.provision.fog.smithi178:Deploy complete!
2024-04-14T10:06:52.737 DEBUG:teuthology.parallel:result is None
2024-04-14T10:06:52.956 INFO:teuthology.lock.ops:Checking smithi086.front.sepia.ceph.com
2024-04-14T10:06:52.956 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-14T10:06:52.984 INFO:teuthology.lock.ops:Checking smithi176.front.sepia.ceph.com
2024-04-14T10:06:52.984 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-14T10:06:53.009 INFO:teuthology.lock.ops:Checking smithi178.front.sepia.ceph.com
2024-04-14T10:06:53.009 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-14T10:06:53.035 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: set os type and version on server
2024-04-14T10:06:53.036 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com'
2024-04-14T10:06:53.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T10:06:53.124 DEBUG:teuthology.orchestra.run.smithi086:> true
2024-04-14T10:06:53.292 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com'
2024-04-14T10:06:53.292 DEBUG:teuthology.orchestra.run.smithi086:> uname -m
2024-04-14T10:06:53.348 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64
2024-04-14T10:06:53.348 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release
2024-04-14T10:06:53.403 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="CentOS Stream"
2024-04-14T10:06:53.404 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="9"
2024-04-14T10:06:53.404 INFO:teuthology.orchestra.run.smithi086.stdout:ID="centos"
2024-04-14T10:06:53.404 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="rhel fedora"
2024-04-14T10:06:53.404 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="9"
2024-04-14T10:06:53.404 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el9"
2024-04-14T10:06:53.404 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-14T10:06:53.404 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31"
2024-04-14T10:06:53.404 INFO:teuthology.orchestra.run.smithi086.stdout:LOGO="fedora-logo-icon"
2024-04-14T10:06:53.404 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-14T10:06:53.404 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://centos.org/"
2024-04-14T10:06:53.404 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-14T10:06:53.404 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-14T10:06:53.404 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-14T10:06:53.405 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server
2024-04-14T10:06:53.425 INFO:teuthology.lock.ops:Updating [smithi176.front.sepia.ceph.com]: set os type and version on server
2024-04-14T10:06:53.425 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com'
2024-04-14T10:06:53.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T10:06:53.518 DEBUG:teuthology.orchestra.run.smithi176:> true
2024-04-14T10:06:53.689 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi176.front.sepia.ceph.com'
2024-04-14T10:06:53.689 DEBUG:teuthology.orchestra.run.smithi176:> uname -m
2024-04-14T10:06:53.744 INFO:teuthology.orchestra.run.smithi176.stdout:x86_64
2024-04-14T10:06:53.745 DEBUG:teuthology.orchestra.run.smithi176:> cat /etc/os-release
2024-04-14T10:06:53.800 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="CentOS Stream"
2024-04-14T10:06:53.800 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="9"
2024-04-14T10:06:53.801 INFO:teuthology.orchestra.run.smithi176.stdout:ID="centos"
2024-04-14T10:06:53.801 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE="rhel fedora"
2024-04-14T10:06:53.801 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="9"
2024-04-14T10:06:53.801 INFO:teuthology.orchestra.run.smithi176.stdout:PLATFORM_ID="platform:el9"
2024-04-14T10:06:53.801 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-14T10:06:53.801 INFO:teuthology.orchestra.run.smithi176.stdout:ANSI_COLOR="0;31"
2024-04-14T10:06:53.801 INFO:teuthology.orchestra.run.smithi176.stdout:LOGO="fedora-logo-icon"
2024-04-14T10:06:53.802 INFO:teuthology.orchestra.run.smithi176.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-14T10:06:53.802 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://centos.org/"
2024-04-14T10:06:53.802 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-14T10:06:53.802 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-14T10:06:53.802 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-14T10:06:53.803 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server
2024-04-14T10:06:53.825 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: set os type and version on server
2024-04-14T10:06:53.826 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com'
2024-04-14T10:06:53.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T10:06:53.919 DEBUG:teuthology.orchestra.run.smithi178:> true
2024-04-14T10:06:53.945 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com'
2024-04-14T10:06:53.946 DEBUG:teuthology.orchestra.run.smithi178:> uname -m
2024-04-14T10:06:54.002 INFO:teuthology.orchestra.run.smithi178.stdout:x86_64
2024-04-14T10:06:54.003 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release
2024-04-14T10:06:54.059 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="CentOS Stream"
2024-04-14T10:06:54.060 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="9"
2024-04-14T10:06:54.060 INFO:teuthology.orchestra.run.smithi178.stdout:ID="centos"
2024-04-14T10:06:54.060 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="rhel fedora"
2024-04-14T10:06:54.060 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="9"
2024-04-14T10:06:54.060 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el9"
2024-04-14T10:06:54.060 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-14T10:06:54.060 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31"
2024-04-14T10:06:54.060 INFO:teuthology.orchestra.run.smithi178.stdout:LOGO="fedora-logo-icon"
2024-04-14T10:06:54.060 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-14T10:06:54.060 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://centos.org/"
2024-04-14T10:06:54.060 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-14T10:06:54.060 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-14T10:06:54.060 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-14T10:06:54.061 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server
2024-04-14T10:06:54.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-14T10:06:54.175 INFO:teuthology.dispatcher.supervisor:Running job 7638538
2024-04-14T10:06:54.175 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638538 --name teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/fs/test_o_trunc}} -- /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638538/orig.config.yaml
2024-04-14T10:06:54.178 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638538
2024-04-14T10:06:54.178 INFO:teuthology.dispatcher.supervisor:Job PID: 2733933
2024-04-14T10:06:54.178 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-14T10:08:54.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-14T10:10:54.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-14T10:12:54.586 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-14T10:14:54.752 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-14T10:16:54.930 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-14T10:18:55.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-14T10:20:55.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-14T10:20:55.335 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1