2024-03-07T19:24:10.049 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-07T19:24:10.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:24:10.221 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fd5ad5edf40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fd5ae54ec10>, signals=[15])
2024-03-07T19:24:10.222 INFO:teuthology.lock.ops:Start node 'smithi044.front.sepia.ceph.com' reimaging
2024-03-07T19:24:10.222 INFO:teuthology.lock.ops:Updating [smithi044.front.sepia.ceph.com]: reset os type and version on server
2024-03-07T19:24:10.222 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server
2024-03-07T19:24:10.259 INFO:teuthology.lock.ops:Start node 'smithi120.front.sepia.ceph.com' reimaging
2024-03-07T19:24:10.259 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: reset os type and version on server
2024-03-07T19:24:10.260 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server
2024-03-07T19:24:10.275 INFO:teuthology.lock.ops:Start node 'smithi145.front.sepia.ceph.com' reimaging
2024-03-07T19:24:10.275 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: reset os type and version on server
2024-03-07T19:24:10.275 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server
2024-03-07T19:24:10.383 DEBUG:teuthology.provision.fog.smithi044:Requesting image smithi_centos_9.stream (ID 10)
2024-03-07T19:24:10.408 DEBUG:teuthology.provision.fog.smithi145:Requesting image smithi_centos_9.stream (ID 10)
2024-03-07T19:24:10.419 DEBUG:teuthology.provision.fog.smithi120:Requesting image smithi_centos_9.stream (ID 10)
2024-03-07T19:24:10.436 INFO:teuthology.provision.fog.smithi044:Scheduling deploy of centos 9.stream
2024-03-07T19:24:10.449 INFO:teuthology.provision.fog.smithi145:Scheduling deploy of centos 9.stream
2024-03-07T19:24:10.462 INFO:teuthology.provision.fog.smithi120:Scheduling deploy of centos 9.stream
2024-03-07T19:24:10.692 INFO:teuthology.orchestra.console.smithi145:Power off
2024-03-07T19:24:10.692 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-07T19:24:10.718 INFO:teuthology.orchestra.console.smithi044:Power off
2024-03-07T19:24:10.718 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-07T19:24:10.739 INFO:teuthology.orchestra.console.smithi120:Power off
2024-03-07T19:24:10.739 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-07T19:24:10.746 DEBUG:teuthology.orchestra.console.smithi145:power off output: Chassis Power Control: Down/Off
2024-03-07T19:24:10.747 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T19:24:10.756 DEBUG:teuthology.orchestra.console.smithi044:power off output: Chassis Power Control: Down/Off
2024-03-07T19:24:10.757 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T19:24:10.771 DEBUG:teuthology.orchestra.console.smithi120:power off output: Chassis Power Control: Down/Off
2024-03-07T19:24:10.772 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T19:24:10.785 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on
2024-03-07T19:24:10.786 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on
2024-03-07T19:24:10.804 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on
2024-03-07T19:24:14.790 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T19:24:14.798 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T19:24:14.808 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T19:24:14.900 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on
2024-03-07T19:24:14.910 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on
2024-03-07T19:24:14.919 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on
2024-03-07T19:24:18.905 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T19:24:18.914 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T19:24:18.921 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T19:24:19.016 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off
2024-03-07T19:24:19.023 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off
2024-03-07T19:24:19.031 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off
2024-03-07T19:24:19.117 INFO:teuthology.orchestra.console.smithi044:Power off completed
2024-03-07T19:24:19.124 INFO:teuthology.orchestra.console.smithi145:Power off completed
2024-03-07T19:24:19.132 INFO:teuthology.orchestra.console.smithi120:Power off completed
2024-03-07T19:24:19.219 INFO:teuthology.orchestra.console.smithi044:Power on
2024-03-07T19:24:19.219 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-07T19:24:19.228 INFO:teuthology.orchestra.console.smithi145:Power on
2024-03-07T19:24:19.229 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-07T19:24:19.236 INFO:teuthology.orchestra.console.smithi120:Power on
2024-03-07T19:24:19.236 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-07T19:24:19.246 DEBUG:teuthology.orchestra.console.smithi044:power on output: Chassis Power Control: Up/On
2024-03-07T19:24:19.247 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T19:24:19.256 DEBUG:teuthology.orchestra.console.smithi145:power on output: Chassis Power Control: Up/On
2024-03-07T19:24:19.257 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T19:24:19.267 DEBUG:teuthology.orchestra.console.smithi120:power on output: Chassis Power Control: Up/On
2024-03-07T19:24:19.267 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T19:24:19.281 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off
2024-03-07T19:24:19.282 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off
2024-03-07T19:24:19.292 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off
2024-03-07T19:24:23.285 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T19:24:23.292 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T19:24:23.298 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T19:24:23.394 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off
2024-03-07T19:24:23.400 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off
2024-03-07T19:24:23.407 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on
2024-03-07T19:24:23.507 INFO:teuthology.orchestra.console.smithi120:Power on completed
2024-03-07T19:24:23.608 INFO:teuthology.provision.fog.smithi120:Waiting for deploy to finish
2024-03-07T19:24:27.398 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T19:24:27.406 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T19:24:27.508 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on
2024-03-07T19:24:27.514 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on
2024-03-07T19:24:27.610 INFO:teuthology.orchestra.console.smithi145:Power on completed
2024-03-07T19:24:27.615 INFO:teuthology.orchestra.console.smithi044:Power on completed
2024-03-07T19:24:27.713 INFO:teuthology.provision.fog.smithi145:Waiting for deploy to finish
2024-03-07T19:24:27.717 INFO:teuthology.provision.fog.smithi044:Waiting for deploy to finish
2024-03-07T19:26:59.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:27:02.174 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44
2024-03-07T19:27:08.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:27:11.266 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44
2024-03-07T19:27:17.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:27:20.350 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44
2024-03-07T19:27:26.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:27:29.406 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44
2024-03-07T19:27:35.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:27:38.494 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44
2024-03-07T19:27:44.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:28:25.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:28:28.574 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2024-03-07T19:28:29.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:28:32.670 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145
2024-03-07T19:28:34.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:28:37.630 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2024-03-07T19:28:38.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:28:41.726 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145
2024-03-07T19:28:43.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:28:44.500 WARNING:teuthology.provision.fog.smithi044:timed out
2024-03-07T19:28:46.686 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2024-03-07T19:28:47.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:28:50.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:28:50.757 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-07T19:28:50.758 DEBUG:teuthology.orchestra.run.smithi044:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-07T19:28:50.782 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145
2024-03-07T19:28:51.094 INFO:teuthology.provision.fog.smithi044:Node is ready
2024-03-07T19:28:51.095 DEBUG:teuthology.orchestra.run.smithi044:> hostname
2024-03-07T19:28:51.110 INFO:teuthology.orchestra.run.smithi044.stdout:smithi044.front.sepia.ceph.com
2024-03-07T19:28:51.110 DEBUG:teuthology.orchestra.run.smithi044:> grep smithi044.front.sepia.ceph.com /etc/hosts
2024-03-07T19:28:51.165 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44 smithi044.front.sepia.ceph.com smithi044
2024-03-07T19:28:51.166 DEBUG:teuthology.orchestra.run.smithi044:> sudo hostname smithi044
2024-03-07T19:28:51.286 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/smithi044.front.sepia.ceph.com/smithi044/g' /etc/hosts
2024-03-07T19:28:51.318 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/172.21.15.44/172.21.15.44/g' /etc/hosts
2024-03-07T19:28:51.389 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/smithi044.front.sepia.ceph.com/smithi044/g' /etc/hostname
2024-03-07T19:28:51.460 DEBUG:teuthology.orchestra.run.smithi044:> sudo hostname smithi044
2024-03-07T19:28:51.530 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release
2024-03-07T19:28:51.585 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="CentOS Stream"
2024-03-07T19:28:51.585 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="9"
2024-03-07T19:28:51.585 INFO:teuthology.orchestra.run.smithi044.stdout:ID="centos"
2024-03-07T19:28:51.585 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE="rhel fedora"
2024-03-07T19:28:51.586 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="9"
2024-03-07T19:28:51.586 INFO:teuthology.orchestra.run.smithi044.stdout:PLATFORM_ID="platform:el9"
2024-03-07T19:28:51.586 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-07T19:28:51.586 INFO:teuthology.orchestra.run.smithi044.stdout:ANSI_COLOR="0;31"
2024-03-07T19:28:51.586 INFO:teuthology.orchestra.run.smithi044.stdout:LOGO="fedora-logo-icon"
2024-03-07T19:28:51.586 INFO:teuthology.orchestra.run.smithi044.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-07T19:28:51.586 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://centos.org/"
2024-03-07T19:28:51.586 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-07T19:28:51.586 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-07T19:28:51.586 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-07T19:28:51.587 INFO:teuthology.provision.fog.smithi044:Deploy complete!
2024-03-07T19:28:51.588 DEBUG:teuthology.parallel:result is None
2024-03-07T19:28:52.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:28:55.742 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2024-03-07T19:28:56.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:28:59.838 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145
2024-03-07T19:29:01.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:29:04.798 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2024-03-07T19:29:05.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:29:08.898 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145
2024-03-07T19:29:10.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:29:13.854 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2024-03-07T19:29:14.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:29:19.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:29:38.334 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2024-03-07T19:29:44.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:29:47.394 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2024-03-07T19:29:53.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:29:56.482 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2024-03-07T19:30:02.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:30:02.848 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-07T19:30:02.848 DEBUG:teuthology.orchestra.run.smithi120:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-07T19:30:14.904 WARNING:teuthology.provision.fog.smithi145:timed out
2024-03-07T19:30:18.298 INFO:teuthology.provision.fog.smithi120:Node is ready
2024-03-07T19:30:18.298 DEBUG:teuthology.orchestra.run.smithi120:> hostname
2024-03-07T19:30:18.356 INFO:teuthology.orchestra.run.smithi120.stdout:smithi120.front.sepia.ceph.com
2024-03-07T19:30:18.356 DEBUG:teuthology.orchestra.run.smithi120:> grep smithi120.front.sepia.ceph.com /etc/hosts
2024-03-07T19:30:18.414 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120 smithi120.front.sepia.ceph.com smithi120
2024-03-07T19:30:18.414 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname smithi120
2024-03-07T19:30:18.526 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/smithi120.front.sepia.ceph.com/smithi120/g' /etc/hosts
2024-03-07T19:30:18.558 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/172.21.15.120/172.21.15.120/g' /etc/hosts
2024-03-07T19:30:18.628 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/smithi120.front.sepia.ceph.com/smithi120/g' /etc/hostname
2024-03-07T19:30:18.697 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname smithi120
2024-03-07T19:30:18.764 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release
2024-03-07T19:30:18.819 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="CentOS Stream"
2024-03-07T19:30:18.819 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="9"
2024-03-07T19:30:18.819 INFO:teuthology.orchestra.run.smithi120.stdout:ID="centos"
2024-03-07T19:30:18.820 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="rhel fedora"
2024-03-07T19:30:18.820 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="9"
2024-03-07T19:30:18.820 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el9"
2024-03-07T19:30:18.820 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-07T19:30:18.820 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31"
2024-03-07T19:30:18.820 INFO:teuthology.orchestra.run.smithi120.stdout:LOGO="fedora-logo-icon"
2024-03-07T19:30:18.820 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-07T19:30:18.820 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://centos.org/"
2024-03-07T19:30:18.820 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-07T19:30:18.820 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-07T19:30:18.820 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-07T19:30:18.821 INFO:teuthology.provision.fog.smithi120:Deploy complete!
2024-03-07T19:30:18.821 DEBUG:teuthology.parallel:result is None
2024-03-07T19:30:20.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:30:21.114 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-07T19:30:21.114 DEBUG:teuthology.orchestra.run.smithi145:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-07T19:30:21.458 INFO:teuthology.provision.fog.smithi145:Node is ready
2024-03-07T19:30:21.458 DEBUG:teuthology.orchestra.run.smithi145:> hostname
2024-03-07T19:30:21.473 INFO:teuthology.orchestra.run.smithi145.stdout:smithi145.front.sepia.ceph.com
2024-03-07T19:30:21.473 DEBUG:teuthology.orchestra.run.smithi145:> grep smithi145.front.sepia.ceph.com /etc/hosts
2024-03-07T19:30:21.528 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.15.145 smithi145.front.sepia.ceph.com smithi145
2024-03-07T19:30:21.529 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145
2024-03-07T19:30:21.642 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145.front.sepia.ceph.com/smithi145/g' /etc/hosts
2024-03-07T19:30:21.670 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/172.21.15.145/172.21.15.145/g' /etc/hosts
2024-03-07T19:30:21.738 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145.front.sepia.ceph.com/smithi145/g' /etc/hostname
2024-03-07T19:30:21.805 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145
2024-03-07T19:30:21.871 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release
2024-03-07T19:30:21.926 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="CentOS Stream"
2024-03-07T19:30:21.926 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="9"
2024-03-07T19:30:21.926 INFO:teuthology.orchestra.run.smithi145.stdout:ID="centos"
2024-03-07T19:30:21.927 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="rhel fedora"
2024-03-07T19:30:21.927 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="9"
2024-03-07T19:30:21.927 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el9"
2024-03-07T19:30:21.927 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-07T19:30:21.927 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31"
2024-03-07T19:30:21.927 INFO:teuthology.orchestra.run.smithi145.stdout:LOGO="fedora-logo-icon"
2024-03-07T19:30:21.927 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-07T19:30:21.927 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://centos.org/"
2024-03-07T19:30:21.927 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-07T19:30:21.927 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-07T19:30:21.927 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-07T19:30:21.927 INFO:teuthology.provision.fog.smithi145:Deploy complete!
2024-03-07T19:30:21.928 DEBUG:teuthology.parallel:result is None
2024-03-07T19:30:22.146 INFO:teuthology.lock.ops:Checking smithi044.front.sepia.ceph.com
2024-03-07T19:30:22.147 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-07T19:30:22.170 INFO:teuthology.lock.ops:Checking smithi120.front.sepia.ceph.com
2024-03-07T19:30:22.170 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-07T19:30:22.186 INFO:teuthology.lock.ops:Checking smithi145.front.sepia.ceph.com
2024-03-07T19:30:22.186 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-07T19:30:22.203 INFO:teuthology.lock.ops:Updating [smithi044.front.sepia.ceph.com]: set os type and version on server
2024-03-07T19:30:22.204 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com'
2024-03-07T19:30:22.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:30:22.306 DEBUG:teuthology.orchestra.run.smithi044:> true
2024-03-07T19:30:22.489 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com'
2024-03-07T19:30:22.489 DEBUG:teuthology.orchestra.run.smithi044:> uname -m
2024-03-07T19:30:22.544 INFO:teuthology.orchestra.run.smithi044.stdout:x86_64
2024-03-07T19:30:22.545 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release
2024-03-07T19:30:22.599 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="CentOS Stream"
2024-03-07T19:30:22.599 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="9"
2024-03-07T19:30:22.599 INFO:teuthology.orchestra.run.smithi044.stdout:ID="centos"
2024-03-07T19:30:22.599 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE="rhel fedora"
2024-03-07T19:30:22.599 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="9"
2024-03-07T19:30:22.599 INFO:teuthology.orchestra.run.smithi044.stdout:PLATFORM_ID="platform:el9"
2024-03-07T19:30:22.599 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-07T19:30:22.599 INFO:teuthology.orchestra.run.smithi044.stdout:ANSI_COLOR="0;31"
2024-03-07T19:30:22.600 INFO:teuthology.orchestra.run.smithi044.stdout:LOGO="fedora-logo-icon"
2024-03-07T19:30:22.600 INFO:teuthology.orchestra.run.smithi044.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-07T19:30:22.600 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://centos.org/"
2024-03-07T19:30:22.600 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-07T19:30:22.600 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-07T19:30:22.600 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-07T19:30:22.600 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server
2024-03-07T19:30:22.619 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: set os type and version on server
2024-03-07T19:30:22.619 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com'
2024-03-07T19:30:22.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:30:22.707 DEBUG:teuthology.orchestra.run.smithi120:> true
2024-03-07T19:30:22.775 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com'
2024-03-07T19:30:22.775 DEBUG:teuthology.orchestra.run.smithi120:> uname -m
2024-03-07T19:30:22.831 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64
2024-03-07T19:30:22.832 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release
2024-03-07T19:30:22.887 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="CentOS Stream"
2024-03-07T19:30:22.887 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="9"
2024-03-07T19:30:22.887 INFO:teuthology.orchestra.run.smithi120.stdout:ID="centos"
2024-03-07T19:30:22.887 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="rhel fedora"
2024-03-07T19:30:22.887 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="9"
2024-03-07T19:30:22.887 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el9"
2024-03-07T19:30:22.887 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-07T19:30:22.888 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31"
2024-03-07T19:30:22.888 INFO:teuthology.orchestra.run.smithi120.stdout:LOGO="fedora-logo-icon"
2024-03-07T19:30:22.888 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-07T19:30:22.888 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://centos.org/"
2024-03-07T19:30:22.888 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-07T19:30:22.888 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-07T19:30:22.888 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-07T19:30:22.888 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server
2024-03-07T19:30:22.911 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: set os type and version on server
2024-03-07T19:30:22.911 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com'
2024-03-07T19:30:22.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:30:23.000 DEBUG:teuthology.orchestra.run.smithi145:> true
2024-03-07T19:30:23.069 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com'
2024-03-07T19:30:23.070 DEBUG:teuthology.orchestra.run.smithi145:> uname -m
2024-03-07T19:30:23.125 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64
2024-03-07T19:30:23.126 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release
2024-03-07T19:30:23.181 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="CentOS Stream"
2024-03-07T19:30:23.182 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="9"
2024-03-07T19:30:23.182 INFO:teuthology.orchestra.run.smithi145.stdout:ID="centos"
2024-03-07T19:30:23.182 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="rhel fedora"
2024-03-07T19:30:23.182 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="9"
2024-03-07T19:30:23.182 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el9"
2024-03-07T19:30:23.182 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-07T19:30:23.182 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31"
2024-03-07T19:30:23.182 INFO:teuthology.orchestra.run.smithi145.stdout:LOGO="fedora-logo-icon"
2024-03-07T19:30:23.182 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-07T19:30:23.182 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://centos.org/"
2024-03-07T19:30:23.183 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-07T19:30:23.183 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-07T19:30:23.183 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-07T19:30:23.183 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server
2024-03-07T19:30:23.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:30:23.296 INFO:teuthology.dispatcher.supervisor:Running job 7584522
2024-03-07T19:30:23.296 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-03-07_10:41:12-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7584522 --name vshankar-2024-03-07_10:41:12-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/fsx}} -- /home/teuthworker/archive/vshankar-2024-03-07_10:41:12-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7584522/orig.config.yaml
2024-03-07T19:30:23.299 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-03-07_10:41:12-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7584522
2024-03-07T19:30:23.300 INFO:teuthology.dispatcher.supervisor:Job PID: 824209
2024-03-07T19:30:23.300 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-07T19:32:23.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:34:23.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:36:23.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:38:23.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:40:24.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:42:24.244 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:44:24.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:46:24.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:48:24.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:50:24.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:52:25.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:54:25.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:56:25.542 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:58:25.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:58:25.783 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1