2024-03-28T16:41:55.815 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-28T16:41:55.816 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T16:41:55.997 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f8ee0f68f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f8ee1fc9c10>, signals=[15])
2024-03-28T16:41:55.997 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging
2024-03-28T16:41:55.998 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server
2024-03-28T16:41:55.998 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server
2024-03-28T16:41:56.022 INFO:teuthology.lock.ops:Start node 'smithi123.front.sepia.ceph.com' reimaging
2024-03-28T16:41:56.022 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: reset os type and version on server
2024-03-28T16:41:56.022 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server
2024-03-28T16:41:56.046 INFO:teuthology.lock.ops:Start node 'smithi142.front.sepia.ceph.com' reimaging
2024-03-28T16:41:56.046 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: reset os type and version on server
2024-03-28T16:41:56.047 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server
2024-03-28T16:41:56.138 DEBUG:teuthology.provision.fog.smithi099:Requesting image smithi_centos_9.stream (ID 10)
2024-03-28T16:41:56.152 DEBUG:teuthology.provision.fog.smithi123:Requesting image smithi_centos_9.stream (ID 10)
2024-03-28T16:41:56.179 DEBUG:teuthology.provision.fog.smithi142:Requesting image smithi_centos_9.stream (ID 10)
2024-03-28T16:41:56.183 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of centos 9.stream
2024-03-28T16:41:56.188 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of centos 9.stream
2024-03-28T16:41:56.225 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of centos 9.stream
2024-03-28T16:41:56.399 INFO:teuthology.orchestra.console.smithi099:Power off
2024-03-28T16:41:56.399 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-28T16:41:56.420 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off
2024-03-28T16:41:56.420 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T16:41:56.435 INFO:teuthology.orchestra.console.smithi123:Power off
2024-03-28T16:41:56.435 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-28T16:41:56.448 INFO:teuthology.orchestra.console.smithi142:Power off
2024-03-28T16:41:56.448 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-28T16:41:56.455 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on
2024-03-28T16:41:56.455 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off
2024-03-28T16:41:56.456 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T16:41:56.477 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on
2024-03-28T16:41:56.489 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off
2024-03-28T16:41:56.489 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T16:41:56.515 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on
2024-03-28T16:42:00.460 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T16:42:00.479 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T16:42:00.516 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T16:42:00.569 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on
2024-03-28T16:42:00.587 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on
2024-03-28T16:42:00.624 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on
2024-03-28T16:42:04.574 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T16:42:04.588 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T16:42:04.625 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T16:42:04.683 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2024-03-28T16:42:04.698 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off
2024-03-28T16:42:04.734 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on
2024-03-28T16:42:04.784 INFO:teuthology.orchestra.console.smithi099:Power off completed
2024-03-28T16:42:04.799 INFO:teuthology.orchestra.console.smithi123:Power off completed
2024-03-28T16:42:04.885 INFO:teuthology.orchestra.console.smithi099:Power on
2024-03-28T16:42:04.885 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-28T16:42:04.899 INFO:teuthology.orchestra.console.smithi123:Power on
2024-03-28T16:42:04.900 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-28T16:42:04.908 DEBUG:teuthology.orchestra.console.smithi099:power on output: Chassis Power Control: Up/On
2024-03-28T16:42:04.908 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T16:42:04.921 DEBUG:teuthology.orchestra.console.smithi123:power on output: Chassis Power Control: Up/On
2024-03-28T16:42:04.921 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T16:42:04.930 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2024-03-28T16:42:04.941 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off
2024-03-28T16:42:08.738 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T16:42:08.847 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off
2024-03-28T16:42:08.932 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T16:42:08.942 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T16:42:08.951 INFO:teuthology.orchestra.console.smithi142:Power off completed
2024-03-28T16:42:09.043 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2024-03-28T16:42:09.053 INFO:teuthology.orchestra.console.smithi142:Power on
2024-03-28T16:42:09.053 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-28T16:42:09.062 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off
2024-03-28T16:42:09.077 DEBUG:teuthology.orchestra.console.smithi142:power on output: Chassis Power Control: Up/On
2024-03-28T16:42:09.077 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T16:42:09.100 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off
2024-03-28T16:42:13.048 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T16:42:13.063 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T16:42:13.101 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T16:42:13.157 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on
2024-03-28T16:42:13.172 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on
2024-03-28T16:42:13.210 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on
2024-03-28T16:42:13.257 INFO:teuthology.orchestra.console.smithi099:Power on completed
2024-03-28T16:42:13.273 INFO:teuthology.orchestra.console.smithi123:Power on completed
2024-03-28T16:42:13.311 INFO:teuthology.orchestra.console.smithi142:Power on completed
2024-03-28T16:42:13.358 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish
2024-03-28T16:42:13.374 INFO:teuthology.provision.fog.smithi123:Waiting for deploy to finish
2024-03-28T16:42:13.412 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish
2024-03-28T16:44:44.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:44:47.326 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2024-03-28T16:44:53.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:44:56.414 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2024-03-28T16:44:59.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:44:59.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:45:02.402 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-03-28T16:45:02.403 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2024-03-28T16:45:02.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:45:05.470 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2024-03-28T16:45:08.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:45:08.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:45:11.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:45:11.486 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-03-28T16:45:11.486 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2024-03-28T16:45:14.530 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2024-03-28T16:45:17.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:45:17.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:45:20.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:45:20.546 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-03-28T16:45:20.546 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2024-03-28T16:45:23.614 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2024-03-28T16:45:26.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:45:26.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:45:29.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:45:29.630 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-03-28T16:45:29.630 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2024-03-28T16:45:32.670 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2024-03-28T16:45:35.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:45:35.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:45:38.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:45:38.686 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2024-03-28T16:45:38.686 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-03-28T16:45:41.726 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2024-03-28T16:45:44.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:45:44.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:45:47.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:45:47.742 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2024-03-28T16:45:53.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:45:57.922 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2024-03-28T16:46:03.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:46:07.006 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2024-03-28T16:46:12.254 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2024-03-28T16:46:13.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:46:16.062 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2024-03-28T16:46:18.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:46:21.314 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2024-03-28T16:46:22.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:46:22.875 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-28T16:46:22.875 DEBUG:teuthology.orchestra.run.smithi123:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-28T16:46:27.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:46:30.366 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2024-03-28T16:46:36.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:46:36.631 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-28T16:46:36.631 DEBUG:teuthology.orchestra.run.smithi099:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-28T16:46:43.276 INFO:teuthology.provision.fog.smithi123:Node is ready
2024-03-28T16:46:43.276 DEBUG:teuthology.orchestra.run.smithi123:> hostname
2024-03-28T16:46:43.335 INFO:teuthology.orchestra.run.smithi123.stdout:smithi046
2024-03-28T16:46:43.335 DEBUG:teuthology.orchestra.run.smithi123:> grep smithi046 /etc/hosts
2024-03-28T16:46:43.393 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046
2024-03-28T16:46:43.393 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123
2024-03-28T16:46:43.581 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi046/smithi123/g' /etc/hosts
2024-03-28T16:46:43.612 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/172.21.15.46/172.21.15.123/g' /etc/hosts
2024-03-28T16:46:43.684 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi046/smithi123/g' /etc/hostname
2024-03-28T16:46:43.757 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123
2024-03-28T16:46:43.829 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release
2024-03-28T16:46:43.886 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="CentOS Stream"
2024-03-28T16:46:43.886 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="9"
2024-03-28T16:46:43.886 INFO:teuthology.orchestra.run.smithi123.stdout:ID="centos"
2024-03-28T16:46:43.886 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="rhel fedora"
2024-03-28T16:46:43.886 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="9"
2024-03-28T16:46:43.886 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el9"
2024-03-28T16:46:43.886 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-28T16:46:43.886 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31"
2024-03-28T16:46:43.886 INFO:teuthology.orchestra.run.smithi123.stdout:LOGO="fedora-logo-icon"
2024-03-28T16:46:43.886 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-28T16:46:43.886 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://centos.org/"
2024-03-28T16:46:43.886 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-28T16:46:43.887 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-28T16:46:43.887 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-28T16:46:43.887 INFO:teuthology.provision.fog.smithi123:Deploy complete!
2024-03-28T16:46:43.889 DEBUG:teuthology.parallel:result is None
2024-03-28T16:46:44.694 WARNING:teuthology.provision.fog.smithi142:timed out
2024-03-28T16:46:50.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:46:50.990 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-28T16:46:50.990 DEBUG:teuthology.orchestra.run.smithi142:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-28T16:46:51.318 INFO:teuthology.provision.fog.smithi142:Node is ready
2024-03-28T16:46:51.318 DEBUG:teuthology.orchestra.run.smithi142:> hostname
2024-03-28T16:46:51.332 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142.front.sepia.ceph.com
2024-03-28T16:46:51.332 DEBUG:teuthology.orchestra.run.smithi142:> grep smithi142.front.sepia.ceph.com /etc/hosts
2024-03-28T16:46:51.387 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142
2024-03-28T16:46:51.388 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142
2024-03-28T16:46:51.494 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hosts
2024-03-28T16:46:51.521 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/172.21.15.142/172.21.15.142/g' /etc/hosts
2024-03-28T16:46:51.588 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hostname
2024-03-28T16:46:51.655 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142
2024-03-28T16:46:51.721 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release
2024-03-28T16:46:51.775 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream"
2024-03-28T16:46:51.776 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="9"
2024-03-28T16:46:51.776 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos"
2024-03-28T16:46:51.776 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora"
2024-03-28T16:46:51.776 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="9"
2024-03-28T16:46:51.776 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el9"
2024-03-28T16:46:51.776 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-28T16:46:51.776 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31"
2024-03-28T16:46:51.776 INFO:teuthology.orchestra.run.smithi142.stdout:LOGO="fedora-logo-icon"
2024-03-28T16:46:51.776 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-28T16:46:51.776 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/"
2024-03-28T16:46:51.776 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-28T16:46:51.776 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-28T16:46:51.776 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-28T16:46:51.777 INFO:teuthology.provision.fog.smithi142:Deploy complete!
2024-03-28T16:46:51.777 DEBUG:teuthology.parallel:result is None
2024-03-28T16:46:52.062 INFO:teuthology.provision.fog.smithi099:Node is ready
2024-03-28T16:46:52.063 DEBUG:teuthology.orchestra.run.smithi099:> hostname
2024-03-28T16:46:52.081 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com
2024-03-28T16:46:52.081 DEBUG:teuthology.orchestra.run.smithi099:> grep smithi099.front.sepia.ceph.com /etc/hosts
2024-03-28T16:46:52.138 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099
2024-03-28T16:46:52.139 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099
2024-03-28T16:46:52.247 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hosts
2024-03-28T16:46:52.277 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/172.21.15.99/172.21.15.99/g' /etc/hosts
2024-03-28T16:46:52.346 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hostname
2024-03-28T16:46:52.415 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099
2024-03-28T16:46:52.483 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release
2024-03-28T16:46:52.539 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream"
2024-03-28T16:46:52.539 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="9"
2024-03-28T16:46:52.539 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos"
2024-03-28T16:46:52.539 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora"
2024-03-28T16:46:52.539 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="9"
2024-03-28T16:46:52.539 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el9"
2024-03-28T16:46:52.539 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-28T16:46:52.539 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31"
2024-03-28T16:46:52.539 INFO:teuthology.orchestra.run.smithi099.stdout:LOGO="fedora-logo-icon"
2024-03-28T16:46:52.539 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-28T16:46:52.540 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/"
2024-03-28T16:46:52.540 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-28T16:46:52.540 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-28T16:46:52.540 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-28T16:46:52.540 INFO:teuthology.provision.fog.smithi099:Deploy complete!
2024-03-28T16:46:52.540 DEBUG:teuthology.parallel:result is None
2024-03-28T16:46:52.762 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com
2024-03-28T16:46:52.763 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-28T16:46:52.786 INFO:teuthology.lock.ops:Checking smithi123.front.sepia.ceph.com
2024-03-28T16:46:52.787 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-28T16:46:52.803 INFO:teuthology.lock.ops:Checking smithi142.front.sepia.ceph.com
2024-03-28T16:46:52.803 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-28T16:46:52.821 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server
2024-03-28T16:46:52.821 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com'
2024-03-28T16:46:52.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:46:52.908 DEBUG:teuthology.orchestra.run.smithi099:> true
2024-03-28T16:46:52.972 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com'
2024-03-28T16:46:52.972 DEBUG:teuthology.orchestra.run.smithi099:> uname -m
2024-03-28T16:46:53.027 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64
2024-03-28T16:46:53.027 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release
2024-03-28T16:46:53.081 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream"
2024-03-28T16:46:53.081 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="9"
2024-03-28T16:46:53.081 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos"
2024-03-28T16:46:53.081 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora"
2024-03-28T16:46:53.081 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="9"
2024-03-28T16:46:53.081 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el9"
2024-03-28T16:46:53.081 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-28T16:46:53.082 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31"
2024-03-28T16:46:53.082 INFO:teuthology.orchestra.run.smithi099.stdout:LOGO="fedora-logo-icon"
2024-03-28T16:46:53.082 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-28T16:46:53.082 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/"
2024-03-28T16:46:53.082 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-28T16:46:53.082 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-28T16:46:53.082 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-28T16:46:53.082 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server
2024-03-28T16:46:53.112 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: set os type and version on server
2024-03-28T16:46:53.112 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com'
2024-03-28T16:46:53.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:46:53.199 DEBUG:teuthology.orchestra.run.smithi123:> true
2024-03-28T16:46:53.272 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com'
2024-03-28T16:46:53.272 DEBUG:teuthology.orchestra.run.smithi123:> uname -m
2024-03-28T16:46:53.329 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64
2024-03-28T16:46:53.329 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release
2024-03-28T16:46:53.385 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="CentOS Stream"
2024-03-28T16:46:53.385 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="9"
2024-03-28T16:46:53.385 INFO:teuthology.orchestra.run.smithi123.stdout:ID="centos"
2024-03-28T16:46:53.385 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="rhel fedora"
2024-03-28T16:46:53.385 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="9"
2024-03-28T16:46:53.385 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el9"
2024-03-28T16:46:53.385 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-28T16:46:53.385 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31"
2024-03-28T16:46:53.385 INFO:teuthology.orchestra.run.smithi123.stdout:LOGO="fedora-logo-icon"
2024-03-28T16:46:53.386 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-28T16:46:53.386 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://centos.org/"
2024-03-28T16:46:53.386 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-28T16:46:53.386 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-28T16:46:53.386 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-28T16:46:53.386 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server
2024-03-28T16:46:53.412 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: set os type and version on server
2024-03-28T16:46:53.412 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com'
2024-03-28T16:46:53.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:46:53.501 DEBUG:teuthology.orchestra.run.smithi142:> true
2024-03-28T16:46:53.571 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com'
2024-03-28T16:46:53.572 DEBUG:teuthology.orchestra.run.smithi142:> uname -m
2024-03-28T16:46:53.629 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64
2024-03-28T16:46:53.629 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release
2024-03-28T16:46:53.685 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream"
2024-03-28T16:46:53.685 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="9"
2024-03-28T16:46:53.685 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos"
2024-03-28T16:46:53.685 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora"
2024-03-28T16:46:53.686 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="9"
2024-03-28T16:46:53.686 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el9"
2024-03-28T16:46:53.686 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-28T16:46:53.686 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31"
2024-03-28T16:46:53.686 INFO:teuthology.orchestra.run.smithi142.stdout:LOGO="fedora-logo-icon"
2024-03-28T16:46:53.686 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-28T16:46:53.686 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/"
2024-03-28T16:46:53.686 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-28T16:46:53.686 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-28T16:46:53.686 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-28T16:46:53.687 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server
2024-03-28T16:46:53.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T16:46:53.807 INFO:teuthology.dispatcher.supervisor:Running job 7625351
2024-03-28T16:46:53.808 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner mchangir --archive /home/teuthworker/archive/mchangir-2024-03-27_03:45:23-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7625351 --name mchangir-2024-03-27_03:45:23-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/fs/test_o_trunc}} -- /home/teuthworker/archive/mchangir-2024-03-27_03:45:23-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7625351/orig.config.yaml
2024-03-28T16:46:53.811 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mchangir-2024-03-27_03:45:23-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7625351
2024-03-28T16:46:53.811 INFO:teuthology.dispatcher.supervisor:Job PID: 1294493
2024-03-28T16:46:53.812 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-28T16:48:53.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T16:50:54.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T16:52:54.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T16:54:54.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T16:56:54.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T16:58:54.742 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T17:00:54.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T17:02:54.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T17:04:55.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T17:06:55.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T17:08:55.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T17:10:55.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T17:12:55.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T17:14:55.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T17:16:56.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T17:18:56.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T17:20:56.371 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T17:22:56.540 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T17:24:56.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T17:24:56.775 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1