2024-03-21T14:37:59.155 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-21T14:37:59.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T14:37:59.341 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fc02e8bff40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fc02f920c10>, signals=[15])
2024-03-21T14:37:59.341 INFO:teuthology.lock.ops:Start node 'smithi039.front.sepia.ceph.com' reimaging
2024-03-21T14:37:59.341 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: reset os type and version on server
2024-03-21T14:37:59.342 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server
2024-03-21T14:37:59.372 INFO:teuthology.lock.ops:Start node 'smithi049.front.sepia.ceph.com' reimaging
2024-03-21T14:37:59.372 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: reset os type and version on server
2024-03-21T14:37:59.372 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server
2024-03-21T14:37:59.396 INFO:teuthology.lock.ops:Start node 'smithi105.front.sepia.ceph.com' reimaging
2024-03-21T14:37:59.397 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: reset os type and version on server
2024-03-21T14:37:59.397 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server
2024-03-21T14:37:59.494 DEBUG:teuthology.provision.fog.smithi039:Requesting image smithi_centos_9.stream (ID 10)
2024-03-21T14:37:59.519 DEBUG:teuthology.provision.fog.smithi049:Requesting image smithi_centos_9.stream (ID 10)
2024-03-21T14:37:59.538 DEBUG:teuthology.provision.fog.smithi105:Requesting image smithi_centos_9.stream (ID 10)
2024-03-21T14:37:59.541 INFO:teuthology.provision.fog.smithi039:Scheduling deploy of centos 9.stream
2024-03-21T14:37:59.561 INFO:teuthology.provision.fog.smithi049:Scheduling deploy of centos 9.stream
2024-03-21T14:37:59.587 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of centos 9.stream
2024-03-21T14:37:59.768 INFO:teuthology.orchestra.console.smithi039:Power off
2024-03-21T14:37:59.769 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-21T14:37:59.795 DEBUG:teuthology.orchestra.console.smithi039:power off output: Chassis Power Control: Down/Off
2024-03-21T14:37:59.795 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T14:37:59.819 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on
2024-03-21T14:37:59.826 INFO:teuthology.orchestra.console.smithi105:Power off
2024-03-21T14:37:59.826 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-21T14:37:59.842 INFO:teuthology.orchestra.console.smithi049:Power off
2024-03-21T14:37:59.843 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-21T14:37:59.854 DEBUG:teuthology.orchestra.console.smithi105:power off output: Chassis Power Control: Down/Off
2024-03-21T14:37:59.854 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T14:37:59.865 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off
2024-03-21T14:37:59.866 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T14:37:59.877 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on
2024-03-21T14:37:59.889 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off
2024-03-21T14:37:59.990 INFO:teuthology.orchestra.console.smithi049:Power off completed
2024-03-21T14:38:00.091 INFO:teuthology.orchestra.console.smithi049:Power on
2024-03-21T14:38:00.091 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-21T14:38:00.112 DEBUG:teuthology.orchestra.console.smithi049:power on output: Chassis Power Control: Up/On
2024-03-21T14:38:00.113 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T14:38:00.140 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off
2024-03-21T14:38:03.822 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T14:38:03.879 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T14:38:03.931 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on
2024-03-21T14:38:03.988 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on
2024-03-21T14:38:04.141 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T14:38:04.250 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on
2024-03-21T14:38:04.351 INFO:teuthology.orchestra.console.smithi049:Power on completed
2024-03-21T14:38:04.451 INFO:teuthology.provision.fog.smithi049:Waiting for deploy to finish
2024-03-21T14:38:07.934 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T14:38:07.989 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T14:38:08.044 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off
2024-03-21T14:38:08.099 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on
2024-03-21T14:38:08.146 INFO:teuthology.orchestra.console.smithi039:Power off completed
2024-03-21T14:38:08.246 INFO:teuthology.orchestra.console.smithi039:Power on
2024-03-21T14:38:08.247 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-21T14:38:08.271 DEBUG:teuthology.orchestra.console.smithi039:power on output: Chassis Power Control: Up/On
2024-03-21T14:38:08.272 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T14:38:08.295 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off
2024-03-21T14:38:12.102 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T14:38:12.211 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off
2024-03-21T14:38:12.297 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T14:38:12.313 INFO:teuthology.orchestra.console.smithi105:Power off completed
2024-03-21T14:38:12.406 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off
2024-03-21T14:38:12.413 INFO:teuthology.orchestra.console.smithi105:Power on
2024-03-21T14:38:12.414 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-21T14:38:12.436 DEBUG:teuthology.orchestra.console.smithi105:power on output: Chassis Power Control: Up/On
2024-03-21T14:38:12.436 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T14:38:12.458 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off
2024-03-21T14:38:16.410 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T14:38:16.459 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T14:38:16.519 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on
2024-03-21T14:38:16.568 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off
2024-03-21T14:38:16.621 INFO:teuthology.orchestra.console.smithi039:Power on completed
2024-03-21T14:38:16.722 INFO:teuthology.provision.fog.smithi039:Waiting for deploy to finish
2024-03-21T14:38:20.570 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T14:38:20.679 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on
2024-03-21T14:38:20.780 INFO:teuthology.orchestra.console.smithi105:Power on completed
2024-03-21T14:38:20.880 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish
2024-03-21T14:40:51.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T14:40:54.626 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2024-03-21T14:41:00.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T14:41:03.710 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2024-03-21T14:41:09.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T14:41:12.770 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2024-03-21T14:41:17.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T14:41:17.773 ERROR:teuthology.orchestra.connection:Error authenticating with smithi039.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-21T14:41:18.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T14:41:21.826 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2024-03-21T14:41:27.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T14:41:30.910 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2024-03-21T14:41:35.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T14:41:36.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T14:41:38.430 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2024-03-21T14:41:39.970 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2024-03-21T14:41:44.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T14:41:45.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T14:41:47.487 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2024-03-21T14:41:53.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T14:41:56.258 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2024-03-21T14:41:56.542 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2024-03-21T14:42:02.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T14:42:02.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T14:42:05.342 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2024-03-21T14:42:05.598 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2024-03-21T14:42:11.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T14:42:11.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T14:42:14.398 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2024-03-21T14:42:14.654 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2024-03-21T14:42:20.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T14:42:20.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T14:42:23.454 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2024-03-21T14:42:23.710 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2024-03-21T14:42:29.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T14:42:29.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T14:42:32.514 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2024-03-21T14:42:32.771 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2024-03-21T14:42:38.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T14:42:38.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T14:42:41.598 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2024-03-21T14:42:41.854 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2024-03-21T14:42:45.974 WARNING:teuthology.provision.fog.smithi105:timed out
2024-03-21T14:42:47.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T14:42:47.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T14:42:50.910 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2024-03-21T14:42:51.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T14:42:52.357 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-21T14:42:52.358 DEBUG:teuthology.orchestra.run.smithi105:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-21T14:42:52.681 INFO:teuthology.provision.fog.smithi105:Node is ready
2024-03-21T14:42:52.681 DEBUG:teuthology.orchestra.run.smithi105:> hostname
2024-03-21T14:42:52.696 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105.front.sepia.ceph.com
2024-03-21T14:42:52.696 DEBUG:teuthology.orchestra.run.smithi105:> grep smithi105.front.sepia.ceph.com /etc/hosts
2024-03-21T14:42:52.751 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105.front.sepia.ceph.com smithi105
2024-03-21T14:42:52.752 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105
2024-03-21T14:42:52.866 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hosts
2024-03-21T14:42:52.894 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/172.21.15.105/172.21.15.105/g' /etc/hosts
2024-03-21T14:42:52.961 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hostname
2024-03-21T14:42:53.028 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105
2024-03-21T14:42:53.094 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release
2024-03-21T14:42:53.149 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream"
2024-03-21T14:42:53.150 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="9"
2024-03-21T14:42:53.150 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos"
2024-03-21T14:42:53.150 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora"
2024-03-21T14:42:53.150 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="9"
2024-03-21T14:42:53.150 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el9"
2024-03-21T14:42:53.150 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-21T14:42:53.150 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31"
2024-03-21T14:42:53.150 INFO:teuthology.orchestra.run.smithi105.stdout:LOGO="fedora-logo-icon"
2024-03-21T14:42:53.150 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-21T14:42:53.150 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/"
2024-03-21T14:42:53.150 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-21T14:42:53.150 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-21T14:42:53.150 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-21T14:42:53.151 INFO:teuthology.provision.fog.smithi105:Deploy complete!
2024-03-21T14:42:53.153 DEBUG:teuthology.parallel:result is None
2024-03-21T14:42:56.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T14:42:59.966 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2024-03-21T14:43:05.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T14:43:09.022 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2024-03-21T14:43:15.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T14:43:47.603 WARNING:teuthology.provision.fog.smithi039:timed out
2024-03-21T14:43:53.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T14:43:53.896 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-21T14:43:53.896 DEBUG:teuthology.orchestra.run.smithi039:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-21T14:43:54.228 INFO:teuthology.provision.fog.smithi039:Node is ready
2024-03-21T14:43:54.228 DEBUG:teuthology.orchestra.run.smithi039:> hostname
2024-03-21T14:43:54.243 INFO:teuthology.orchestra.run.smithi039.stdout:smithi039.front.sepia.ceph.com
2024-03-21T14:43:54.243 DEBUG:teuthology.orchestra.run.smithi039:> grep smithi039.front.sepia.ceph.com /etc/hosts
2024-03-21T14:43:54.299 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39 smithi039.front.sepia.ceph.com smithi039
2024-03-21T14:43:54.300 DEBUG:teuthology.orchestra.run.smithi039:> sudo hostname smithi039
2024-03-21T14:43:54.415 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/smithi039.front.sepia.ceph.com/smithi039/g' /etc/hosts
2024-03-21T14:43:54.447 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/172.21.15.39/172.21.15.39/g' /etc/hosts
2024-03-21T14:43:54.519 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/smithi039.front.sepia.ceph.com/smithi039/g' /etc/hostname
2024-03-21T14:43:54.590 DEBUG:teuthology.orchestra.run.smithi039:> sudo hostname smithi039
2024-03-21T14:43:54.661 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release
2024-03-21T14:43:54.716 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="CentOS Stream"
2024-03-21T14:43:54.717 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="9"
2024-03-21T14:43:54.717 INFO:teuthology.orchestra.run.smithi039.stdout:ID="centos"
2024-03-21T14:43:54.717 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="rhel fedora"
2024-03-21T14:43:54.717 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="9"
2024-03-21T14:43:54.717 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el9"
2024-03-21T14:43:54.717 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-21T14:43:54.717 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31"
2024-03-21T14:43:54.717 INFO:teuthology.orchestra.run.smithi039.stdout:LOGO="fedora-logo-icon"
2024-03-21T14:43:54.717 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-21T14:43:54.717 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://centos.org/"
2024-03-21T14:43:54.718 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-21T14:43:54.718 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-21T14:43:54.718 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-21T14:43:54.718 INFO:teuthology.provision.fog.smithi039:Deploy complete!
2024-03-21T14:43:54.719 DEBUG:teuthology.parallel:result is None
2024-03-21T14:44:15.026 WARNING:teuthology.provision.fog.smithi049:timed out
2024-03-21T14:44:21.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T14:44:21.352 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-21T14:44:21.352 DEBUG:teuthology.orchestra.run.smithi049:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-21T14:44:21.721 INFO:teuthology.provision.fog.smithi049:Node is ready
2024-03-21T14:44:21.722 DEBUG:teuthology.orchestra.run.smithi049:> hostname
2024-03-21T14:44:21.738 INFO:teuthology.orchestra.run.smithi049.stdout:smithi049.front.sepia.ceph.com
2024-03-21T14:44:21.738 DEBUG:teuthology.orchestra.run.smithi049:> grep smithi049.front.sepia.ceph.com /etc/hosts
2024-03-21T14:44:21.795 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49 smithi049.front.sepia.ceph.com smithi049
2024-03-21T14:44:21.796 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049
2024-03-21T14:44:21.911 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hosts
2024-03-21T14:44:21.943 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/172.21.15.49/172.21.15.49/g' /etc/hosts
2024-03-21T14:44:22.014 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hostname
2024-03-21T14:44:22.085 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049
2024-03-21T14:44:22.155 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release
2024-03-21T14:44:22.210 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="CentOS Stream"
2024-03-21T14:44:22.210 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="9"
2024-03-21T14:44:22.210 INFO:teuthology.orchestra.run.smithi049.stdout:ID="centos"
2024-03-21T14:44:22.210 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="rhel fedora"
2024-03-21T14:44:22.211 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="9"
2024-03-21T14:44:22.211 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el9"
2024-03-21T14:44:22.211 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-21T14:44:22.211 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31"
2024-03-21T14:44:22.211 INFO:teuthology.orchestra.run.smithi049.stdout:LOGO="fedora-logo-icon"
2024-03-21T14:44:22.211 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-21T14:44:22.211 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://centos.org/"
2024-03-21T14:44:22.211 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-21T14:44:22.211 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-21T14:44:22.211 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-21T14:44:22.211 INFO:teuthology.provision.fog.smithi049:Deploy complete!
2024-03-21T14:44:22.212 DEBUG:teuthology.parallel:result is None
2024-03-21T14:44:22.447 INFO:teuthology.lock.ops:Checking smithi039.front.sepia.ceph.com
2024-03-21T14:44:22.448 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-21T14:44:22.467 INFO:teuthology.lock.ops:Checking smithi049.front.sepia.ceph.com
2024-03-21T14:44:22.468 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-21T14:44:22.484 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com
2024-03-21T14:44:22.484 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-21T14:44:22.502 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: set os type and version on server
2024-03-21T14:44:22.502 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com'
2024-03-21T14:44:22.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T14:44:22.609 DEBUG:teuthology.orchestra.run.smithi039:> true
2024-03-21T14:44:22.679 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com'
2024-03-21T14:44:22.679 DEBUG:teuthology.orchestra.run.smithi039:> uname -m
2024-03-21T14:44:22.735 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64
2024-03-21T14:44:22.736 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release
2024-03-21T14:44:22.792 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="CentOS Stream"
2024-03-21T14:44:22.793 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="9"
2024-03-21T14:44:22.793 INFO:teuthology.orchestra.run.smithi039.stdout:ID="centos"
2024-03-21T14:44:22.793 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="rhel fedora"
2024-03-21T14:44:22.793 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="9"
2024-03-21T14:44:22.793 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el9"
2024-03-21T14:44:22.793 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-21T14:44:22.793 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31"
2024-03-21T14:44:22.793 INFO:teuthology.orchestra.run.smithi039.stdout:LOGO="fedora-logo-icon"
2024-03-21T14:44:22.793 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-21T14:44:22.793 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://centos.org/"
2024-03-21T14:44:22.793 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-21T14:44:22.793 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-21T14:44:22.793 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-21T14:44:22.794 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server
2024-03-21T14:44:22.818 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: set os type and version on server
2024-03-21T14:44:22.818 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com'
2024-03-21T14:44:22.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T14:44:22.921 DEBUG:teuthology.orchestra.run.smithi049:> true
2024-03-21T14:44:22.989 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com'
2024-03-21T14:44:22.989 DEBUG:teuthology.orchestra.run.smithi049:> uname -m
2024-03-21T14:44:23.044 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64
2024-03-21T14:44:23.044 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release
2024-03-21T14:44:23.099 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="CentOS Stream"
2024-03-21T14:44:23.100 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="9"
2024-03-21T14:44:23.100 INFO:teuthology.orchestra.run.smithi049.stdout:ID="centos"
2024-03-21T14:44:23.100 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="rhel fedora"
2024-03-21T14:44:23.100 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="9"
2024-03-21T14:44:23.100 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el9"
2024-03-21T14:44:23.100 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-21T14:44:23.100 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31"
2024-03-21T14:44:23.100 INFO:teuthology.orchestra.run.smithi049.stdout:LOGO="fedora-logo-icon"
2024-03-21T14:44:23.100 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-21T14:44:23.100 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://centos.org/"
2024-03-21T14:44:23.100 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-21T14:44:23.100 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-21T14:44:23.101 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-21T14:44:23.101 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server
2024-03-21T14:44:23.126 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server
2024-03-21T14:44:23.126 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com'
2024-03-21T14:44:23.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T14:44:23.217 DEBUG:teuthology.orchestra.run.smithi105:> true
2024-03-21T14:44:23.384 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com'
2024-03-21T14:44:23.385 DEBUG:teuthology.orchestra.run.smithi105:> uname -m
2024-03-21T14:44:23.439 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64
2024-03-21T14:44:23.439 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release
2024-03-21T14:44:23.494 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream"
2024-03-21T14:44:23.494 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="9"
2024-03-21T14:44:23.494 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos"
2024-03-21T14:44:23.494 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora"
2024-03-21T14:44:23.495 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="9"
2024-03-21T14:44:23.495 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el9"
2024-03-21T14:44:23.495 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-21T14:44:23.495 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31"
2024-03-21T14:44:23.495 INFO:teuthology.orchestra.run.smithi105.stdout:LOGO="fedora-logo-icon"
2024-03-21T14:44:23.495 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-21T14:44:23.495 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/"
2024-03-21T14:44:23.495 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-21T14:44:23.495 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-21T14:44:23.495 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-21T14:44:23.496 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server
2024-03-21T14:44:23.518 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T14:44:23.623 INFO:teuthology.dispatcher.supervisor:Running job 7613808
2024-03-21T14:44:23.623 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi/7613808 --name teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/fs/norstats}} -- /home/teuthworker/archive/teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi/7613808/orig.config.yaml
2024-03-21T14:44:23.626 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi/7613808
2024-03-21T14:44:23.627 INFO:teuthology.dispatcher.supervisor:Job PID: 1479458
2024-03-21T14:44:23.627 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-21T14:46:23.628 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T14:48:23.698 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T14:50:23.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T14:52:23.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T14:54:23.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T14:56:23.988 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T14:58:24.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T15:00:24.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T15:02:24.204 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T15:04:24.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T15:06:24.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T15:08:24.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T15:10:24.640 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T15:12:24.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T15:14:24.786 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T15:16:24.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T15:18:24.929 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T15:18:25.002 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-03-21T15:18:25.226 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi039 but it was locked by another job: /home/teuthworker/archive/teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi/7613838
2024-03-21T15:18:25.226 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi049 but it was locked by another job: /home/teuthworker/archive/teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi/7613842
2024-03-21T15:18:25.226 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi105 but it was locked by another job: /home/teuthworker/archive/teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi/7613838