2024-03-14T16:15:59.393 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-14T16:15:59.394 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T16:15:59.589 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f91bef7af40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f91bffdbc10>, signals=[15])
2024-03-14T16:15:59.589 INFO:teuthology.lock.ops:Start node 'smithi002.front.sepia.ceph.com' reimaging
2024-03-14T16:15:59.589 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: reset os type and version on server
2024-03-14T16:15:59.589 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server
2024-03-14T16:15:59.616 INFO:teuthology.lock.ops:Start node 'smithi066.front.sepia.ceph.com' reimaging
2024-03-14T16:15:59.616 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: reset os type and version on server
2024-03-14T16:15:59.616 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server
2024-03-14T16:15:59.632 INFO:teuthology.lock.ops:Start node 'smithi122.front.sepia.ceph.com' reimaging
2024-03-14T16:15:59.632 INFO:teuthology.lock.ops:Updating [smithi122.front.sepia.ceph.com]: reset os type and version on server
2024-03-14T16:15:59.633 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server
2024-03-14T16:15:59.718 DEBUG:teuthology.provision.fog.smithi002:Requesting image smithi_centos_9.stream (ID 10)
2024-03-14T16:15:59.756 DEBUG:teuthology.provision.fog.smithi066:Requesting image smithi_centos_9.stream (ID 10)
2024-03-14T16:15:59.759 INFO:teuthology.provision.fog.smithi002:Scheduling deploy of centos 9.stream
2024-03-14T16:15:59.763 DEBUG:teuthology.provision.fog.smithi122:Requesting image smithi_centos_9.stream (ID 10)
2024-03-14T16:15:59.798 INFO:teuthology.provision.fog.smithi066:Scheduling deploy of centos 9.stream
2024-03-14T16:15:59.801 INFO:teuthology.provision.fog.smithi122:Scheduling deploy of centos 9.stream
2024-03-14T16:16:00.031 INFO:teuthology.orchestra.console.smithi002:Power off
2024-03-14T16:16:00.031 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-14T16:16:00.047 INFO:teuthology.orchestra.console.smithi066:Power off
2024-03-14T16:16:00.048 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-14T16:16:00.059 DEBUG:teuthology.orchestra.console.smithi002:power off output: Chassis Power Control: Down/Off
2024-03-14T16:16:00.059 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T16:16:00.068 DEBUG:teuthology.orchestra.console.smithi066:power off output: Chassis Power Control: Down/Off
2024-03-14T16:16:00.068 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T16:16:00.084 INFO:teuthology.orchestra.console.smithi122:Power off
2024-03-14T16:16:00.084 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-14T16:16:00.093 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off
2024-03-14T16:16:00.093 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off
2024-03-14T16:16:00.105 DEBUG:teuthology.orchestra.console.smithi122:power off output: Chassis Power Control: Down/Off
2024-03-14T16:16:00.105 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T16:16:00.127 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is off
2024-03-14T16:16:00.194 INFO:teuthology.orchestra.console.smithi066:Power off completed
2024-03-14T16:16:00.194 INFO:teuthology.orchestra.console.smithi002:Power off completed
2024-03-14T16:16:00.229 INFO:teuthology.orchestra.console.smithi122:Power off completed
2024-03-14T16:16:00.295 INFO:teuthology.orchestra.console.smithi066:Power on
2024-03-14T16:16:00.296 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-14T16:16:00.304 INFO:teuthology.orchestra.console.smithi002:Power on
2024-03-14T16:16:00.304 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-14T16:16:00.319 DEBUG:teuthology.orchestra.console.smithi066:power on output: Chassis Power Control: Up/On
2024-03-14T16:16:00.319 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T16:16:00.328 DEBUG:teuthology.orchestra.console.smithi002:power on output: Chassis Power Control: Up/On
2024-03-14T16:16:00.328 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T16:16:00.335 INFO:teuthology.orchestra.console.smithi122:Power on
2024-03-14T16:16:00.335 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-14T16:16:00.344 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off
2024-03-14T16:16:00.349 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off
2024-03-14T16:16:00.354 DEBUG:teuthology.orchestra.console.smithi122:power on output: Chassis Power Control: Up/On
2024-03-14T16:16:00.354 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T16:16:00.381 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is off
2024-03-14T16:16:04.346 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T16:16:04.354 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T16:16:04.382 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T16:16:04.456 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off
2024-03-14T16:16:04.462 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on
2024-03-14T16:16:04.491 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is on
2024-03-14T16:16:04.563 INFO:teuthology.orchestra.console.smithi002:Power on completed
2024-03-14T16:16:04.591 INFO:teuthology.orchestra.console.smithi122:Power on completed
2024-03-14T16:16:04.664 INFO:teuthology.provision.fog.smithi002:Waiting for deploy to finish
2024-03-14T16:16:04.692 INFO:teuthology.provision.fog.smithi122:Waiting for deploy to finish
2024-03-14T16:16:08.461 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T16:16:08.570 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on
2024-03-14T16:16:08.670 INFO:teuthology.orchestra.console.smithi066:Power on completed
2024-03-14T16:16:08.771 INFO:teuthology.provision.fog.smithi066:Waiting for deploy to finish
2024-03-14T16:18:35.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T16:18:50.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T16:18:54.110 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2
2024-03-14T16:19:00.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T16:19:03.166 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2
2024-03-14T16:19:09.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T16:19:09.214 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122
2024-03-14T16:19:12.254 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2
2024-03-14T16:19:15.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T16:19:18.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T16:19:18.270 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122
2024-03-14T16:19:21.310 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2
2024-03-14T16:19:24.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T16:19:24.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T16:19:27.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T16:19:27.326 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122
2024-03-14T16:19:33.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T16:19:36.414 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122
2024-03-14T16:19:42.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T16:19:43.266 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-14T16:19:49.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T16:19:52.354 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-14T16:19:58.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T16:20:01.442 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-14T16:20:07.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T16:20:10.526 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-14T16:20:16.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T16:20:19.614 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-14T16:20:25.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T16:20:27.318 WARNING:teuthology.provision.fog.smithi002:timed out
2024-03-14T16:20:28.702 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-14T16:20:33.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T16:20:33.617 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-14T16:20:33.618 DEBUG:teuthology.orchestra.run.smithi002:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-14T16:20:33.945 INFO:teuthology.provision.fog.smithi002:Node is ready
2024-03-14T16:20:33.945 DEBUG:teuthology.orchestra.run.smithi002:> hostname
2024-03-14T16:20:33.960 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002.front.sepia.ceph.com
2024-03-14T16:20:33.960 DEBUG:teuthology.orchestra.run.smithi002:> grep smithi002.front.sepia.ceph.com /etc/hosts
2024-03-14T16:20:34.017 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2 smithi002.front.sepia.ceph.com smithi002
2024-03-14T16:20:34.017 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname smithi002
2024-03-14T16:20:34.122 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/smithi002.front.sepia.ceph.com/smithi002/g' /etc/hosts
2024-03-14T16:20:34.153 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/172.21.15.2/172.21.15.2/g' /etc/hosts
2024-03-14T16:20:34.225 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/smithi002.front.sepia.ceph.com/smithi002/g' /etc/hostname
2024-03-14T16:20:34.297 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname smithi002
2024-03-14T16:20:34.367 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release
2024-03-14T16:20:34.421 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream"
2024-03-14T16:20:34.421 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="9"
2024-03-14T16:20:34.421 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos"
2024-03-14T16:20:34.422 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora"
2024-03-14T16:20:34.422 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="9"
2024-03-14T16:20:34.422 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el9"
2024-03-14T16:20:34.422 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-14T16:20:34.422 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31"
2024-03-14T16:20:34.422 INFO:teuthology.orchestra.run.smithi002.stdout:LOGO="fedora-logo-icon"
2024-03-14T16:20:34.422 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-14T16:20:34.422 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/"
2024-03-14T16:20:34.422 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-14T16:20:34.422 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-14T16:20:34.423 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-14T16:20:34.423 INFO:teuthology.provision.fog.smithi002:Deploy complete!
2024-03-14T16:20:34.425 DEBUG:teuthology.parallel:result is None
2024-03-14T16:20:34.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T16:20:37.762 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-14T16:20:42.426 WARNING:teuthology.provision.fog.smithi122:timed out
2024-03-14T16:20:43.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T16:20:46.846 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-14T16:20:48.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T16:20:48.683 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-14T16:20:48.683 DEBUG:teuthology.orchestra.run.smithi122:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-14T16:20:49.028 INFO:teuthology.provision.fog.smithi122:Node is ready
2024-03-14T16:20:49.028 DEBUG:teuthology.orchestra.run.smithi122:> hostname
2024-03-14T16:20:49.044 INFO:teuthology.orchestra.run.smithi122.stdout:smithi122.front.sepia.ceph.com
2024-03-14T16:20:49.044 DEBUG:teuthology.orchestra.run.smithi122:> grep smithi122.front.sepia.ceph.com /etc/hosts
2024-03-14T16:20:49.101 INFO:teuthology.orchestra.run.smithi122.stdout:172.21.15.122 smithi122.front.sepia.ceph.com smithi122
2024-03-14T16:20:49.102 DEBUG:teuthology.orchestra.run.smithi122:> sudo hostname smithi122
2024-03-14T16:20:49.224 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i -e 's/smithi122.front.sepia.ceph.com/smithi122/g' /etc/hosts
2024-03-14T16:20:49.256 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i -e 's/172.21.15.122/172.21.15.122/g' /etc/hosts
2024-03-14T16:20:49.328 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i -e 's/smithi122.front.sepia.ceph.com/smithi122/g' /etc/hostname
2024-03-14T16:20:49.399 DEBUG:teuthology.orchestra.run.smithi122:> sudo hostname smithi122
2024-03-14T16:20:49.468 DEBUG:teuthology.orchestra.run.smithi122:> cat /etc/os-release
2024-03-14T16:20:49.523 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="CentOS Stream"
2024-03-14T16:20:49.523 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="9"
2024-03-14T16:20:49.523 INFO:teuthology.orchestra.run.smithi122.stdout:ID="centos"
2024-03-14T16:20:49.524 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE="rhel fedora"
2024-03-14T16:20:49.524 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="9"
2024-03-14T16:20:49.524 INFO:teuthology.orchestra.run.smithi122.stdout:PLATFORM_ID="platform:el9"
2024-03-14T16:20:49.524 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-14T16:20:49.524 INFO:teuthology.orchestra.run.smithi122.stdout:ANSI_COLOR="0;31"
2024-03-14T16:20:49.524 INFO:teuthology.orchestra.run.smithi122.stdout:LOGO="fedora-logo-icon"
2024-03-14T16:20:49.524 INFO:teuthology.orchestra.run.smithi122.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-14T16:20:49.524 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://centos.org/"
2024-03-14T16:20:49.524 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-14T16:20:49.524 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-14T16:20:49.524 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-14T16:20:49.524 INFO:teuthology.provision.fog.smithi122:Deploy complete!
2024-03-14T16:20:49.525 DEBUG:teuthology.parallel:result is None
2024-03-14T16:20:52.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T16:20:55.902 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-14T16:21:01.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T16:21:04.990 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-14T16:21:10.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T16:22:11.043 WARNING:teuthology.provision.fog.smithi066:timed out
2024-03-14T16:22:17.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T16:22:17.306 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-14T16:22:17.307 DEBUG:teuthology.orchestra.run.smithi066:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-14T16:22:17.663 INFO:teuthology.provision.fog.smithi066:Node is ready
2024-03-14T16:22:17.664 DEBUG:teuthology.orchestra.run.smithi066:> hostname
2024-03-14T16:22:17.679 INFO:teuthology.orchestra.run.smithi066.stdout:smithi066.front.sepia.ceph.com
2024-03-14T16:22:17.679 DEBUG:teuthology.orchestra.run.smithi066:> grep smithi066.front.sepia.ceph.com /etc/hosts
2024-03-14T16:22:17.735 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66 smithi066.front.sepia.ceph.com smithi066
2024-03-14T16:22:17.736 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname smithi066
2024-03-14T16:22:17.854 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi066.front.sepia.ceph.com/smithi066/g' /etc/hosts
2024-03-14T16:22:17.886 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/172.21.15.66/172.21.15.66/g' /etc/hosts
2024-03-14T16:22:17.958 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi066.front.sepia.ceph.com/smithi066/g' /etc/hostname
2024-03-14T16:22:18.030 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname smithi066
2024-03-14T16:22:18.102 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release
2024-03-14T16:22:18.157 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Stream"
2024-03-14T16:22:18.157 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="9"
2024-03-14T16:22:18.157 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos"
2024-03-14T16:22:18.157 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora"
2024-03-14T16:22:18.157 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="9"
2024-03-14T16:22:18.158 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el9"
2024-03-14T16:22:18.158 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-14T16:22:18.158 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31"
2024-03-14T16:22:18.158 INFO:teuthology.orchestra.run.smithi066.stdout:LOGO="fedora-logo-icon"
2024-03-14T16:22:18.158 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-14T16:22:18.158 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://centos.org/"
2024-03-14T16:22:18.158 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-14T16:22:18.158 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-14T16:22:18.158 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-14T16:22:18.159 INFO:teuthology.provision.fog.smithi066:Deploy complete!
2024-03-14T16:22:18.159 DEBUG:teuthology.parallel:result is None
2024-03-14T16:22:18.378 INFO:teuthology.lock.ops:Checking smithi002.front.sepia.ceph.com
2024-03-14T16:22:18.378 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-14T16:22:18.406 INFO:teuthology.lock.ops:Checking smithi066.front.sepia.ceph.com
2024-03-14T16:22:18.406 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-14T16:22:18.422 INFO:teuthology.lock.ops:Checking smithi122.front.sepia.ceph.com
2024-03-14T16:22:18.423 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-14T16:22:18.440 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: set os type and version on server
2024-03-14T16:22:18.441 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com'
2024-03-14T16:22:18.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T16:22:18.548 DEBUG:teuthology.orchestra.run.smithi002:> true
2024-03-14T16:22:18.733 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com'
2024-03-14T16:22:18.734 DEBUG:teuthology.orchestra.run.smithi002:> uname -m
2024-03-14T16:22:18.788 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64
2024-03-14T16:22:18.788 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release
2024-03-14T16:22:18.843 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream"
2024-03-14T16:22:18.843 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="9"
2024-03-14T16:22:18.843 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos"
2024-03-14T16:22:18.843 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora"
2024-03-14T16:22:18.843 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="9"
2024-03-14T16:22:18.844 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el9"
2024-03-14T16:22:18.844 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-14T16:22:18.844 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31"
2024-03-14T16:22:18.844 INFO:teuthology.orchestra.run.smithi002.stdout:LOGO="fedora-logo-icon"
2024-03-14T16:22:18.844 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-14T16:22:18.844 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/"
2024-03-14T16:22:18.844 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-14T16:22:18.844 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-14T16:22:18.844 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-14T16:22:18.845 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server
2024-03-14T16:22:18.864 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: set os type and version on server
2024-03-14T16:22:18.865 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com'
2024-03-14T16:22:18.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T16:22:18.963 DEBUG:teuthology.orchestra.run.smithi066:> true
2024-03-14T16:22:19.029 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com'
2024-03-14T16:22:19.029 DEBUG:teuthology.orchestra.run.smithi066:> uname -m
2024-03-14T16:22:19.083 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64
2024-03-14T16:22:19.083 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release
2024-03-14T16:22:19.138 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Stream"
2024-03-14T16:22:19.138 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="9"
2024-03-14T16:22:19.138 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos"
2024-03-14T16:22:19.138 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora"
2024-03-14T16:22:19.138 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="9"
2024-03-14T16:22:19.138 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el9"
2024-03-14T16:22:19.139 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-14T16:22:19.139 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31"
2024-03-14T16:22:19.139 INFO:teuthology.orchestra.run.smithi066.stdout:LOGO="fedora-logo-icon"
2024-03-14T16:22:19.139 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-14T16:22:19.139 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://centos.org/"
2024-03-14T16:22:19.139 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-14T16:22:19.139 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-14T16:22:19.139 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-14T16:22:19.139 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server
2024-03-14T16:22:19.164 INFO:teuthology.lock.ops:Updating [smithi122.front.sepia.ceph.com]: set os type and version on server
2024-03-14T16:22:19.164 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com'
2024-03-14T16:22:19.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T16:22:19.253 DEBUG:teuthology.orchestra.run.smithi122:> true
2024-03-14T16:22:19.420 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi122.front.sepia.ceph.com'
2024-03-14T16:22:19.420 DEBUG:teuthology.orchestra.run.smithi122:> uname -m
2024-03-14T16:22:19.474 INFO:teuthology.orchestra.run.smithi122.stdout:x86_64
2024-03-14T16:22:19.474 DEBUG:teuthology.orchestra.run.smithi122:> cat /etc/os-release
2024-03-14T16:22:19.529 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="CentOS Stream"
2024-03-14T16:22:19.529 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="9"
2024-03-14T16:22:19.529 INFO:teuthology.orchestra.run.smithi122.stdout:ID="centos"
2024-03-14T16:22:19.529 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE="rhel fedora"
2024-03-14T16:22:19.529 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="9"
2024-03-14T16:22:19.529 INFO:teuthology.orchestra.run.smithi122.stdout:PLATFORM_ID="platform:el9"
2024-03-14T16:22:19.529 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-14T16:22:19.529 INFO:teuthology.orchestra.run.smithi122.stdout:ANSI_COLOR="0;31"
2024-03-14T16:22:19.529 INFO:teuthology.orchestra.run.smithi122.stdout:LOGO="fedora-logo-icon"
2024-03-14T16:22:19.529 INFO:teuthology.orchestra.run.smithi122.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-14T16:22:19.530 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://centos.org/"
2024-03-14T16:22:19.530 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-14T16:22:19.530 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-14T16:22:19.530 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-14T16:22:19.530 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server
2024-03-14T16:22:19.556 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T16:22:19.642 INFO:teuthology.dispatcher.supervisor:Running job 7600225
2024-03-14T16:22:19.642 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-03-14_15:20:35-fs-wip-batrick-testing-20240310.014948-distro-default-smithi/7600225 --name pdonnell-2024-03-14_15:20:35-fs-wip-batrick-testing-20240310.014948-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/suites/fsx}} -- /home/teuthworker/archive/pdonnell-2024-03-14_15:20:35-fs-wip-batrick-testing-20240310.014948-distro-default-smithi/7600225/orig.config.yaml
2024-03-14T16:22:19.645 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-03-14_15:20:35-fs-wip-batrick-testing-20240310.014948-distro-default-smithi/7600225
2024-03-14T16:22:19.646 INFO:teuthology.dispatcher.supervisor:Job PID: 1451843
2024-03-14T16:22:19.646 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-14T16:24:19.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T16:26:19.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T16:28:20.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T16:30:20.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T16:32:20.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T16:34:20.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T16:36:20.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T16:38:20.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T16:40:20.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T16:42:21.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T16:44:21.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T16:46:21.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T16:48:21.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T16:50:21.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T16:52:21.937 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T16:52:21.999 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1