2024-04-01T09:03:43.008 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-04-01T09:03:43.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T09:03:43.187 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f951cb5ef40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f951dbbfc10>, signals=[15])
2024-04-01T09:03:43.187 INFO:teuthology.lock.ops:Start node 'smithi042.front.sepia.ceph.com' reimaging
2024-04-01T09:03:43.187 INFO:teuthology.lock.ops:Updating [smithi042.front.sepia.ceph.com]: reset os type and version on server
2024-04-01T09:03:43.188 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server
2024-04-01T09:03:43.204 INFO:teuthology.lock.ops:Start node 'smithi078.front.sepia.ceph.com' reimaging
2024-04-01T09:03:43.204 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: reset os type and version on server
2024-04-01T09:03:43.204 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server
2024-04-01T09:03:43.229 INFO:teuthology.lock.ops:Start node 'smithi130.front.sepia.ceph.com' reimaging
2024-04-01T09:03:43.229 INFO:teuthology.lock.ops:Updating [smithi130.front.sepia.ceph.com]: reset os type and version on server
2024-04-01T09:03:43.229 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server
2024-04-01T09:03:43.316 DEBUG:teuthology.provision.fog.smithi042:Requesting image smithi_centos_9.stream (ID 10)
2024-04-01T09:03:43.358 DEBUG:teuthology.provision.fog.smithi078:Requesting image smithi_centos_9.stream (ID 10)
2024-04-01T09:03:43.362 DEBUG:teuthology.provision.fog.smithi130:Requesting image smithi_centos_9.stream (ID 10)
2024-04-01T09:03:43.375 INFO:teuthology.provision.fog.smithi042:Scheduling deploy of centos 9.stream
2024-04-01T09:03:43.403 INFO:teuthology.provision.fog.smithi130:Scheduling deploy of centos 9.stream
2024-04-01T09:03:43.407 INFO:teuthology.provision.fog.smithi078:Scheduling deploy of centos 9.stream
2024-04-01T09:03:43.588 INFO:teuthology.orchestra.console.smithi042:Power off
2024-04-01T09:03:43.588 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-01T09:03:43.612 DEBUG:teuthology.orchestra.console.smithi042:power off output: Chassis Power Control: Down/Off
2024-04-01T09:03:43.613 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T09:03:43.630 INFO:teuthology.orchestra.console.smithi078:Power off
2024-04-01T09:03:43.631 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-01T09:03:43.644 INFO:teuthology.orchestra.console.smithi130:Power off
2024-04-01T09:03:43.645 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-01T09:03:43.652 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is on
2024-04-01T09:03:43.653 DEBUG:teuthology.orchestra.console.smithi078:power off output: Chassis Power Control: Down/Off
2024-04-01T09:03:43.654 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T09:03:43.666 DEBUG:teuthology.orchestra.console.smithi130:power off output: Chassis Power Control: Down/Off
2024-04-01T09:03:43.667 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T09:03:43.677 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on
2024-04-01T09:03:43.694 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on
2024-04-01T09:03:47.654 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T09:03:47.679 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T09:03:47.695 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T09:03:47.764 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is on
2024-04-01T09:03:47.788 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on
2024-04-01T09:03:47.804 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on
2024-04-01T09:03:51.766 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T09:03:51.789 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T09:03:51.806 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T09:03:51.876 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is off
2024-04-01T09:03:51.899 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on
2024-04-01T09:03:51.917 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is off
2024-04-01T09:03:51.978 INFO:teuthology.orchestra.console.smithi042:Power off completed
2024-04-01T09:03:52.017 INFO:teuthology.orchestra.console.smithi130:Power off completed
2024-04-01T09:03:52.079 INFO:teuthology.orchestra.console.smithi042:Power on
2024-04-01T09:03:52.079 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-01T09:03:52.102 DEBUG:teuthology.orchestra.console.smithi042:power on output: Chassis Power Control: Up/On
2024-04-01T09:03:52.103 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T09:03:52.119 INFO:teuthology.orchestra.console.smithi130:Power on
2024-04-01T09:03:52.119 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-01T09:03:52.133 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is off
2024-04-01T09:03:52.146 DEBUG:teuthology.orchestra.console.smithi130:power on output: Chassis Power Control: Up/On
2024-04-01T09:03:52.146 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T09:03:52.167 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is off
2024-04-01T09:03:55.902 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T09:03:56.012 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off
2024-04-01T09:03:56.113 INFO:teuthology.orchestra.console.smithi078:Power off completed
2024-04-01T09:03:56.134 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T09:03:56.168 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T09:03:56.214 INFO:teuthology.orchestra.console.smithi078:Power on
2024-04-01T09:03:56.214 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-01T09:03:56.237 DEBUG:teuthology.orchestra.console.smithi078:power on output: Chassis Power Control: Up/On
2024-04-01T09:03:56.237 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T09:03:56.246 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is off
2024-04-01T09:03:56.259 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off
2024-04-01T09:03:56.284 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is off
2024-04-01T09:04:00.250 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T09:04:00.260 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T09:04:00.286 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T09:04:00.369 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off
2024-04-01T09:04:00.428 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is on
2024-04-01T09:04:00.429 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on
2024-04-01T09:04:00.529 INFO:teuthology.orchestra.console.smithi042:Power on completed
2024-04-01T09:04:00.530 INFO:teuthology.orchestra.console.smithi130:Power on completed
2024-04-01T09:04:00.630 INFO:teuthology.provision.fog.smithi042:Waiting for deploy to finish
2024-04-01T09:04:00.634 INFO:teuthology.provision.fog.smithi130:Waiting for deploy to finish
2024-04-01T09:04:04.370 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T09:04:04.479 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on
2024-04-01T09:04:04.580 INFO:teuthology.orchestra.console.smithi078:Power on completed
2024-04-01T09:04:04.680 INFO:teuthology.provision.fog.smithi078:Waiting for deploy to finish
2024-04-01T09:06:31.393 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:06:31.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:06:34.462 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42
2024-04-01T09:06:34.463 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130
2024-04-01T09:06:35.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:06:40.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:06:40.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:06:43.518 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42
2024-04-01T09:06:43.519 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130
2024-04-01T09:06:49.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:06:49.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:06:52.574 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130
2024-04-01T09:06:52.575 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42
2024-04-01T09:06:58.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:06:58.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:07:01.630 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130
2024-04-01T09:07:01.631 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42
2024-04-01T09:07:06.329 ERROR:teuthology.orchestra.connection:Error authenticating with smithi078.front.sepia.ceph.com: AuthenticationException('Authentication timeout.')
2024-04-01T09:07:07.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:07:07.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:07:10.686 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130
2024-04-01T09:07:10.687 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42
2024-04-01T09:07:13.410 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78
2024-04-01T09:07:16.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:07:16.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:07:19.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:07:19.742 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130
2024-04-01T09:07:22.462 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78
2024-04-01T09:07:25.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:07:28.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:07:30.718 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78
2024-04-01T09:07:36.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:08:16.692 WARNING:teuthology.provision.fog.smithi042:timed out
2024-04-01T09:08:22.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:08:22.966 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-01T09:08:22.967 DEBUG:teuthology.orchestra.run.smithi042:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-01T09:08:23.300 INFO:teuthology.provision.fog.smithi042:Node is ready
2024-04-01T09:08:23.300 DEBUG:teuthology.orchestra.run.smithi042:> hostname
2024-04-01T09:08:23.315 INFO:teuthology.orchestra.run.smithi042.stdout:smithi042.front.sepia.ceph.com
2024-04-01T09:08:23.315 DEBUG:teuthology.orchestra.run.smithi042:> grep smithi042.front.sepia.ceph.com /etc/hosts
2024-04-01T09:08:23.371 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42 smithi042.front.sepia.ceph.com smithi042
2024-04-01T09:08:23.371 DEBUG:teuthology.orchestra.run.smithi042:> sudo hostname smithi042
2024-04-01T09:08:23.480 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i -e 's/smithi042.front.sepia.ceph.com/smithi042/g' /etc/hosts
2024-04-01T09:08:23.512 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i -e 's/172.21.15.42/172.21.15.42/g' /etc/hosts
2024-04-01T09:08:23.582 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i -e 's/smithi042.front.sepia.ceph.com/smithi042/g' /etc/hostname
2024-04-01T09:08:23.653 DEBUG:teuthology.orchestra.run.smithi042:> sudo hostname smithi042
2024-04-01T09:08:23.722 DEBUG:teuthology.orchestra.run.smithi042:> cat /etc/os-release
2024-04-01T09:08:23.777 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="CentOS Stream"
2024-04-01T09:08:23.777 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="9"
2024-04-01T09:08:23.777 INFO:teuthology.orchestra.run.smithi042.stdout:ID="centos"
2024-04-01T09:08:23.777 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE="rhel fedora"
2024-04-01T09:08:23.777 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="9"
2024-04-01T09:08:23.777 INFO:teuthology.orchestra.run.smithi042.stdout:PLATFORM_ID="platform:el9"
2024-04-01T09:08:23.777 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-01T09:08:23.777 INFO:teuthology.orchestra.run.smithi042.stdout:ANSI_COLOR="0;31"
2024-04-01T09:08:23.778 INFO:teuthology.orchestra.run.smithi042.stdout:LOGO="fedora-logo-icon"
2024-04-01T09:08:23.778 INFO:teuthology.orchestra.run.smithi042.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-01T09:08:23.778 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://centos.org/"
2024-04-01T09:08:23.778 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-01T09:08:23.778 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-01T09:08:23.778 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-01T09:08:23.779 INFO:teuthology.provision.fog.smithi042:Deploy complete!
2024-04-01T09:08:23.780 DEBUG:teuthology.parallel:result is None
2024-04-01T09:08:25.746 WARNING:teuthology.provision.fog.smithi130:timed out
2024-04-01T09:08:31.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:08:32.052 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-01T09:08:32.052 DEBUG:teuthology.orchestra.run.smithi130:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-01T09:08:32.390 INFO:teuthology.provision.fog.smithi130:Node is ready
2024-04-01T09:08:32.391 DEBUG:teuthology.orchestra.run.smithi130:> hostname
2024-04-01T09:08:32.405 INFO:teuthology.orchestra.run.smithi130.stdout:smithi130.front.sepia.ceph.com
2024-04-01T09:08:32.405 DEBUG:teuthology.orchestra.run.smithi130:> grep smithi130.front.sepia.ceph.com /etc/hosts
2024-04-01T09:08:32.460 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.15.130 smithi130.front.sepia.ceph.com smithi130
2024-04-01T09:08:32.461 DEBUG:teuthology.orchestra.run.smithi130:> sudo hostname smithi130
2024-04-01T09:08:32.569 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i -e 's/smithi130.front.sepia.ceph.com/smithi130/g' /etc/hosts
2024-04-01T09:08:32.597 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i -e 's/172.21.15.130/172.21.15.130/g' /etc/hosts
2024-04-01T09:08:32.665 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i -e 's/smithi130.front.sepia.ceph.com/smithi130/g' /etc/hostname
2024-04-01T09:08:32.732 DEBUG:teuthology.orchestra.run.smithi130:> sudo hostname smithi130
2024-04-01T09:08:32.798 DEBUG:teuthology.orchestra.run.smithi130:> cat /etc/os-release
2024-04-01T09:08:32.852 INFO:teuthology.orchestra.run.smithi130.stdout:NAME="CentOS Stream"
2024-04-01T09:08:32.852 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION="9"
2024-04-01T09:08:32.853 INFO:teuthology.orchestra.run.smithi130.stdout:ID="centos"
2024-04-01T09:08:32.853 INFO:teuthology.orchestra.run.smithi130.stdout:ID_LIKE="rhel fedora"
2024-04-01T09:08:32.853 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_ID="9"
2024-04-01T09:08:32.853 INFO:teuthology.orchestra.run.smithi130.stdout:PLATFORM_ID="platform:el9"
2024-04-01T09:08:32.853 INFO:teuthology.orchestra.run.smithi130.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-01T09:08:32.853 INFO:teuthology.orchestra.run.smithi130.stdout:ANSI_COLOR="0;31"
2024-04-01T09:08:32.853 INFO:teuthology.orchestra.run.smithi130.stdout:LOGO="fedora-logo-icon"
2024-04-01T09:08:32.853 INFO:teuthology.orchestra.run.smithi130.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-01T09:08:32.853 INFO:teuthology.orchestra.run.smithi130.stdout:HOME_URL="https://centos.org/"
2024-04-01T09:08:32.853 INFO:teuthology.orchestra.run.smithi130.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-01T09:08:32.853 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-01T09:08:32.853 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-01T09:08:32.854 INFO:teuthology.provision.fog.smithi130:Deploy complete!
2024-04-01T09:08:32.854 DEBUG:teuthology.parallel:result is None
2024-04-01T09:08:36.722 WARNING:teuthology.provision.fog.smithi078:timed out
2024-04-01T09:08:42.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:08:43.020 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-01T09:08:43.020 DEBUG:teuthology.orchestra.run.smithi078:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-01T09:08:43.361 INFO:teuthology.provision.fog.smithi078:Node is ready
2024-04-01T09:08:43.361 DEBUG:teuthology.orchestra.run.smithi078:> hostname
2024-04-01T09:08:43.375 INFO:teuthology.orchestra.run.smithi078.stdout:smithi078.front.sepia.ceph.com
2024-04-01T09:08:43.376 DEBUG:teuthology.orchestra.run.smithi078:> grep smithi078.front.sepia.ceph.com /etc/hosts
2024-04-01T09:08:43.422 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2024-04-01T09:08:43.430 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78 smithi078.front.sepia.ceph.com smithi078
2024-04-01T09:08:43.431 DEBUG:teuthology.orchestra.run.smithi078:> sudo hostname smithi078
2024-04-01T09:08:43.538 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/smithi078.front.sepia.ceph.com/smithi078/g' /etc/hosts
2024-04-01T09:08:43.566 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/172.21.15.78/172.21.15.78/g' /etc/hosts
2024-04-01T09:08:43.633 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/smithi078.front.sepia.ceph.com/smithi078/g' /etc/hostname
2024-04-01T09:08:43.700 DEBUG:teuthology.orchestra.run.smithi078:> sudo hostname smithi078
2024-04-01T09:08:43.766 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release
2024-04-01T09:08:43.820 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="CentOS Stream"
2024-04-01T09:08:43.820 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="9"
2024-04-01T09:08:43.820 INFO:teuthology.orchestra.run.smithi078.stdout:ID="centos"
2024-04-01T09:08:43.821 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="rhel fedora"
2024-04-01T09:08:43.821 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="9"
2024-04-01T09:08:43.821 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el9"
2024-04-01T09:08:43.821 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-01T09:08:43.821 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31"
2024-04-01T09:08:43.821 INFO:teuthology.orchestra.run.smithi078.stdout:LOGO="fedora-logo-icon"
2024-04-01T09:08:43.821 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-01T09:08:43.821 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://centos.org/"
2024-04-01T09:08:43.821 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-01T09:08:43.821 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-01T09:08:43.821 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-01T09:08:43.821 INFO:teuthology.provision.fog.smithi078:Deploy complete!
2024-04-01T09:08:43.822 DEBUG:teuthology.parallel:result is None
2024-04-01T09:08:44.037 INFO:teuthology.lock.ops:Checking smithi042.front.sepia.ceph.com
2024-04-01T09:08:44.037 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-01T09:08:44.061 INFO:teuthology.lock.ops:Checking smithi078.front.sepia.ceph.com
2024-04-01T09:08:44.062 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-01T09:08:44.078 INFO:teuthology.lock.ops:Checking smithi130.front.sepia.ceph.com
2024-04-01T09:08:44.078 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-01T09:08:44.096 INFO:teuthology.lock.ops:Updating [smithi042.front.sepia.ceph.com]: set os type and version on server
2024-04-01T09:08:44.096 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com'
2024-04-01T09:08:44.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:08:44.200 DEBUG:teuthology.orchestra.run.smithi042:> true
2024-04-01T09:08:44.381 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com'
2024-04-01T09:08:44.381 DEBUG:teuthology.orchestra.run.smithi042:> uname -m
2024-04-01T09:08:44.437 INFO:teuthology.orchestra.run.smithi042.stdout:x86_64
2024-04-01T09:08:44.437 DEBUG:teuthology.orchestra.run.smithi042:> cat /etc/os-release
2024-04-01T09:08:44.493 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="CentOS Stream"
2024-04-01T09:08:44.493 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="9"
2024-04-01T09:08:44.493 INFO:teuthology.orchestra.run.smithi042.stdout:ID="centos"
2024-04-01T09:08:44.493 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE="rhel fedora"
2024-04-01T09:08:44.493 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="9"
2024-04-01T09:08:44.493 INFO:teuthology.orchestra.run.smithi042.stdout:PLATFORM_ID="platform:el9"
2024-04-01T09:08:44.493 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-01T09:08:44.494 INFO:teuthology.orchestra.run.smithi042.stdout:ANSI_COLOR="0;31"
2024-04-01T09:08:44.494 INFO:teuthology.orchestra.run.smithi042.stdout:LOGO="fedora-logo-icon"
2024-04-01T09:08:44.494 INFO:teuthology.orchestra.run.smithi042.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-01T09:08:44.494 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://centos.org/"
2024-04-01T09:08:44.494 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-01T09:08:44.494 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-01T09:08:44.494 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-01T09:08:44.494 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server
2024-04-01T09:08:44.520 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: set os type and version on server
2024-04-01T09:08:44.521 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com'
2024-04-01T09:08:44.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:08:44.605 DEBUG:teuthology.orchestra.run.smithi078:> true
2024-04-01T09:08:44.672 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com'
2024-04-01T09:08:44.673 DEBUG:teuthology.orchestra.run.smithi078:> uname -m
2024-04-01T09:08:44.727 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64
2024-04-01T09:08:44.727 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release
2024-04-01T09:08:44.782 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="CentOS Stream"
2024-04-01T09:08:44.782 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="9"
2024-04-01T09:08:44.782 INFO:teuthology.orchestra.run.smithi078.stdout:ID="centos"
2024-04-01T09:08:44.783 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="rhel fedora"
2024-04-01T09:08:44.783 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="9"
2024-04-01T09:08:44.783 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el9"
2024-04-01T09:08:44.783 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-01T09:08:44.783 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31"
2024-04-01T09:08:44.783 INFO:teuthology.orchestra.run.smithi078.stdout:LOGO="fedora-logo-icon"
2024-04-01T09:08:44.783 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-01T09:08:44.783 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://centos.org/"
2024-04-01T09:08:44.783 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-01T09:08:44.783 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-01T09:08:44.783 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-01T09:08:44.784 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server
2024-04-01T09:08:44.803 INFO:teuthology.lock.ops:Updating [smithi130.front.sepia.ceph.com]: set os type and version on server
2024-04-01T09:08:44.804 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com'
2024-04-01T09:08:44.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:08:44.890 DEBUG:teuthology.orchestra.run.smithi130:> true
2024-04-01T09:08:45.061 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com'
2024-04-01T09:08:45.061 DEBUG:teuthology.orchestra.run.smithi130:> uname -m
2024-04-01T09:08:45.115 INFO:teuthology.orchestra.run.smithi130.stdout:x86_64
2024-04-01T09:08:45.116 DEBUG:teuthology.orchestra.run.smithi130:> cat /etc/os-release
2024-04-01T09:08:45.171 INFO:teuthology.orchestra.run.smithi130.stdout:NAME="CentOS Stream"
2024-04-01T09:08:45.171 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION="9"
2024-04-01T09:08:45.171 INFO:teuthology.orchestra.run.smithi130.stdout:ID="centos"
2024-04-01T09:08:45.171 INFO:teuthology.orchestra.run.smithi130.stdout:ID_LIKE="rhel fedora"
2024-04-01T09:08:45.172 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_ID="9"
2024-04-01T09:08:45.172 INFO:teuthology.orchestra.run.smithi130.stdout:PLATFORM_ID="platform:el9"
2024-04-01T09:08:45.172 INFO:teuthology.orchestra.run.smithi130.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-01T09:08:45.172 INFO:teuthology.orchestra.run.smithi130.stdout:ANSI_COLOR="0;31"
2024-04-01T09:08:45.172 INFO:teuthology.orchestra.run.smithi130.stdout:LOGO="fedora-logo-icon"
2024-04-01T09:08:45.172 INFO:teuthology.orchestra.run.smithi130.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-01T09:08:45.172 INFO:teuthology.orchestra.run.smithi130.stdout:HOME_URL="https://centos.org/"
2024-04-01T09:08:45.173 INFO:teuthology.orchestra.run.smithi130.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-01T09:08:45.173 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-01T09:08:45.173 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-01T09:08:45.174 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server
2024-04-01T09:08:45.196 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T09:08:45.290 INFO:teuthology.dispatcher.supervisor:Running job 7632205
2024-04-01T09:08:45.290 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-03-31_08:09:41-fs-wip-batrick-testing-20240331.000745-distro-default-smithi/7632205 --name pdonnell-2024-03-31_08:09:41-fs-wip-batrick-testing-20240331.000745-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/pjd}} -- /home/teuthworker/archive/pdonnell-2024-03-31_08:09:41-fs-wip-batrick-testing-20240331.000745-distro-default-smithi/7632205/orig.config.yaml
2024-04-01T09:08:45.293 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-03-31_08:09:41-fs-wip-batrick-testing-20240331.000745-distro-default-smithi/7632205
2024-04-01T09:08:45.294 INFO:teuthology.dispatcher.supervisor:Job PID: 1524987
2024-04-01T09:08:45.294 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-01T09:10:45.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T09:12:45.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T09:14:45.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T09:16:45.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T09:18:45.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T09:20:46.141 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T09:22:46.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T09:24:46.490 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T09:24:46.561 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1