2024-04-17T23:40:29.099 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d
2024-04-17T23:40:29.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T23:40:29.270 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f39d7295f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f39d82f6c10>, signals=[15])
2024-04-17T23:40:29.270 INFO:teuthology.lock.ops:Start node 'smithi027.front.sepia.ceph.com' reimaging
2024-04-17T23:40:29.270 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: reset os type and version on server
2024-04-17T23:40:29.270 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server
2024-04-17T23:40:29.292 INFO:teuthology.lock.ops:Start node 'smithi069.front.sepia.ceph.com' reimaging
2024-04-17T23:40:29.292 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: reset os type and version on server
2024-04-17T23:40:29.293 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server
2024-04-17T23:40:29.317 INFO:teuthology.lock.ops:Start node 'smithi113.front.sepia.ceph.com' reimaging
2024-04-17T23:40:29.317 INFO:teuthology.lock.ops:Updating [smithi113.front.sepia.ceph.com]: reset os type and version on server
2024-04-17T23:40:29.317 INFO:teuthology.lock.ops:Updating smithi113.front.sepia.ceph.com on lock server
2024-04-17T23:40:29.420 DEBUG:teuthology.provision.fog.smithi069:Requesting image smithi_centos_9.stream (ID 10)
2024-04-17T23:40:29.424 DEBUG:teuthology.provision.fog.smithi027:Requesting image smithi_centos_9.stream (ID 10)
2024-04-17T23:40:29.443 DEBUG:teuthology.provision.fog.smithi113:Requesting image smithi_centos_9.stream (ID 10)
2024-04-17T23:40:29.463 INFO:teuthology.provision.fog.smithi027:Scheduling deploy of centos 9.stream
2024-04-17T23:40:29.469 INFO:teuthology.provision.fog.smithi069:Scheduling deploy of centos 9.stream
2024-04-17T23:40:29.487 INFO:teuthology.provision.fog.smithi113:Scheduling deploy of centos 9.stream
2024-04-17T23:40:29.733 INFO:teuthology.orchestra.console.smithi069:Power off
2024-04-17T23:40:29.733 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-17T23:40:29.749 INFO:teuthology.orchestra.console.smithi027:Power off
2024-04-17T23:40:29.750 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-17T23:40:29.761 DEBUG:teuthology.orchestra.console.smithi069:power off output: Chassis Power Control: Down/Off
2024-04-17T23:40:29.761 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T23:40:29.771 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off
2024-04-17T23:40:29.771 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T23:40:29.781 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off
2024-04-17T23:40:29.788 INFO:teuthology.orchestra.console.smithi113:Power off
2024-04-17T23:40:29.788 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-17T23:40:29.796 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off
2024-04-17T23:40:29.809 DEBUG:teuthology.orchestra.console.smithi113:power off output: Chassis Power Control: Down/Off
2024-04-17T23:40:29.810 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T23:40:29.831 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off
2024-04-17T23:40:29.882 INFO:teuthology.orchestra.console.smithi069:Power off completed
2024-04-17T23:40:29.897 INFO:teuthology.orchestra.console.smithi027:Power off completed
2024-04-17T23:40:29.932 INFO:teuthology.orchestra.console.smithi113:Power off completed
2024-04-17T23:40:29.983 INFO:teuthology.orchestra.console.smithi069:Power on
2024-04-17T23:40:29.984 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-17T23:40:29.998 INFO:teuthology.orchestra.console.smithi027:Power on
2024-04-17T23:40:29.999 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-17T23:40:30.012 DEBUG:teuthology.orchestra.console.smithi069:power on output: Chassis Power Control: Up/On
2024-04-17T23:40:30.013 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T23:40:30.025 DEBUG:teuthology.orchestra.console.smithi027:power on output: Chassis Power Control: Up/On
2024-04-17T23:40:30.025 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T23:40:30.033 INFO:teuthology.orchestra.console.smithi113:Power on
2024-04-17T23:40:30.034 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-17T23:40:30.042 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off
2024-04-17T23:40:30.046 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off
2024-04-17T23:40:30.059 DEBUG:teuthology.orchestra.console.smithi113:power on output: Chassis Power Control: Up/On
2024-04-17T23:40:30.059 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T23:40:30.080 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off
2024-04-17T23:40:34.046 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T23:40:34.054 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T23:40:34.081 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T23:40:34.156 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off
2024-04-17T23:40:34.162 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off
2024-04-17T23:40:34.192 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off
2024-04-17T23:40:38.160 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T23:40:38.167 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T23:40:38.193 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T23:40:38.276 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on
2024-04-17T23:40:38.301 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on
2024-04-17T23:40:38.333 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on
2024-04-17T23:40:38.377 INFO:teuthology.orchestra.console.smithi027:Power on completed
2024-04-17T23:40:38.402 INFO:teuthology.orchestra.console.smithi113:Power on completed
2024-04-17T23:40:38.434 INFO:teuthology.orchestra.console.smithi069:Power on completed
2024-04-17T23:40:38.478 INFO:teuthology.provision.fog.smithi027:Waiting for deploy to finish
2024-04-17T23:40:38.503 INFO:teuthology.provision.fog.smithi113:Waiting for deploy to finish
2024-04-17T23:40:38.535 INFO:teuthology.provision.fog.smithi069:Waiting for deploy to finish
2024-04-17T23:43:10.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T23:43:13.410 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69
2024-04-17T23:43:19.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T23:43:22.494 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69
2024-04-17T23:43:25.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T23:43:28.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T23:43:28.542 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-04-17T23:43:31.550 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69
2024-04-17T23:43:34.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T23:43:37.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T23:43:37.598 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-04-17T23:43:40.608 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69
2024-04-17T23:43:43.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T23:43:46.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T23:43:46.654 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-04-17T23:43:49.662 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69
2024-04-17T23:43:52.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T23:43:55.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T23:43:55.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T23:43:55.714 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-04-17T23:43:58.718 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69
2024-04-17T23:43:58.782 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-17T23:44:01.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T23:44:04.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T23:44:04.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T23:44:04.798 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-04-17T23:44:07.774 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69
2024-04-17T23:44:07.838 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-17T23:44:10.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T23:44:13.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T23:44:13.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T23:44:13.854 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-04-17T23:44:16.894 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-17T23:44:19.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T23:44:22.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T23:44:22.910 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-04-17T23:44:25.950 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-17T23:44:28.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T23:44:31.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T23:44:31.966 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-04-17T23:44:35.006 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-17T23:44:37.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T23:44:41.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T23:44:44.062 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-17T23:44:48.158 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-04-17T23:44:50.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T23:44:53.118 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-17T23:44:54.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T23:44:57.214 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-04-17T23:44:59.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T23:45:02.174 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-17T23:45:03.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T23:45:06.270 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-04-17T23:45:08.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T23:45:11.230 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-17T23:45:12.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T23:45:13.783 WARNING:teuthology.provision.fog.smithi069:timed out
2024-04-17T23:45:14.863 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-17T23:45:14.864 DEBUG:teuthology.orchestra.run.smithi113:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-17T23:45:17.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T23:45:19.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T23:45:20.065 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-17T23:45:20.065 DEBUG:teuthology.orchestra.run.smithi069:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-17T23:45:20.286 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-17T23:45:20.383 INFO:teuthology.provision.fog.smithi069:Node is ready
2024-04-17T23:45:20.383 DEBUG:teuthology.orchestra.run.smithi069:> hostname
2024-04-17T23:45:20.398 INFO:teuthology.orchestra.run.smithi069.stdout:smithi069.front.sepia.ceph.com
2024-04-17T23:45:20.398 DEBUG:teuthology.orchestra.run.smithi069:> grep smithi069.front.sepia.ceph.com /etc/hosts
2024-04-17T23:45:20.450 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69 smithi069.front.sepia.ceph.com smithi069
2024-04-17T23:45:20.450 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname smithi069
2024-04-17T23:45:20.559 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/smithi069.front.sepia.ceph.com/smithi069/g' /etc/hosts
2024-04-17T23:45:20.587 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/172.21.15.69/172.21.15.69/g' /etc/hosts
2024-04-17T23:45:20.653 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/smithi069.front.sepia.ceph.com/smithi069/g' /etc/hostname
2024-04-17T23:45:20.717 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname smithi069
2024-04-17T23:45:20.780 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release
2024-04-17T23:45:20.833 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="CentOS Stream"
2024-04-17T23:45:20.833 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="9"
2024-04-17T23:45:20.833 INFO:teuthology.orchestra.run.smithi069.stdout:ID="centos"
2024-04-17T23:45:20.834 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="rhel fedora"
2024-04-17T23:45:20.834 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="9"
2024-04-17T23:45:20.834 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el9"
2024-04-17T23:45:20.834 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T23:45:20.834 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31"
2024-04-17T23:45:20.834 INFO:teuthology.orchestra.run.smithi069.stdout:LOGO="fedora-logo-icon"
2024-04-17T23:45:20.834 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T23:45:20.834 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://centos.org/"
2024-04-17T23:45:20.834 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T23:45:20.834 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T23:45:20.834 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T23:45:20.835 INFO:teuthology.provision.fog.smithi069:Deploy complete!
2024-04-17T23:45:20.836 DEBUG:teuthology.parallel:result is None
2024-04-17T23:45:26.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T23:45:35.218 INFO:teuthology.provision.fog.smithi113:Node is ready
2024-04-17T23:45:35.218 DEBUG:teuthology.orchestra.run.smithi113:> hostname
2024-04-17T23:45:35.236 INFO:teuthology.orchestra.run.smithi113.stdout:smithi046
2024-04-17T23:45:35.236 DEBUG:teuthology.orchestra.run.smithi113:> grep smithi046 /etc/hosts
2024-04-17T23:45:35.293 INFO:teuthology.orchestra.run.smithi113.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046
2024-04-17T23:45:35.294 DEBUG:teuthology.orchestra.run.smithi113:> sudo hostname smithi113
2024-04-17T23:45:35.452 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/smithi046/smithi113/g' /etc/hosts
2024-04-17T23:45:35.482 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/172.21.15.46/172.21.15.113/g' /etc/hosts
2024-04-17T23:45:35.550 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/smithi046/smithi113/g' /etc/hostname
2024-04-17T23:45:35.619 DEBUG:teuthology.orchestra.run.smithi113:> sudo hostname smithi113
2024-04-17T23:45:35.686 DEBUG:teuthology.orchestra.run.smithi113:> cat /etc/os-release
2024-04-17T23:45:35.740 INFO:teuthology.orchestra.run.smithi113.stdout:NAME="CentOS Stream"
2024-04-17T23:45:35.740 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION="9"
2024-04-17T23:45:35.740 INFO:teuthology.orchestra.run.smithi113.stdout:ID="centos"
2024-04-17T23:45:35.740 INFO:teuthology.orchestra.run.smithi113.stdout:ID_LIKE="rhel fedora"
2024-04-17T23:45:35.741 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_ID="9"
2024-04-17T23:45:35.741 INFO:teuthology.orchestra.run.smithi113.stdout:PLATFORM_ID="platform:el9"
2024-04-17T23:45:35.741 INFO:teuthology.orchestra.run.smithi113.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T23:45:35.741 INFO:teuthology.orchestra.run.smithi113.stdout:ANSI_COLOR="0;31"
2024-04-17T23:45:35.741 INFO:teuthology.orchestra.run.smithi113.stdout:LOGO="fedora-logo-icon"
2024-04-17T23:45:35.741 INFO:teuthology.orchestra.run.smithi113.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T23:45:35.741 INFO:teuthology.orchestra.run.smithi113.stdout:HOME_URL="https://centos.org/"
2024-04-17T23:45:35.741 INFO:teuthology.orchestra.run.smithi113.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T23:45:35.741 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T23:45:35.741 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T23:45:35.741 INFO:teuthology.provision.fog.smithi113:Deploy complete!
2024-04-17T23:45:35.742 DEBUG:teuthology.parallel:result is None
2024-04-17T23:46:26.303 WARNING:teuthology.provision.fog.smithi027:timed out
2024-04-17T23:46:32.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T23:46:32.584 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-17T23:46:32.584 DEBUG:teuthology.orchestra.run.smithi027:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-17T23:46:32.920 INFO:teuthology.provision.fog.smithi027:Node is ready
2024-04-17T23:46:32.920 DEBUG:teuthology.orchestra.run.smithi027:> hostname
2024-04-17T23:46:32.935 INFO:teuthology.orchestra.run.smithi027.stdout:smithi027.front.sepia.ceph.com
2024-04-17T23:46:32.935 DEBUG:teuthology.orchestra.run.smithi027:> grep smithi027.front.sepia.ceph.com /etc/hosts
2024-04-17T23:46:32.991 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27 smithi027.front.sepia.ceph.com smithi027
2024-04-17T23:46:32.991 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027
2024-04-17T23:46:33.109 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hosts
2024-04-17T23:46:33.141 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/172.21.15.27/172.21.15.27/g' /etc/hosts
2024-04-17T23:46:33.212 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hostname
2024-04-17T23:46:33.283 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027
2024-04-17T23:46:33.354 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release
2024-04-17T23:46:33.409 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="CentOS Stream"
2024-04-17T23:46:33.409 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="9"
2024-04-17T23:46:33.409 INFO:teuthology.orchestra.run.smithi027.stdout:ID="centos"
2024-04-17T23:46:33.409 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="rhel fedora"
2024-04-17T23:46:33.409 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="9"
2024-04-17T23:46:33.409 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el9"
2024-04-17T23:46:33.410 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T23:46:33.410 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31"
2024-04-17T23:46:33.410 INFO:teuthology.orchestra.run.smithi027.stdout:LOGO="fedora-logo-icon"
2024-04-17T23:46:33.410 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T23:46:33.410 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://centos.org/"
2024-04-17T23:46:33.410 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T23:46:33.410 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T23:46:33.410 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T23:46:33.410 INFO:teuthology.provision.fog.smithi027:Deploy complete!
2024-04-17T23:46:33.411 DEBUG:teuthology.parallel:result is None
2024-04-17T23:46:33.623 INFO:teuthology.lock.ops:Checking smithi027.front.sepia.ceph.com
2024-04-17T23:46:33.623 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-17T23:46:33.643 INFO:teuthology.lock.ops:Checking smithi069.front.sepia.ceph.com
2024-04-17T23:46:33.644 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-17T23:46:33.660 INFO:teuthology.lock.ops:Checking smithi113.front.sepia.ceph.com
2024-04-17T23:46:33.660 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-17T23:46:33.678 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: set os type and version on server
2024-04-17T23:46:33.678 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com'
2024-04-17T23:46:33.679 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T23:46:33.782 DEBUG:teuthology.orchestra.run.smithi027:> true
2024-04-17T23:46:33.852 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com'
2024-04-17T23:46:33.853 DEBUG:teuthology.orchestra.run.smithi027:> uname -m
2024-04-17T23:46:33.907 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64
2024-04-17T23:46:33.907 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release
2024-04-17T23:46:33.962 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="CentOS Stream"
2024-04-17T23:46:33.962 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="9"
2024-04-17T23:46:33.962 INFO:teuthology.orchestra.run.smithi027.stdout:ID="centos"
2024-04-17T23:46:33.962 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="rhel fedora"
2024-04-17T23:46:33.962 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="9"
2024-04-17T23:46:33.963 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el9"
2024-04-17T23:46:33.963 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T23:46:33.963 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31"
2024-04-17T23:46:33.963 INFO:teuthology.orchestra.run.smithi027.stdout:LOGO="fedora-logo-icon"
2024-04-17T23:46:33.963 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T23:46:33.963 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://centos.org/"
2024-04-17T23:46:33.963 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T23:46:33.963 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T23:46:33.963 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T23:46:33.963 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server
2024-04-17T23:46:33.985 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: set os type and version on server
2024-04-17T23:46:33.985 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com'
2024-04-17T23:46:33.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T23:46:34.069 DEBUG:teuthology.orchestra.run.smithi069:> true
2024-04-17T23:46:34.236 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi069.front.sepia.ceph.com'
2024-04-17T23:46:34.236 DEBUG:teuthology.orchestra.run.smithi069:> uname -m
2024-04-17T23:46:34.291 INFO:teuthology.orchestra.run.smithi069.stdout:x86_64
2024-04-17T23:46:34.292 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release
2024-04-17T23:46:34.346 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="CentOS Stream"
2024-04-17T23:46:34.347 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="9"
2024-04-17T23:46:34.347 INFO:teuthology.orchestra.run.smithi069.stdout:ID="centos"
2024-04-17T23:46:34.347 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="rhel fedora"
2024-04-17T23:46:34.347 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="9"
2024-04-17T23:46:34.347 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el9"
2024-04-17T23:46:34.347 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T23:46:34.347 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31"
2024-04-17T23:46:34.347 INFO:teuthology.orchestra.run.smithi069.stdout:LOGO="fedora-logo-icon"
2024-04-17T23:46:34.347 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T23:46:34.347 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://centos.org/"
2024-04-17T23:46:34.347 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T23:46:34.347 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T23:46:34.347 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T23:46:34.348 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server
2024-04-17T23:46:34.368 INFO:teuthology.lock.ops:Updating [smithi113.front.sepia.ceph.com]: set os type and version on server
2024-04-17T23:46:34.369 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi113.front.sepia.ceph.com'
2024-04-17T23:46:34.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T23:46:34.457 DEBUG:teuthology.orchestra.run.smithi113:> true
2024-04-17T23:46:34.628 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi113.front.sepia.ceph.com'
2024-04-17T23:46:34.629 DEBUG:teuthology.orchestra.run.smithi113:> uname -m
2024-04-17T23:46:34.683 INFO:teuthology.orchestra.run.smithi113.stdout:x86_64
2024-04-17T23:46:34.683 DEBUG:teuthology.orchestra.run.smithi113:> cat /etc/os-release
2024-04-17T23:46:34.736 INFO:teuthology.orchestra.run.smithi113.stdout:NAME="CentOS Stream"
2024-04-17T23:46:34.736 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION="9"
2024-04-17T23:46:34.737 INFO:teuthology.orchestra.run.smithi113.stdout:ID="centos"
2024-04-17T23:46:34.737 INFO:teuthology.orchestra.run.smithi113.stdout:ID_LIKE="rhel fedora"
2024-04-17T23:46:34.737 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_ID="9"
2024-04-17T23:46:34.737 INFO:teuthology.orchestra.run.smithi113.stdout:PLATFORM_ID="platform:el9"
2024-04-17T23:46:34.737 INFO:teuthology.orchestra.run.smithi113.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T23:46:34.737 INFO:teuthology.orchestra.run.smithi113.stdout:ANSI_COLOR="0;31"
2024-04-17T23:46:34.737 INFO:teuthology.orchestra.run.smithi113.stdout:LOGO="fedora-logo-icon"
2024-04-17T23:46:34.737 INFO:teuthology.orchestra.run.smithi113.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T23:46:34.737 INFO:teuthology.orchestra.run.smithi113.stdout:HOME_URL="https://centos.org/"
2024-04-17T23:46:34.737 INFO:teuthology.orchestra.run.smithi113.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T23:46:34.737 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T23:46:34.737 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T23:46:34.738 INFO:teuthology.lock.ops:Updating smithi113.front.sepia.ceph.com on lock server
2024-04-17T23:46:34.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T23:46:34.860 INFO:teuthology.dispatcher.supervisor:Running job 7661297
2024-04-17T23:46:34.861 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-17_21:24:02-fs-squid-distro-default-smithi/7661297 --name teuthology-2024-04-17_21:24:02-fs-squid-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/direct_io}} -- /home/teuthworker/archive/teuthology-2024-04-17_21:24:02-fs-squid-distro-default-smithi/7661297/orig.config.yaml
2024-04-17T23:46:34.866 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-17_21:24:02-fs-squid-distro-default-smithi/7661297
2024-04-17T23:46:34.866 INFO:teuthology.dispatcher.supervisor:Job PID: 3924026
2024-04-17T23:46:34.866 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-17T23:48:34.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T23:50:35.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T23:52:35.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T23:54:35.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T23:56:35.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T23:56:35.658 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1