2024-04-15T00:07:26.740 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-15T00:07:26.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T00:07:26.937 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb5922c6c10>, signals=[15]) 2024-04-15T00:07:26.938 INFO:teuthology.lock.ops:Start node 'smithi064.front.sepia.ceph.com' reimaging 2024-04-15T00:07:26.938 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: reset os type and version on server 2024-04-15T00:07:26.938 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2024-04-15T00:07:26.960 INFO:teuthology.lock.ops:Start node 'smithi098.front.sepia.ceph.com' reimaging 2024-04-15T00:07:26.960 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: reset os type and version on server 2024-04-15T00:07:26.960 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2024-04-15T00:07:26.985 INFO:teuthology.lock.ops:Start node 'smithi183.front.sepia.ceph.com' reimaging 2024-04-15T00:07:26.985 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: reset os type and version on server 2024-04-15T00:07:26.985 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2024-04-15T00:07:27.056 DEBUG:teuthology.provision.fog.smithi064:Requesting image smithi_centos_9.stream (ID 10) 2024-04-15T00:07:27.108 INFO:teuthology.provision.fog.smithi064:Scheduling deploy of centos 9.stream 2024-04-15T00:07:27.119 DEBUG:teuthology.provision.fog.smithi098:Requesting image smithi_centos_9.stream (ID 10) 2024-04-15T00:07:27.128 DEBUG:teuthology.provision.fog.smithi183:Requesting image smithi_centos_9.stream (ID 10) 2024-04-15T00:07:27.180 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of centos 9.stream 2024-04-15T00:07:27.189 INFO:teuthology.provision.fog.smithi183:Scheduling deploy of centos 9.stream 2024-04-15T00:07:27.420 INFO:teuthology.orchestra.console.smithi064:Power off 2024-04-15T00:07:27.420 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-15T00:07:27.448 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off 2024-04-15T00:07:27.449 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T00:07:27.470 INFO:teuthology.orchestra.console.smithi098:Power off 2024-04-15T00:07:27.470 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-15T00:07:27.478 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2024-04-15T00:07:27.484 INFO:teuthology.orchestra.console.smithi183:Power off 2024-04-15T00:07:27.485 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-15T00:07:27.493 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off 2024-04-15T00:07:27.494 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T00:07:27.506 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off 2024-04-15T00:07:27.506 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T00:07:27.515 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2024-04-15T00:07:27.527 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2024-04-15T00:07:31.481 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T00:07:31.517 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T00:07:31.527 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T00:07:31.591 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2024-04-15T00:07:31.628 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2024-04-15T00:07:31.636 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2024-04-15T00:07:35.594 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T00:07:35.629 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T00:07:35.637 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T00:07:35.704 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2024-04-15T00:07:35.739 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2024-04-15T00:07:35.746 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2024-04-15T00:07:35.806 INFO:teuthology.orchestra.console.smithi064:Power off completed 2024-04-15T00:07:35.907 INFO:teuthology.orchestra.console.smithi064:Power on 2024-04-15T00:07:35.907 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-15T00:07:35.929 DEBUG:teuthology.orchestra.console.smithi064:power on output: Chassis Power Control: Up/On 2024-04-15T00:07:35.929 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T00:07:35.953 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2024-04-15T00:07:39.742 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T00:07:39.750 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T00:07:39.852 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2024-04-15T00:07:39.858 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2024-04-15T00:07:39.953 INFO:teuthology.orchestra.console.smithi098:Power off completed 2024-04-15T00:07:39.954 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T00:07:39.960 INFO:teuthology.orchestra.console.smithi183:Power off completed 2024-04-15T00:07:40.054 INFO:teuthology.orchestra.console.smithi098:Power on 2024-04-15T00:07:40.054 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-15T00:07:40.062 INFO:teuthology.orchestra.console.smithi183:Power on 2024-04-15T00:07:40.062 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-15T00:07:40.070 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2024-04-15T00:07:40.076 DEBUG:teuthology.orchestra.console.smithi098:power on output: Chassis Power Control: Up/On 2024-04-15T00:07:40.076 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T00:07:40.084 DEBUG:teuthology.orchestra.console.smithi183:power on output: Chassis Power Control: Up/On 2024-04-15T00:07:40.084 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T00:07:40.096 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2024-04-15T00:07:40.107 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2024-04-15T00:07:44.075 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T00:07:44.098 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T00:07:44.108 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T00:07:44.185 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2024-04-15T00:07:44.206 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2024-04-15T00:07:44.216 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2024-04-15T00:07:44.286 INFO:teuthology.orchestra.console.smithi064:Power on completed 2024-04-15T00:07:44.307 INFO:teuthology.orchestra.console.smithi098:Power on completed 2024-04-15T00:07:44.317 INFO:teuthology.orchestra.console.smithi183:Power on completed 2024-04-15T00:07:44.388 INFO:teuthology.provision.fog.smithi064:Waiting for deploy to finish 2024-04-15T00:07:44.408 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish 2024-04-15T00:07:44.418 INFO:teuthology.provision.fog.smithi183:Waiting for deploy to finish 2024-04-15T00:10:15.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T00:10:15.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T00:10:15.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T00:10:18.462 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2024-04-15T00:10:18.463 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-04-15T00:10:24.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T00:10:24.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T00:10:27.518 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2024-04-15T00:10:27.522 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-04-15T00:10:33.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T00:10:33.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T00:10:36.574 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2024-04-15T00:10:36.575 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-04-15T00:10:42.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T00:10:42.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T00:10:45.634 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2024-04-15T00:10:45.635 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-04-15T00:10:51.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T00:10:51.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T00:10:54.718 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-04-15T00:10:54.719 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2024-04-15T00:11:00.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T00:11:00.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T00:11:03.774 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-04-15T00:11:03.775 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2024-04-15T00:11:09.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T00:11:09.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T00:11:12.834 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-04-15T00:11:12.835 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2024-04-15T00:11:15.438 ERROR:teuthology.orchestra.connection:Error authenticating with smithi183.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 457, in connect server_key = t.get_remote_server_key() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 918, in get_remote_server_key raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2024-04-15T00:11:18.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T00:11:18.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T00:12:06.815 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-04-15T00:12:18.848 WARNING:teuthology.provision.fog.smithi098:timed out 2024-04-15T00:12:18.849 WARNING:teuthology.provision.fog.smithi064:timed out 2024-04-15T00:12:19.442 WARNING:teuthology.provision.fog.smithi183:timed out 2024-04-15T00:12:24.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T00:12:24.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T00:12:25.047 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-15T00:12:25.048 DEBUG:teuthology.orchestra.run.smithi098:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-15T00:12:25.178 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-15T00:12:25.179 DEBUG:teuthology.orchestra.run.smithi064:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-15T00:12:25.368 INFO:teuthology.provision.fog.smithi098:Node is ready 2024-04-15T00:12:25.368 DEBUG:teuthology.orchestra.run.smithi098:> hostname 2024-04-15T00:12:25.382 INFO:teuthology.orchestra.run.smithi098.stdout:smithi098.front.sepia.ceph.com 2024-04-15T00:12:25.382 DEBUG:teuthology.orchestra.run.smithi098:> grep smithi098.front.sepia.ceph.com /etc/hosts 2024-04-15T00:12:25.438 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98 smithi098.front.sepia.ceph.com smithi098 2024-04-15T00:12:25.438 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2024-04-15T00:12:25.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T00:12:25.532 INFO:teuthology.provision.fog.smithi064:Node is ready 2024-04-15T00:12:25.532 DEBUG:teuthology.orchestra.run.smithi064:> hostname 2024-04-15T00:12:25.547 INFO:teuthology.orchestra.run.smithi064.stdout:smithi064.front.sepia.ceph.com 2024-04-15T00:12:25.548 DEBUG:teuthology.orchestra.run.smithi064:> grep smithi064.front.sepia.ceph.com /etc/hosts 2024-04-15T00:12:25.559 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hosts 2024-04-15T00:12:25.587 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/172.21.15.98/172.21.15.98/g' /etc/hosts 2024-04-15T00:12:25.603 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64 smithi064.front.sepia.ceph.com smithi064 2024-04-15T00:12:25.604 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064 2024-04-15T00:12:25.651 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-15T00:12:25.651 DEBUG:teuthology.orchestra.run.smithi183:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-15T00:12:25.654 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hostname 2024-04-15T00:12:25.720 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064.front.sepia.ceph.com/smithi064/g' /etc/hosts 2024-04-15T00:12:25.721 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2024-04-15T00:12:25.752 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/172.21.15.64/172.21.15.64/g' /etc/hosts 2024-04-15T00:12:25.787 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2024-04-15T00:12:25.824 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064.front.sepia.ceph.com/smithi064/g' /etc/hostname 2024-04-15T00:12:25.841 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2024-04-15T00:12:25.842 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="9" 2024-04-15T00:12:25.842 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2024-04-15T00:12:25.842 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2024-04-15T00:12:25.842 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="9" 2024-04-15T00:12:25.842 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el9" 2024-04-15T00:12:25.842 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-15T00:12:25.842 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2024-04-15T00:12:25.842 INFO:teuthology.orchestra.run.smithi098.stdout:LOGO="fedora-logo-icon" 2024-04-15T00:12:25.842 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-15T00:12:25.842 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2024-04-15T00:12:25.842 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-15T00:12:25.842 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-15T00:12:25.842 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-15T00:12:25.843 INFO:teuthology.provision.fog.smithi098:Deploy complete! 2024-04-15T00:12:25.844 DEBUG:teuthology.parallel:result is None 2024-04-15T00:12:25.895 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064 2024-04-15T00:12:25.965 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2024-04-15T00:12:25.967 INFO:teuthology.provision.fog.smithi183:Node is ready 2024-04-15T00:12:25.967 DEBUG:teuthology.orchestra.run.smithi183:> hostname 2024-04-15T00:12:25.982 INFO:teuthology.orchestra.run.smithi183.stdout:smithi183.front.sepia.ceph.com 2024-04-15T00:12:25.982 DEBUG:teuthology.orchestra.run.smithi183:> grep smithi183.front.sepia.ceph.com /etc/hosts 2024-04-15T00:12:26.020 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream" 2024-04-15T00:12:26.020 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="9" 2024-04-15T00:12:26.020 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos" 2024-04-15T00:12:26.020 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora" 2024-04-15T00:12:26.020 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="9" 2024-04-15T00:12:26.020 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el9" 2024-04-15T00:12:26.020 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-15T00:12:26.020 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2024-04-15T00:12:26.020 INFO:teuthology.orchestra.run.smithi064.stdout:LOGO="fedora-logo-icon" 2024-04-15T00:12:26.020 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-15T00:12:26.020 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/" 2024-04-15T00:12:26.020 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-15T00:12:26.021 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-15T00:12:26.021 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-15T00:12:26.021 INFO:teuthology.provision.fog.smithi064:Deploy complete! 2024-04-15T00:12:26.021 DEBUG:teuthology.parallel:result is None 2024-04-15T00:12:26.038 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.15.183 smithi183.front.sepia.ceph.com smithi183 2024-04-15T00:12:26.038 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183 2024-04-15T00:12:26.135 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi183.front.sepia.ceph.com/smithi183/g' /etc/hosts 2024-04-15T00:12:26.162 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/172.21.15.183/172.21.15.183/g' /etc/hosts 2024-04-15T00:12:26.230 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi183.front.sepia.ceph.com/smithi183/g' /etc/hostname 2024-04-15T00:12:26.296 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183 2024-04-15T00:12:26.362 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2024-04-15T00:12:26.413 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="CentOS Stream" 2024-04-15T00:12:26.413 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="9" 2024-04-15T00:12:26.413 INFO:teuthology.orchestra.run.smithi183.stdout:ID="centos" 2024-04-15T00:12:26.413 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="rhel fedora" 2024-04-15T00:12:26.414 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="9" 2024-04-15T00:12:26.414 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el9" 2024-04-15T00:12:26.414 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-15T00:12:26.414 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31" 2024-04-15T00:12:26.414 INFO:teuthology.orchestra.run.smithi183.stdout:LOGO="fedora-logo-icon" 2024-04-15T00:12:26.414 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-15T00:12:26.414 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://centos.org/" 2024-04-15T00:12:26.414 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-15T00:12:26.414 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-15T00:12:26.414 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-15T00:12:26.414 INFO:teuthology.provision.fog.smithi183:Deploy complete! 2024-04-15T00:12:26.415 DEBUG:teuthology.parallel:result is None 2024-04-15T00:12:26.625 INFO:teuthology.lock.ops:Checking smithi064.front.sepia.ceph.com 2024-04-15T00:12:26.625 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-15T00:12:26.650 INFO:teuthology.lock.ops:Checking smithi098.front.sepia.ceph.com 2024-04-15T00:12:26.650 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-15T00:12:26.666 INFO:teuthology.lock.ops:Checking smithi183.front.sepia.ceph.com 2024-04-15T00:12:26.666 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-15T00:12:26.692 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: set os type and version on server 2024-04-15T00:12:26.692 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2024-04-15T00:12:26.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T00:12:26.795 DEBUG:teuthology.orchestra.run.smithi064:> true 2024-04-15T00:12:26.860 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi064.front.sepia.ceph.com' 2024-04-15T00:12:26.860 DEBUG:teuthology.orchestra.run.smithi064:> uname -m 2024-04-15T00:12:26.916 INFO:teuthology.orchestra.run.smithi064.stdout:x86_64 2024-04-15T00:12:26.916 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2024-04-15T00:12:26.971 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream" 2024-04-15T00:12:26.971 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="9" 2024-04-15T00:12:26.971 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos" 2024-04-15T00:12:26.971 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora" 2024-04-15T00:12:26.971 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="9" 2024-04-15T00:12:26.971 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el9" 2024-04-15T00:12:26.971 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-15T00:12:26.971 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2024-04-15T00:12:26.971 INFO:teuthology.orchestra.run.smithi064.stdout:LOGO="fedora-logo-icon" 2024-04-15T00:12:26.972 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-15T00:12:26.972 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/" 2024-04-15T00:12:26.972 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-15T00:12:26.972 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-15T00:12:26.972 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-15T00:12:26.972 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2024-04-15T00:12:26.991 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: set os type and version on server 2024-04-15T00:12:26.991 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-04-15T00:12:26.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T00:12:27.089 DEBUG:teuthology.orchestra.run.smithi098:> true 2024-04-15T00:12:27.158 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-04-15T00:12:27.158 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2024-04-15T00:12:27.210 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2024-04-15T00:12:27.210 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2024-04-15T00:12:27.265 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2024-04-15T00:12:27.265 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="9" 2024-04-15T00:12:27.266 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2024-04-15T00:12:27.266 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2024-04-15T00:12:27.266 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="9" 2024-04-15T00:12:27.266 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el9" 2024-04-15T00:12:27.266 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-15T00:12:27.266 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2024-04-15T00:12:27.266 INFO:teuthology.orchestra.run.smithi098.stdout:LOGO="fedora-logo-icon" 2024-04-15T00:12:27.267 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-15T00:12:27.267 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2024-04-15T00:12:27.267 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-15T00:12:27.267 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-15T00:12:27.267 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-15T00:12:27.267 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2024-04-15T00:12:27.291 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: set os type and version on server 2024-04-15T00:12:27.291 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2024-04-15T00:12:27.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T00:12:27.377 DEBUG:teuthology.orchestra.run.smithi183:> true 2024-04-15T00:12:27.446 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com' 2024-04-15T00:12:27.446 DEBUG:teuthology.orchestra.run.smithi183:> uname -m 2024-04-15T00:12:27.499 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64 2024-04-15T00:12:27.499 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2024-04-15T00:12:27.555 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="CentOS Stream" 2024-04-15T00:12:27.555 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="9" 2024-04-15T00:12:27.555 INFO:teuthology.orchestra.run.smithi183.stdout:ID="centos" 2024-04-15T00:12:27.555 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="rhel fedora" 2024-04-15T00:12:27.555 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="9" 2024-04-15T00:12:27.555 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el9" 2024-04-15T00:12:27.555 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-15T00:12:27.555 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31" 2024-04-15T00:12:27.555 INFO:teuthology.orchestra.run.smithi183.stdout:LOGO="fedora-logo-icon" 2024-04-15T00:12:27.555 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-15T00:12:27.555 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://centos.org/" 2024-04-15T00:12:27.555 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-15T00:12:27.555 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-15T00:12:27.556 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-15T00:12:27.556 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2024-04-15T00:12:27.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T00:12:27.742 INFO:teuthology.dispatcher.supervisor:Running job 7656641 2024-04-15T00:12:27.742 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656641 --name teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/postgres}} -- /home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656641/orig.config.yaml 2024-04-15T00:12:27.745 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656641 2024-04-15T00:12:27.745 INFO:teuthology.dispatcher.supervisor:Job PID: 2862215 2024-04-15T00:12:27.745 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-15T00:14:27.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T00:16:28.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T00:18:28.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T00:20:28.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T00:22:28.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T00:24:28.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T00:24:28.801 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1