2024-03-20T01:08:57.256 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-20T01:08:57.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T01:08:57.452 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f06fc5f3f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f06fd554c10>, signals=[15])
2024-03-20T01:08:57.452 INFO:teuthology.lock.ops:Start node 'smithi012.front.sepia.ceph.com' reimaging
2024-03-20T01:08:57.452 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: reset os type and version on server
2024-03-20T01:08:57.453 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server
2024-03-20T01:08:57.471 INFO:teuthology.lock.ops:Start node 'smithi055.front.sepia.ceph.com' reimaging
2024-03-20T01:08:57.471 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: reset os type and version on server
2024-03-20T01:08:57.471 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server
2024-03-20T01:08:57.495 INFO:teuthology.lock.ops:Start node 'smithi060.front.sepia.ceph.com' reimaging
2024-03-20T01:08:57.496 INFO:teuthology.lock.ops:Updating [smithi060.front.sepia.ceph.com]: reset os type and version on server
2024-03-20T01:08:57.496 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server
2024-03-20T01:08:57.575 DEBUG:teuthology.provision.fog.smithi012:Requesting image smithi_centos_9.stream (ID 10)
2024-03-20T01:08:57.607 DEBUG:teuthology.provision.fog.smithi055:Requesting image smithi_centos_9.stream (ID 10)
2024-03-20T01:08:57.621 INFO:teuthology.provision.fog.smithi012:Scheduling deploy of centos 9.stream
2024-03-20T01:08:57.625 DEBUG:teuthology.provision.fog.smithi060:Requesting image smithi_centos_9.stream (ID 10)
2024-03-20T01:08:57.651 INFO:teuthology.provision.fog.smithi055:Scheduling deploy of centos 9.stream
2024-03-20T01:08:57.672 INFO:teuthology.provision.fog.smithi060:Scheduling deploy of centos 9.stream
2024-03-20T01:08:57.915 INFO:teuthology.orchestra.console.smithi012:Power off
2024-03-20T01:08:57.915 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-20T01:08:57.936 DEBUG:teuthology.orchestra.console.smithi012:power off output: Chassis Power Control: Down/Off
2024-03-20T01:08:57.937 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T01:08:57.959 INFO:teuthology.orchestra.console.smithi055:Power off
2024-03-20T01:08:57.960 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-20T01:08:57.972 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off
2024-03-20T01:08:57.990 DEBUG:teuthology.orchestra.console.smithi055:power off output: Chassis Power Control: Down/Off
2024-03-20T01:08:57.990 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T01:08:58.008 INFO:teuthology.orchestra.console.smithi060:Power off
2024-03-20T01:08:58.008 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-20T01:08:58.017 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off
2024-03-20T01:08:58.030 DEBUG:teuthology.orchestra.console.smithi060:power off output: Chassis Power Control: Down/Off
2024-03-20T01:08:58.030 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T01:08:58.052 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is off
2024-03-20T01:08:58.073 INFO:teuthology.orchestra.console.smithi012:Power off completed
2024-03-20T01:08:58.119 INFO:teuthology.orchestra.console.smithi055:Power off completed
2024-03-20T01:08:58.154 INFO:teuthology.orchestra.console.smithi060:Power off completed
2024-03-20T01:08:58.174 INFO:teuthology.orchestra.console.smithi012:Power on
2024-03-20T01:08:58.174 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-20T01:08:58.196 DEBUG:teuthology.orchestra.console.smithi012:power on output: Chassis Power Control: Up/On
2024-03-20T01:08:58.196 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T01:08:58.216 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off
2024-03-20T01:08:58.220 INFO:teuthology.orchestra.console.smithi055:Power on
2024-03-20T01:08:58.220 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-20T01:08:58.244 DEBUG:teuthology.orchestra.console.smithi055:power on output: Chassis Power Control: Up/On
2024-03-20T01:08:58.244 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T01:08:58.255 INFO:teuthology.orchestra.console.smithi060:Power on
2024-03-20T01:08:58.256 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-20T01:08:58.266 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off
2024-03-20T01:08:58.276 DEBUG:teuthology.orchestra.console.smithi060:power on output: Chassis Power Control: Up/On
2024-03-20T01:08:58.276 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T01:08:58.299 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is off
2024-03-20T01:09:02.218 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T01:09:02.268 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T01:09:02.301 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T01:09:02.328 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on
2024-03-20T01:09:02.378 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off
2024-03-20T01:09:02.410 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is off
2024-03-20T01:09:02.430 INFO:teuthology.orchestra.console.smithi012:Power on completed
2024-03-20T01:09:02.530 INFO:teuthology.provision.fog.smithi012:Waiting for deploy to finish
2024-03-20T01:09:06.382 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T01:09:06.411 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T01:09:06.492 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on
2024-03-20T01:09:06.524 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is on
2024-03-20T01:09:06.594 INFO:teuthology.orchestra.console.smithi055:Power on completed
2024-03-20T01:09:06.625 INFO:teuthology.orchestra.console.smithi060:Power on completed
2024-03-20T01:09:06.695 INFO:teuthology.provision.fog.smithi055:Waiting for deploy to finish
2024-03-20T01:09:06.726 INFO:teuthology.provision.fog.smithi060:Waiting for deploy to finish
2024-03-20T01:11:22.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T01:11:37.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T01:11:40.926 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60
2024-03-20T01:11:46.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T01:11:49.982 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60
2024-03-20T01:11:55.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T01:11:59.038 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60
2024-03-20T01:12:05.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T01:12:08.094 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60
2024-03-20T01:12:14.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T01:12:17.150 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60
2024-03-20T01:12:18.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T01:12:22.014 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12
2024-03-20T01:12:22.896 ERROR:teuthology.orchestra.connection:Error authenticating with smithi055.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 457, in connect
    server_key = t.get_remote_server_key()
  File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 918, in get_remote_server_key
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2024-03-20T01:12:23.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T01:12:28.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T01:12:29.950 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55
2024-03-20T01:12:31.070 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12
2024-03-20T01:12:35.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T01:12:37.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T01:12:39.006 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55
2024-03-20T01:12:40.130 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12
2024-03-20T01:12:45.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T01:12:46.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T01:12:48.066 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55
2024-03-20T01:12:49.182 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12
2024-03-20T01:12:54.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T01:12:54.596 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-20T01:12:54.597 DEBUG:teuthology.orchestra.run.smithi055:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-20T01:12:55.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T01:12:58.238 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12
2024-03-20T01:13:04.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T01:13:09.967 INFO:teuthology.provision.fog.smithi055:Node is ready
2024-03-20T01:13:09.968 DEBUG:teuthology.orchestra.run.smithi055:> hostname
2024-03-20T01:13:09.987 INFO:teuthology.orchestra.run.smithi055.stdout:smithi055.front.sepia.ceph.com
2024-03-20T01:13:09.987 DEBUG:teuthology.orchestra.run.smithi055:> grep smithi055.front.sepia.ceph.com /etc/hosts
2024-03-20T01:13:10.046 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55 smithi055.front.sepia.ceph.com smithi055
2024-03-20T01:13:10.046 DEBUG:teuthology.orchestra.run.smithi055:> sudo hostname smithi055
2024-03-20T01:13:10.196 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/smithi055.front.sepia.ceph.com/smithi055/g' /etc/hosts
2024-03-20T01:13:10.230 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/172.21.15.55/172.21.15.55/g' /etc/hosts
2024-03-20T01:13:10.304 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/smithi055.front.sepia.ceph.com/smithi055/g' /etc/hostname
2024-03-20T01:13:10.377 DEBUG:teuthology.orchestra.run.smithi055:> sudo hostname smithi055
2024-03-20T01:13:10.449 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release
2024-03-20T01:13:10.505 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="CentOS Stream"
2024-03-20T01:13:10.505 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="9"
2024-03-20T01:13:10.506 INFO:teuthology.orchestra.run.smithi055.stdout:ID="centos"
2024-03-20T01:13:10.506 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="rhel fedora"
2024-03-20T01:13:10.506 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="9"
2024-03-20T01:13:10.506 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el9"
2024-03-20T01:13:10.506 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-20T01:13:10.506 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31"
2024-03-20T01:13:10.506 INFO:teuthology.orchestra.run.smithi055.stdout:LOGO="fedora-logo-icon"
2024-03-20T01:13:10.506 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-20T01:13:10.506 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://centos.org/"
2024-03-20T01:13:10.506 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-20T01:13:10.506 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-20T01:13:10.506 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-20T01:13:10.507 INFO:teuthology.provision.fog.smithi055:Deploy complete!
2024-03-20T01:13:10.509 DEBUG:teuthology.parallel:result is None
2024-03-20T01:13:10.690 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2024-03-20T01:13:23.164 WARNING:teuthology.provision.fog.smithi060:timed out
2024-03-20T01:13:29.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T01:13:29.466 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-20T01:13:29.466 DEBUG:teuthology.orchestra.run.smithi060:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-20T01:13:29.808 INFO:teuthology.provision.fog.smithi060:Node is ready
2024-03-20T01:13:29.808 DEBUG:teuthology.orchestra.run.smithi060:> hostname
2024-03-20T01:13:29.823 INFO:teuthology.orchestra.run.smithi060.stdout:smithi060.front.sepia.ceph.com
2024-03-20T01:13:29.824 DEBUG:teuthology.orchestra.run.smithi060:> grep smithi060.front.sepia.ceph.com /etc/hosts
2024-03-20T01:13:29.879 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60 smithi060.front.sepia.ceph.com smithi060
2024-03-20T01:13:29.880 DEBUG:teuthology.orchestra.run.smithi060:> sudo hostname smithi060
2024-03-20T01:13:29.996 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/smithi060.front.sepia.ceph.com/smithi060/g' /etc/hosts
2024-03-20T01:13:30.027 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/172.21.15.60/172.21.15.60/g' /etc/hosts
2024-03-20T01:13:30.098 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/smithi060.front.sepia.ceph.com/smithi060/g' /etc/hostname
2024-03-20T01:13:30.170 DEBUG:teuthology.orchestra.run.smithi060:> sudo hostname smithi060
2024-03-20T01:13:30.240 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release
2024-03-20T01:13:30.295 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="CentOS Stream"
2024-03-20T01:13:30.295 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="9"
2024-03-20T01:13:30.295 INFO:teuthology.orchestra.run.smithi060.stdout:ID="centos"
2024-03-20T01:13:30.295 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="rhel fedora"
2024-03-20T01:13:30.296 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="9"
2024-03-20T01:13:30.296 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el9"
2024-03-20T01:13:30.296 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-20T01:13:30.296 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31"
2024-03-20T01:13:30.296 INFO:teuthology.orchestra.run.smithi060.stdout:LOGO="fedora-logo-icon"
2024-03-20T01:13:30.296 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-20T01:13:30.296 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://centos.org/"
2024-03-20T01:13:30.296 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-20T01:13:30.296 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-20T01:13:30.296 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-20T01:13:30.296 INFO:teuthology.provision.fog.smithi060:Deploy complete!
2024-03-20T01:13:30.297 DEBUG:teuthology.parallel:result is None
2024-03-20T01:14:04.274 WARNING:teuthology.provision.fog.smithi012:timed out
2024-03-20T01:14:10.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T01:14:10.517 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-20T01:14:10.517 DEBUG:teuthology.orchestra.run.smithi012:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-20T01:14:10.882 INFO:teuthology.provision.fog.smithi012:Node is ready
2024-03-20T01:14:10.882 DEBUG:teuthology.orchestra.run.smithi012:> hostname
2024-03-20T01:14:10.897 INFO:teuthology.orchestra.run.smithi012.stdout:smithi012.front.sepia.ceph.com
2024-03-20T01:14:10.897 DEBUG:teuthology.orchestra.run.smithi012:> grep smithi012.front.sepia.ceph.com /etc/hosts
2024-03-20T01:14:10.953 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12 smithi012.front.sepia.ceph.com smithi012
2024-03-20T01:14:10.953 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012
2024-03-20T01:14:11.056 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hosts
2024-03-20T01:14:11.089 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/172.21.15.12/172.21.15.12/g' /etc/hosts
2024-03-20T01:14:11.160 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hostname
2024-03-20T01:14:11.231 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012
2024-03-20T01:14:11.302 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release
2024-03-20T01:14:11.357 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream"
2024-03-20T01:14:11.357 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="9"
2024-03-20T01:14:11.357 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos"
2024-03-20T01:14:11.357 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora"
2024-03-20T01:14:11.357 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="9"
2024-03-20T01:14:11.357 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el9"
2024-03-20T01:14:11.358 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-20T01:14:11.358 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31"
2024-03-20T01:14:11.358 INFO:teuthology.orchestra.run.smithi012.stdout:LOGO="fedora-logo-icon"
2024-03-20T01:14:11.358 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-20T01:14:11.358 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/"
2024-03-20T01:14:11.358 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-20T01:14:11.358 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-20T01:14:11.358 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-20T01:14:11.358 INFO:teuthology.provision.fog.smithi012:Deploy complete!
2024-03-20T01:14:11.359 DEBUG:teuthology.parallel:result is None
2024-03-20T01:14:11.583 INFO:teuthology.lock.ops:Checking smithi012.front.sepia.ceph.com
2024-03-20T01:14:11.583 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-20T01:14:11.610 INFO:teuthology.lock.ops:Checking smithi055.front.sepia.ceph.com
2024-03-20T01:14:11.611 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-20T01:14:11.627 INFO:teuthology.lock.ops:Checking smithi060.front.sepia.ceph.com
2024-03-20T01:14:11.627 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-20T01:14:11.645 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: set os type and version on server
2024-03-20T01:14:11.645 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com'
2024-03-20T01:14:11.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T01:14:11.749 DEBUG:teuthology.orchestra.run.smithi012:> true
2024-03-20T01:14:11.816 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com'
2024-03-20T01:14:11.816 DEBUG:teuthology.orchestra.run.smithi012:> uname -m
2024-03-20T01:14:11.874 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64
2024-03-20T01:14:11.874 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release
2024-03-20T01:14:11.926 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream"
2024-03-20T01:14:11.926 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="9"
2024-03-20T01:14:11.926 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos"
2024-03-20T01:14:11.926 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora"
2024-03-20T01:14:11.926 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="9"
2024-03-20T01:14:11.926 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el9"
2024-03-20T01:14:11.926 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-20T01:14:11.926 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31"
2024-03-20T01:14:11.926 INFO:teuthology.orchestra.run.smithi012.stdout:LOGO="fedora-logo-icon"
2024-03-20T01:14:11.927 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-20T01:14:11.927 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/"
2024-03-20T01:14:11.927 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-20T01:14:11.927 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-20T01:14:11.927 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-20T01:14:11.927 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server
2024-03-20T01:14:11.973 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: set os type and version on server
2024-03-20T01:14:11.973 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com'
2024-03-20T01:14:11.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T01:14:12.073 DEBUG:teuthology.orchestra.run.smithi055:> true
2024-03-20T01:14:12.257 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi055.front.sepia.ceph.com'
2024-03-20T01:14:12.257 DEBUG:teuthology.orchestra.run.smithi055:> uname -m
2024-03-20T01:14:12.312 INFO:teuthology.orchestra.run.smithi055.stdout:x86_64
2024-03-20T01:14:12.312 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release
2024-03-20T01:14:12.367 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="CentOS Stream"
2024-03-20T01:14:12.367 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="9"
2024-03-20T01:14:12.367 INFO:teuthology.orchestra.run.smithi055.stdout:ID="centos"
2024-03-20T01:14:12.367 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="rhel fedora"
2024-03-20T01:14:12.367 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="9"
2024-03-20T01:14:12.367 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el9"
2024-03-20T01:14:12.367 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-20T01:14:12.368 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31"
2024-03-20T01:14:12.368 INFO:teuthology.orchestra.run.smithi055.stdout:LOGO="fedora-logo-icon"
2024-03-20T01:14:12.368 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-20T01:14:12.368 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://centos.org/"
2024-03-20T01:14:12.368 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-20T01:14:12.368 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-20T01:14:12.368 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-20T01:14:12.368 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server
2024-03-20T01:14:12.402 INFO:teuthology.lock.ops:Updating [smithi060.front.sepia.ceph.com]: set os type and version on server
2024-03-20T01:14:12.402 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com'
2024-03-20T01:14:12.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T01:14:12.506 DEBUG:teuthology.orchestra.run.smithi060:> true
2024-03-20T01:14:12.689 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com'
2024-03-20T01:14:12.689 DEBUG:teuthology.orchestra.run.smithi060:> uname -m
2024-03-20T01:14:12.745 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64
2024-03-20T01:14:12.745 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release
2024-03-20T01:14:12.801 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="CentOS Stream"
2024-03-20T01:14:12.801 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="9"
2024-03-20T01:14:12.801 INFO:teuthology.orchestra.run.smithi060.stdout:ID="centos"
2024-03-20T01:14:12.801 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="rhel fedora"
2024-03-20T01:14:12.801 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="9"
2024-03-20T01:14:12.801 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el9"
2024-03-20T01:14:12.801 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-20T01:14:12.801 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31"
2024-03-20T01:14:12.801 INFO:teuthology.orchestra.run.smithi060.stdout:LOGO="fedora-logo-icon"
2024-03-20T01:14:12.801 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-20T01:14:12.801 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://centos.org/"
2024-03-20T01:14:12.802 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-20T01:14:12.802 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-20T01:14:12.802 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-20T01:14:12.802 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server
2024-03-20T01:14:12.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T01:14:12.931 INFO:teuthology.dispatcher.supervisor:Running job 7608069
2024-03-20T01:14:12.931 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-03-17_21:24:03-fs-squid-distro-default-smithi/7608069 --name teuthology-2024-03-17_21:24:03-fs-squid-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/fsstress}} -- /home/teuthworker/archive/teuthology-2024-03-17_21:24:03-fs-squid-distro-default-smithi/7608069/orig.config.yaml
2024-03-20T01:14:12.934 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-03-17_21:24:03-fs-squid-distro-default-smithi/7608069
2024-03-20T01:14:12.934 INFO:teuthology.dispatcher.supervisor:Job PID: 2002626
2024-03-20T01:14:12.935 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-20T01:16:13.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T01:18:13.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T01:20:13.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T01:22:13.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T01:24:13.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T01:26:13.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T01:28:14.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T01:30:14.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T01:32:14.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T01:34:14.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T01:36:14.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T01:38:14.916 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T01:40:15.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T01:42:15.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T01:44:15.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T01:46:15.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T01:48:15.752 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T01:50:15.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T01:52:16.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T01:52:16.158 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1