2024-02-08T08:45:06.277 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22
2024-02-08T08:45:06.277 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-08T08:45:06.451 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f0f1eb5df40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f0f1fbbdc10>, signals=[15])
2024-02-08T08:45:06.451 INFO:teuthology.lock.ops:Start node 'smithi052.front.sepia.ceph.com' reimaging
2024-02-08T08:45:06.451 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: reset os type and version on server
2024-02-08T08:45:06.452 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server
2024-02-08T08:45:06.472 INFO:teuthology.lock.ops:Start node 'smithi110.front.sepia.ceph.com' reimaging
2024-02-08T08:45:06.473 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: reset os type and version on server
2024-02-08T08:45:06.473 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server
2024-02-08T08:45:06.497 INFO:teuthology.lock.ops:Start node 'smithi191.front.sepia.ceph.com' reimaging
2024-02-08T08:45:06.497 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: reset os type and version on server
2024-02-08T08:45:06.497 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server
2024-02-08T08:45:06.581 DEBUG:teuthology.provision.fog.smithi052:Requesting image smithi_centos_9.stream (ID 10)
2024-02-08T08:45:06.609 DEBUG:teuthology.provision.fog.smithi110:Requesting image smithi_centos_9.stream (ID 10)
2024-02-08T08:45:06.626 DEBUG:teuthology.provision.fog.smithi191:Requesting image smithi_centos_9.stream (ID 10)
2024-02-08T08:45:06.636 INFO:teuthology.provision.fog.smithi052:Scheduling deploy of centos 9.stream
2024-02-08T08:45:06.656 INFO:teuthology.provision.fog.smithi110:Scheduling deploy of centos 9.stream
2024-02-08T08:45:06.684 INFO:teuthology.provision.fog.smithi191:Scheduling deploy of centos 9.stream
2024-02-08T08:45:06.922 INFO:teuthology.orchestra.console.smithi110:Power off
2024-02-08T08:45:06.922 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-08T08:45:06.937 INFO:teuthology.orchestra.console.smithi052:Power off
2024-02-08T08:45:06.937 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-08T08:45:06.949 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off
2024-02-08T08:45:06.949 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-08T08:45:06.960 DEBUG:teuthology.orchestra.console.smithi052:power off output: Chassis Power Control: Down/Off
2024-02-08T08:45:06.961 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-08T08:45:06.975 INFO:teuthology.orchestra.console.smithi191:Power off
2024-02-08T08:45:06.976 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-08T08:45:06.984 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off
2024-02-08T08:45:06.984 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off
2024-02-08T08:45:07.001 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off
2024-02-08T08:45:07.001 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-08T08:45:07.024 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off
2024-02-08T08:45:07.085 INFO:teuthology.orchestra.console.smithi052:Power off completed
2024-02-08T08:45:07.086 INFO:teuthology.orchestra.console.smithi110:Power off completed
2024-02-08T08:45:07.125 INFO:teuthology.orchestra.console.smithi191:Power off completed
2024-02-08T08:45:07.187 INFO:teuthology.orchestra.console.smithi052:Power on
2024-02-08T08:45:07.187 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-08T08:45:07.195 INFO:teuthology.orchestra.console.smithi110:Power on
2024-02-08T08:45:07.195 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-08T08:45:07.210 DEBUG:teuthology.orchestra.console.smithi052:power on output: Chassis Power Control: Up/On
2024-02-08T08:45:07.211 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-08T08:45:07.220 DEBUG:teuthology.orchestra.console.smithi110:power on output: Chassis Power Control: Up/On
2024-02-08T08:45:07.220 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-08T08:45:07.226 INFO:teuthology.orchestra.console.smithi191:Power on
2024-02-08T08:45:07.226 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-08T08:45:07.234 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off
2024-02-08T08:45:07.240 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off
2024-02-08T08:45:07.248 DEBUG:teuthology.orchestra.console.smithi191:power on output: Chassis Power Control: Up/On
2024-02-08T08:45:07.248 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-08T08:45:07.272 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off
2024-02-08T08:45:11.239 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-08T08:45:11.247 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-08T08:45:11.273 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-08T08:45:11.350 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on
2024-02-08T08:45:11.356 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off
2024-02-08T08:45:11.381 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off
2024-02-08T08:45:11.451 INFO:teuthology.orchestra.console.smithi052:Power on completed
2024-02-08T08:45:11.552 INFO:teuthology.provision.fog.smithi052:Waiting for deploy to finish
2024-02-08T08:45:15.360 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-08T08:45:15.382 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-08T08:45:15.469 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on
2024-02-08T08:45:15.491 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on
2024-02-08T08:45:15.570 INFO:teuthology.orchestra.console.smithi110:Power on completed
2024-02-08T08:45:15.592 INFO:teuthology.orchestra.console.smithi191:Power on completed
2024-02-08T08:45:15.671 INFO:teuthology.provision.fog.smithi110:Waiting for deploy to finish
2024-02-08T08:45:15.693 INFO:teuthology.provision.fog.smithi191:Waiting for deploy to finish
2024-02-08T08:47:42.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T08:47:45.756 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52
2024-02-08T08:47:46.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T08:47:51.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T08:47:54.812 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52
2024-02-08T08:48:00.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T08:48:01.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T08:48:03.868 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52
2024-02-08T08:48:04.895 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2024-02-08T08:48:09.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T08:48:10.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T08:48:12.927 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52
2024-02-08T08:48:13.951 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2024-02-08T08:48:18.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T08:48:19.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T08:48:21.980 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52
2024-02-08T08:48:23.008 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2024-02-08T08:48:27.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T08:48:29.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T08:48:32.060 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2024-02-08T08:48:38.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T08:48:41.116 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2024-02-08T08:48:47.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T08:48:47.416 ERROR:teuthology.orchestra.connection:Error authenticating with smithi110.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 457, in connect
    server_key = t.get_remote_server_key()
  File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 918, in get_remote_server_key
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2024-02-08T08:48:50.176 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2024-02-08T08:48:56.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T08:49:27.984 WARNING:teuthology.provision.fog.smithi052:timed out
2024-02-08T08:49:33.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T08:49:34.235 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-08T08:49:34.235 DEBUG:teuthology.orchestra.run.smithi052:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-08T08:49:34.558 INFO:teuthology.provision.fog.smithi052:Node is ready
2024-02-08T08:49:34.558 DEBUG:teuthology.orchestra.run.smithi052:> hostname
2024-02-08T08:49:34.573 INFO:teuthology.orchestra.run.smithi052.stdout:smithi052.front.sepia.ceph.com
2024-02-08T08:49:34.573 DEBUG:teuthology.orchestra.run.smithi052:> grep smithi052.front.sepia.ceph.com /etc/hosts
2024-02-08T08:49:34.629 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52 smithi052.front.sepia.ceph.com smithi052
2024-02-08T08:49:34.629 DEBUG:teuthology.orchestra.run.smithi052:> sudo hostname smithi052
2024-02-08T08:49:34.731 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/smithi052.front.sepia.ceph.com/smithi052/g' /etc/hosts
2024-02-08T08:49:34.763 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/172.21.15.52/172.21.15.52/g' /etc/hosts
2024-02-08T08:49:34.833 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/smithi052.front.sepia.ceph.com/smithi052/g' /etc/hostname
2024-02-08T08:49:34.905 DEBUG:teuthology.orchestra.run.smithi052:> sudo hostname smithi052
2024-02-08T08:49:34.975 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release
2024-02-08T08:49:35.030 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Stream"
2024-02-08T08:49:35.030 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="9"
2024-02-08T08:49:35.030 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos"
2024-02-08T08:49:35.030 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora"
2024-02-08T08:49:35.030 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="9"
2024-02-08T08:49:35.030 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el9"
2024-02-08T08:49:35.030 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-08T08:49:35.030 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31"
2024-02-08T08:49:35.030 INFO:teuthology.orchestra.run.smithi052.stdout:LOGO="fedora-logo-icon"
2024-02-08T08:49:35.030 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-08T08:49:35.030 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://centos.org/"
2024-02-08T08:49:35.030 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-08T08:49:35.031 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-08T08:49:35.031 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-08T08:49:35.031 INFO:teuthology.provision.fog.smithi052:Deploy complete!
2024-02-08T08:49:35.033 DEBUG:teuthology.parallel:result is None
2024-02-08T08:49:45.536 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2024-02-08T08:49:51.478 WARNING:teuthology.provision.fog.smithi110:timed out
2024-02-08T08:49:56.184 WARNING:teuthology.provision.fog.smithi191:timed out
2024-02-08T08:49:57.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T08:49:57.754 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-08T08:49:57.755 DEBUG:teuthology.orchestra.run.smithi110:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-08T08:49:58.087 INFO:teuthology.provision.fog.smithi110:Node is ready
2024-02-08T08:49:58.087 DEBUG:teuthology.orchestra.run.smithi110:> hostname
2024-02-08T08:49:58.102 INFO:teuthology.orchestra.run.smithi110.stdout:smithi110.front.sepia.ceph.com
2024-02-08T08:49:58.102 DEBUG:teuthology.orchestra.run.smithi110:> grep smithi110.front.sepia.ceph.com /etc/hosts
2024-02-08T08:49:58.157 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110 smithi110.front.sepia.ceph.com smithi110
2024-02-08T08:49:58.158 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110
2024-02-08T08:49:58.265 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hosts
2024-02-08T08:49:58.293 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/172.21.15.110/172.21.15.110/g' /etc/hosts
2024-02-08T08:49:58.360 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hostname
2024-02-08T08:49:58.427 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110
2024-02-08T08:49:58.492 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release
2024-02-08T08:49:58.546 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Stream"
2024-02-08T08:49:58.547 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="9"
2024-02-08T08:49:58.547 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos"
2024-02-08T08:49:58.547 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora"
2024-02-08T08:49:58.547 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="9"
2024-02-08T08:49:58.547 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el9"
2024-02-08T08:49:58.547 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-08T08:49:58.547 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31"
2024-02-08T08:49:58.547 INFO:teuthology.orchestra.run.smithi110.stdout:LOGO="fedora-logo-icon"
2024-02-08T08:49:58.547 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-08T08:49:58.547 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://centos.org/"
2024-02-08T08:49:58.547 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-08T08:49:58.547 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-08T08:49:58.547 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-08T08:49:58.548 INFO:teuthology.provision.fog.smithi110:Deploy complete!
2024-02-08T08:49:58.548 DEBUG:teuthology.parallel:result is None
2024-02-08T08:50:02.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T08:50:02.556 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-08T08:50:02.557 DEBUG:teuthology.orchestra.run.smithi191:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-08T08:50:02.881 INFO:teuthology.provision.fog.smithi191:Node is ready
2024-02-08T08:50:02.881 DEBUG:teuthology.orchestra.run.smithi191:> hostname
2024-02-08T08:50:02.896 INFO:teuthology.orchestra.run.smithi191.stdout:smithi191.front.sepia.ceph.com
2024-02-08T08:50:02.896 DEBUG:teuthology.orchestra.run.smithi191:> grep smithi191.front.sepia.ceph.com /etc/hosts
2024-02-08T08:50:02.951 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.15.191 smithi191.front.sepia.ceph.com smithi191
2024-02-08T08:50:02.952 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191
2024-02-08T08:50:03.058 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hosts
2024-02-08T08:50:03.085 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/172.21.15.191/172.21.15.191/g' /etc/hosts
2024-02-08T08:50:03.153 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hostname
2024-02-08T08:50:03.220 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191
2024-02-08T08:50:03.286 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release
2024-02-08T08:50:03.341 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream"
2024-02-08T08:50:03.341 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="9"
2024-02-08T08:50:03.341 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos"
2024-02-08T08:50:03.341 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora"
2024-02-08T08:50:03.341 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="9"
2024-02-08T08:50:03.341 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el9"
2024-02-08T08:50:03.341 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-08T08:50:03.341 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31"
2024-02-08T08:50:03.341 INFO:teuthology.orchestra.run.smithi191.stdout:LOGO="fedora-logo-icon"
2024-02-08T08:50:03.341 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-08T08:50:03.341 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/"
2024-02-08T08:50:03.341 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-08T08:50:03.342 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-08T08:50:03.342 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-08T08:50:03.342 INFO:teuthology.provision.fog.smithi191:Deploy complete!
2024-02-08T08:50:03.342 DEBUG:teuthology.parallel:result is None
2024-02-08T08:50:03.560 INFO:teuthology.lock.ops:Checking smithi052.front.sepia.ceph.com
2024-02-08T08:50:03.561 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-08T08:50:03.585 INFO:teuthology.lock.ops:Checking smithi110.front.sepia.ceph.com
2024-02-08T08:50:03.585 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-08T08:50:03.601 INFO:teuthology.lock.ops:Checking smithi191.front.sepia.ceph.com
2024-02-08T08:50:03.601 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-08T08:50:03.619 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: set os type and version on server
2024-02-08T08:50:03.620 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com'
2024-02-08T08:50:03.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T08:50:03.725 DEBUG:teuthology.orchestra.run.smithi052:> true
2024-02-08T08:50:03.910 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com'
2024-02-08T08:50:03.911 DEBUG:teuthology.orchestra.run.smithi052:> uname -m
2024-02-08T08:50:03.965 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64
2024-02-08T08:50:03.966 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release
2024-02-08T08:50:04.021 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Stream"
2024-02-08T08:50:04.021 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="9"
2024-02-08T08:50:04.021 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos"
2024-02-08T08:50:04.021 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora"
2024-02-08T08:50:04.021 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="9"
2024-02-08T08:50:04.021 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el9"
2024-02-08T08:50:04.021 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-08T08:50:04.021 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31"
2024-02-08T08:50:04.021 INFO:teuthology.orchestra.run.smithi052.stdout:LOGO="fedora-logo-icon"
2024-02-08T08:50:04.022 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-08T08:50:04.022 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://centos.org/"
2024-02-08T08:50:04.022 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-08T08:50:04.022 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-08T08:50:04.022 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-08T08:50:04.022 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server
2024-02-08T08:50:04.052 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: set os type and version on server
2024-02-08T08:50:04.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com'
2024-02-08T08:50:04.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T08:50:04.142 DEBUG:teuthology.orchestra.run.smithi110:> true
2024-02-08T08:50:04.213 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com'
2024-02-08T08:50:04.213 DEBUG:teuthology.orchestra.run.smithi110:> uname -m
2024-02-08T08:50:04.269 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64
2024-02-08T08:50:04.269 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release
2024-02-08T08:50:04.325 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Stream"
2024-02-08T08:50:04.325 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="9"
2024-02-08T08:50:04.325 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos"
2024-02-08T08:50:04.325 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora"
2024-02-08T08:50:04.325 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="9"
2024-02-08T08:50:04.325 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el9"
2024-02-08T08:50:04.325 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-08T08:50:04.325 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31"
2024-02-08T08:50:04.326 INFO:teuthology.orchestra.run.smithi110.stdout:LOGO="fedora-logo-icon"
2024-02-08T08:50:04.326 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-08T08:50:04.326 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://centos.org/"
2024-02-08T08:50:04.326 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-08T08:50:04.326 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-08T08:50:04.326 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-08T08:50:04.326 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server
2024-02-08T08:50:04.352 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: set os type and version on server
2024-02-08T08:50:04.352 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com'
2024-02-08T08:50:04.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T08:50:04.441 DEBUG:teuthology.orchestra.run.smithi191:> true
2024-02-08T08:50:04.513 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com'
2024-02-08T08:50:04.513 DEBUG:teuthology.orchestra.run.smithi191:> uname -m
2024-02-08T08:50:04.570 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64
2024-02-08T08:50:04.570 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release
2024-02-08T08:50:04.626 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream"
2024-02-08T08:50:04.626 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="9"
2024-02-08T08:50:04.626 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos"
2024-02-08T08:50:04.627 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora"
2024-02-08T08:50:04.627 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="9"
2024-02-08T08:50:04.627 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el9"
2024-02-08T08:50:04.627 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-08T08:50:04.627 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31"
2024-02-08T08:50:04.627 INFO:teuthology.orchestra.run.smithi191.stdout:LOGO="fedora-logo-icon"
2024-02-08T08:50:04.627 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-08T08:50:04.627 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/"
2024-02-08T08:50:04.627 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-08T08:50:04.627 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-08T08:50:04.627 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-08T08:50:04.628 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server
2024-02-08T08:50:04.652 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-08T08:50:04.745 INFO:teuthology.dispatcher.supervisor:Running job 7550781
2024-02-08T08:50:04.745 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-02-07_22:15:19-rados-wip-yuri6-testing-2024-02-07-1000-distro-default-smithi/7550781 --name yuriw-2024-02-07_22:15:19-rados-wip-yuri6-testing-2024-02-07-1000-distro-default-smithi --description rados/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_rgw_multisite} -- /home/teuthworker/archive/yuriw-2024-02-07_22:15:19-rados-wip-yuri6-testing-2024-02-07-1000-distro-default-smithi/7550781/orig.config.yaml
2024-02-08T08:50:04.749 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-02-07_22:15:19-rados-wip-yuri6-testing-2024-02-07-1000-distro-default-smithi/7550781
2024-02-08T08:50:04.749 INFO:teuthology.dispatcher.supervisor:Job PID: 3436279
2024-02-08T08:50:04.749 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-02-08T08:52:04.838 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-08T08:54:05.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-08T08:56:05.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-08T08:58:05.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-08T09:00:05.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-08T09:02:05.714 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-08T09:04:05.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-08T09:06:06.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-08T09:06:06.135 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1