2024-03-07T13:37:47.929 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-07T13:37:47.930 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T13:37:48.092 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fc5ad024f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fc5ae098c10>, signals=[15])
2024-03-07T13:37:48.092 INFO:teuthology.lock.ops:Start node 'smithi150.front.sepia.ceph.com' reimaging
2024-03-07T13:37:48.092 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: reset os type and version on server
2024-03-07T13:37:48.092 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server
2024-03-07T13:37:48.116 INFO:teuthology.lock.ops:Start node 'smithi181.front.sepia.ceph.com' reimaging
2024-03-07T13:37:48.116 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: reset os type and version on server
2024-03-07T13:37:48.116 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server
2024-03-07T13:37:48.220 DEBUG:teuthology.provision.fog.smithi150:Requesting image smithi_centos_9.stream (ID 10)
2024-03-07T13:37:48.241 DEBUG:teuthology.provision.fog.smithi181:Requesting image smithi_centos_9.stream (ID 10)
2024-03-07T13:37:48.273 INFO:teuthology.provision.fog.smithi150:Scheduling deploy of centos 9.stream
2024-03-07T13:37:48.280 INFO:teuthology.provision.fog.smithi181:Scheduling deploy of centos 9.stream
2024-03-07T13:37:48.611 INFO:teuthology.orchestra.console.smithi181:Power off
2024-03-07T13:37:48.612 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-07T13:37:48.626 INFO:teuthology.orchestra.console.smithi150:Power off
2024-03-07T13:37:48.627 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-07T13:37:48.643 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off
2024-03-07T13:37:48.643 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T13:37:48.660 DEBUG:teuthology.orchestra.console.smithi150:power off output: Chassis Power Control: Down/Off
2024-03-07T13:37:48.660 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T13:37:48.672 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on
2024-03-07T13:37:48.683 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on
2024-03-07T13:37:52.676 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T13:37:52.684 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T13:37:52.787 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off
2024-03-07T13:37:52.793 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off
2024-03-07T13:37:52.888 INFO:teuthology.orchestra.console.smithi181:Power off completed
2024-03-07T13:37:52.894 INFO:teuthology.orchestra.console.smithi150:Power off completed
2024-03-07T13:37:52.989 INFO:teuthology.orchestra.console.smithi181:Power on
2024-03-07T13:37:52.990 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-07T13:37:53.002 INFO:teuthology.orchestra.console.smithi150:Power on
2024-03-07T13:37:53.003 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-07T13:37:53.018 DEBUG:teuthology.orchestra.console.smithi181:power on output: Chassis Power Control: Up/On
2024-03-07T13:37:53.018 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T13:37:53.029 DEBUG:teuthology.orchestra.console.smithi150:power on output: Chassis Power Control: Up/On
2024-03-07T13:37:53.030 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T13:37:53.042 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off
2024-03-07T13:37:53.052 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off
2024-03-07T13:37:57.044 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T13:37:57.054 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T13:37:57.156 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off
2024-03-07T13:37:57.162 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on
2024-03-07T13:37:57.263 INFO:teuthology.orchestra.console.smithi150:Power on completed
2024-03-07T13:37:57.364 INFO:teuthology.provision.fog.smithi150:Waiting for deploy to finish
2024-03-07T13:38:01.160 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T13:38:01.304 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on
2024-03-07T13:38:01.405 INFO:teuthology.orchestra.console.smithi181:Power on completed
2024-03-07T13:38:01.505 INFO:teuthology.provision.fog.smithi181:Waiting for deploy to finish
2024-03-07T13:40:47.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:40:47.764 ERROR:teuthology.orchestra.connection:Error authenticating with smithi181.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-07T13:40:58.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:41:01.788 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2024-03-07T13:41:07.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:41:10.844 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2024-03-07T13:41:16.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:41:19.900 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2024-03-07T13:41:25.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:41:28.956 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2024-03-07T13:41:34.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:41:38.012 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2024-03-07T13:41:44.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:41:47.068 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2024-03-07T13:41:51.767 WARNING:teuthology.provision.fog.smithi181:timed out
2024-03-07T13:41:53.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:41:56.128 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2024-03-07T13:41:57.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:42:00.828 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181
2024-03-07T13:42:02.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:42:06.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:42:09.884 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181
2024-03-07T13:42:15.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:42:18.940 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181
2024-03-07T13:42:24.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:42:28.000 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181
2024-03-07T13:42:34.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:42:34.253 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-07T13:42:34.254 DEBUG:teuthology.orchestra.run.smithi181:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-07T13:42:49.739 INFO:teuthology.provision.fog.smithi181:Node is ready
2024-03-07T13:42:49.739 DEBUG:teuthology.orchestra.run.smithi181:> hostname
2024-03-07T13:42:49.756 INFO:teuthology.orchestra.run.smithi181.stdout:smithi181.front.sepia.ceph.com
2024-03-07T13:42:49.756 DEBUG:teuthology.orchestra.run.smithi181:> grep smithi181.front.sepia.ceph.com /etc/hosts
2024-03-07T13:42:49.812 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.181 smithi181.front.sepia.ceph.com smithi181
2024-03-07T13:42:49.812 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181
2024-03-07T13:42:49.931 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181.front.sepia.ceph.com/smithi181/g' /etc/hosts
2024-03-07T13:42:49.959 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/172.21.15.181/172.21.15.181/g' /etc/hosts
2024-03-07T13:42:50.027 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181.front.sepia.ceph.com/smithi181/g' /etc/hostname
2024-03-07T13:42:50.094 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181
2024-03-07T13:42:50.161 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release
2024-03-07T13:42:50.215 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream"
2024-03-07T13:42:50.215 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="9"
2024-03-07T13:42:50.216 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos"
2024-03-07T13:42:50.216 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora"
2024-03-07T13:42:50.216 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="9"
2024-03-07T13:42:50.216 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el9"
2024-03-07T13:42:50.216 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-07T13:42:50.216 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31"
2024-03-07T13:42:50.216 INFO:teuthology.orchestra.run.smithi181.stdout:LOGO="fedora-logo-icon"
2024-03-07T13:42:50.216 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-07T13:42:50.216 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/"
2024-03-07T13:42:50.216 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-07T13:42:50.216 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-07T13:42:50.216 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-07T13:42:50.217 INFO:teuthology.provision.fog.smithi181:Deploy complete!
2024-03-07T13:42:50.219 DEBUG:teuthology.parallel:result is None
2024-03-07T13:43:02.132 WARNING:teuthology.provision.fog.smithi150:timed out
2024-03-07T13:43:08.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:43:08.489 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-07T13:43:08.490 DEBUG:teuthology.orchestra.run.smithi150:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-07T13:43:08.799 INFO:teuthology.provision.fog.smithi150:Node is ready
2024-03-07T13:43:08.799 DEBUG:teuthology.orchestra.run.smithi150:> hostname
2024-03-07T13:43:08.814 INFO:teuthology.orchestra.run.smithi150.stdout:smithi150.front.sepia.ceph.com
2024-03-07T13:43:08.814 DEBUG:teuthology.orchestra.run.smithi150:> grep smithi150.front.sepia.ceph.com /etc/hosts
2024-03-07T13:43:08.869 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.15.150 smithi150.front.sepia.ceph.com smithi150
2024-03-07T13:43:08.869 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150
2024-03-07T13:43:08.968 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hosts
2024-03-07T13:43:08.996 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/172.21.15.150/172.21.15.150/g' /etc/hosts
2024-03-07T13:43:09.063 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hostname
2024-03-07T13:43:09.130 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150
2024-03-07T13:43:09.196 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release
2024-03-07T13:43:09.250 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Stream"
2024-03-07T13:43:09.250 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="9"
2024-03-07T13:43:09.251 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos"
2024-03-07T13:43:09.251 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora"
2024-03-07T13:43:09.251 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="9"
2024-03-07T13:43:09.251 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el9"
2024-03-07T13:43:09.251 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-07T13:43:09.251 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31"
2024-03-07T13:43:09.251 INFO:teuthology.orchestra.run.smithi150.stdout:LOGO="fedora-logo-icon"
2024-03-07T13:43:09.251 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-07T13:43:09.251 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://centos.org/"
2024-03-07T13:43:09.251 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-07T13:43:09.251 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-07T13:43:09.251 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-07T13:43:09.252 INFO:teuthology.provision.fog.smithi150:Deploy complete!
2024-03-07T13:43:09.252 DEBUG:teuthology.parallel:result is None
2024-03-07T13:43:09.422 INFO:teuthology.lock.ops:Checking smithi150.front.sepia.ceph.com
2024-03-07T13:43:09.422 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-07T13:43:09.445 INFO:teuthology.lock.ops:Checking smithi181.front.sepia.ceph.com
2024-03-07T13:43:09.445 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-07T13:43:09.462 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: set os type and version on server
2024-03-07T13:43:09.463 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com'
2024-03-07T13:43:09.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:43:09.548 DEBUG:teuthology.orchestra.run.smithi150:> true
2024-03-07T13:43:09.618 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com'
2024-03-07T13:43:09.618 DEBUG:teuthology.orchestra.run.smithi150:> uname -m
2024-03-07T13:43:09.673 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64
2024-03-07T13:43:09.673 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release
2024-03-07T13:43:09.727 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Stream"
2024-03-07T13:43:09.727 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="9"
2024-03-07T13:43:09.727 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos"
2024-03-07T13:43:09.728 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora"
2024-03-07T13:43:09.728 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="9"
2024-03-07T13:43:09.728 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el9"
2024-03-07T13:43:09.728 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-07T13:43:09.728 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31"
2024-03-07T13:43:09.728 INFO:teuthology.orchestra.run.smithi150.stdout:LOGO="fedora-logo-icon"
2024-03-07T13:43:09.728 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-07T13:43:09.728 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://centos.org/"
2024-03-07T13:43:09.728 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-07T13:43:09.728 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-07T13:43:09.728 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-07T13:43:09.729 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server
2024-03-07T13:43:09.832 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: set os type and version on server
2024-03-07T13:43:09.832 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com'
2024-03-07T13:43:09.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:43:09.920 DEBUG:teuthology.orchestra.run.smithi181:> true
2024-03-07T13:43:10.090 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com'
2024-03-07T13:43:10.090 DEBUG:teuthology.orchestra.run.smithi181:> uname -m
2024-03-07T13:43:10.144 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64
2024-03-07T13:43:10.144 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release
2024-03-07T13:43:10.198 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream"
2024-03-07T13:43:10.198 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="9"
2024-03-07T13:43:10.198 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos"
2024-03-07T13:43:10.198 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora"
2024-03-07T13:43:10.199 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="9"
2024-03-07T13:43:10.199 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el9"
2024-03-07T13:43:10.199 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-07T13:43:10.199 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31"
2024-03-07T13:43:10.199 INFO:teuthology.orchestra.run.smithi181.stdout:LOGO="fedora-logo-icon"
2024-03-07T13:43:10.199 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-07T13:43:10.199 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/"
2024-03-07T13:43:10.199 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-07T13:43:10.199 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-07T13:43:10.199 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-07T13:43:10.199 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server
2024-03-07T13:43:10.220 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T13:43:10.326 INFO:teuthology.dispatcher.supervisor:Running job 7584490
2024-03-07T13:43:10.326 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-03-07_10:41:12-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7584490 --name vshankar-2024-03-07_10:41:12-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/quota} -- /home/teuthworker/archive/vshankar-2024-03-07_10:41:12-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7584490/orig.config.yaml
2024-03-07T13:43:10.330 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-03-07_10:41:12-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7584490
2024-03-07T13:43:10.330 INFO:teuthology.dispatcher.supervisor:Job PID: 694456
2024-03-07T13:43:10.330 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-07T13:45:10.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T13:47:10.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T13:49:10.472 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T13:50:10.544 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/vshankar-2024-03-07_10:41:12-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/jobs/ failed with status 504: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>

2024-03-07T13:50:59.432 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/vshankar-2024-03-07_10:41:12-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/jobs/ failed with status 502: <html>
<head><title>502 Bad Gateway</title></head>
<body>
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>

2024-03-07T13:51:02.040 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/vshankar-2024-03-07_10:41:12-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/jobs/ failed with status 502: <html>
<head><title>502 Bad Gateway</title></head>
<body>
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>

2024-03-07T13:51:05.450 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/vshankar-2024-03-07_10:41:12-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/jobs/ failed with status 502: <html>
<head><title>502 Bad Gateway</title></head>
<body>
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>

2024-03-07T13:51:09.752 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/vshankar-2024-03-07_10:41:12-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/jobs/ failed with status 502: <html>
<head><title>502 Bad Gateway</title></head>
<body>
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>

2024-03-07T13:51:14.766 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/vshankar-2024-03-07_10:41:12-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/jobs/ failed with status 502: <html>
<head><title>502 Bad Gateway</title></head>
<body>
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>

2024-03-07T13:51:20.582 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/vshankar-2024-03-07_10:41:12-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/jobs/ failed with status 502: <html>
<head><title>502 Bad Gateway</title></head>
<body>
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>

2024-03-07T13:51:27.200 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/vshankar-2024-03-07_10:41:12-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/jobs/ failed with status 502: <html>
<head><title>502 Bad Gateway</title></head>
<body>
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>

2024-03-07T13:51:34.620 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/vshankar-2024-03-07_10:41:12-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/jobs/ failed with status 502: <html>
<head><title>502 Bad Gateway</title></head>
<body>
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>

2024-03-07T13:51:42.842 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/vshankar-2024-03-07_10:41:12-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/jobs/ failed with status 502: <html>
<head><title>502 Bad Gateway</title></head>
<body>
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>

2024-03-07T13:51:42.842 ERROR:teuthology.dispatcher.supervisor:Failed to report job status; ignoring
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/dispatcher/supervisor.py", line 335, in run_with_watchdog
    report.try_push_job_info(job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/report.py", line 512, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/report.py", line 474, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/report.py", line 299, in report_job
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'report job 7584490' reached maximum tries (11) after waiting for 46.09065127459328 seconds
2024-03-07T13:53:42.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T13:53:42.939 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1