2024-03-07T13:15:36.732 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-07T13:15:36.732 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T13:15:36.909 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7ff098cd8f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7ff099d39c10>, signals=[15])
2024-03-07T13:15:36.910 INFO:teuthology.lock.ops:Start node 'smithi071.front.sepia.ceph.com' reimaging
2024-03-07T13:15:36.910 INFO:teuthology.lock.ops:Updating [smithi071.front.sepia.ceph.com]: reset os type and version on server
2024-03-07T13:15:36.910 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server
2024-03-07T13:15:36.936 INFO:teuthology.lock.ops:Start node 'smithi146.front.sepia.ceph.com' reimaging
2024-03-07T13:15:36.936 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: reset os type and version on server
2024-03-07T13:15:36.936 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server
2024-03-07T13:15:36.961 INFO:teuthology.lock.ops:Start node 'smithi156.front.sepia.ceph.com' reimaging
2024-03-07T13:15:36.961 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: reset os type and version on server
2024-03-07T13:15:36.961 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server
2024-03-07T13:15:37.055 DEBUG:teuthology.provision.fog.smithi071:Requesting image smithi_centos_9.stream (ID 10)
2024-03-07T13:15:37.084 DEBUG:teuthology.provision.fog.smithi146:Requesting image smithi_centos_9.stream (ID 10)
2024-03-07T13:15:37.095 DEBUG:teuthology.provision.fog.smithi156:Requesting image smithi_centos_9.stream (ID 10)
2024-03-07T13:15:37.106 INFO:teuthology.provision.fog.smithi071:Scheduling deploy of centos 9.stream
2024-03-07T13:15:37.133 INFO:teuthology.provision.fog.smithi146:Scheduling deploy of centos 9.stream
2024-03-07T13:15:37.137 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of centos 9.stream
2024-03-07T13:15:37.315 INFO:teuthology.orchestra.console.smithi071:Power off
2024-03-07T13:15:37.315 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-07T13:15:37.339 DEBUG:teuthology.orchestra.console.smithi071:power off output: Chassis Power Control: Down/Off
2024-03-07T13:15:37.339 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T13:15:37.358 INFO:teuthology.orchestra.console.smithi146:Power off
2024-03-07T13:15:37.359 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-07T13:15:37.372 INFO:teuthology.orchestra.console.smithi156:Power off
2024-03-07T13:15:37.372 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-07T13:15:37.380 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on
2024-03-07T13:15:37.382 DEBUG:teuthology.orchestra.console.smithi146:power off output: Chassis Power Control: Down/Off
2024-03-07T13:15:37.382 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T13:15:37.394 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off
2024-03-07T13:15:37.394 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T13:15:37.403 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on
2024-03-07T13:15:37.418 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on
2024-03-07T13:15:41.384 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T13:15:41.404 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T13:15:41.419 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T13:15:41.493 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on
2024-03-07T13:15:41.513 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on
2024-03-07T13:15:41.528 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on
2024-03-07T13:15:45.496 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T13:15:45.514 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T13:15:45.529 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T13:15:45.606 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off
2024-03-07T13:15:45.624 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on
2024-03-07T13:15:45.638 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off
2024-03-07T13:15:45.707 INFO:teuthology.orchestra.console.smithi071:Power off completed
2024-03-07T13:15:45.739 INFO:teuthology.orchestra.console.smithi156:Power off completed
2024-03-07T13:15:45.808 INFO:teuthology.orchestra.console.smithi071:Power on
2024-03-07T13:15:45.809 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-07T13:15:45.831 DEBUG:teuthology.orchestra.console.smithi071:power on output: Chassis Power Control: Up/On
2024-03-07T13:15:45.831 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T13:15:45.840 INFO:teuthology.orchestra.console.smithi156:Power on
2024-03-07T13:15:45.841 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-07T13:15:45.855 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off
2024-03-07T13:15:45.865 DEBUG:teuthology.orchestra.console.smithi156:power on output: Chassis Power Control: Up/On
2024-03-07T13:15:45.865 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T13:15:45.887 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off
2024-03-07T13:15:49.628 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T13:15:49.737 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off
2024-03-07T13:15:49.838 INFO:teuthology.orchestra.console.smithi146:Power off completed
2024-03-07T13:15:49.856 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T13:15:49.888 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T13:15:49.938 INFO:teuthology.orchestra.console.smithi146:Power on
2024-03-07T13:15:49.939 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-07T13:15:49.962 DEBUG:teuthology.orchestra.console.smithi146:power on output: Chassis Power Control: Up/On
2024-03-07T13:15:49.963 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T13:15:49.971 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off
2024-03-07T13:15:49.983 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off
2024-03-07T13:15:49.996 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on
2024-03-07T13:15:50.097 INFO:teuthology.orchestra.console.smithi156:Power on completed
2024-03-07T13:15:50.197 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish
2024-03-07T13:15:53.974 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T13:15:53.984 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T13:15:54.083 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on
2024-03-07T13:15:54.093 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on
2024-03-07T13:15:54.185 INFO:teuthology.orchestra.console.smithi071:Power on completed
2024-03-07T13:15:54.194 INFO:teuthology.orchestra.console.smithi146:Power on completed
2024-03-07T13:15:54.286 INFO:teuthology.provision.fog.smithi071:Waiting for deploy to finish
2024-03-07T13:15:54.295 INFO:teuthology.provision.fog.smithi146:Waiting for deploy to finish
2024-03-07T13:18:24.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:18:27.996 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71
2024-03-07T13:18:34.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:18:35.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:18:37.088 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71
2024-03-07T13:18:39.004 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2024-03-07T13:18:39.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:18:43.040 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-03-07T13:18:43.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:18:45.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:18:46.140 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71
2024-03-07T13:18:48.060 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2024-03-07T13:18:49.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:18:52.128 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-03-07T13:18:52.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:18:54.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:18:55.199 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71
2024-03-07T13:18:57.120 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2024-03-07T13:18:58.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:19:01.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:19:01.216 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-03-07T13:19:03.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:19:04.284 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71
2024-03-07T13:19:06.204 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2024-03-07T13:19:07.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:19:10.272 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-03-07T13:19:10.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:19:12.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:19:13.340 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71
2024-03-07T13:19:15.260 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2024-03-07T13:19:16.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:19:19.328 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-03-07T13:19:19.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:19:21.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:19:22.396 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71
2024-03-07T13:19:24.316 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2024-03-07T13:19:25.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:19:28.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:19:28.412 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-03-07T13:19:30.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:19:33.372 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2024-03-07T13:19:34.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:19:37.468 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-03-07T13:19:39.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:19:43.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:19:46.748 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71
2024-03-07T13:19:52.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:19:55.836 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71
2024-03-07T13:20:01.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:20:04.896 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71
2024-03-07T13:20:10.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:20:11.144 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-07T13:20:11.145 DEBUG:teuthology.orchestra.run.smithi071:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-07T13:20:26.618 INFO:teuthology.provision.fog.smithi071:Node is ready
2024-03-07T13:20:26.619 DEBUG:teuthology.orchestra.run.smithi071:> hostname
2024-03-07T13:20:26.636 INFO:teuthology.orchestra.run.smithi071.stdout:smithi046
2024-03-07T13:20:26.637 DEBUG:teuthology.orchestra.run.smithi071:> grep smithi046 /etc/hosts
2024-03-07T13:20:26.693 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046
2024-03-07T13:20:26.694 DEBUG:teuthology.orchestra.run.smithi071:> sudo hostname smithi071
2024-03-07T13:20:26.809 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/smithi046/smithi071/g' /etc/hosts
2024-03-07T13:20:26.839 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/172.21.15.46/172.21.15.71/g' /etc/hosts
2024-03-07T13:20:26.909 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/smithi046/smithi071/g' /etc/hostname
2024-03-07T13:20:26.978 DEBUG:teuthology.orchestra.run.smithi071:> sudo hostname smithi071
2024-03-07T13:20:27.046 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release
2024-03-07T13:20:27.101 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream"
2024-03-07T13:20:27.101 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="9"
2024-03-07T13:20:27.101 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos"
2024-03-07T13:20:27.101 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora"
2024-03-07T13:20:27.101 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="9"
2024-03-07T13:20:27.101 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el9"
2024-03-07T13:20:27.102 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-07T13:20:27.102 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31"
2024-03-07T13:20:27.102 INFO:teuthology.orchestra.run.smithi071.stdout:LOGO="fedora-logo-icon"
2024-03-07T13:20:27.102 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-07T13:20:27.102 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/"
2024-03-07T13:20:27.102 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-07T13:20:27.102 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-07T13:20:27.102 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-07T13:20:27.103 INFO:teuthology.provision.fog.smithi071:Deploy complete!
2024-03-07T13:20:27.104 DEBUG:teuthology.parallel:result is None
2024-03-07T13:20:39.388 WARNING:teuthology.provision.fog.smithi156:timed out
2024-03-07T13:20:43.480 WARNING:teuthology.provision.fog.smithi146:timed out
2024-03-07T13:20:45.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:20:45.691 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-07T13:20:45.692 DEBUG:teuthology.orchestra.run.smithi156:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-07T13:20:46.012 INFO:teuthology.provision.fog.smithi156:Node is ready
2024-03-07T13:20:46.012 DEBUG:teuthology.orchestra.run.smithi156:> hostname
2024-03-07T13:20:46.027 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com
2024-03-07T13:20:46.028 DEBUG:teuthology.orchestra.run.smithi156:> grep smithi156.front.sepia.ceph.com /etc/hosts
2024-03-07T13:20:46.083 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156
2024-03-07T13:20:46.083 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156
2024-03-07T13:20:46.192 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hosts
2024-03-07T13:20:46.220 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/172.21.15.156/172.21.15.156/g' /etc/hosts
2024-03-07T13:20:46.287 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hostname
2024-03-07T13:20:46.354 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156
2024-03-07T13:20:46.420 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release
2024-03-07T13:20:46.474 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream"
2024-03-07T13:20:46.474 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="9"
2024-03-07T13:20:46.474 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos"
2024-03-07T13:20:46.475 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora"
2024-03-07T13:20:46.475 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="9"
2024-03-07T13:20:46.475 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el9"
2024-03-07T13:20:46.475 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-07T13:20:46.475 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31"
2024-03-07T13:20:46.475 INFO:teuthology.orchestra.run.smithi156.stdout:LOGO="fedora-logo-icon"
2024-03-07T13:20:46.475 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-07T13:20:46.475 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/"
2024-03-07T13:20:46.475 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-07T13:20:46.475 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-07T13:20:46.475 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-07T13:20:46.475 INFO:teuthology.provision.fog.smithi156:Deploy complete!
2024-03-07T13:20:46.476 DEBUG:teuthology.parallel:result is None
2024-03-07T13:20:49.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:20:49.971 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-07T13:20:49.971 DEBUG:teuthology.orchestra.run.smithi146:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-07T13:20:50.296 INFO:teuthology.provision.fog.smithi146:Node is ready
2024-03-07T13:20:50.296 DEBUG:teuthology.orchestra.run.smithi146:> hostname
2024-03-07T13:20:50.312 INFO:teuthology.orchestra.run.smithi146.stdout:smithi146.front.sepia.ceph.com
2024-03-07T13:20:50.312 DEBUG:teuthology.orchestra.run.smithi146:> grep smithi146.front.sepia.ceph.com /etc/hosts
2024-03-07T13:20:50.368 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146 smithi146.front.sepia.ceph.com smithi146
2024-03-07T13:20:50.368 DEBUG:teuthology.orchestra.run.smithi146:> sudo hostname smithi146
2024-03-07T13:20:50.465 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/smithi146.front.sepia.ceph.com/smithi146/g' /etc/hosts
2024-03-07T13:20:50.493 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/172.21.15.146/172.21.15.146/g' /etc/hosts
2024-03-07T13:20:50.562 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/smithi146.front.sepia.ceph.com/smithi146/g' /etc/hostname
2024-03-07T13:20:50.629 DEBUG:teuthology.orchestra.run.smithi146:> sudo hostname smithi146
2024-03-07T13:20:50.696 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release
2024-03-07T13:20:50.751 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="CentOS Stream"
2024-03-07T13:20:50.752 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="9"
2024-03-07T13:20:50.752 INFO:teuthology.orchestra.run.smithi146.stdout:ID="centos"
2024-03-07T13:20:50.752 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="rhel fedora"
2024-03-07T13:20:50.752 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="9"
2024-03-07T13:20:50.752 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el9"
2024-03-07T13:20:50.752 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-07T13:20:50.752 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31"
2024-03-07T13:20:50.752 INFO:teuthology.orchestra.run.smithi146.stdout:LOGO="fedora-logo-icon"
2024-03-07T13:20:50.752 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-07T13:20:50.752 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://centos.org/"
2024-03-07T13:20:50.752 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-07T13:20:50.753 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-07T13:20:50.753 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-07T13:20:50.753 INFO:teuthology.provision.fog.smithi146:Deploy complete!
2024-03-07T13:20:50.753 DEBUG:teuthology.parallel:result is None
2024-03-07T13:20:50.968 INFO:teuthology.lock.ops:Checking smithi071.front.sepia.ceph.com
2024-03-07T13:20:50.968 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-07T13:20:50.985 INFO:teuthology.lock.ops:Checking smithi146.front.sepia.ceph.com
2024-03-07T13:20:50.985 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-07T13:20:51.009 INFO:teuthology.lock.ops:Checking smithi156.front.sepia.ceph.com
2024-03-07T13:20:51.009 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-07T13:20:51.027 INFO:teuthology.lock.ops:Updating [smithi071.front.sepia.ceph.com]: set os type and version on server
2024-03-07T13:20:51.027 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com'
2024-03-07T13:20:51.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:20:51.115 DEBUG:teuthology.orchestra.run.smithi071:> true
2024-03-07T13:20:51.282 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com'
2024-03-07T13:20:51.282 DEBUG:teuthology.orchestra.run.smithi071:> uname -m
2024-03-07T13:20:51.336 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64
2024-03-07T13:20:51.336 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release
2024-03-07T13:20:51.391 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream"
2024-03-07T13:20:51.391 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="9"
2024-03-07T13:20:51.391 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos"
2024-03-07T13:20:51.391 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora"
2024-03-07T13:20:51.391 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="9"
2024-03-07T13:20:51.391 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el9"
2024-03-07T13:20:51.392 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-07T13:20:51.392 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31"
2024-03-07T13:20:51.392 INFO:teuthology.orchestra.run.smithi071.stdout:LOGO="fedora-logo-icon"
2024-03-07T13:20:51.392 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-07T13:20:51.392 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/"
2024-03-07T13:20:51.392 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-07T13:20:51.392 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-07T13:20:51.392 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-07T13:20:51.393 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server
2024-03-07T13:20:51.409 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: set os type and version on server
2024-03-07T13:20:51.410 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com'
2024-03-07T13:20:51.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:20:51.498 DEBUG:teuthology.orchestra.run.smithi146:> true
2024-03-07T13:20:51.568 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com'
2024-03-07T13:20:51.568 DEBUG:teuthology.orchestra.run.smithi146:> uname -m
2024-03-07T13:20:51.623 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64
2024-03-07T13:20:51.623 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release
2024-03-07T13:20:51.678 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="CentOS Stream"
2024-03-07T13:20:51.678 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="9"
2024-03-07T13:20:51.678 INFO:teuthology.orchestra.run.smithi146.stdout:ID="centos"
2024-03-07T13:20:51.678 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="rhel fedora"
2024-03-07T13:20:51.678 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="9"
2024-03-07T13:20:51.679 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el9"
2024-03-07T13:20:51.679 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-07T13:20:51.679 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31"
2024-03-07T13:20:51.679 INFO:teuthology.orchestra.run.smithi146.stdout:LOGO="fedora-logo-icon"
2024-03-07T13:20:51.679 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-07T13:20:51.679 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://centos.org/"
2024-03-07T13:20:51.679 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-07T13:20:51.679 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-07T13:20:51.679 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-07T13:20:51.679 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server
2024-03-07T13:20:51.701 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: set os type and version on server
2024-03-07T13:20:51.701 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com'
2024-03-07T13:20:51.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T13:20:51.791 DEBUG:teuthology.orchestra.run.smithi156:> true
2024-03-07T13:20:51.864 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com'
2024-03-07T13:20:51.864 DEBUG:teuthology.orchestra.run.smithi156:> uname -m
2024-03-07T13:20:51.920 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64
2024-03-07T13:20:51.920 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release
2024-03-07T13:20:51.976 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream"
2024-03-07T13:20:51.976 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="9"
2024-03-07T13:20:51.977 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos"
2024-03-07T13:20:51.977 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora"
2024-03-07T13:20:51.977 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="9"
2024-03-07T13:20:51.977 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el9"
2024-03-07T13:20:51.977 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-07T13:20:51.977 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31"
2024-03-07T13:20:51.977 INFO:teuthology.orchestra.run.smithi156.stdout:LOGO="fedora-logo-icon"
2024-03-07T13:20:51.977 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-07T13:20:51.977 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/"
2024-03-07T13:20:51.977 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-07T13:20:51.977 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-07T13:20:51.977 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-07T13:20:51.978 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server
2024-03-07T13:20:52.001 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T13:20:52.107 INFO:teuthology.dispatcher.supervisor:Running job 7584459
2024-03-07T13:20:52.107 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-03-07_10:36:38-fs-wip-vshankar-testing-20240307.013758-testing-default-smithi/7584459 --name vshankar-2024-03-07_10:36:38-fs-wip-vshankar-testing-20240307.013758-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/fs/norstats}} -- /home/teuthworker/archive/vshankar-2024-03-07_10:36:38-fs-wip-vshankar-testing-20240307.013758-testing-default-smithi/7584459/orig.config.yaml
2024-03-07T13:20:52.110 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-03-07_10:36:38-fs-wip-vshankar-testing-20240307.013758-testing-default-smithi/7584459
2024-03-07T13:20:52.110 INFO:teuthology.dispatcher.supervisor:Job PID: 600155
2024-03-07T13:20:52.110 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-07T13:22:52.196 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T13:24:52.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T13:26:52.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T13:28:52.717 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T13:30:52.897 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T13:32:53.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T13:34:53.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T13:36:53.460 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T13:38:53.631 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T13:40:53.801 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T13:42:53.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T13:44:54.142 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T13:46:54.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T13:48:54.460 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T13:49:54.497 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/vshankar-2024-03-07_10:36:38-fs-wip-vshankar-testing-20240307.013758-testing-default-smithi/jobs/ failed with status 504: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>

2024-03-07T13:50:56.444 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/vshankar-2024-03-07_10:36:38-fs-wip-vshankar-testing-20240307.013758-testing-default-smithi/jobs/ failed with status 504: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>

2024-03-07T13:51:00.342 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/vshankar-2024-03-07_10:36:38-fs-wip-vshankar-testing-20240307.013758-testing-default-smithi/jobs/ failed with status 502: <html>
<head><title>502 Bad Gateway</title></head>
<body>
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>

2024-03-07T13:51:04.171 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/vshankar-2024-03-07_10:36:38-fs-wip-vshankar-testing-20240307.013758-testing-default-smithi/jobs/ failed with status 502: <html>
<head><title>502 Bad Gateway</title></head>
<body>
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>

2024-03-07T13:51:08.941 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/vshankar-2024-03-07_10:36:38-fs-wip-vshankar-testing-20240307.013758-testing-default-smithi/jobs/ failed with status 502: <html>
<head><title>502 Bad Gateway</title></head>
<body>
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>

2024-03-07T13:51:14.651 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/vshankar-2024-03-07_10:36:38-fs-wip-vshankar-testing-20240307.013758-testing-default-smithi/jobs/ failed with status 502: <html>
<head><title>502 Bad Gateway</title></head>
<body>
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>

2024-03-07T13:51:21.305 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/vshankar-2024-03-07_10:36:38-fs-wip-vshankar-testing-20240307.013758-testing-default-smithi/jobs/ failed with status 502: <html>
<head><title>502 Bad Gateway</title></head>
<body>
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>

2024-03-07T13:51:28.898 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/vshankar-2024-03-07_10:36:38-fs-wip-vshankar-testing-20240307.013758-testing-default-smithi/jobs/ failed with status 502: <html>
<head><title>502 Bad Gateway</title></head>
<body>
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>

2024-03-07T13:51:37.432 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/vshankar-2024-03-07_10:36:38-fs-wip-vshankar-testing-20240307.013758-testing-default-smithi/jobs/ failed with status 502: <html>
<head><title>502 Bad Gateway</title></head>
<body>
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>

2024-03-07T13:51:46.910 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/vshankar-2024-03-07_10:36:38-fs-wip-vshankar-testing-20240307.013758-testing-default-smithi/jobs/ failed with status 502: <html>
<head><title>502 Bad Gateway</title></head>
<body>
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>

2024-03-07T13:51:46.910 ERROR:teuthology.dispatcher.supervisor:Failed to report job status; ignoring
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/dispatcher/supervisor.py", line 335, in run_with_watchdog
    report.try_push_job_info(job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/report.py", line 512, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/report.py", line 474, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/report.py", line 299, in report_job
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'report job 7584459' reached maximum tries (11) after waiting for 52.320235331503504 seconds
2024-03-07T13:53:47.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:10:15.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:12:15.718 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:14:15.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:16:16.054 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:18:16.209 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:20:16.357 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:22:16.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:24:16.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:26:16.877 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:28:17.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:30:17.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:32:17.390 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:34:17.550 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:36:17.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:38:17.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:40:18.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:42:18.218 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:44:18.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:46:18.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:48:18.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:50:18.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:52:19.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:54:19.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:56:19.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:58:19.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:00:19.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:02:19.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:04:20.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:06:20.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:08:20.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:10:20.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:12:20.773 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:14:20.950 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:16:21.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:18:21.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:20:21.456 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:22:21.634 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:24:21.808 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:26:21.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:28:22.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:30:22.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:32:22.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:34:22.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:36:22.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:38:23.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:40:23.186 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:42:23.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:44:23.521 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:46:23.702 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:48:23.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:50:24.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:52:24.249 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:54:24.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:56:24.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:58:24.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T21:00:24.940 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T21:02:25.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T21:04:25.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T21:06:25.406 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T21:08:25.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T21:10:25.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T21:12:25.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T21:14:26.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T21:16:26.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T21:18:26.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T21:20:26.652 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T21:22:26.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T21:24:26.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T21:26:27.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T21:28:27.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T21:30:27.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T21:32:27.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T21:34:27.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T21:36:28.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T21:38:28.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T21:40:28.369 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T21:42:28.534 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T21:44:28.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T21:46:28.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T21:48:29.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T21:50:29.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T21:52:29.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T21:54:29.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T21:56:29.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T21:58:29.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T22:00:30.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T22:02:30.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T22:04:30.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T22:06:30.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T22:08:30.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T22:10:31.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T22:12:31.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T22:14:31.310 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T22:16:31.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T22:18:31.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T22:20:31.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T22:22:31.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T22:24:32.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T22:26:32.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T22:28:32.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T22:30:32.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T22:32:32.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T22:34:33.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T22:36:33.166 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T22:38:33.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T22:40:33.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T22:42:33.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T22:44:33.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T22:46:33.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T22:48:34.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T22:50:34.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T22:52:34.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T22:54:34.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T22:56:34.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T22:58:34.976 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T23:00:35.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T23:02:35.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T23:04:35.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T23:06:35.652 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T23:08:35.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T23:10:35.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T23:12:36.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T23:14:36.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T23:16:36.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T23:18:36.686 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T23:20:36.926 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T23:22:37.118 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T23:24:37.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T23:26:37.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T23:28:37.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T23:30:37.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T23:32:37.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T23:34:38.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T23:36:38.238 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T23:38:38.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T23:40:38.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T23:42:38.757 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T23:44:38.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T23:46:39.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T23:48:39.289 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T23:50:39.445 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T23:52:39.616 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T23:54:39.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T23:56:39.954 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T23:58:40.109 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T00:00:40.272 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T00:02:40.442 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T00:04:40.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T00:06:40.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T00:08:40.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T00:10:41.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T00:12:41.292 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T00:14:41.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T00:16:41.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T00:18:41.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T00:20:41.992 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T00:22:42.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T00:24:42.292 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T00:26:42.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T00:28:42.631 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T00:30:42.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T00:32:43.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T00:34:43.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T00:36:43.371 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T00:38:43.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T00:40:43.728 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T00:42:43.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T00:44:44.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T00:46:44.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T00:48:44.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T00:50:44.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T00:52:44.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T00:54:44.954 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T00:56:45.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T00:58:45.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T01:00:45.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T01:02:45.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T01:04:45.813 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T01:06:45.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T01:08:46.142 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T01:10:46.321 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T01:12:46.502 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T01:14:46.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T01:16:46.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T01:18:46.994 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T01:20:47.132 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T01:22:47.305 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2024-03-08T01:22:47.456 INFO:teuthology.kill:Killing Pids: {600155}
2024-03-08T01:22:48.437 INFO:teuthology.task.internal:roles: ubuntu@smithi071.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0']
2024-03-08T01:22:48.438 INFO:teuthology.task.internal:roles: ubuntu@smithi146.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10']
2024-03-08T01:22:48.438 INFO:teuthology.task.internal:roles: ubuntu@smithi156.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11']
2024-03-08T01:22:48.438 INFO:teuthology.misc:Compressing logs...
2024-03-08T01:22:48.438 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com'
2024-03-08T01:22:48.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-08T01:22:48.530 DEBUG:teuthology.orchestra.run.smithi071:> true
2024-03-08T01:22:48.752 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com'
2024-03-08T01:22:48.753 DEBUG:teuthology.orchestra.run.smithi071:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2024-03-08T01:22:48.795 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com'
2024-03-08T01:22:48.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-08T01:22:48.887 DEBUG:teuthology.orchestra.run.smithi146:> true
2024-03-08T01:22:49.104 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com'
2024-03-08T01:22:49.105 DEBUG:teuthology.orchestra.run.smithi146:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2024-03-08T01:22:49.147 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com'
2024-03-08T01:22:49.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-08T01:22:49.239 DEBUG:teuthology.orchestra.run.smithi156:> true
2024-03-08T01:22:49.456 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com'
2024-03-08T01:22:49.457 DEBUG:teuthology.orchestra.run.smithi156:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2024-03-08T01:22:49.531 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-03-07_10:36:38-fs-wip-vshankar-testing-20240307.013758-testing-default-smithi/7584459/remote/smithi071/crash
2024-03-08T01:22:49.531 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/lib/ceph/crash -- .
2024-03-08T01:22:49.561 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-03-07_10:36:38-fs-wip-vshankar-testing-20240307.013758-testing-default-smithi/7584459/remote/smithi146/crash
2024-03-08T01:22:49.562 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /var/lib/ceph/crash -- .
2024-03-08T01:22:49.607 DEBUG:teuthology.misc:Transferring archived files from smithi156:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-03-07_10:36:38-fs-wip-vshankar-testing-20240307.013758-testing-default-smithi/7584459/remote/smithi156/crash
2024-03-08T01:22:49.607 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar c -f - -C /var/lib/ceph/crash -- .
2024-03-08T01:22:49.642 INFO:teuthology.misc:Compressing logs...
2024-03-08T01:22:49.643 DEBUG:teuthology.orchestra.run.smithi071:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2024-03-08T01:22:49.645 DEBUG:teuthology.orchestra.run.smithi146:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2024-03-08T01:22:49.647 DEBUG:teuthology.orchestra.run.smithi156:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2024-03-08T01:22:49.671 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log
2024-03-08T01:22:49.671 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log
2024-03-08T01:22:49.672 INFO:teuthology.orchestra.run.smithi071.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log:	  0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz
2024-03-08T01:22:49.672 INFO:teuthology.orchestra.run.smithi071.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log:	  0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz
2024-03-08T01:22:49.672 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log
2024-03-08T01:22:49.673 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log
2024-03-08T01:22:49.673 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log:	  0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz
2024-03-08T01:22:49.673 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log:	  0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz
2024-03-08T01:22:49.710 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log
2024-03-08T01:22:49.710 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log
2024-03-08T01:22:49.710 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log:	  0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz
2024-03-08T01:22:49.711 INFO:teuthology.orchestra.run.smithi156.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log:	  0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz
2024-03-08T01:22:49.712 DEBUG:teuthology.misc:Transferring archived files from smithi071:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-03-07_10:36:38-fs-wip-vshankar-testing-20240307.013758-testing-default-smithi/7584459/remote/smithi071/
2024-03-08T01:22:49.712 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- .
2024-03-08T01:22:49.745 DEBUG:teuthology.misc:Transferring archived files from smithi146:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-03-07_10:36:38-fs-wip-vshankar-testing-20240307.013758-testing-default-smithi/7584459/remote/smithi146/
2024-03-08T01:22:49.745 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- .
2024-03-08T01:22:49.775 DEBUG:teuthology.misc:Transferring archived files from smithi156:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-03-07_10:36:38-fs-wip-vshankar-testing-20240307.013758-testing-default-smithi/7584459/remote/smithi156/
2024-03-08T01:22:49.775 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- .
2024-03-08T01:22:49.803 INFO:teuthology.misc:Compressing logs...
2024-03-08T01:22:49.804 DEBUG:teuthology.orchestra.run.smithi071:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2024-03-08T01:22:49.806 DEBUG:teuthology.orchestra.run.smithi146:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2024-03-08T01:22:49.819 DEBUG:teuthology.orchestra.run.smithi156:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2024-03-08T01:22:49.831 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log
2024-03-08T01:22:49.832 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.6.log
2024-03-08T01:22:49.832 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mon.a.log
2024-03-08T01:22:49.833 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/cephadm.log:	gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph.audit.log
2024-03-08T01:22:49.833 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.6.log:	/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mon.a.log:	gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.g.log
2024-03-08T01:22:49.834 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.j.log
2024-03-08T01:22:49.834 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph.audit.log:	/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.g.log:	gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.3.log
2024-03-08T01:22:49.834 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.j.log:	gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mgr.x.log
2024-03-08T01:22:49.834 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.3.log:	gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.0.log
2024-03-08T01:22:49.840 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mgr.x.log:	gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph.cephadm.log
2024-03-08T01:22:49.842 INFO:teuthology.orchestra.run.smithi071.stderr: 93.0% -- replaced with /var/log/ceph/cephadm.log.gz
2024-03-08T01:22:49.844 INFO:teuthology.orchestra.run.smithi071.stderr: 92.2% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph.audit.log.gz
2024-03-08T01:22:49.845 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log
2024-03-08T01:22:49.846 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.10.log
2024-03-08T01:22:49.846 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph.audit.log
2024-03-08T01:22:49.846 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/cephadm.log:	gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.b.log
2024-03-08T01:22:49.846 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.10.log:	gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.4.log
2024-03-08T01:22:49.846 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph.audit.log:	/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.b.log:	gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.1.log
2024-03-08T01:22:49.848 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.4.log:	gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.k.log
2024-03-08T01:22:49.848 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.1.log:	gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.h.log
2024-03-08T01:22:49.848 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.k.log:	gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.7.log
2024-03-08T01:22:49.850 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.h.log:	 92.0% -- replaced with /var/log/ceph/cephadm.log.gz
2024-03-08T01:22:49.850 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.e.log
2024-03-08T01:22:49.857 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.7.log:	 92.3% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph.audit.log.gz
2024-03-08T01:22:49.858 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mgr.y.log
2024-03-08T01:22:49.858 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.e.log:	gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph.cephadm.log
2024-03-08T01:22:49.859 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.0.log:	gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph.log
2024-03-08T01:22:49.859 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph.cephadm.log:	gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-volume.log
2024-03-08T01:22:49.860 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph.log:	 90.4% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph.cephadm.log.gz
2024-03-08T01:22:49.860 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.9.log
2024-03-08T01:22:49.871 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-volume.log:	gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.d.log
2024-03-08T01:22:49.872 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mgr.y.log:	gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph.log
2024-03-08T01:22:49.872 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log
2024-03-08T01:22:49.872 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.l.log
2024-03-08T01:22:49.874 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph.audit.log
2024-03-08T01:22:49.874 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/cephadm.log:	gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.i.log
2024-03-08T01:22:49.874 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.l.log:	/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph.audit.log:	gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.11.log
2024-03-08T01:22:49.874 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mgr.z.log
2024-03-08T01:22:49.874 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.i.log:	/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.11.log:	gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.8.log
2024-03-08T01:22:49.874 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mgr.z.log:	gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.5.log
2024-03-08T01:22:49.875 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph.cephadm.log:	 90.8% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph.cephadm.log.gz
2024-03-08T01:22:49.876 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.8.log:	gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.f.log
2024-03-08T01:22:49.877 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.5.log:	 92.1% -- replaced with /var/log/ceph/cephadm.log.gz
2024-03-08T01:22:49.877 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph.cephadm.log
2024-03-08T01:22:49.883 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-volume.log
2024-03-08T01:22:49.885 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.f.log:	 92.3% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph.audit.log.gz
2024-03-08T01:22:49.885 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph.log
2024-03-08T01:22:49.887 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph.cephadm.log:	 90.7% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph.cephadm.log.gz
2024-03-08T01:22:49.887 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.2.log
2024-03-08T01:22:49.890 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph.log:	gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mon.b.log
2024-03-08T01:22:49.891 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.9.log:	gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.a.log
2024-03-08T01:22:49.900 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph.log:	gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.c.log
2024-03-08T01:22:49.905 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.d.log:	/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.a.log:	 91.3% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-volume.log.gz
2024-03-08T01:22:49.917 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.2.log:	gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-volume.log
2024-03-08T01:22:49.923 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.c.log:	gzip -5 --verbose -- /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mon.c.log
2024-03-08T01:22:49.958 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-volume.log:	/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mon.b.log:	 91.3% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-volume.log.gz
2024-03-08T01:22:49.965 INFO:teuthology.orchestra.run.smithi071.stderr: 94.7% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.g.log.gz
2024-03-08T01:22:49.966 INFO:teuthology.orchestra.run.smithi071.stderr: 94.6% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.j.log.gz
2024-03-08T01:22:49.966 INFO:teuthology.orchestra.run.smithi071.stderr: 90.8% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph.log.gz
2024-03-08T01:22:49.982 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-volume.log:	/var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mon.c.log:	 90.8% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph.log.gz
2024-03-08T01:22:49.988 INFO:teuthology.orchestra.run.smithi146.stderr: 90.8% 94.4% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.k.log.gz
2024-03-08T01:22:49.992 INFO:teuthology.orchestra.run.smithi146.stderr: 94.5% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mgr.y.log.gz
2024-03-08T01:22:49.996 INFO:teuthology.orchestra.run.smithi156.stderr: 91.4% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-volume.log.gz
2024-03-08T01:22:49.997 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph.log.gz
2024-03-08T01:22:50.015 INFO:teuthology.orchestra.run.smithi156.stderr: 94.3% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.l.log.gz
2024-03-08T01:22:50.030 INFO:teuthology.orchestra.run.smithi071.stderr: 94.6% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.d.log.gz
2024-03-08T01:22:50.044 INFO:teuthology.orchestra.run.smithi156.stderr:gzip: /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mgr.z.log: file size changed while zipping
2024-03-08T01:22:50.044 INFO:teuthology.orchestra.run.smithi156.stderr: 94.5% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mgr.z.log.gz
2024-03-08T01:22:50.059 INFO:teuthology.orchestra.run.smithi071.stderr: 94.6% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.a.log.gz
2024-03-08T01:22:53.051 INFO:teuthology.orchestra.run.smithi146.stderr:gzip: /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.e.log: file size changed while zipping
2024-03-08T01:22:53.051 INFO:teuthology.orchestra.run.smithi146.stderr: 95.1% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.e.log.gz
2024-03-08T01:22:53.134 INFO:teuthology.orchestra.run.smithi156.stderr:gzip: /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.f.log: file size changed while zipping
2024-03-08T01:22:53.134 INFO:teuthology.orchestra.run.smithi156.stderr: 95.2% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.f.log.gz
2024-03-08T01:22:55.483 INFO:teuthology.orchestra.run.smithi156.stderr:gzip: /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.c.log: file size changed while zipping
2024-03-08T01:22:55.483 INFO:teuthology.orchestra.run.smithi156.stderr: 95.0% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.c.log.gz
2024-03-08T01:22:58.573 INFO:teuthology.orchestra.run.smithi071.stderr:gzip: /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mgr.x.log: file size changed while zipping
2024-03-08T01:22:58.573 INFO:teuthology.orchestra.run.smithi071.stderr: 90.5% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mgr.x.log.gz
2024-03-08T01:22:59.633 INFO:teuthology.orchestra.run.smithi146.stderr:gzip: /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mon.b.log: file size changed while zipping
2024-03-08T01:22:59.633 INFO:teuthology.orchestra.run.smithi146.stderr: 92.1% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mon.b.log.gz
2024-03-08T01:23:00.623 INFO:teuthology.orchestra.run.smithi156.stderr:gzip: /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mon.c.log: file size changed while zipping
2024-03-08T01:23:00.623 INFO:teuthology.orchestra.run.smithi156.stderr: 92.0% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mon.c.log.gz
2024-03-08T01:23:00.832 INFO:teuthology.orchestra.run.smithi156.stderr:gzip: /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.i.log: file size changed while zipping
2024-03-08T01:23:00.832 INFO:teuthology.orchestra.run.smithi156.stderr: 93.6% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.i.log.gz
2024-03-08T01:23:01.193 INFO:teuthology.orchestra.run.smithi146.stderr:gzip: /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.h.log: file size changed while zipping
2024-03-08T01:23:01.194 INFO:teuthology.orchestra.run.smithi146.stderr: 93.7% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.h.log.gz
2024-03-08T01:23:14.485 INFO:teuthology.orchestra.run.smithi071.stderr:gzip: /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mon.a.log: file size changed while zipping
2024-03-08T01:23:14.486 INFO:teuthology.orchestra.run.smithi071.stderr: 89.9% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mon.a.log.gz
2024-03-08T01:23:18.335 INFO:teuthology.orchestra.run.smithi156.stderr:gzip: /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.2.log: file size changed while zipping
2024-03-08T01:23:18.335 INFO:teuthology.orchestra.run.smithi156.stderr: 92.5% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.2.log.gz
2024-03-08T01:23:19.803 INFO:teuthology.orchestra.run.smithi146.stderr:gzip: /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.1.log: file size changed while zipping
2024-03-08T01:23:19.824 INFO:teuthology.orchestra.run.smithi146.stderr: 92.6% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.1.log.gz
2024-03-08T01:23:20.454 INFO:teuthology.orchestra.run.smithi156.stderr:gzip: /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.11.log: file size changed while zipping
2024-03-08T01:23:20.455 INFO:teuthology.orchestra.run.smithi156.stderr: 92.5% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.11.log.gz
2024-03-08T01:23:21.743 INFO:teuthology.orchestra.run.smithi146.stderr:gzip: /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.b.log: file size changed while zipping
2024-03-08T01:23:21.743 INFO:teuthology.orchestra.run.smithi146.stderr: 93.3% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-mds.b.log.gz
2024-03-08T01:23:22.290 INFO:teuthology.orchestra.run.smithi071.stderr:gzip: /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.0.log: file size changed while zipping
2024-03-08T01:23:22.290 INFO:teuthology.orchestra.run.smithi071.stderr: 92.6% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.0.log.gz
2024-03-08T01:23:24.353 INFO:teuthology.orchestra.run.smithi156.stderr:gzip: /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.5.log: file size changed while zipping
2024-03-08T01:23:24.353 INFO:teuthology.orchestra.run.smithi156.stderr: 92.6% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.5.log.gz
2024-03-08T01:23:24.910 INFO:teuthology.orchestra.run.smithi071.stderr:gzip: /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.9.log: file size changed while zipping
2024-03-08T01:23:24.910 INFO:teuthology.orchestra.run.smithi071.stderr: 92.3% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.9.log.gz
2024-03-08T01:23:25.467 INFO:teuthology.orchestra.run.smithi146.stderr:gzip: /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.4.log: file size changed while zipping
2024-03-08T01:23:25.467 INFO:teuthology.orchestra.run.smithi146.stderr: 92.4% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.4.log.gz
2024-03-08T01:23:25.958 INFO:teuthology.orchestra.run.smithi071.stderr:gzip: /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.3.log: file size changed while zipping
2024-03-08T01:23:25.958 INFO:teuthology.orchestra.run.smithi071.stderr: 92.8% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.3.log.gz
2024-03-08T01:23:29.111 INFO:teuthology.orchestra.run.smithi156.stderr:gzip: /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.8.log: file size changed while zipping
2024-03-08T01:23:29.111 INFO:teuthology.orchestra.run.smithi156.stderr: 92.2% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.8.log.gz
2024-03-08T01:23:30.726 INFO:teuthology.orchestra.run.smithi146.stderr:gzip: /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.7.log: file size changed while zipping
2024-03-08T01:23:30.726 INFO:teuthology.orchestra.run.smithi146.stderr: 92.3% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.7.log.gz
2024-03-08T01:23:31.096 INFO:teuthology.orchestra.run.smithi146.stderr:gzip: /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.10.log: file size changed while zipping
2024-03-08T01:23:31.096 INFO:teuthology.orchestra.run.smithi146.stderr: 92.2% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.10.log.gz
2024-03-08T01:23:33.155 INFO:teuthology.orchestra.run.smithi071.stderr:gzip: /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.6.log: file size changed while zipping
2024-03-08T01:23:33.155 INFO:teuthology.orchestra.run.smithi071.stderr: 91.8% -- replaced with /var/log/ceph/fe29bb1e-dc86-11ee-95c6-87774f69a715/ceph-osd.6.log.gz
2024-03-08T01:23:33.158 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-03-07_10:36:38-fs-wip-vshankar-testing-20240307.013758-testing-default-smithi/7584459/remote/smithi071/log
2024-03-08T01:23:33.159 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/log/ceph -- .
2024-03-08T01:23:58.921 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-03-07_10:36:38-fs-wip-vshankar-testing-20240307.013758-testing-default-smithi/7584459/remote/smithi146/log
2024-03-08T01:23:58.922 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /var/log/ceph -- .
2024-03-08T01:24:25.410 DEBUG:teuthology.misc:Transferring archived files from smithi156:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-03-07_10:36:38-fs-wip-vshankar-testing-20240307.013758-testing-default-smithi/7584459/remote/smithi156/log
2024-03-08T01:24:25.411 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar c -f - -C /var/log/ceph -- .
2024-03-08T01:24:48.200 INFO:teuthology.orchestra.run.smithi156.stderr:tar: ./fe29bb1e-dc86-11ee-95c6-87774f69a715: file changed as we read it
2024-03-08T01:24:48.287 INFO:teuthology.kill:No teuthology processes running
2024-03-08T01:24:49.421 INFO:teuthology.kill:Nuking machines: ['smithi071', 'smithi146', 'smithi156']
2024-03-08T01:24:50.263 INFO:teuthology.kill:2024-03-08 01:24:50,262.262 INFO:teuthology.nuke:targets:
2024-03-08T01:24:50.264 INFO:teuthology.kill:  smithi071.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNXKjx7zYxzbr6Z0Mpuu5E/0VYbkzkqn3mBZCx+AduHWV2EpPHjtL0EtG9dBRoyb8vFO4+pkDDTNnsZyA22NpbE=
2024-03-08T01:24:50.264 INFO:teuthology.kill:  smithi146.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCtazkMjq9Nq3FhFUFGufWgMJxrAVFuNevHueO1UW5IaGQTDkdAhbjQsXAoK9dPgL53Ar6ZV5MS6yVUizMngmzw=
2024-03-08T01:24:50.264 INFO:teuthology.kill:  smithi156.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIHl0Ll00XDjEpv/G9D9fgWYcCqs7wykN/FI6HU2W675/oAWilubR2LFMy3oEsDx6OeonU8ji+DBczKOsqwMF4g=
2024-03-08T01:24:50.264 INFO:teuthology.kill:2024-03-08 01:24:50,262.262 INFO:teuthology.nuke:Checking targets against current locks
2024-03-08T01:24:50.317 INFO:teuthology.kill:2024-03-08 01:24:50,317.317 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-03-08T01:24:50.334 INFO:teuthology.kill:2024-03-08 01:24:50,334.334 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-03-08T01:24:50.348 INFO:teuthology.kill:2024-03-08 01:24:50,348.348 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-03-08T01:24:50.378 INFO:teuthology.kill:2024-03-08 01:24:50,378.378 INFO:teuthology.orchestra.console.smithi071:Power off
2024-03-08T01:24:50.391 INFO:teuthology.kill:2024-03-08 01:24:50,390.390 INFO:teuthology.orchestra.console.smithi146:Power off
2024-03-08T01:24:50.430 INFO:teuthology.kill:2024-03-08 01:24:50,430.430 INFO:teuthology.orchestra.console.smithi156:Power off
2024-03-08T01:24:58.750 INFO:teuthology.kill:2024-03-08 01:24:58,749.749 INFO:teuthology.orchestra.console.smithi071:Power off completed
2024-03-08T01:24:58.755 INFO:teuthology.kill:2024-03-08 01:24:58,755.755 INFO:teuthology.orchestra.console.smithi146:Power off completed
2024-03-08T01:24:58.908 INFO:teuthology.kill:2024-03-08 01:24:58,908.908 INFO:teuthology.lock.ops:unlocked: smithi146.front.sepia.ceph.com
2024-03-08T01:24:58.925 INFO:teuthology.kill:2024-03-08 01:24:58,924.924 INFO:teuthology.lock.ops:unlocked: smithi071.front.sepia.ceph.com
2024-03-08T01:25:02.901 INFO:teuthology.kill:2024-03-08 01:25:02,901.901 INFO:teuthology.orchestra.console.smithi156:Power off completed
2024-03-08T01:25:03.047 INFO:teuthology.kill:2024-03-08 01:25:03,047.047 INFO:teuthology.lock.ops:unlocked: smithi156.front.sepia.ceph.com
2024-03-08T01:25:03.120 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T01:27:03.277 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T01:27:03.377 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15