2023-08-14T06:40:59.744 INFO:root:teuthology version: 0.0.1.dev181+g7fda959
2023-08-14T06:40:59.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T06:40:59.951 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f85bbfe17f0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f85bb8c6f70>, signals=[15])
2023-08-14T06:40:59.952 INFO:teuthology.lock.ops:Start node 'smithi002.front.sepia.ceph.com' reimaging
2023-08-14T06:40:59.953 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: reset os type and version on server
2023-08-14T06:40:59.953 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server
2023-08-14T06:40:59.977 INFO:teuthology.lock.ops:Start node 'smithi093.front.sepia.ceph.com' reimaging
2023-08-14T06:40:59.978 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: reset os type and version on server
2023-08-14T06:40:59.978 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server
2023-08-14T06:40:59.979 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /host {"name": "smithi002"}
2023-08-14T06:41:00.002 INFO:teuthology.lock.ops:Start node 'smithi117.front.sepia.ceph.com' reimaging
2023-08-14T06:41:00.003 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: reset os type and version on server
2023-08-14T06:41:00.003 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server
2023-08-14T06:41:00.004 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /host {"name": "smithi093"}
2023-08-14T06:41:00.019 INFO:teuthology.lock.ops:Start node 'smithi123.front.sepia.ceph.com' reimaging
2023-08-14T06:41:00.019 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: reset os type and version on server
2023-08-14T06:41:00.019 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server
2023-08-14T06:41:00.020 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /host {"name": "smithi117"}
2023-08-14T06:41:00.043 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-08-14T06:41:00.046 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /host {"name": "smithi123"}
2023-08-14T06:41:00.067 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-08-14T06:41:00.078 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-08-14T06:41:00.081 DEBUG:teuthology.provision.fog.smithi002:Requesting image smithi_centos_9.stream (ID 10)
2023-08-14T06:41:00.081 DEBUG:teuthology.provision.fog.smithi002:FOG request: PUT /host/108 {"imageID": 10}
2023-08-14T06:41:00.104 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-08-14T06:41:00.115 DEBUG:teuthology.provision.fog.smithi093:Requesting image smithi_centos_9.stream (ID 10)
2023-08-14T06:41:00.115 DEBUG:teuthology.provision.fog.smithi093:FOG request: PUT /host/198 {"imageID": 10}
2023-08-14T06:41:00.120 INFO:teuthology.provision.fog.smithi002:Scheduling deploy of centos 9.stream
2023-08-14T06:41:00.120 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-08-14T06:41:00.122 DEBUG:teuthology.provision.fog.smithi117:Requesting image smithi_centos_9.stream (ID 10)
2023-08-14T06:41:00.122 DEBUG:teuthology.provision.fog.smithi117:FOG request: PUT /host/222 {"imageID": 10}
2023-08-14T06:41:00.151 DEBUG:teuthology.provision.fog.smithi123:Requesting image smithi_centos_9.stream (ID 10)
2023-08-14T06:41:00.151 DEBUG:teuthology.provision.fog.smithi123:FOG request: PUT /host/228 {"imageID": 10}
2023-08-14T06:41:00.164 INFO:teuthology.provision.fog.smithi093:Scheduling deploy of centos 9.stream
2023-08-14T06:41:00.164 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-14T06:41:00.175 INFO:teuthology.provision.fog.smithi117:Scheduling deploy of centos 9.stream
2023-08-14T06:41:00.175 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-08-14T06:41:00.207 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of centos 9.stream
2023-08-14T06:41:00.207 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-14T06:41:00.271 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /tasktype {"name": "deploy"}
2023-08-14T06:41:00.276 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /tasktype {"name": "deploy"}
2023-08-14T06:41:00.285 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /tasktype {"name": "deploy"}
2023-08-14T06:41:00.308 DEBUG:teuthology.provision.fog.smithi002:FOG request: POST /host/108/task {"taskTypeID": 1}
2023-08-14T06:41:00.311 DEBUG:teuthology.provision.fog.smithi093:FOG request: POST /host/198/task {"taskTypeID": 1}
2023-08-14T06:41:00.314 DEBUG:teuthology.provision.fog.smithi117:FOG request: POST /host/222/task {"taskTypeID": 1}
2023-08-14T06:41:00.344 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /tasktype {"name": "deploy"}
2023-08-14T06:41:00.361 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-08-14T06:41:00.363 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-14T06:41:00.366 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-08-14T06:41:00.379 DEBUG:teuthology.provision.fog.smithi123:FOG request: POST /host/228/task {"taskTypeID": 1}
2023-08-14T06:41:00.428 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-14T06:41:00.554 INFO:teuthology.orchestra.console.smithi093:Power off
2023-08-14T06:41:00.555 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-14T06:41:00.573 INFO:teuthology.orchestra.console.smithi117:Power off
2023-08-14T06:41:00.574 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-14T06:41:00.586 INFO:teuthology.orchestra.console.smithi002:Power off
2023-08-14T06:41:00.587 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-14T06:41:00.596 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off
2023-08-14T06:41:00.596 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-14T06:41:00.603 DEBUG:teuthology.orchestra.console.smithi117:power off output: Chassis Power Control: Down/Off
2023-08-14T06:41:00.604 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-14T06:41:00.617 DEBUG:teuthology.orchestra.console.smithi002:power off output: Chassis Power Control: Down/Off
2023-08-14T06:41:00.618 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-14T06:41:00.624 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on
2023-08-14T06:41:00.626 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is on
2023-08-14T06:41:00.637 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on
2023-08-14T06:41:00.643 INFO:teuthology.orchestra.console.smithi123:Power off
2023-08-14T06:41:00.644 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-14T06:41:00.663 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off
2023-08-14T06:41:00.664 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-14T06:41:00.683 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on
2023-08-14T06:41:04.629 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-14T06:41:04.637 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-14T06:41:04.643 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-14T06:41:04.684 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-14T06:41:04.738 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on
2023-08-14T06:41:04.745 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is on
2023-08-14T06:41:04.751 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on
2023-08-14T06:41:04.793 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on
2023-08-14T06:41:08.744 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-14T06:41:08.752 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-14T06:41:08.758 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-14T06:41:08.794 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-14T06:41:08.854 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off
2023-08-14T06:41:08.860 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is off
2023-08-14T06:41:08.867 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off
2023-08-14T06:41:08.902 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off
2023-08-14T06:41:08.955 INFO:teuthology.orchestra.console.smithi093:Power off completed
2023-08-14T06:41:08.961 INFO:teuthology.orchestra.console.smithi117:Power off completed
2023-08-14T06:41:08.968 INFO:teuthology.orchestra.console.smithi002:Power off completed
2023-08-14T06:41:09.003 INFO:teuthology.orchestra.console.smithi123:Power off completed
2023-08-14T06:41:09.056 INFO:teuthology.orchestra.console.smithi093:Power on
2023-08-14T06:41:09.056 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-14T06:41:09.064 INFO:teuthology.orchestra.console.smithi117:Power on
2023-08-14T06:41:09.064 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-14T06:41:09.071 INFO:teuthology.orchestra.console.smithi002:Power on
2023-08-14T06:41:09.071 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-14T06:41:09.079 DEBUG:teuthology.orchestra.console.smithi093:power on output: Chassis Power Control: Up/On
2023-08-14T06:41:09.080 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-14T06:41:09.088 DEBUG:teuthology.orchestra.console.smithi117:power on output: Chassis Power Control: Up/On
2023-08-14T06:41:09.088 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-14T06:41:09.096 DEBUG:teuthology.orchestra.console.smithi002:power on output: Chassis Power Control: Up/On
2023-08-14T06:41:09.097 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-14T06:41:09.103 INFO:teuthology.orchestra.console.smithi123:Power on
2023-08-14T06:41:09.104 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-14T06:41:09.111 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off
2023-08-14T06:41:09.111 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is off
2023-08-14T06:41:09.117 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off
2023-08-14T06:41:09.122 DEBUG:teuthology.orchestra.console.smithi123:power on output: Chassis Power Control: Up/On
2023-08-14T06:41:09.122 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-14T06:41:09.143 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off
2023-08-14T06:41:13.116 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-14T06:41:13.123 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-14T06:41:13.131 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-14T06:41:13.144 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-14T06:41:13.226 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off
2023-08-14T06:41:13.233 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is off
2023-08-14T06:41:13.239 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off
2023-08-14T06:41:13.253 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off
2023-08-14T06:41:17.232 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-14T06:41:17.239 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-14T06:41:17.246 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-14T06:41:17.254 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-14T06:41:17.341 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on
2023-08-14T06:41:17.354 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on
2023-08-14T06:41:17.362 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on
2023-08-14T06:41:17.400 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is on
2023-08-14T06:41:17.442 INFO:teuthology.orchestra.console.smithi093:Power on completed
2023-08-14T06:41:17.456 INFO:teuthology.orchestra.console.smithi002:Power on completed
2023-08-14T06:41:17.463 INFO:teuthology.orchestra.console.smithi123:Power on completed
2023-08-14T06:41:17.502 INFO:teuthology.orchestra.console.smithi117:Power on completed
2023-08-14T06:41:17.543 INFO:teuthology.provision.fog.smithi093:Waiting for deploy to finish
2023-08-14T06:41:17.544 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-14T06:41:17.556 INFO:teuthology.provision.fog.smithi002:Waiting for deploy to finish
2023-08-14T06:41:17.557 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-08-14T06:41:17.564 INFO:teuthology.provision.fog.smithi123:Waiting for deploy to finish
2023-08-14T06:41:17.564 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-14T06:41:17.603 INFO:teuthology.provision.fog.smithi117:Waiting for deploy to finish
2023-08-14T06:41:17.603 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-08-14T06:41:32.692 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-08-14T06:41:32.693 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-14T06:41:32.695 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-14T06:41:32.723 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-08-14T06:41:47.828 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-14T06:41:47.829 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-14T06:41:47.831 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-08-14T06:41:47.850 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-08-14T06:42:02.964 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-14T06:42:02.965 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-14T06:42:02.967 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-08-14T06:42:02.977 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-08-14T06:42:18.096 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-14T06:42:18.097 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-08-14T06:42:18.098 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-08-14T06:42:18.099 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-14T06:42:33.228 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-14T06:42:33.229 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-08-14T06:42:33.230 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-14T06:42:33.231 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-08-14T06:42:48.399 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-08-14T06:42:48.400 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-14T06:42:48.401 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-14T06:42:48.402 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-08-14T06:43:03.579 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-14T06:43:03.581 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-08-14T06:43:03.581 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-14T06:43:03.582 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-08-14T06:43:18.764 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-08-14T06:43:18.765 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-14T06:43:18.768 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-14T06:43:18.769 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-08-14T06:43:33.903 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-08-14T06:43:33.905 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-14T06:43:33.909 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-14T06:43:33.913 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-08-14T06:43:49.042 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-14T06:43:49.044 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-14T06:43:49.045 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-08-14T06:43:49.048 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-08-14T06:44:04.217 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-08-14T06:44:04.218 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-14T06:44:04.219 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-14T06:44:04.220 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-08-14T06:44:19.385 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-08-14T06:44:19.388 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-14T06:44:19.389 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-08-14T06:44:19.391 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-14T06:44:34.541 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-14T06:44:34.543 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-08-14T06:44:34.545 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-14T06:44:34.546 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-08-14T06:44:49.688 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-14T06:44:49.689 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-08-14T06:44:49.690 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-14T06:44:49.691 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-08-14T06:45:04.845 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-14T06:45:04.846 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-08-14T06:45:04.847 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-08-14T06:45:04.848 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-14T06:45:19.988 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-14T06:45:19.989 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-08-14T06:45:19.991 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-08-14T06:45:19.992 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-14T06:45:35.140 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-08-14T06:45:35.141 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-14T06:45:35.142 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-08-14T06:45:35.143 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-14T06:45:50.264 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-14T06:45:50.265 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-08-14T06:45:50.266 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-14T06:45:50.267 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-08-14T06:46:05.395 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None
2023-08-14T06:46:05.397 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-14T06:46:05.398 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-14T06:46:05.399 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-08-14T06:46:05.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-14T06:46:20.505 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-08-14T06:46:20.506 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-14T06:46:20.507 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-14T06:46:23.856 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2
2023-08-14T06:46:29.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-14T06:46:32.944 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2
2023-08-14T06:46:35.600 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-14T06:46:35.601 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-08-14T06:46:35.605 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-14T06:46:38.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-14T06:46:42.000 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2
2023-08-14T06:46:48.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-14T06:46:50.696 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-14T06:46:50.697 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-08-14T06:46:50.700 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-14T06:46:51.088 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2
2023-08-14T06:46:57.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-14T06:47:05.795 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-14T06:47:05.796 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-08-14T06:47:05.797 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-14T06:47:05.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-14T06:47:20.877 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-08-14T06:47:20.888 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-14T06:47:24.272 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-08-14T06:47:30.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-14T06:47:33.360 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-08-14T06:47:35.957 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-14T06:47:35.958 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-08-14T06:47:39.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-14T06:47:42.416 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-08-14T06:47:48.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-14T06:47:51.032 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-08-14T06:47:51.033 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-14T06:47:51.504 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-08-14T06:47:57.102 WARNING:teuthology.provision.fog.smithi002:timed out
2023-08-14T06:47:57.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-14T06:48:00.560 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-08-14T06:48:03.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-14T06:48:03.317 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-14T06:48:03.318 DEBUG:teuthology.orchestra.run.smithi002:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-14T06:48:03.626 INFO:teuthology.provision.fog.smithi002:Node is ready
2023-08-14T06:48:03.626 DEBUG:teuthology.orchestra.run.smithi002:> hostname
2023-08-14T06:48:03.640 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002.front.sepia.ceph.com
2023-08-14T06:48:03.641 DEBUG:teuthology.orchestra.run.smithi002:> grep smithi002.front.sepia.ceph.com /etc/hosts
2023-08-14T06:48:03.695 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2 smithi002.front.sepia.ceph.com smithi002
2023-08-14T06:48:03.696 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname smithi002
2023-08-14T06:48:03.810 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/smithi002.front.sepia.ceph.com/smithi002/g' /etc/hosts
2023-08-14T06:48:03.842 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/172.21.15.2/172.21.15.2/g' /etc/hosts
2023-08-14T06:48:03.912 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/smithi002.front.sepia.ceph.com/smithi002/g' /etc/hostname
2023-08-14T06:48:03.982 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname smithi002
2023-08-14T06:48:04.052 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release
2023-08-14T06:48:04.106 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream"
2023-08-14T06:48:04.107 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="9"
2023-08-14T06:48:04.107 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos"
2023-08-14T06:48:04.107 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora"
2023-08-14T06:48:04.107 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="9"
2023-08-14T06:48:04.107 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el9"
2023-08-14T06:48:04.107 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 9"
2023-08-14T06:48:04.108 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31"
2023-08-14T06:48:04.108 INFO:teuthology.orchestra.run.smithi002.stdout:LOGO="fedora-logo-icon"
2023-08-14T06:48:04.108 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-08-14T06:48:04.108 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/"
2023-08-14T06:48:04.108 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-14T06:48:04.108 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-08-14T06:48:04.108 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-14T06:48:04.109 INFO:teuthology.provision.fog.smithi002:Deploy complete!
2023-08-14T06:48:04.110 DEBUG:teuthology.parallel:result is None
2023-08-14T06:48:06.111 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-14T06:48:06.112 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-08-14T06:48:06.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-14T06:48:06.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-14T06:48:09.616 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-08-14T06:48:15.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-14T06:48:21.177 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-08-14T06:48:24.688 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-08-14T06:48:30.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-14T06:48:33.744 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-08-14T06:48:36.228 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-08-14T06:48:36.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-14T06:48:39.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-14T06:48:42.800 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-08-14T06:48:48.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-14T06:48:51.888 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-08-14T06:48:54.640 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117
2023-08-14T06:48:57.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-14T06:49:00.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-14T06:49:00.944 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-08-14T06:49:03.696 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117
2023-08-14T06:49:06.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-14T06:49:09.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-14T06:49:12.752 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117
2023-08-14T06:49:15.628 WARNING:teuthology.provision.fog.smithi093:timed out
2023-08-14T06:49:18.757 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-14T06:49:21.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-14T06:49:21.808 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117
2023-08-14T06:49:21.843 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-14T06:49:21.843 DEBUG:teuthology.orchestra.run.smithi093:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-14T06:49:22.127 INFO:teuthology.provision.fog.smithi093:Node is ready
2023-08-14T06:49:22.127 DEBUG:teuthology.orchestra.run.smithi093:> hostname
2023-08-14T06:49:22.142 INFO:teuthology.orchestra.run.smithi093.stdout:smithi093.front.sepia.ceph.com
2023-08-14T06:49:22.142 DEBUG:teuthology.orchestra.run.smithi093:> grep smithi093.front.sepia.ceph.com /etc/hosts
2023-08-14T06:49:22.198 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93 smithi093.front.sepia.ceph.com smithi093
2023-08-14T06:49:22.198 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093
2023-08-14T06:49:22.312 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093.front.sepia.ceph.com/smithi093/g' /etc/hosts
2023-08-14T06:49:22.341 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/172.21.15.93/172.21.15.93/g' /etc/hosts
2023-08-14T06:49:22.408 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093.front.sepia.ceph.com/smithi093/g' /etc/hostname
2023-08-14T06:49:22.476 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093
2023-08-14T06:49:22.543 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release
2023-08-14T06:49:22.598 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="CentOS Stream"
2023-08-14T06:49:22.598 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="9"
2023-08-14T06:49:22.598 INFO:teuthology.orchestra.run.smithi093.stdout:ID="centos"
2023-08-14T06:49:22.598 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="rhel fedora"
2023-08-14T06:49:22.598 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="9"
2023-08-14T06:49:22.599 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el9"
2023-08-14T06:49:22.599 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="CentOS Stream 9"
2023-08-14T06:49:22.599 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31"
2023-08-14T06:49:22.599 INFO:teuthology.orchestra.run.smithi093.stdout:LOGO="fedora-logo-icon"
2023-08-14T06:49:22.599 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-08-14T06:49:22.599 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://centos.org/"
2023-08-14T06:49:22.599 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-14T06:49:22.600 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-08-14T06:49:22.600 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-14T06:49:22.600 INFO:teuthology.provision.fog.smithi093:Deploy complete!
2023-08-14T06:49:22.601 DEBUG:teuthology.parallel:result is None
2023-08-14T06:49:27.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-14T06:50:06.961 WARNING:teuthology.provision.fog.smithi123:timed out
2023-08-14T06:50:12.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-14T06:50:13.131 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-14T06:50:13.131 DEBUG:teuthology.orchestra.run.smithi123:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-14T06:50:13.456 INFO:teuthology.provision.fog.smithi123:Node is ready
2023-08-14T06:50:13.457 DEBUG:teuthology.orchestra.run.smithi123:> hostname
2023-08-14T06:50:13.471 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123.front.sepia.ceph.com
2023-08-14T06:50:13.471 DEBUG:teuthology.orchestra.run.smithi123:> grep smithi123.front.sepia.ceph.com /etc/hosts
2023-08-14T06:50:13.526 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123 smithi123.front.sepia.ceph.com smithi123
2023-08-14T06:50:13.526 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123
2023-08-14T06:50:13.657 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hosts
2023-08-14T06:50:13.685 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/172.21.15.123/172.21.15.123/g' /etc/hosts
2023-08-14T06:50:13.753 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hostname
2023-08-14T06:50:13.819 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123
2023-08-14T06:50:13.885 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release
2023-08-14T06:50:13.939 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="CentOS Stream"
2023-08-14T06:50:13.939 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="9"
2023-08-14T06:50:13.940 INFO:teuthology.orchestra.run.smithi123.stdout:ID="centos"
2023-08-14T06:50:13.940 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="rhel fedora"
2023-08-14T06:50:13.940 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="9"
2023-08-14T06:50:13.940 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el9"
2023-08-14T06:50:13.940 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="CentOS Stream 9"
2023-08-14T06:50:13.940 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31"
2023-08-14T06:50:13.940 INFO:teuthology.orchestra.run.smithi123.stdout:LOGO="fedora-logo-icon"
2023-08-14T06:50:13.941 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-08-14T06:50:13.941 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://centos.org/"
2023-08-14T06:50:13.941 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-14T06:50:13.941 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-08-14T06:50:13.941 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-14T06:50:13.941 INFO:teuthology.provision.fog.smithi123:Deploy complete!
2023-08-14T06:50:13.942 DEBUG:teuthology.parallel:result is None
2023-08-14T06:50:27.828 WARNING:teuthology.provision.fog.smithi117:timed out
2023-08-14T06:50:33.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-14T06:50:34.042 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-14T06:50:34.043 DEBUG:teuthology.orchestra.run.smithi117:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-14T06:50:34.415 INFO:teuthology.provision.fog.smithi117:Node is ready
2023-08-14T06:50:34.415 DEBUG:teuthology.orchestra.run.smithi117:> hostname
2023-08-14T06:50:34.430 INFO:teuthology.orchestra.run.smithi117.stdout:smithi117.front.sepia.ceph.com
2023-08-14T06:50:34.430 DEBUG:teuthology.orchestra.run.smithi117:> grep smithi117.front.sepia.ceph.com /etc/hosts
2023-08-14T06:50:34.485 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117 smithi117.front.sepia.ceph.com smithi117
2023-08-14T06:50:34.486 DEBUG:teuthology.orchestra.run.smithi117:> sudo hostname smithi117
2023-08-14T06:50:34.587 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/smithi117.front.sepia.ceph.com/smithi117/g' /etc/hosts
2023-08-14T06:50:34.614 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/172.21.15.117/172.21.15.117/g' /etc/hosts
2023-08-14T06:50:34.681 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/smithi117.front.sepia.ceph.com/smithi117/g' /etc/hostname
2023-08-14T06:50:34.748 DEBUG:teuthology.orchestra.run.smithi117:> sudo hostname smithi117
2023-08-14T06:50:34.814 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release
2023-08-14T06:50:34.868 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="CentOS Stream"
2023-08-14T06:50:34.869 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="9"
2023-08-14T06:50:34.869 INFO:teuthology.orchestra.run.smithi117.stdout:ID="centos"
2023-08-14T06:50:34.869 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="rhel fedora"
2023-08-14T06:50:34.869 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="9"
2023-08-14T06:50:34.869 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el9"
2023-08-14T06:50:34.869 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="CentOS Stream 9"
2023-08-14T06:50:34.869 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31"
2023-08-14T06:50:34.870 INFO:teuthology.orchestra.run.smithi117.stdout:LOGO="fedora-logo-icon"
2023-08-14T06:50:34.870 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-08-14T06:50:34.870 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://centos.org/"
2023-08-14T06:50:34.870 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-14T06:50:34.870 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-08-14T06:50:34.870 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-14T06:50:34.870 INFO:teuthology.provision.fog.smithi117:Deploy complete!
2023-08-14T06:50:34.871 DEBUG:teuthology.parallel:result is None
2023-08-14T06:50:35.079 INFO:teuthology.lock.ops:Checking smithi002.front.sepia.ceph.com
2023-08-14T06:50:35.080 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-14T06:50:35.100 INFO:teuthology.lock.ops:Checking smithi093.front.sepia.ceph.com
2023-08-14T06:50:35.101 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-14T06:50:35.117 INFO:teuthology.lock.ops:Checking smithi117.front.sepia.ceph.com
2023-08-14T06:50:35.117 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-14T06:50:35.134 INFO:teuthology.lock.ops:Checking smithi123.front.sepia.ceph.com
2023-08-14T06:50:35.134 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-14T06:50:35.152 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: set os type and version on server
2023-08-14T06:50:35.152 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com'
2023-08-14T06:50:35.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-14T06:50:35.250 DEBUG:teuthology.orchestra.run.smithi002:> true
2023-08-14T06:50:35.438 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com'
2023-08-14T06:50:35.439 DEBUG:teuthology.orchestra.run.smithi002:> uname -m
2023-08-14T06:50:35.493 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64
2023-08-14T06:50:35.494 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release
2023-08-14T06:50:35.549 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream"
2023-08-14T06:50:35.549 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="9"
2023-08-14T06:50:35.550 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos"
2023-08-14T06:50:35.550 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora"
2023-08-14T06:50:35.550 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="9"
2023-08-14T06:50:35.550 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el9"
2023-08-14T06:50:35.551 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 9"
2023-08-14T06:50:35.551 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31"
2023-08-14T06:50:35.551 INFO:teuthology.orchestra.run.smithi002.stdout:LOGO="fedora-logo-icon"
2023-08-14T06:50:35.551 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-08-14T06:50:35.552 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/"
2023-08-14T06:50:35.552 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-14T06:50:35.552 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-08-14T06:50:35.553 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-14T06:50:35.553 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server
2023-08-14T06:50:35.576 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: set os type and version on server
2023-08-14T06:50:35.577 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com'
2023-08-14T06:50:35.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-14T06:50:35.658 DEBUG:teuthology.orchestra.run.smithi093:> true
2023-08-14T06:50:35.787 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi093.front.sepia.ceph.com'
2023-08-14T06:50:35.788 DEBUG:teuthology.orchestra.run.smithi093:> uname -m
2023-08-14T06:50:35.842 INFO:teuthology.orchestra.run.smithi093.stdout:x86_64
2023-08-14T06:50:35.842 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release
2023-08-14T06:50:35.896 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="CentOS Stream"
2023-08-14T06:50:35.896 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="9"
2023-08-14T06:50:35.896 INFO:teuthology.orchestra.run.smithi093.stdout:ID="centos"
2023-08-14T06:50:35.896 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="rhel fedora"
2023-08-14T06:50:35.897 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="9"
2023-08-14T06:50:35.897 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el9"
2023-08-14T06:50:35.897 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="CentOS Stream 9"
2023-08-14T06:50:35.897 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31"
2023-08-14T06:50:35.897 INFO:teuthology.orchestra.run.smithi093.stdout:LOGO="fedora-logo-icon"
2023-08-14T06:50:35.897 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-08-14T06:50:35.897 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://centos.org/"
2023-08-14T06:50:35.898 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-14T06:50:35.898 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-08-14T06:50:35.898 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-14T06:50:35.898 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server
2023-08-14T06:50:35.917 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: set os type and version on server
2023-08-14T06:50:35.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com'
2023-08-14T06:50:35.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-14T06:50:35.998 DEBUG:teuthology.orchestra.run.smithi117:> true
2023-08-14T06:50:36.070 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com'
2023-08-14T06:50:36.071 DEBUG:teuthology.orchestra.run.smithi117:> uname -m
2023-08-14T06:50:36.125 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64
2023-08-14T06:50:36.125 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release
2023-08-14T06:50:36.180 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="CentOS Stream"
2023-08-14T06:50:36.180 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="9"
2023-08-14T06:50:36.181 INFO:teuthology.orchestra.run.smithi117.stdout:ID="centos"
2023-08-14T06:50:36.181 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="rhel fedora"
2023-08-14T06:50:36.181 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="9"
2023-08-14T06:50:36.181 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el9"
2023-08-14T06:50:36.181 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="CentOS Stream 9"
2023-08-14T06:50:36.181 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31"
2023-08-14T06:50:36.181 INFO:teuthology.orchestra.run.smithi117.stdout:LOGO="fedora-logo-icon"
2023-08-14T06:50:36.182 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-08-14T06:50:36.182 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://centos.org/"
2023-08-14T06:50:36.182 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-14T06:50:36.182 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-08-14T06:50:36.182 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-14T06:50:36.183 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server
2023-08-14T06:50:36.201 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: set os type and version on server
2023-08-14T06:50:36.201 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com'
2023-08-14T06:50:36.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-14T06:50:36.284 DEBUG:teuthology.orchestra.run.smithi123:> true
2023-08-14T06:50:36.450 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com'
2023-08-14T06:50:36.450 DEBUG:teuthology.orchestra.run.smithi123:> uname -m
2023-08-14T06:50:36.505 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64
2023-08-14T06:50:36.505 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release
2023-08-14T06:50:36.558 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="CentOS Stream"
2023-08-14T06:50:36.559 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="9"
2023-08-14T06:50:36.559 INFO:teuthology.orchestra.run.smithi123.stdout:ID="centos"
2023-08-14T06:50:36.559 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="rhel fedora"
2023-08-14T06:50:36.559 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="9"
2023-08-14T06:50:36.559 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el9"
2023-08-14T06:50:36.559 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="CentOS Stream 9"
2023-08-14T06:50:36.560 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31"
2023-08-14T06:50:36.560 INFO:teuthology.orchestra.run.smithi123.stdout:LOGO="fedora-logo-icon"
2023-08-14T06:50:36.560 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-08-14T06:50:36.560 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://centos.org/"
2023-08-14T06:50:36.560 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-14T06:50:36.560 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-08-14T06:50:36.560 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-14T06:50:36.561 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server
2023-08-14T06:50:36.576 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T06:50:36.691 INFO:teuthology.dispatcher.supervisor:Running job 7367618
2023-08-14T06:50:36.692 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/bin/teuthology -v --owner scheduled_nmordech@teuthology --archive /home/teuthworker/archive/nmordech-2023-08-14_06:39:59-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/7367618 --name nmordech-2023-08-14_06:39:59-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi --description rados:thrash-erasure-code-crush-4-nodes/{arch/x86_64 ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=8-m=6-crush} -- /home/teuthworker/archive/nmordech-2023-08-14_06:39:59-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/7367618/orig.config.yaml
2023-08-14T06:50:36.696 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/nmordech-2023-08-14_06:39:59-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/7367618
2023-08-14T06:50:36.696 INFO:teuthology.dispatcher.supervisor:Job PID: 4575
2023-08-14T06:50:36.697 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-08-14T06:52:36.797 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T06:54:36.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T06:56:37.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T06:58:37.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T07:00:37.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T07:02:37.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T07:04:37.964 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T07:06:38.040 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T07:08:38.200 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T07:10:38.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T07:12:38.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T07:14:38.641 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T07:16:38.785 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T07:18:38.950 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T07:20:39.109 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T07:22:39.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T07:24:39.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T07:26:39.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T07:28:39.813 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T07:30:39.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T07:32:40.086 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T07:34:40.249 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T07:36:40.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T07:38:40.549 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T07:40:40.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T07:42:40.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T07:44:40.944 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T07:46:41.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T07:48:41.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T07:50:41.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T07:52:41.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T07:54:41.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T07:56:41.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T07:58:42.001 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T08:00:42.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T08:02:42.238 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T08:04:42.317 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T08:06:42.421 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T08:08:42.586 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T08:10:42.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T08:12:42.901 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T08:14:42.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T08:16:43.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T08:18:43.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T08:20:43.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T08:22:43.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T08:24:43.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T08:26:43.758 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T08:28:43.888 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T08:30:44.021 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T08:32:44.185 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T08:34:44.250 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T08:36:44.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T08:38:44.568 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T08:40:44.640 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T08:42:44.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T08:44:44.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T08:46:44.909 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T08:48:45.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T08:50:45.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T08:52:45.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T08:54:45.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T08:56:45.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T08:58:45.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T09:00:46.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T09:02:46.073 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T09:04:46.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T09:06:46.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T09:08:46.521 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T09:10:46.669 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T09:12:47.030 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T09:14:47.344 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T09:16:47.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T09:18:47.657 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T09:20:47.793 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T09:22:48.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T09:24:48.109 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T09:26:48.252 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T09:28:48.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T09:30:48.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T09:32:48.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T09:34:48.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T09:36:48.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T09:38:48.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T09:40:49.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T09:42:49.456 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T09:44:49.618 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T09:46:49.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T09:48:49.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T09:50:50.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T09:52:50.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T09:54:50.358 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T09:56:50.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T09:58:50.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T10:00:50.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T10:02:50.898 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T10:04:50.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T10:06:51.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T10:08:51.108 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T10:10:51.177 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T10:12:51.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T10:14:51.420 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T10:16:51.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T10:18:51.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T10:20:51.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T10:22:52.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T10:24:52.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T10:26:52.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T10:28:52.501 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T10:30:52.673 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T10:32:52.837 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T10:34:53.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T10:36:53.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T10:38:53.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T10:40:53.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T10:42:53.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T10:44:53.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T10:46:53.782 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T10:48:53.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T10:50:54.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T10:52:54.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T10:54:54.272 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T10:56:54.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T10:58:54.530 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T11:00:54.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T11:02:54.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T11:04:54.854 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T11:06:55.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T11:08:55.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T11:10:55.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T11:12:55.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T11:14:55.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T11:16:55.669 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T11:18:55.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T11:20:55.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T11:22:55.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T11:24:56.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T11:26:56.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T11:28:56.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T11:30:56.400 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T11:32:56.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T11:34:56.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T11:36:56.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T11:38:56.937 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T11:40:57.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T11:42:57.124 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T11:44:57.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T11:46:57.350 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T11:48:57.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T11:50:57.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T11:52:57.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T11:54:57.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T11:56:58.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T11:58:58.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T12:00:58.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T12:02:58.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T12:04:58.532 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T12:06:58.596 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T12:08:58.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T12:10:58.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T12:12:58.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T12:14:59.032 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T12:16:59.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T12:18:59.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T12:20:59.392 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T12:22:59.556 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T12:24:59.621 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T12:26:59.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T12:28:59.962 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T12:31:00.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T12:33:00.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T12:35:00.441 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T12:37:00.614 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T12:39:00.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T12:41:00.849 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T12:43:01.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T12:45:01.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T12:47:01.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T12:49:01.404 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T12:51:01.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T12:53:01.626 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T12:55:01.784 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T12:57:01.844 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T12:59:02.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T13:01:02.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T13:03:02.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T13:05:02.328 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T13:07:02.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T13:09:02.570 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T13:11:02.657 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T13:13:02.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T13:15:02.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T13:17:03.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T13:19:03.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T13:21:03.264 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T13:23:03.424 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T13:25:03.484 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T13:27:03.672 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T13:29:03.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T13:31:03.926 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T13:33:04.089 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T13:35:04.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T13:37:04.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T13:39:04.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T13:41:04.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T13:43:04.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T13:45:04.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T13:47:04.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T13:49:05.130 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T13:51:05.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T13:53:05.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T13:55:05.624 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T13:57:05.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T13:59:05.844 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T14:01:06.001 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T14:03:06.182 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T14:05:06.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T14:07:06.513 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T14:09:06.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T14:11:06.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T14:13:06.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T14:15:07.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T14:17:07.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T14:19:07.317 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T14:21:07.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T14:23:07.652 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T14:25:07.805 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T14:27:07.888 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T14:29:08.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T14:31:08.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T14:33:08.338 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T14:35:08.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T14:37:08.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T14:39:08.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T14:41:08.913 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T14:43:09.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T14:45:09.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T14:47:09.553 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T14:49:09.718 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T14:51:09.793 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T14:53:09.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T14:55:10.116 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T14:57:10.204 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T14:59:10.338 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T15:01:10.530 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T15:03:10.652 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T15:05:10.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T15:07:10.804 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T15:09:10.972 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T15:11:11.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T15:13:11.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T15:15:11.402 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T15:17:11.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T15:19:11.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T15:21:11.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T15:23:12.090 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T15:25:12.210 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T15:27:12.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T15:29:12.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T15:31:12.641 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T15:33:12.740 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T15:35:12.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T15:37:12.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T15:39:13.093 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T15:41:13.260 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T15:43:13.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T15:45:13.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T15:47:13.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T15:49:13.826 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T15:51:13.893 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T15:53:14.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T15:55:14.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T15:57:14.354 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T15:59:14.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T16:01:14.606 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T16:03:14.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T16:05:14.826 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T16:07:14.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T16:09:14.974 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T16:11:15.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T16:13:15.186 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T16:15:15.258 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T16:17:30.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T16:19:30.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T16:21:30.686 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T16:23:30.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T16:25:30.936 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T16:27:31.036 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T16:29:31.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T16:31:31.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T16:33:31.281 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T16:35:31.369 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T16:37:31.438 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T16:39:31.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T16:41:31.838 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T16:43:32.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T16:45:32.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T16:47:32.222 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T16:49:32.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T16:51:32.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T16:53:32.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T16:55:32.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T16:57:32.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T16:59:33.081 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T17:01:33.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T17:03:33.368 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T17:05:33.488 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T17:07:33.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T17:09:33.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T17:11:33.814 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T17:13:33.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T17:15:34.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T17:17:34.357 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T17:19:34.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T17:21:34.626 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T17:23:34.774 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T17:25:34.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T17:27:35.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T17:29:35.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T17:31:35.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T17:33:35.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T17:35:35.721 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T17:37:35.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T17:39:36.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T17:41:36.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T17:43:36.389 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T17:45:36.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T17:47:36.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T17:49:36.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T17:51:36.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T17:53:37.149 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T17:55:37.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T17:57:37.438 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T17:59:37.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T18:01:37.738 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T18:03:37.898 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T18:05:38.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T18:07:38.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T18:09:38.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T18:11:38.466 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T18:13:38.613 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T18:13:38.686 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/nmordech-2023-08-14_06:39:59-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2023-08-14T18:13:40.448 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/nmordech-2023-08-14_06:39:59-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2023-08-14T18:13:42.915 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/nmordech-2023-08-14_06:39:59-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2023-08-14T18:13:46.085 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/nmordech-2023-08-14_06:39:59-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2023-08-14T18:13:49.958 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/nmordech-2023-08-14_06:39:59-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2023-08-14T18:13:54.549 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/nmordech-2023-08-14_06:39:59-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2023-08-14T18:13:59.828 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/nmordech-2023-08-14_06:39:59-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2023-08-14T18:14:05.827 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/nmordech-2023-08-14_06:39:59-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2023-08-14T18:14:12.504 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/nmordech-2023-08-14_06:39:59-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2023-08-14T18:14:19.884 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/nmordech-2023-08-14_06:39:59-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2023-08-14T18:14:19.884 ERROR:teuthology.dispatcher.supervisor:Failed to report job status; ignoring
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/dispatcher/supervisor.py", line 332, in run_with_watchdog
    report.try_push_job_info(job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/report.py", line 512, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/report.py", line 474, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/report.py", line 299, in report_job
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'report job 7367618' reached maximum tries (11) after waiting for 41.60838407370953 seconds
2023-08-14T18:16:19.976 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T18:16:20.054 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/nmordech-2023-08-14_06:39:59-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2023-08-14T18:16:22.076 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/nmordech-2023-08-14_06:39:59-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2023-08-14T18:16:25.059 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/nmordech-2023-08-14_06:39:59-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2023-08-14T18:16:29.009 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/nmordech-2023-08-14_06:39:59-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2023-08-14T18:16:33.919 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/nmordech-2023-08-14_06:39:59-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2023-08-14T18:16:39.798 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/nmordech-2023-08-14_06:39:59-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2023-08-14T18:16:46.651 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/nmordech-2023-08-14_06:39:59-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2023-08-14T18:16:54.462 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/nmordech-2023-08-14_06:39:59-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2023-08-14T18:17:03.159 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/nmordech-2023-08-14_06:39:59-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/jobs/ failed with status 502: <html>
<head><title>502 Bad Gateway</title></head>
<body>
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>

2023-08-14T18:17:12.828 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/nmordech-2023-08-14_06:39:59-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/jobs/ failed with status 502: <html>
<head><title>502 Bad Gateway</title></head>
<body>
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>

2023-08-14T18:17:12.828 ERROR:teuthology.dispatcher.supervisor:Failed to report job status; ignoring
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/dispatcher/supervisor.py", line 332, in run_with_watchdog
    report.try_push_job_info(job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/report.py", line 512, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/report.py", line 474, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/report.py", line 299, in report_job
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'report job 7367618' reached maximum tries (11) after waiting for 53.27747757443419 seconds
2023-08-14T18:19:12.929 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T18:19:12.942 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/nmordech-2023-08-14_06:39:59-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/jobs/ failed with status 502: <html>
<head><title>502 Bad Gateway</title></head>
<body>
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>

2023-08-14T18:19:14.481 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/nmordech-2023-08-14_06:39:59-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/jobs/ failed with status 502: <html>
<head><title>502 Bad Gateway</title></head>
<body>
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>

2023-08-14T18:19:16.599 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/nmordech-2023-08-14_06:39:59-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/jobs/ failed with status 502: <html>
<head><title>502 Bad Gateway</title></head>
<body>
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>

2023-08-14T18:19:19.206 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/nmordech-2023-08-14_06:39:59-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/jobs/ failed with status 502: <html>
<head><title>502 Bad Gateway</title></head>
<body>
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>

2023-08-14T18:19:22.348 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/nmordech-2023-08-14_06:39:59-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/jobs/ failed with status 502: <html>
<head><title>502 Bad Gateway</title></head>
<body>
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>

2023-08-14T18:19:26.023 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/nmordech-2023-08-14_06:39:59-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/jobs/ failed with status 502: <html>
<head><title>502 Bad Gateway</title></head>
<body>
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>

2023-08-14T18:19:30.230 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/nmordech-2023-08-14_06:39:59-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/jobs/ failed with status 502: <html>
<head><title>502 Bad Gateway</title></head>
<body>
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>

2023-08-14T18:19:34.976 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/nmordech-2023-08-14_06:39:59-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/jobs/ failed with status 502: <html>
<head><title>502 Bad Gateway</title></head>
<body>
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>

2023-08-14T18:19:40.257 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/nmordech-2023-08-14_06:39:59-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/jobs/ failed with status 502: <html>
<head><title>502 Bad Gateway</title></head>
<body>
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>

2023-08-14T18:19:46.072 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/nmordech-2023-08-14_06:39:59-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/jobs/ failed with status 502: <html>
<head><title>502 Bad Gateway</title></head>
<body>
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>

2023-08-14T18:19:46.072 ERROR:teuthology.dispatcher.supervisor:Failed to report job status; ignoring
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/dispatcher/supervisor.py", line 332, in run_with_watchdog
    report.try_push_job_info(job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/report.py", line 512, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/report.py", line 474, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/report.py", line 299, in report_job
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'report job 7367618' reached maximum tries (11) after waiting for 34.0279586327504 seconds
2023-08-14T18:21:46.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T18:23:46.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T18:25:46.358 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T18:27:46.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T18:29:46.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T18:31:46.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T18:33:46.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T18:35:47.150 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T18:37:47.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T18:39:47.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T18:41:47.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T18:43:47.753 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T18:45:47.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T18:47:48.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T18:49:48.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T18:51:48.256 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2023-08-14T18:51:49.074 INFO:teuthology.kill:Killing Pids: {4575}
2023-08-14T18:51:49.982 INFO:teuthology.task.internal:roles: ubuntu@smithi002.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12']
2023-08-14T18:51:49.983 INFO:teuthology.task.internal:roles: ubuntu@smithi093.front.sepia.ceph.com - ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13']
2023-08-14T18:51:49.983 INFO:teuthology.task.internal:roles: ubuntu@smithi117.front.sepia.ceph.com - ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14']
2023-08-14T18:51:49.983 INFO:teuthology.task.internal:roles: ubuntu@smithi123.front.sepia.ceph.com - ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0']
2023-08-14T18:51:49.984 INFO:teuthology.misc:Compressing logs...
2023-08-14T18:51:49.984 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com'
2023-08-14T18:51:49.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-14T18:51:50.104 DEBUG:teuthology.orchestra.run.smithi002:> true
2023-08-14T18:51:50.224 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com'
2023-08-14T18:51:50.225 DEBUG:teuthology.orchestra.run.smithi002:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2023-08-14T18:51:50.267 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com'
2023-08-14T18:51:50.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-14T18:51:50.633 DEBUG:teuthology.orchestra.run.smithi093:> true
2023-08-14T18:51:50.777 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi093.front.sepia.ceph.com'
2023-08-14T18:51:50.777 DEBUG:teuthology.orchestra.run.smithi093:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2023-08-14T18:51:50.819 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com'
2023-08-14T18:51:50.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-14T18:51:51.151 DEBUG:teuthology.orchestra.run.smithi117:> true
2023-08-14T18:51:51.281 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com'
2023-08-14T18:51:51.282 DEBUG:teuthology.orchestra.run.smithi117:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2023-08-14T18:51:51.324 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com'
2023-08-14T18:51:51.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-14T18:51:51.787 DEBUG:teuthology.orchestra.run.smithi123:> true
2023-08-14T18:51:51.915 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com'
2023-08-14T18:51:51.916 DEBUG:teuthology.orchestra.run.smithi123:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2023-08-14T18:51:51.993 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/lib/ceph/crash to /home/teuthworker/archive/nmordech-2023-08-14_06:39:59-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/7367618/remote/smithi002/crash
2023-08-14T18:51:51.994 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/lib/ceph/crash -- .
2023-08-14T18:51:52.061 DEBUG:teuthology.misc:Transferring archived files from smithi093:/var/lib/ceph/crash to /home/teuthworker/archive/nmordech-2023-08-14_06:39:59-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/7367618/remote/smithi093/crash
2023-08-14T18:51:52.062 DEBUG:teuthology.orchestra.run.smithi093:> sudo tar c -f - -C /var/lib/ceph/crash -- .
2023-08-14T18:51:52.218 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/crash to /home/teuthworker/archive/nmordech-2023-08-14_06:39:59-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/7367618/remote/smithi117/crash
2023-08-14T18:51:52.219 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/lib/ceph/crash -- .
2023-08-14T18:51:52.310 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/lib/ceph/crash to /home/teuthworker/archive/nmordech-2023-08-14_06:39:59-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/7367618/remote/smithi123/crash
2023-08-14T18:51:52.311 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /var/lib/ceph/crash -- .
2023-08-14T18:51:52.429 INFO:teuthology.misc:Compressing logs...
2023-08-14T18:51:52.429 DEBUG:teuthology.orchestra.run.smithi002:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2023-08-14T18:51:52.432 DEBUG:teuthology.orchestra.run.smithi093:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2023-08-14T18:51:52.434 DEBUG:teuthology.orchestra.run.smithi117:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2023-08-14T18:51:52.436 DEBUG:teuthology.orchestra.run.smithi123:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2023-08-14T18:51:52.474 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log
2023-08-14T18:51:52.481 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log
2023-08-14T18:51:52.482 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log
2023-08-14T18:51:52.482 INFO:teuthology.orchestra.run.smithi117.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log:	/home/ubuntu/cephtest/archive/syslog/misc.log:	  0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz
2023-08-14T18:51:52.483 INFO:teuthology.orchestra.run.smithi117.stderr:  0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz
2023-08-14T18:51:52.486 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log
2023-08-14T18:51:52.487 INFO:teuthology.orchestra.run.smithi002.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log:
2023-08-14T18:51:52.488 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log.gz: No space left on device
2023-08-14T18:51:52.488 INFO:teuthology.orchestra.run.smithi002.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log:
2023-08-14T18:51:52.488 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/kern.log.gz: No space left on device
2023-08-14T18:51:52.488 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log
2023-08-14T18:51:52.489 DEBUG:teuthology.orchestra.run:got remote process result: 123
2023-08-14T18:51:52.489 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/dispatcher/supervisor.py", line 316, in run_with_watchdog
    transfer_archives(job_info['name'], job_info['job_id'],
  File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/dispatcher/supervisor.py", line 381, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/misc.py", line 1368, in compress_logs
    run.wait(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/run.py", line 479, in wait
    proc.wait()
  File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/run.py", line 161, in wait
    self._raise_for_status()
  File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/run.py", line 181, in _raise_for_status
    raise CommandFailedError(
teuthology.exceptions.CommandFailedError: Command failed on smithi002 with status 123: 'sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --'
2023-08-14T18:51:52.572 INFO:teuthology.kill:No teuthology processes running
2023-08-14T18:51:53.300 INFO:teuthology.kill:Nuking machines: ['smithi002', 'smithi093', 'smithi117', 'smithi123']
2023-08-14T18:51:53.867 INFO:teuthology.kill:2023-08-14 18:51:53,867.867 INFO:teuthology.nuke:targets:
2023-08-14T18:51:53.868 INFO:teuthology.kill:  smithi002.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOnSFdxUD4zkTLJ5VyyKV5eDVaF3C1GfJDSPAM3Lc5g3cxvocNaq3YYhgDKw36pGsuKODTaJms+Gm0eoJrosqXA=
2023-08-14T18:51:53.868 INFO:teuthology.kill:  smithi093.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJF7hOXZ09qdkMHNABmQMDOlNDu14zK9Sm93P+WyaU3g89UV9Xs3iTmErcP7N4+Rdyapf0Jz57uSmjjWpcb6Unw=
2023-08-14T18:51:53.869 INFO:teuthology.kill:  smithi117.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFgdmQNvM8jgIApu7chPiu877a3pep9lMDUTJZtbZ8eZ+lU0lNmCQSh/gc1IG9XiRpIwDX9JnB2fV+ngpE2jv1A=
2023-08-14T18:51:53.869 INFO:teuthology.kill:  smithi123.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG8EEhvCcocnfXQ/KSIfpsdtC09cu6uQXrSuiFp+jbofff+NcXfEQmSbeivMpggnC0P8PCinDKPTUr9xZvCw6v0=
2023-08-14T18:51:53.869 INFO:teuthology.kill:2023-08-14 18:51:53,867.867 INFO:teuthology.nuke:Checking targets against current locks
2023-08-14T18:51:53.919 INFO:teuthology.kill:2023-08-14 18:51:53,919.919 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-14T18:51:53.938 INFO:teuthology.kill:2023-08-14 18:51:53,938.938 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-14T18:51:53.959 INFO:teuthology.kill:2023-08-14 18:51:53,959.959 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-14T18:51:53.970 INFO:teuthology.kill:2023-08-14 18:51:53,970.970 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-14T18:51:53.983 INFO:teuthology.kill:2023-08-14 18:51:53,983.983 INFO:teuthology.orchestra.console.smithi002:Power off
2023-08-14T18:51:54.027 INFO:teuthology.kill:2023-08-14 18:51:54,027.027 INFO:teuthology.orchestra.console.smithi093:Power off
2023-08-14T18:51:54.067 INFO:teuthology.kill:2023-08-14 18:51:54,067.067 INFO:teuthology.orchestra.console.smithi123:Power off
2023-08-14T18:51:54.081 INFO:teuthology.kill:2023-08-14 18:51:54,081.081 INFO:teuthology.orchestra.console.smithi117:Power off
2023-08-14T18:52:02.366 INFO:teuthology.kill:2023-08-14 18:52:02,366.366 INFO:teuthology.orchestra.console.smithi002:Power off completed
2023-08-14T18:52:02.419 INFO:teuthology.kill:2023-08-14 18:52:02,418.418 INFO:teuthology.orchestra.console.smithi093:Power off completed
2023-08-14T18:52:02.429 INFO:teuthology.kill:2023-08-14 18:52:02,429.429 INFO:teuthology.orchestra.console.smithi123:Power off completed
2023-08-14T18:52:02.442 INFO:teuthology.kill:2023-08-14 18:52:02,442.442 INFO:teuthology.orchestra.console.smithi117:Power off completed
2023-08-14T18:52:02.518 INFO:teuthology.kill:2023-08-14 18:52:02,518.518 INFO:teuthology.lock.ops:unlocked: smithi002.front.sepia.ceph.com
2023-08-14T18:52:02.560 INFO:teuthology.kill:2023-08-14 18:52:02,560.560 INFO:teuthology.lock.ops:unlocked: smithi093.front.sepia.ceph.com
2023-08-14T18:52:02.568 INFO:teuthology.kill:2023-08-14 18:52:02,568.568 INFO:teuthology.lock.ops:unlocked: smithi123.front.sepia.ceph.com
2023-08-14T18:52:02.585 INFO:teuthology.kill:2023-08-14 18:52:02,585.585 INFO:teuthology.lock.ops:unlocked: smithi117.front.sepia.ceph.com
2023-08-14T18:52:02.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T18:54:02.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-14T18:54:02.891 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15