2023-11-02T16:57:44.179 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-02T16:57:44.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T16:57:44.317 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb77dc8fc10>, signals=[15]) 2023-11-02T16:57:44.319 INFO:teuthology.lock.ops:Start node 'smithi064.front.sepia.ceph.com' reimaging 2023-11-02T16:57:44.319 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: reset os type and version on server 2023-11-02T16:57:44.319 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2023-11-02T16:57:44.341 INFO:teuthology.lock.ops:Start node 'smithi195.front.sepia.ceph.com' reimaging 2023-11-02T16:57:44.341 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: reset os type and version on server 2023-11-02T16:57:44.342 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-11-02T16:57:44.343 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /host {"name": "smithi064"} 2023-11-02T16:57:44.366 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /host {"name": "smithi195"} 2023-11-02T16:57:44.426 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-11-02T16:57:44.441 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-11-02T16:57:44.467 DEBUG:teuthology.provision.fog.smithi064:Requesting image smithi_centos_9.stream (ID 10) 2023-11-02T16:57:44.467 DEBUG:teuthology.provision.fog.smithi064:FOG request: PUT /host/169 {"imageID": 10} 2023-11-02T16:57:44.483 DEBUG:teuthology.provision.fog.smithi195:Requesting image smithi_centos_9.stream (ID 10) 2023-11-02T16:57:44.483 DEBUG:teuthology.provision.fog.smithi195:FOG request: PUT /host/300 {"imageID": 10} 2023-11-02T16:57:44.512 INFO:teuthology.provision.fog.smithi064:Scheduling deploy of centos 9.stream 2023-11-02T16:57:44.512 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-02T16:57:44.521 INFO:teuthology.provision.fog.smithi195:Scheduling deploy of centos 9.stream 2023-11-02T16:57:44.522 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-11-02T16:57:44.571 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /tasktype {"name": "deploy"} 2023-11-02T16:57:44.572 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /tasktype {"name": "deploy"} 2023-11-02T16:57:44.608 DEBUG:teuthology.provision.fog.smithi195:FOG request: POST /host/300/task {"taskTypeID": 1} 2023-11-02T16:57:44.611 DEBUG:teuthology.provision.fog.smithi064:FOG request: POST /host/169/task {"taskTypeID": 1} 2023-11-02T16:57:44.662 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-02T16:57:44.665 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-11-02T16:57:44.751 INFO:teuthology.orchestra.console.smithi195:Power off 2023-11-02T16:57:44.752 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-02T16:57:44.765 INFO:teuthology.orchestra.console.smithi064:Power off 2023-11-02T16:57:44.765 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-02T16:57:44.774 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2023-11-02T16:57:44.774 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-02T16:57:44.794 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off 2023-11-02T16:57:44.795 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-02T16:57:44.801 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-11-02T16:57:44.826 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-11-02T16:57:48.806 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-02T16:57:48.827 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-02T16:57:48.916 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-11-02T16:57:48.936 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-11-02T16:57:52.920 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-02T16:57:52.937 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-02T16:57:53.029 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-11-02T16:57:53.045 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-11-02T16:57:57.035 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-02T16:57:57.046 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-02T16:57:57.144 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-11-02T16:57:57.154 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-11-02T16:57:57.246 INFO:teuthology.orchestra.console.smithi195:Power off completed 2023-11-02T16:57:57.256 INFO:teuthology.orchestra.console.smithi064:Power off completed 2023-11-02T16:57:57.347 INFO:teuthology.orchestra.console.smithi195:Power on 2023-11-02T16:57:57.347 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-02T16:57:57.357 INFO:teuthology.orchestra.console.smithi064:Power on 2023-11-02T16:57:57.357 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-02T16:57:57.369 DEBUG:teuthology.orchestra.console.smithi195:power on output: Chassis Power Control: Up/On 2023-11-02T16:57:57.369 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-02T16:57:57.377 DEBUG:teuthology.orchestra.console.smithi064:power on output: Chassis Power Control: Up/On 2023-11-02T16:57:57.378 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-02T16:57:57.389 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-11-02T16:57:57.398 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-11-02T16:58:01.394 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-02T16:58:01.401 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-02T16:58:01.504 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-11-02T16:58:01.511 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-11-02T16:58:01.612 INFO:teuthology.orchestra.console.smithi064:Power on completed 2023-11-02T16:58:01.712 INFO:teuthology.provision.fog.smithi064:Waiting for deploy to finish 2023-11-02T16:58:01.713 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-02T16:58:05.509 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-02T16:58:05.617 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-11-02T16:58:05.718 INFO:teuthology.orchestra.console.smithi195:Power on completed 2023-11-02T16:58:05.819 INFO:teuthology.provision.fog.smithi195:Waiting for deploy to finish 2023-11-02T16:58:05.819 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-11-02T16:58:16.794 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-02T16:58:20.900 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-11-02T16:58:31.882 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-02T16:58:35.990 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-11-02T16:58:46.974 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-02T16:58:51.078 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-11-02T16:59:02.062 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-02T16:59:06.170 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-11-02T16:59:17.142 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-02T16:59:21.250 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-11-02T16:59:32.225 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-02T16:59:36.326 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-11-02T16:59:47.302 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-02T16:59:51.397 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-11-02T17:00:02.378 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-02T17:00:06.470 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-11-02T17:00:17.465 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-02T17:00:21.558 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-11-02T17:00:32.562 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-02T17:00:36.626 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-11-02T17:00:36.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T17:00:39.738 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-11-02T17:00:45.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T17:00:47.636 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-02T17:00:47.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T17:00:48.794 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-11-02T17:00:50.778 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-11-02T17:00:54.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T17:00:56.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T17:00:57.854 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-11-02T17:00:59.834 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-11-02T17:01:03.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T17:01:05.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T17:01:06.942 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-11-02T17:01:08.890 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-11-02T17:01:12.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T17:01:14.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T17:01:16.026 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-11-02T17:01:17.950 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-11-02T17:01:22.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T17:01:23.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T17:01:25.086 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-11-02T17:01:27.034 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-11-02T17:01:31.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T17:01:33.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T17:01:36.094 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-11-02T17:01:42.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T17:02:31.143 WARNING:teuthology.provision.fog.smithi195:timed out 2023-11-02T17:02:37.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T17:02:37.575 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-02T17:02:37.576 DEBUG:teuthology.orchestra.run.smithi195:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-02T17:02:37.916 INFO:teuthology.provision.fog.smithi195:Node is ready 2023-11-02T17:02:37.917 DEBUG:teuthology.orchestra.run.smithi195:> hostname 2023-11-02T17:02:37.932 INFO:teuthology.orchestra.run.smithi195.stdout:smithi195.front.sepia.ceph.com 2023-11-02T17:02:37.933 DEBUG:teuthology.orchestra.run.smithi195:> grep smithi195.front.sepia.ceph.com /etc/hosts 2023-11-02T17:02:37.989 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.15.195 smithi195.front.sepia.ceph.com smithi195 2023-11-02T17:02:37.989 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2023-11-02T17:02:38.092 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hosts 2023-11-02T17:02:38.120 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/172.21.15.195/172.21.15.195/g' /etc/hosts 2023-11-02T17:02:38.188 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hostname 2023-11-02T17:02:38.256 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2023-11-02T17:02:38.323 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2023-11-02T17:02:38.377 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream" 2023-11-02T17:02:38.377 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="9" 2023-11-02T17:02:38.378 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos" 2023-11-02T17:02:38.378 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora" 2023-11-02T17:02:38.378 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="9" 2023-11-02T17:02:38.378 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el9" 2023-11-02T17:02:38.378 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-02T17:02:38.379 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2023-11-02T17:02:38.379 INFO:teuthology.orchestra.run.smithi195.stdout:LOGO="fedora-logo-icon" 2023-11-02T17:02:38.379 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-02T17:02:38.379 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/" 2023-11-02T17:02:38.379 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-02T17:02:38.380 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-02T17:02:38.380 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-02T17:02:38.381 INFO:teuthology.provision.fog.smithi195:Deploy complete! 2023-11-02T17:02:38.382 DEBUG:teuthology.parallel:result is None 2023-11-02T17:02:42.106 WARNING:teuthology.provision.fog.smithi064:timed out 2023-11-02T17:02:48.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T17:02:48.409 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-02T17:02:48.409 DEBUG:teuthology.orchestra.run.smithi064:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-02T17:02:48.762 INFO:teuthology.provision.fog.smithi064:Node is ready 2023-11-02T17:02:48.763 DEBUG:teuthology.orchestra.run.smithi064:> hostname 2023-11-02T17:02:48.778 INFO:teuthology.orchestra.run.smithi064.stdout:smithi064.front.sepia.ceph.com 2023-11-02T17:02:48.778 DEBUG:teuthology.orchestra.run.smithi064:> grep smithi064.front.sepia.ceph.com /etc/hosts 2023-11-02T17:02:48.834 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64 smithi064.front.sepia.ceph.com smithi064 2023-11-02T17:02:48.834 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064 2023-11-02T17:02:48.941 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064.front.sepia.ceph.com/smithi064/g' /etc/hosts 2023-11-02T17:02:48.974 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/172.21.15.64/172.21.15.64/g' /etc/hosts 2023-11-02T17:02:49.045 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064.front.sepia.ceph.com/smithi064/g' /etc/hostname 2023-11-02T17:02:49.116 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064 2023-11-02T17:02:49.187 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2023-11-02T17:02:49.242 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream" 2023-11-02T17:02:49.243 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="9" 2023-11-02T17:02:49.243 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos" 2023-11-02T17:02:49.243 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora" 2023-11-02T17:02:49.244 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="9" 2023-11-02T17:02:49.244 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el9" 2023-11-02T17:02:49.244 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-02T17:02:49.245 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2023-11-02T17:02:49.245 INFO:teuthology.orchestra.run.smithi064.stdout:LOGO="fedora-logo-icon" 2023-11-02T17:02:49.245 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-02T17:02:49.246 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/" 2023-11-02T17:02:49.246 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-02T17:02:49.246 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-02T17:02:49.247 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-02T17:02:49.247 INFO:teuthology.provision.fog.smithi064:Deploy complete! 2023-11-02T17:02:49.248 DEBUG:teuthology.parallel:result is None 2023-11-02T17:02:49.429 INFO:teuthology.lock.ops:Checking smithi064.front.sepia.ceph.com 2023-11-02T17:02:49.429 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-02T17:02:49.457 INFO:teuthology.lock.ops:Checking smithi195.front.sepia.ceph.com 2023-11-02T17:02:49.457 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-02T17:02:49.482 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: set os type and version on server 2023-11-02T17:02:49.483 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-11-02T17:02:49.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T17:02:49.579 DEBUG:teuthology.orchestra.run.smithi064:> true 2023-11-02T17:02:49.644 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-11-02T17:02:49.645 DEBUG:teuthology.orchestra.run.smithi064:> uname -m 2023-11-02T17:02:49.699 INFO:teuthology.orchestra.run.smithi064.stdout:x86_64 2023-11-02T17:02:49.700 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2023-11-02T17:02:49.754 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream" 2023-11-02T17:02:49.755 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="9" 2023-11-02T17:02:49.755 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos" 2023-11-02T17:02:49.755 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora" 2023-11-02T17:02:49.755 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="9" 2023-11-02T17:02:49.756 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el9" 2023-11-02T17:02:49.756 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-02T17:02:49.756 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2023-11-02T17:02:49.756 INFO:teuthology.orchestra.run.smithi064.stdout:LOGO="fedora-logo-icon" 2023-11-02T17:02:49.756 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-02T17:02:49.757 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/" 2023-11-02T17:02:49.757 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-02T17:02:49.757 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-02T17:02:49.757 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-02T17:02:49.758 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2023-11-02T17:02:49.781 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: set os type and version on server 2023-11-02T17:02:49.782 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-11-02T17:02:49.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T17:02:49.865 DEBUG:teuthology.orchestra.run.smithi195:> true 2023-11-02T17:02:50.037 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-11-02T17:02:50.037 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2023-11-02T17:02:50.092 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2023-11-02T17:02:50.093 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2023-11-02T17:02:50.146 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream" 2023-11-02T17:02:50.147 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="9" 2023-11-02T17:02:50.147 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos" 2023-11-02T17:02:50.147 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora" 2023-11-02T17:02:50.147 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="9" 2023-11-02T17:02:50.148 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el9" 2023-11-02T17:02:50.148 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-02T17:02:50.148 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2023-11-02T17:02:50.148 INFO:teuthology.orchestra.run.smithi195.stdout:LOGO="fedora-logo-icon" 2023-11-02T17:02:50.148 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-02T17:02:50.149 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/" 2023-11-02T17:02:50.149 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-02T17:02:50.149 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-02T17:02:50.149 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-02T17:02:50.150 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-11-02T17:02:50.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T17:02:50.278 INFO:teuthology.dispatcher.supervisor:Running job 7442637 2023-11-02T17:02:50.279 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2023-11-01_06:18:13-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442637 --name benhanokh-2023-11-01_06:18:13-rados-DBG_maintain_prefix_itr_2-distro-default-smithi --description rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} -- /home/teuthworker/archive/benhanokh-2023-11-01_06:18:13-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442637/orig.config.yaml 2023-11-02T17:02:50.286 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2023-11-01_06:18:13-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442637 2023-11-02T17:02:50.287 INFO:teuthology.dispatcher.supervisor:Job PID: 1918495 2023-11-02T17:02:50.287 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-02T17:04:50.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T17:06:50.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T17:08:50.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T17:10:50.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T17:12:51.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T17:14:51.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T17:16:51.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T17:18:51.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T17:20:51.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T17:22:51.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T17:24:52.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T17:26:52.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T17:28:52.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T17:30:52.629 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T17:32:52.804 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T17:34:52.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T17:36:53.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T17:38:53.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T17:40:53.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T17:42:53.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T17:44:53.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T17:46:53.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T17:48:54.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T17:50:54.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T17:52:54.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T17:54:54.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T17:56:54.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T17:58:54.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T18:00:55.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T18:02:55.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T18:04:55.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T18:06:55.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T18:08:55.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T18:10:55.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T18:12:56.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T18:14:56.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T18:16:56.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T18:18:56.640 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T18:20:56.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T18:22:56.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T18:24:57.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T18:26:57.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T18:28:57.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T18:30:57.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T18:32:57.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T18:34:57.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T18:36:58.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T18:38:58.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T18:40:58.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T18:42:58.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T18:44:59.012 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T18:46:59.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T18:48:59.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T18:50:59.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T18:52:59.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T18:55:00.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T18:57:00.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T18:59:00.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T19:01:00.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T19:03:00.804 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T19:05:00.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T19:07:01.136 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T19:09:01.308 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T19:11:01.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T19:13:01.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T19:15:01.806 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T19:17:01.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T19:19:02.150 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T19:21:02.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T19:23:02.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T19:25:02.656 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T19:27:02.818 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T19:29:02.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T19:31:03.158 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T19:33:03.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T19:35:03.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T19:37:03.636 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T19:39:03.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T19:41:03.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T19:43:04.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T19:45:04.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T19:47:04.450 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T19:49:04.616 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T19:51:04.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T19:53:04.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T19:55:05.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T19:57:05.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T19:59:05.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T20:01:05.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T20:03:05.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T20:05:05.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T20:07:06.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T20:09:06.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T20:11:06.444 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T20:13:06.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T20:15:06.770 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T20:17:06.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T20:19:07.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T20:21:07.274 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T20:23:07.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T20:25:07.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T20:27:07.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T20:29:07.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T20:31:08.094 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T20:33:08.262 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T20:35:08.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T20:37:08.590 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T20:39:08.754 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T20:41:08.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T20:43:09.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T20:45:09.250 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T20:47:09.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T20:49:09.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T20:51:09.721 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T20:53:09.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T20:55:10.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T20:57:10.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T20:59:10.394 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T21:01:10.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T21:03:10.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T21:05:10.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T21:07:11.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T21:09:11.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T21:11:11.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T21:13:11.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T21:15:11.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T21:17:11.850 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T21:19:11.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T21:21:12.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T21:23:12.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T21:25:12.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T21:27:12.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T21:29:12.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T21:31:12.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T21:33:13.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T21:35:13.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T21:37:13.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T21:39:13.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T21:41:13.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T21:43:13.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T21:45:14.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T21:47:14.292 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T21:49:14.440 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T21:51:14.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T21:53:14.770 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T21:55:14.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T21:57:15.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T21:59:15.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T22:01:15.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T22:03:15.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T22:05:15.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T22:07:15.928 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T22:09:16.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T22:11:16.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T22:13:16.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T22:15:16.616 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T22:17:16.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T22:19:16.929 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T22:21:17.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T22:23:17.260 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T22:25:17.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T22:27:17.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T22:29:17.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T22:31:17.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T22:33:18.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T22:35:18.269 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T22:37:18.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T22:39:18.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T22:41:18.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T22:43:18.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T22:45:19.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T22:47:19.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T22:49:19.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T22:51:19.613 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T22:53:19.780 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T22:55:19.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T22:57:20.114 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T22:59:20.285 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T23:01:20.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T23:03:20.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T23:05:20.780 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T23:07:20.948 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T23:09:21.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T23:11:21.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T23:13:21.456 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T23:15:21.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T23:17:21.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T23:19:21.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T23:21:22.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T23:23:22.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T23:25:22.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T23:27:22.636 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T23:29:22.776 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T23:31:22.945 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T23:33:23.106 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T23:35:23.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T23:37:23.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T23:39:23.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T23:41:23.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T23:43:24.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T23:45:24.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T23:47:24.332 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T23:49:24.494 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T23:51:24.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T23:53:24.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T23:55:25.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T23:57:25.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T23:59:25.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T00:01:25.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T00:03:25.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T00:05:25.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T00:07:25.937 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T00:09:26.102 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T00:11:26.249 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T00:13:26.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T00:15:26.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T00:17:26.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T00:19:26.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T00:21:27.048 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T00:23:27.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T00:25:27.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T00:27:27.568 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T00:29:27.736 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T00:31:27.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T00:33:28.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T00:35:28.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T00:37:28.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T00:39:28.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T00:41:28.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T00:43:28.870 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T00:45:29.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T00:47:29.212 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T00:49:29.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T00:51:29.550 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T00:53:29.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T00:55:29.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T00:57:30.054 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T00:59:30.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T01:01:30.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T01:03:30.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T01:05:30.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T01:07:30.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T01:09:31.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T01:11:31.234 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T01:13:31.400 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T01:15:31.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T01:17:31.734 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T01:19:31.908 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T01:21:32.076 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T01:23:32.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T01:25:32.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T01:27:32.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T01:29:32.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T01:31:32.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T01:33:33.070 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T01:35:33.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T01:37:33.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T01:39:33.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T01:41:33.752 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T01:43:33.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T01:45:34.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T01:47:34.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T01:49:34.428 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T01:51:34.596 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T01:53:34.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T01:55:34.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T01:57:35.084 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T01:59:35.250 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T02:01:35.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T02:03:35.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T02:05:35.772 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T02:07:35.936 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T02:09:36.102 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T02:11:36.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T02:13:36.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T02:15:36.590 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T02:17:36.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T02:19:36.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T02:21:37.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T02:23:37.240 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T02:25:37.410 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T02:27:37.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T02:29:37.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T02:31:37.890 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T02:33:38.030 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T02:35:38.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T02:37:38.371 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T02:39:38.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T02:41:38.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T02:43:38.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T02:45:39.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T02:47:39.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T02:49:39.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T02:51:39.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T02:53:39.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T02:55:39.882 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T02:57:40.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T02:59:40.202 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T03:01:40.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T03:03:40.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T03:05:40.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T03:07:40.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T03:09:41.036 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T03:11:41.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T03:13:41.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T03:15:41.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T03:17:41.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T03:19:41.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T03:21:42.020 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T03:23:42.154 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T03:25:42.324 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T03:27:42.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T03:29:42.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T03:31:42.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T03:33:43.001 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T03:35:43.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T03:37:43.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T03:39:43.505 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T03:41:43.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T03:43:43.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T03:45:44.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T03:47:44.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T03:49:44.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T03:51:44.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T03:53:44.718 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T03:55:44.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T03:57:45.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T03:59:45.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T04:01:45.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T04:03:45.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T04:05:45.712 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T04:07:45.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T04:09:46.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T04:11:46.216 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T04:13:46.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T04:15:46.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T04:17:46.681 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T04:19:46.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T04:21:47.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T04:23:47.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T04:25:47.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T04:27:47.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T04:29:47.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T04:31:47.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T04:33:48.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T04:35:48.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T04:37:48.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T04:39:48.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T04:41:48.708 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T04:43:48.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T04:45:49.042 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T04:47:49.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T04:49:49.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T04:51:49.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T04:53:49.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T04:55:49.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T04:57:50.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T04:59:50.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T05:01:50.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T05:03:50.531 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-11-03T05:03:50.649 INFO:teuthology.kill:Killing Pids: {1918495} 2023-11-03T05:03:51.477 INFO:teuthology.task.internal:roles: ubuntu@smithi064.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2023-11-03T05:03:51.478 INFO:teuthology.task.internal:roles: ubuntu@smithi195.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2023-11-03T05:03:51.478 INFO:teuthology.misc:Compressing logs... 2023-11-03T05:03:51.479 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-11-03T05:03:51.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T05:03:51.577 DEBUG:teuthology.orchestra.run.smithi064:> true 2023-11-03T05:03:51.645 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-11-03T05:03:51.646 DEBUG:teuthology.orchestra.run.smithi064:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-03T05:03:51.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-11-03T05:03:51.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T05:03:51.774 DEBUG:teuthology.orchestra.run.smithi195:> true 2023-11-03T05:03:51.847 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-11-03T05:03:51.848 DEBUG:teuthology.orchestra.run.smithi195:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-03T05:03:51.923 DEBUG:teuthology.misc:Transferring archived files from smithi064:/var/lib/ceph/crash to /home/teuthworker/archive/benhanokh-2023-11-01_06:18:13-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442637/remote/smithi064/crash 2023-11-03T05:03:51.924 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-03T05:03:52.016 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/crash to /home/teuthworker/archive/benhanokh-2023-11-01_06:18:13-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442637/remote/smithi195/crash 2023-11-03T05:03:52.017 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-03T05:03:52.111 INFO:teuthology.misc:Compressing logs... 2023-11-03T05:03:52.112 DEBUG:teuthology.orchestra.run.smithi064:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-03T05:03:52.114 DEBUG:teuthology.orchestra.run.smithi195:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-03T05:03:52.143 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-03T05:03:52.143 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-03T05:03:52.143 INFO:teuthology.orchestra.run.smithi064.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-11-03T05:03:52.143 INFO:teuthology.orchestra.run.smithi064.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-11-03T05:03:52.171 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-03T05:03:52.171 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-03T05:03:52.172 INFO:teuthology.orchestra.run.smithi195.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-11-03T05:03:52.172 INFO:teuthology.orchestra.run.smithi195.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-11-03T05:03:52.173 DEBUG:teuthology.misc:Transferring archived files from smithi064:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/benhanokh-2023-11-01_06:18:13-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442637/remote/smithi064/ 2023-11-03T05:03:52.173 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-03T05:04:05.630 DEBUG:teuthology.misc:Transferring archived files from smithi195:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/benhanokh-2023-11-01_06:18:13-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442637/remote/smithi195/ 2023-11-03T05:04:05.630 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-03T05:04:21.475 INFO:teuthology.misc:Compressing logs... 2023-11-03T05:04:21.476 DEBUG:teuthology.orchestra.run.smithi064:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-03T05:04:21.478 DEBUG:teuthology.orchestra.run.smithi195:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-03T05:04:21.512 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90323.log 2023-11-03T05:04:21.513 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89980.log 2023-11-03T05:04:21.513 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-03T05:04:21.513 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90323.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90323.log.gz 2023-11-03T05:04:21.514 INFO:teuthology.orchestra.run.smithi064.stderr:gzip/var/log/ceph/ceph-client.admin.89980.log: -5 --verbose -- /var/log/ceph/ceph-client.0.90795.log 2023-11-03T05:04:21.514 INFO:teuthology.orchestra.run.smithi064.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89980.log.gz 2023-11-03T05:04:21.533 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89646.log 2023-11-03T05:04:21.534 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.0.90795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89467.log 2023-11-03T05:04:21.534 INFO:teuthology.orchestra.run.smithi064.stderr: 72.7% -- replaced with /var/log/ceph/ceph-client.0.90795.log.gz 2023-11-03T05:04:21.534 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90643.log 2023-11-03T05:04:21.534 INFO:teuthology.orchestra.run.smithi064.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89646.log.gz 2023-11-03T05:04:21.534 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89195.log 2023-11-03T05:04:21.535 INFO:teuthology.orchestra.run.smithi064.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89467.log.gz 2023-11-03T05:04:21.535 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90320.log 2023-11-03T05:04:21.535 INFO:teuthology.orchestra.run.smithi064.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90643.log.gz 2023-11-03T05:04:21.535 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89293.log 2023-11-03T05:04:21.536 INFO:teuthology.orchestra.run.smithi064.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89195.log.gz 2023-11-03T05:04:21.536 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89644.log 2023-11-03T05:04:21.536 INFO:teuthology.orchestra.run.smithi064.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90320.log.gz 2023-11-03T05:04:21.536 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89640.log 2023-11-03T05:04:21.536 INFO:teuthology.orchestra.run.smithi064.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89293.log.gz 2023-11-03T05:04:21.536 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89984.log 2023-11-03T05:04:21.537 INFO:teuthology.orchestra.run.smithi064.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89644.log.gz 2023-11-03T05:04:21.537 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89640.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-03T05:04:21.537 INFO:teuthology.orchestra.run.smithi064.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89640.log.gz 2023-11-03T05:04:21.537 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90181.log 2023-11-03T05:04:21.537 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89984.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89984.log.gz 2023-11-03T05:04:21.538 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89985.log 2023-11-03T05:04:21.538 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89648.log 2023-11-03T05:04:21.538 INFO:teuthology.orchestra.run.smithi064.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90181.log.gz 2023-11-03T05:04:21.538 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89981.log 2023-11-03T05:04:21.538 INFO:teuthology.orchestra.run.smithi064.stderr: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-03T05:04:21.539 INFO:teuthology.orchestra.run.smithi064.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89985.log.gz 2023-11-03T05:04:21.539 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89845.log 2023-11-03T05:04:21.539 INFO:teuthology.orchestra.run.smithi064.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89648.log.gz 2023-11-03T05:04:21.539 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89647.log 2023-11-03T05:04:21.539 INFO:teuthology.orchestra.run.smithi064.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89981.log.gz 2023-11-03T05:04:21.540 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90601.log 2023-11-03T05:04:21.540 INFO:teuthology.orchestra.run.smithi064.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89845.log.gz 2023-11-03T05:04:21.540 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89647.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-03T05:04:21.540 INFO:teuthology.orchestra.run.smithi064.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89647.log.gz 2023-11-03T05:04:21.540 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89973.log 2023-11-03T05:04:21.541 INFO:teuthology.orchestra.run.smithi064.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90601.log.gz 2023-11-03T05:04:21.541 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90772.log 2023-11-03T05:04:21.541 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90318.log 2023-11-03T05:04:21.541 INFO:teuthology.orchestra.run.smithi064.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89973.log.gz 2023-11-03T05:04:21.541 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90201.log 2023-11-03T05:04:21.542 INFO:teuthology.orchestra.run.smithi064.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90772.log.gz 2023-11-03T05:04:21.542 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89417.log 2023-11-03T05:04:21.542 INFO:teuthology.orchestra.run.smithi064.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90318.log.gz 2023-11-03T05:04:21.542 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90201.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-03T05:04:21.542 INFO:teuthology.orchestra.run.smithi064.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90201.log.gz 2023-11-03T05:04:21.543 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89645.log 2023-11-03T05:04:21.543 INFO:teuthology.orchestra.run.smithi064.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89417.log.gz 2023-11-03T05:04:21.543 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90322.log 2023-11-03T05:04:21.543 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90559.log 2023-11-03T05:04:21.543 INFO:teuthology.orchestra.run.smithi064.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89645.log.gz 2023-11-03T05:04:21.543 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90322.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90322.log.gz 2023-11-03T05:04:21.544 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89982.log 2023-11-03T05:04:21.544 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-03T05:04:21.544 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90559.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90559.log.gz 2023-11-03T05:04:21.544 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89367.log 2023-11-03T05:04:21.544 INFO:teuthology.orchestra.run.smithi064.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89982.log.gz 2023-11-03T05:04:21.545 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85978.log 2023-11-03T05:04:21.545 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89367.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.79772.log 2023-11-03T05:04:21.545 INFO:teuthology.orchestra.run.smithi064.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89367.log.gz 2023-11-03T05:04:21.545 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.85978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85584.log 2023-11-03T05:04:21.545 INFO:teuthology.orchestra.run.smithi064.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.85978.log.gz 2023-11-03T05:04:21.546 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph.tmp-client.admin.79772.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-03T05:04:21.546 INFO:teuthology.orchestra.run.smithi064.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.79772.log.gz 2023-11-03T05:04:21.546 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.85584.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-03T05:04:21.546 INFO:teuthology.orchestra.run.smithi064.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.85584.log.gz 2023-11-03T05:04:21.546 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90321.log 2023-11-03T05:04:21.547 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-03T05:04:21.547 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85875.log 2023-11-03T05:04:21.547 INFO:teuthology.orchestra.run.smithi064.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90321.log.gz 2023-11-03T05:04:21.547 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89643.log 2023-11-03T05:04:21.547 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.85875.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.85875.log.gz 2023-11-03T05:04:21.548 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89649.log 2023-11-03T05:04:21.548 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89643.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89643.log.gz 2023-11-03T05:04:21.548 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90317.log 2023-11-03T05:04:21.548 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89649.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89649.log.gz 2023-11-03T05:04:21.548 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89974.log 2023-11-03T05:04:21.549 INFO:teuthology.orchestra.run.smithi064.stderr: 94.2%/var/log/ceph/ceph-client.admin.90317.log: -- replaced with /var/log/ceph/ceph.log.gz 2023-11-03T05:04:21.549 INFO:teuthology.orchestra.run.smithi064.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90317.log.gz 2023-11-03T05:04:21.549 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90517.log 2023-11-03T05:04:21.549 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89974.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.89974.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.90685.log 2023-11-03T05:04:21.549 INFO:teuthology.orchestra.run.smithi064.stderr: 2023-11-03T05:04:21.550 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89251.log 2023-11-03T05:04:21.550 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90685.log: /var/log/ceph/ceph-client.admin.90517.log: 93.9% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90517.log.gz 2023-11-03T05:04:21.550 INFO:teuthology.orchestra.run.smithi064.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90685.log.gz 2023-11-03T05:04:21.550 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-03T05:04:21.550 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90730.log 2023-11-03T05:04:21.551 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.89251.log: gzip 0.0% -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-03T05:04:21.551 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.89251.log.gz 2023-11-03T05:04:21.551 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.90730.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90730.log.gz 2023-11-03T05:04:21.556 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-11-03T05:04:21.556 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86032.log 2023-11-03T05:04:21.557 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-03T05:04:21.557 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.86032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85912.log 2023-11-03T05:04:21.557 INFO:teuthology.orchestra.run.smithi195.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.86032.log.gz 2023-11-03T05:04:21.557 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-03T05:04:21.557 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.85912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86112.log 2023-11-03T05:04:21.558 INFO:teuthology.orchestra.run.smithi195.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.85912.log.gz 2023-11-03T05:04:21.558 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-03T05:04:21.558 INFO:teuthology.orchestra.run.smithi195.stderr: 88.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-03T05:04:21.558 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.86112.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.86112.log.gz -5 2023-11-03T05:04:21.558 INFO:teuthology.orchestra.run.smithi195.stderr: --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-03T05:04:21.559 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85952.log 2023-11-03T05:04:21.559 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86072.log 2023-11-03T05:04:21.559 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.85952.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-03T05:04:21.559 INFO:teuthology.orchestra.run.smithi195.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.85952.log.gz 2023-11-03T05:04:21.559 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.86072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86152.log 2023-11-03T05:04:21.560 INFO:teuthology.orchestra.run.smithi195.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.86072.log.gz 2023-11-03T05:04:21.560 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85992.log 2023-11-03T05:04:21.560 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.86152.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-03T05:04:21.560 INFO:teuthology.orchestra.run.smithi195.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.86152.log.gz 2023-11-03T05:04:21.560 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.85992.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-03T05:04:21.561 INFO:teuthology.orchestra.run.smithi195.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.85992.log.gz 2023-11-03T05:04:21.561 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86192.log 2023-11-03T05:04:21.561 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.86192.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.86192.log.gz 2023-11-03T05:04:21.561 INFO:teuthology.orchestra.run.smithi195.stderr: 89.7% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-03T05:04:21.625 INFO:teuthology.orchestra.run.smithi195.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-03T05:04:21.761 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-mon.c.log: 92.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-03T05:04:21.807 INFO:teuthology.orchestra.run.smithi195.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-03T05:04:21.941 INFO:teuthology.orchestra.run.smithi064.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-03T05:04:22.316 INFO:teuthology.orchestra.run.smithi195.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-03T05:04:22.346 INFO:teuthology.orchestra.run.smithi064.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-03T05:04:22.440 INFO:teuthology.orchestra.run.smithi195.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-03T05:04:22.689 INFO:teuthology.orchestra.run.smithi195.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-03T05:04:22.690 INFO:teuthology.orchestra.run.smithi064.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-03T05:04:22.690 INFO:teuthology.orchestra.run.smithi064.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-03T05:04:22.893 INFO:teuthology.orchestra.run.smithi064.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-03T05:04:23.384 INFO:teuthology.orchestra.run.smithi195.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-03T05:04:23.387 DEBUG:teuthology.misc:Transferring archived files from smithi064:/var/log/ceph to /home/teuthworker/archive/benhanokh-2023-11-01_06:18:13-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442637/remote/smithi064/log 2023-11-03T05:04:23.388 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-03T05:04:24.212 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/log/ceph to /home/teuthworker/archive/benhanokh-2023-11-01_06:18:13-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442637/remote/smithi195/log 2023-11-03T05:04:24.213 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-03T05:04:25.111 INFO:teuthology.kill:No teuthology processes running 2023-11-03T05:04:25.894 INFO:teuthology.kill:Nuking machines: ['smithi064', 'smithi195'] 2023-11-03T05:04:26.531 INFO:teuthology.kill:2023-11-03 05:04:26,531.531 INFO:teuthology.nuke:targets: 2023-11-03T05:04:26.532 INFO:teuthology.kill: smithi064.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNjIOeBb7nejacaubSVCOwrWdZw/o35Y/SVYHiqITqZHPPDRG8X+Q+ZPIAE9loCxXnVzCv410DyRRR9BIWWcz2Q= 2023-11-03T05:04:26.533 INFO:teuthology.kill: smithi195.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOq9iCYMCclOOS3aPay0b1KI8fwczIXY6DGOBg5toRnixFi3SBxddfL8woWlc2hrO6+jN2zi6XrPZzKlikkDOfw= 2023-11-03T05:04:26.533 INFO:teuthology.kill:2023-11-03 05:04:26,531.531 INFO:teuthology.nuke:Checking targets against current locks 2023-11-03T05:04:26.581 INFO:teuthology.kill:2023-11-03 05:04:26,581.581 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-03T05:04:26.604 INFO:teuthology.kill:2023-11-03 05:04:26,604.604 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-03T05:04:26.653 INFO:teuthology.kill:2023-11-03 05:04:26,653.653 INFO:teuthology.orchestra.console.smithi064:Power off 2023-11-03T05:04:26.690 INFO:teuthology.kill:2023-11-03 05:04:26,689.689 INFO:teuthology.orchestra.console.smithi195:Power off 2023-11-03T05:04:35.052 INFO:teuthology.kill:2023-11-03 05:04:35,052.052 INFO:teuthology.orchestra.console.smithi195:Power off completed 2023-11-03T05:04:35.209 INFO:teuthology.kill:2023-11-03 05:04:35,208.208 INFO:teuthology.lock.ops:unlocked: smithi195.front.sepia.ceph.com 2023-11-03T05:04:39.132 INFO:teuthology.kill:2023-11-03 05:04:39,131.131 INFO:teuthology.orchestra.console.smithi064:Power off completed 2023-11-03T05:04:39.283 INFO:teuthology.kill:2023-11-03 05:04:39,283.283 INFO:teuthology.lock.ops:unlocked: smithi064.front.sepia.ceph.com 2023-11-03T05:04:39.374 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T05:06:39.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T05:06:39.612 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2023-11-03T05:06:39.707 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi064 but it was locked by another job: /home/teuthworker/archive/leonidus-2023-11-02_12:51:57-fs-wip-lusov-balance-after-stop-distro-default-smithi/7444296 2023-11-03T05:06:39.707 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi195 but it was locked by another job: /home/teuthworker/archive/leonidus-2023-11-02_12:51:57-fs-wip-lusov-balance-after-stop-distro-default-smithi/7444299