2023-11-05T07:03:39.247 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-05T07:03:39.248 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T07:03:39.393 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd252ecbc10>, signals=[15]) 2023-11-05T07:03:39.395 INFO:teuthology.lock.ops:Start node 'smithi028.front.sepia.ceph.com' reimaging 2023-11-05T07:03:39.395 INFO:teuthology.lock.ops:Updating [smithi028.front.sepia.ceph.com]: reset os type and version on server 2023-11-05T07:03:39.395 INFO:teuthology.lock.ops:Updating smithi028.front.sepia.ceph.com on lock server 2023-11-05T07:03:39.414 INFO:teuthology.lock.ops:Start node 'smithi031.front.sepia.ceph.com' reimaging 2023-11-05T07:03:39.414 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: reset os type and version on server 2023-11-05T07:03:39.415 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2023-11-05T07:03:39.417 DEBUG:teuthology.provision.fog.smithi028:FOG request: GET /host {"name": "smithi028"} 2023-11-05T07:03:39.447 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /host {"name": "smithi031"} 2023-11-05T07:03:39.500 DEBUG:teuthology.provision.fog.smithi028:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-11-05T07:03:39.515 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-11-05T07:03:39.540 DEBUG:teuthology.provision.fog.smithi028:Requesting image smithi_centos_9.stream (ID 10) 2023-11-05T07:03:39.540 DEBUG:teuthology.provision.fog.smithi028:FOG request: PUT /host/133 {"imageID": 10} 2023-11-05T07:03:39.559 DEBUG:teuthology.provision.fog.smithi031:Requesting image smithi_centos_9.stream (ID 10) 2023-11-05T07:03:39.559 DEBUG:teuthology.provision.fog.smithi031:FOG request: PUT /host/136 {"imageID": 10} 2023-11-05T07:03:39.584 INFO:teuthology.provision.fog.smithi028:Scheduling deploy of centos 9.stream 2023-11-05T07:03:39.585 DEBUG:teuthology.provision.fog.smithi028:FOG request: GET /task/active None 2023-11-05T07:03:39.606 INFO:teuthology.provision.fog.smithi031:Scheduling deploy of centos 9.stream 2023-11-05T07:03:39.607 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-05T07:03:39.657 DEBUG:teuthology.provision.fog.smithi028:FOG request: GET /tasktype {"name": "deploy"} 2023-11-05T07:03:39.668 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /tasktype {"name": "deploy"} 2023-11-05T07:03:39.700 DEBUG:teuthology.provision.fog.smithi028:FOG request: POST /host/133/task {"taskTypeID": 1} 2023-11-05T07:03:39.716 DEBUG:teuthology.provision.fog.smithi031:FOG request: POST /host/136/task {"taskTypeID": 1} 2023-11-05T07:03:39.749 DEBUG:teuthology.provision.fog.smithi028:FOG request: GET /task/active None 2023-11-05T07:03:39.778 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-05T07:03:39.861 INFO:teuthology.orchestra.console.smithi028:Power off 2023-11-05T07:03:39.862 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-05T07:03:39.875 INFO:teuthology.orchestra.console.smithi031:Power off 2023-11-05T07:03:39.876 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-05T07:03:39.885 DEBUG:teuthology.orchestra.console.smithi028:power off output: Chassis Power Control: Down/Off 2023-11-05T07:03:39.886 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T07:03:39.898 DEBUG:teuthology.orchestra.console.smithi031:power off output: Chassis Power Control: Down/Off 2023-11-05T07:03:39.899 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T07:03:39.911 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is on 2023-11-05T07:03:39.927 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-11-05T07:03:43.914 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T07:03:43.928 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T07:03:44.023 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is on 2023-11-05T07:03:44.037 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-11-05T07:03:48.026 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T07:03:48.038 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T07:03:48.137 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is off 2023-11-05T07:03:48.147 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-11-05T07:03:48.239 INFO:teuthology.orchestra.console.smithi028:Power off completed 2023-11-05T07:03:48.248 INFO:teuthology.orchestra.console.smithi031:Power off completed 2023-11-05T07:03:48.340 INFO:teuthology.orchestra.console.smithi028:Power on 2023-11-05T07:03:48.341 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-05T07:03:48.349 INFO:teuthology.orchestra.console.smithi031:Power on 2023-11-05T07:03:48.349 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-05T07:03:48.362 DEBUG:teuthology.orchestra.console.smithi028:power on output: Chassis Power Control: Up/On 2023-11-05T07:03:48.363 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T07:03:48.372 DEBUG:teuthology.orchestra.console.smithi031:power on output: Chassis Power Control: Up/On 2023-11-05T07:03:48.372 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T07:03:48.384 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is off 2023-11-05T07:03:48.396 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-11-05T07:03:52.386 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T07:03:52.397 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T07:03:52.499 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is off 2023-11-05T07:03:52.505 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-11-05T07:03:52.606 INFO:teuthology.orchestra.console.smithi031:Power on completed 2023-11-05T07:03:52.707 INFO:teuthology.provision.fog.smithi031:Waiting for deploy to finish 2023-11-05T07:03:52.708 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-05T07:03:56.502 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T07:03:56.610 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is on 2023-11-05T07:03:56.712 INFO:teuthology.orchestra.console.smithi028:Power on completed 2023-11-05T07:03:56.813 INFO:teuthology.provision.fog.smithi028:Waiting for deploy to finish 2023-11-05T07:03:56.813 DEBUG:teuthology.provision.fog.smithi028:FOG request: GET /task/active None 2023-11-05T07:04:07.794 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-05T07:04:11.890 DEBUG:teuthology.provision.fog.smithi028:FOG request: GET /task/active None 2023-11-05T07:04:22.878 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-05T07:04:26.978 DEBUG:teuthology.provision.fog.smithi028:FOG request: GET /task/active None 2023-11-05T07:04:37.978 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-05T07:04:42.076 DEBUG:teuthology.provision.fog.smithi028:FOG request: GET /task/active None 2023-11-05T07:04:53.064 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-05T07:04:57.170 DEBUG:teuthology.provision.fog.smithi028:FOG request: GET /task/active None 2023-11-05T07:05:08.151 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-05T07:05:12.254 DEBUG:teuthology.provision.fog.smithi028:FOG request: GET /task/active None 2023-11-05T07:05:23.234 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-05T07:05:27.334 DEBUG:teuthology.provision.fog.smithi028:FOG request: GET /task/active None 2023-11-05T07:05:38.354 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-05T07:05:42.430 DEBUG:teuthology.provision.fog.smithi028:FOG request: GET /task/active None 2023-11-05T07:05:53.442 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-05T07:05:57.534 DEBUG:teuthology.provision.fog.smithi028:FOG request: GET /task/active None 2023-11-05T07:06:08.542 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-05T07:06:08.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T07:06:11.674 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-11-05T07:06:12.616 DEBUG:teuthology.provision.fog.smithi028:FOG request: GET /task/active None 2023-11-05T07:06:12.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T07:06:15.770 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28 2023-11-05T07:06:17.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T07:06:20.730 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-11-05T07:06:21.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T07:06:24.826 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28 2023-11-05T07:06:26.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T07:06:29.790 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-11-05T07:06:30.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T07:06:33.882 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28 2023-11-05T07:06:35.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T07:06:38.881 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-11-05T07:06:39.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T07:06:42.942 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28 2023-11-05T07:06:44.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T07:06:47.966 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-11-05T07:06:48.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T07:06:51.994 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28 2023-11-05T07:06:53.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T07:06:57.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T07:07:01.050 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28 2023-11-05T07:07:07.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T07:07:38.712 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-05T07:07:38.713 DEBUG:teuthology.orchestra.run.smithi028:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-05T07:07:53.973 WARNING:teuthology.provision.fog.smithi031:timed out 2023-11-05T07:07:59.216 INFO:teuthology.provision.fog.smithi028:Node is ready 2023-11-05T07:07:59.216 DEBUG:teuthology.orchestra.run.smithi028:> hostname 2023-11-05T07:07:59.236 INFO:teuthology.orchestra.run.smithi028.stdout:smithi028.front.sepia.ceph.com 2023-11-05T07:07:59.237 DEBUG:teuthology.orchestra.run.smithi028:> grep smithi028.front.sepia.ceph.com /etc/hosts 2023-11-05T07:07:59.296 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.15.28 smithi028.front.sepia.ceph.com smithi028 2023-11-05T07:07:59.297 DEBUG:teuthology.orchestra.run.smithi028:> sudo hostname smithi028 2023-11-05T07:07:59.421 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i -e 's/smithi028.front.sepia.ceph.com/smithi028/g' /etc/hosts 2023-11-05T07:07:59.456 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i -e 's/172.21.15.28/172.21.15.28/g' /etc/hosts 2023-11-05T07:07:59.531 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i -e 's/smithi028.front.sepia.ceph.com/smithi028/g' /etc/hostname 2023-11-05T07:07:59.604 DEBUG:teuthology.orchestra.run.smithi028:> sudo hostname smithi028 2023-11-05T07:07:59.676 DEBUG:teuthology.orchestra.run.smithi028:> cat /etc/os-release 2023-11-05T07:07:59.732 INFO:teuthology.orchestra.run.smithi028.stdout:NAME="CentOS Stream" 2023-11-05T07:07:59.733 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION="9" 2023-11-05T07:07:59.733 INFO:teuthology.orchestra.run.smithi028.stdout:ID="centos" 2023-11-05T07:07:59.733 INFO:teuthology.orchestra.run.smithi028.stdout:ID_LIKE="rhel fedora" 2023-11-05T07:07:59.733 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_ID="9" 2023-11-05T07:07:59.733 INFO:teuthology.orchestra.run.smithi028.stdout:PLATFORM_ID="platform:el9" 2023-11-05T07:07:59.734 INFO:teuthology.orchestra.run.smithi028.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-05T07:07:59.734 INFO:teuthology.orchestra.run.smithi028.stdout:ANSI_COLOR="0;31" 2023-11-05T07:07:59.734 INFO:teuthology.orchestra.run.smithi028.stdout:LOGO="fedora-logo-icon" 2023-11-05T07:07:59.734 INFO:teuthology.orchestra.run.smithi028.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-05T07:07:59.734 INFO:teuthology.orchestra.run.smithi028.stdout:HOME_URL="https://centos.org/" 2023-11-05T07:07:59.735 INFO:teuthology.orchestra.run.smithi028.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-05T07:07:59.735 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-05T07:07:59.735 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-05T07:07:59.736 INFO:teuthology.provision.fog.smithi028:Deploy complete! 2023-11-05T07:07:59.738 DEBUG:teuthology.parallel:result is None 2023-11-05T07:07:59.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T07:08:00.243 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-05T07:08:00.243 DEBUG:teuthology.orchestra.run.smithi031:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-05T07:08:00.565 INFO:teuthology.provision.fog.smithi031:Node is ready 2023-11-05T07:08:00.565 DEBUG:teuthology.orchestra.run.smithi031:> hostname 2023-11-05T07:08:00.580 INFO:teuthology.orchestra.run.smithi031.stdout:smithi031.front.sepia.ceph.com 2023-11-05T07:08:00.581 DEBUG:teuthology.orchestra.run.smithi031:> grep smithi031.front.sepia.ceph.com /etc/hosts 2023-11-05T07:08:00.637 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31 smithi031.front.sepia.ceph.com smithi031 2023-11-05T07:08:00.637 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031 2023-11-05T07:08:00.740 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hosts 2023-11-05T07:08:00.772 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/172.21.15.31/172.21.15.31/g' /etc/hosts 2023-11-05T07:08:00.844 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hostname 2023-11-05T07:08:00.916 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031 2023-11-05T07:08:00.986 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2023-11-05T07:08:01.040 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="CentOS Stream" 2023-11-05T07:08:01.041 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="9" 2023-11-05T07:08:01.041 INFO:teuthology.orchestra.run.smithi031.stdout:ID="centos" 2023-11-05T07:08:01.041 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="rhel fedora" 2023-11-05T07:08:01.041 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="9" 2023-11-05T07:08:01.041 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el9" 2023-11-05T07:08:01.042 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-05T07:08:01.042 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31" 2023-11-05T07:08:01.042 INFO:teuthology.orchestra.run.smithi031.stdout:LOGO="fedora-logo-icon" 2023-11-05T07:08:01.042 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-05T07:08:01.042 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://centos.org/" 2023-11-05T07:08:01.043 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-05T07:08:01.043 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-05T07:08:01.043 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-05T07:08:01.043 INFO:teuthology.provision.fog.smithi031:Deploy complete! 2023-11-05T07:08:01.044 DEBUG:teuthology.parallel:result is None 2023-11-05T07:08:01.265 INFO:teuthology.lock.ops:Checking smithi028.front.sepia.ceph.com 2023-11-05T07:08:01.266 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-05T07:08:01.294 INFO:teuthology.lock.ops:Checking smithi031.front.sepia.ceph.com 2023-11-05T07:08:01.294 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-05T07:08:01.319 INFO:teuthology.lock.ops:Updating [smithi028.front.sepia.ceph.com]: set os type and version on server 2023-11-05T07:08:01.319 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com' 2023-11-05T07:08:01.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T07:08:01.459 DEBUG:teuthology.orchestra.run.smithi028:> true 2023-11-05T07:08:01.530 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi028.front.sepia.ceph.com' 2023-11-05T07:08:01.531 DEBUG:teuthology.orchestra.run.smithi028:> uname -m 2023-11-05T07:08:01.587 INFO:teuthology.orchestra.run.smithi028.stdout:x86_64 2023-11-05T07:08:01.588 DEBUG:teuthology.orchestra.run.smithi028:> cat /etc/os-release 2023-11-05T07:08:01.644 INFO:teuthology.orchestra.run.smithi028.stdout:NAME="CentOS Stream" 2023-11-05T07:08:01.645 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION="9" 2023-11-05T07:08:01.645 INFO:teuthology.orchestra.run.smithi028.stdout:ID="centos" 2023-11-05T07:08:01.645 INFO:teuthology.orchestra.run.smithi028.stdout:ID_LIKE="rhel fedora" 2023-11-05T07:08:01.645 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_ID="9" 2023-11-05T07:08:01.645 INFO:teuthology.orchestra.run.smithi028.stdout:PLATFORM_ID="platform:el9" 2023-11-05T07:08:01.646 INFO:teuthology.orchestra.run.smithi028.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-05T07:08:01.646 INFO:teuthology.orchestra.run.smithi028.stdout:ANSI_COLOR="0;31" 2023-11-05T07:08:01.646 INFO:teuthology.orchestra.run.smithi028.stdout:LOGO="fedora-logo-icon" 2023-11-05T07:08:01.646 INFO:teuthology.orchestra.run.smithi028.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-05T07:08:01.646 INFO:teuthology.orchestra.run.smithi028.stdout:HOME_URL="https://centos.org/" 2023-11-05T07:08:01.647 INFO:teuthology.orchestra.run.smithi028.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-05T07:08:01.647 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-05T07:08:01.647 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-05T07:08:01.648 INFO:teuthology.lock.ops:Updating smithi028.front.sepia.ceph.com on lock server 2023-11-05T07:08:01.668 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: set os type and version on server 2023-11-05T07:08:01.668 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-11-05T07:08:01.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T07:08:01.764 DEBUG:teuthology.orchestra.run.smithi031:> true 2023-11-05T07:08:01.833 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-11-05T07:08:01.833 DEBUG:teuthology.orchestra.run.smithi031:> uname -m 2023-11-05T07:08:01.889 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64 2023-11-05T07:08:01.889 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2023-11-05T07:08:01.944 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="CentOS Stream" 2023-11-05T07:08:01.944 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="9" 2023-11-05T07:08:01.944 INFO:teuthology.orchestra.run.smithi031.stdout:ID="centos" 2023-11-05T07:08:01.944 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="rhel fedora" 2023-11-05T07:08:01.945 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="9" 2023-11-05T07:08:01.945 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el9" 2023-11-05T07:08:01.945 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-05T07:08:01.945 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31" 2023-11-05T07:08:01.945 INFO:teuthology.orchestra.run.smithi031.stdout:LOGO="fedora-logo-icon" 2023-11-05T07:08:01.946 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-05T07:08:01.946 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://centos.org/" 2023-11-05T07:08:01.946 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-05T07:08:01.946 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-05T07:08:01.947 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-05T07:08:01.947 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2023-11-05T07:08:01.968 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T07:08:02.068 INFO:teuthology.dispatcher.supervisor:Running job 7442345 2023-11-05T07:08:02.068 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2023-10-31_16:43:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442345 --name benhanokh-2023-10-31_16:43:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi --description rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} -- /home/teuthworker/archive/benhanokh-2023-10-31_16:43:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442345/orig.config.yaml 2023-11-05T07:08:02.072 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2023-10-31_16:43:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442345 2023-11-05T07:08:02.073 INFO:teuthology.dispatcher.supervisor:Job PID: 3044830 2023-11-05T07:08:02.074 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-05T07:10:02.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T07:12:02.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T07:14:02.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T07:16:02.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T07:18:02.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T07:20:03.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T07:22:03.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T07:24:03.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T07:26:03.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T07:28:03.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T07:30:03.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T07:32:04.032 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T07:34:04.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T07:36:04.366 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T07:38:04.532 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T07:40:04.698 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T07:42:04.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T07:44:05.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T07:46:05.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T07:48:05.362 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T07:50:05.532 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T07:52:05.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T07:54:05.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T07:56:06.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T07:58:06.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T08:00:06.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T08:02:06.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T08:04:06.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T08:06:06.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T08:08:07.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T08:10:07.212 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T08:12:07.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T08:14:07.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T08:16:07.676 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T08:18:07.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T08:20:08.018 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T08:22:08.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T08:24:08.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T08:26:08.514 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T08:28:08.676 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T08:30:08.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T08:32:08.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T08:34:09.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T08:36:09.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T08:38:09.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T08:40:09.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T08:42:09.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T08:44:10.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T08:46:10.244 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T08:48:10.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T08:50:10.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T08:52:10.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T08:54:10.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T08:56:11.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T08:58:11.264 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T09:00:11.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T09:02:11.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T09:04:11.756 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T09:06:11.932 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T09:08:12.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T09:10:12.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T09:12:12.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T09:14:12.624 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T09:16:12.788 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T09:18:12.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T09:20:13.098 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T09:22:13.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T09:24:13.410 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T09:26:13.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T09:28:14.014 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T09:30:14.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T09:32:14.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T09:34:14.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T09:36:14.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T09:38:14.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T09:40:15.014 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T09:42:15.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T09:44:15.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T09:46:15.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T09:48:15.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T09:50:15.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T09:52:16.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T09:54:16.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T09:56:16.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T09:58:16.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T10:00:16.672 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T10:02:16.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T10:04:16.988 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T10:06:17.130 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T10:08:17.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T10:10:17.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T10:12:17.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T10:14:17.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T10:16:17.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T10:18:18.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T10:20:18.212 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T10:22:18.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T10:24:18.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T10:26:18.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T10:28:18.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T10:30:19.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T10:32:19.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T10:34:19.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T10:36:19.526 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T10:38:19.690 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T10:40:19.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T10:42:20.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T10:44:20.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T10:46:20.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T10:48:20.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T10:50:20.668 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T10:52:20.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T10:54:20.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T10:56:21.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T10:58:21.314 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T11:00:21.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T11:02:21.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T11:04:21.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T11:06:21.980 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T11:08:22.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T11:10:22.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T11:12:22.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T11:14:22.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T11:16:22.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T11:18:23.069 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T11:20:23.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T11:22:23.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T11:24:23.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T11:26:23.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T11:28:23.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T11:30:24.048 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T11:32:24.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T11:34:24.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T11:36:24.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T11:38:24.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T11:40:24.897 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T11:42:25.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T11:44:25.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T11:46:25.420 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T11:48:25.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T11:50:25.736 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T11:52:25.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T11:54:26.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T11:56:26.230 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T11:58:26.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T12:00:26.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T12:02:26.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T12:04:26.920 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T12:06:27.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T12:08:27.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T12:10:27.448 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T12:12:27.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T12:14:27.792 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T12:16:27.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T12:18:28.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T12:20:28.328 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T12:22:28.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T12:24:28.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T12:26:28.813 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T12:28:29.021 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T12:30:29.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T12:32:29.348 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T12:34:29.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T12:36:29.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T12:38:29.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T12:40:30.008 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T12:42:30.164 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T12:44:30.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T12:46:30.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T12:48:30.668 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T12:50:30.838 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T12:52:31.020 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T12:54:31.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T12:56:31.366 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T12:58:31.532 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T13:00:31.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T13:02:31.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T13:04:32.001 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T13:06:32.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T13:08:32.312 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T13:10:32.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T13:12:32.644 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T13:14:32.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T13:16:32.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T13:18:33.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T13:20:33.310 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T13:22:33.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T13:24:33.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T13:26:33.826 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T13:28:33.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T13:30:34.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T13:32:34.285 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T13:34:34.445 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T13:36:34.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T13:38:34.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T13:40:35.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T13:42:35.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T13:44:35.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T13:46:35.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T13:48:35.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T13:50:35.946 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T13:52:36.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T13:54:36.260 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T13:56:36.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T13:58:36.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T14:00:36.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T14:02:36.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T14:04:37.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T14:06:37.240 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T14:08:37.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T14:10:37.532 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T14:12:37.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T14:14:37.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T14:16:38.018 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T14:18:38.186 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T14:20:38.357 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T14:22:38.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T14:24:38.696 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T14:26:38.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T14:28:38.980 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T14:30:39.141 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T14:32:39.310 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T14:34:39.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T14:36:39.598 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T14:38:39.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T14:40:39.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T14:42:40.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T14:44:40.250 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T14:46:40.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T14:48:40.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T14:50:40.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T14:52:40.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T14:54:41.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T14:56:41.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T14:58:41.366 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T15:00:41.534 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T15:02:41.702 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T15:04:41.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T15:06:42.038 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T15:08:42.212 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T15:10:42.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T15:12:42.553 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T15:14:42.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T15:16:42.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T15:18:43.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T15:20:43.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T15:22:43.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T15:24:43.522 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T15:26:43.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T15:28:43.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T15:30:44.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T15:32:44.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T15:34:44.353 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T15:36:44.510 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T15:38:44.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T15:40:44.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T15:42:44.996 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T15:44:45.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T15:46:45.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T15:48:45.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T15:50:45.670 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T15:52:45.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T15:54:45.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T15:56:46.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T15:58:46.334 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T16:00:46.485 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T16:02:46.630 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T16:04:46.800 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T16:06:46.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T16:08:47.118 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T16:10:47.285 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T16:12:47.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T16:14:47.626 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T16:16:47.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T16:18:47.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T16:20:48.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T16:22:48.284 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T16:24:48.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T16:26:48.616 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T16:28:48.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T16:30:48.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T16:32:49.120 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T16:34:49.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T16:36:49.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T16:38:49.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T16:40:49.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T16:42:49.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T16:44:50.014 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T16:46:50.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T16:48:50.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T16:50:50.533 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T16:52:50.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T16:54:50.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T16:56:51.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T16:58:51.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T17:00:51.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T17:02:51.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T17:04:51.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T17:06:51.842 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T17:08:52.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T17:10:52.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T17:12:52.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T17:14:52.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T17:16:52.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T17:18:52.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T17:20:53.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T17:22:53.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T17:24:53.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T17:26:53.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T17:28:53.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T17:30:53.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T17:32:54.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T17:34:54.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T17:36:54.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T17:38:54.512 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T17:40:54.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T17:42:54.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T17:44:55.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T17:46:55.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T17:48:55.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T17:50:55.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T17:52:55.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T17:54:55.837 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T17:56:56.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T17:58:56.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T18:00:56.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T18:02:56.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T18:04:56.638 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T18:06:56.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T18:08:56.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T18:10:57.149 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T18:12:57.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T18:14:57.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T18:16:57.642 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T18:18:57.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T18:20:57.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T18:22:58.118 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T18:24:58.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T18:26:58.406 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T18:28:58.570 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T18:30:58.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T18:32:58.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T18:34:59.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T18:36:59.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T18:38:59.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T18:40:59.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T18:42:59.710 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T18:44:59.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T18:47:00.034 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T18:49:00.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T18:51:00.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T18:53:00.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T18:55:00.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T18:57:00.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T18:59:01.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T19:01:01.146 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T19:03:01.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T19:05:01.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T19:07:01.629 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T19:09:01.787 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-11-05T19:09:01.919 INFO:teuthology.kill:Killing Pids: {3044830} 2023-11-05T19:09:02.723 INFO:teuthology.task.internal:roles: ubuntu@smithi028.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2023-11-05T19:09:02.724 INFO:teuthology.task.internal:roles: ubuntu@smithi031.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2023-11-05T19:09:02.724 INFO:teuthology.misc:Compressing logs... 2023-11-05T19:09:02.725 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com' 2023-11-05T19:09:02.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T19:09:02.820 DEBUG:teuthology.orchestra.run.smithi028:> true 2023-11-05T19:09:02.890 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi028.front.sepia.ceph.com' 2023-11-05T19:09:02.890 DEBUG:teuthology.orchestra.run.smithi028:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-05T19:09:02.932 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-11-05T19:09:02.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T19:09:03.032 DEBUG:teuthology.orchestra.run.smithi031:> true 2023-11-05T19:09:03.104 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-11-05T19:09:03.104 DEBUG:teuthology.orchestra.run.smithi031:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-05T19:09:03.186 DEBUG:teuthology.misc:Transferring archived files from smithi028:/var/lib/ceph/crash to /home/teuthworker/archive/benhanokh-2023-10-31_16:43:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442345/remote/smithi028/crash 2023-11-05T19:09:03.187 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-05T19:09:03.299 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/crash to /home/teuthworker/archive/benhanokh-2023-10-31_16:43:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442345/remote/smithi031/crash 2023-11-05T19:09:03.300 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-05T19:09:03.462 INFO:teuthology.misc:Compressing logs... 2023-11-05T19:09:03.462 DEBUG:teuthology.orchestra.run.smithi028:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-05T19:09:03.465 DEBUG:teuthology.orchestra.run.smithi031:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-05T19:09:03.492 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-05T19:09:03.493 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-05T19:09:03.494 INFO:teuthology.orchestra.run.smithi028.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-11-05T19:09:03.494 INFO:teuthology.orchestra.run.smithi028.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-11-05T19:09:03.522 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-05T19:09:03.522 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-05T19:09:03.523 INFO:teuthology.orchestra.run.smithi031.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-11-05T19:09:03.523 INFO:teuthology.orchestra.run.smithi031.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-11-05T19:09:03.524 DEBUG:teuthology.misc:Transferring archived files from smithi028:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/benhanokh-2023-10-31_16:43:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442345/remote/smithi028/ 2023-11-05T19:09:03.524 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-05T19:09:17.034 DEBUG:teuthology.misc:Transferring archived files from smithi031:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/benhanokh-2023-10-31_16:43:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442345/remote/smithi031/ 2023-11-05T19:09:17.035 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-05T19:09:57.074 INFO:teuthology.misc:Compressing logs... 2023-11-05T19:09:57.075 DEBUG:teuthology.orchestra.run.smithi028:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-05T19:09:57.078 DEBUG:teuthology.orchestra.run.smithi031:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-05T19:09:57.111 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-05T19:09:57.111 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90005.log 2023-11-05T19:09:57.113 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89760.log 2023-11-05T19:09:57.113 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-mon.a.log: gzip/var/log/ceph/ceph-client.admin.90005.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.89752.log 2023-11-05T19:09:57.113 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90005.log.gz 2023-11-05T19:09:57.113 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.89760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90006.log 2023-11-05T19:09:57.114 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89760.log.gz 2023-11-05T19:09:57.114 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.89752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89751.log 2023-11-05T19:09:57.129 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89752.log.gz 2023-11-05T19:09:57.129 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.90006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89755.log 2023-11-05T19:09:57.129 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90006.log.gz 2023-11-05T19:09:57.129 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.89751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90452.log 2023-11-05T19:09:57.129 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89751.log.gz 2023-11-05T19:09:57.130 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.89755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90013.log 2023-11-05T19:09:57.130 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89755.log.gz 2023-11-05T19:09:57.130 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.90452.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.90452.log.gz --verbose 2023-11-05T19:09:57.130 INFO:teuthology.orchestra.run.smithi028.stderr: -- /var/log/ceph/ceph-client.admin.90901.log 2023-11-05T19:09:57.130 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.90013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89761.log 2023-11-05T19:09:57.131 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90013.log.gz 2023-11-05T19:09:57.131 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.90901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90055.log 2023-11-05T19:09:57.131 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90901.log.gz 2023-11-05T19:09:57.131 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.89761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90646.log 2023-11-05T19:09:57.131 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89761.log.gz 2023-11-05T19:09:57.132 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.90055.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-05T19:09:57.132 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90055.log.gz 2023-11-05T19:09:57.132 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.90646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90688.log 2023-11-05T19:09:57.132 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90646.log.gz 2023-11-05T19:09:57.132 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86027.log 2023-11-05T19:09:57.133 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.90688.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.90688.log.gz 2023-11-05T19:09:57.133 INFO:teuthology.orchestra.run.smithi028.stderr: --verbose -- /var/log/ceph/ceph-client.admin.90156.log 2023-11-05T19:09:57.133 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89453.log 2023-11-05T19:09:57.133 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.86027.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.86027.log.gz 2023-11-05T19:09:57.133 INFO:teuthology.orchestra.run.smithi028.stderr: 93.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-05T19:09:57.133 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.90156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85631.log 2023-11-05T19:09:57.134 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90156.log.gz 2023-11-05T19:09:57.134 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.89453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90014.log 2023-11-05T19:09:57.134 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89453.log.gz 2023-11-05T19:09:57.134 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.85631.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.85631.log.gz 2023-11-05T19:09:57.134 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.79812.log 2023-11-05T19:09:57.135 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89368.log 2023-11-05T19:09:57.135 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.90014.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90014.log.gz 2023-11-05T19:09:57.135 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph.tmp-client.admin.79812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89756.log 2023-11-05T19:09:57.135 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.79812.log.gz 2023-11-05T19:09:57.135 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.89368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85922.log 2023-11-05T19:09:57.136 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89368.log.gz 2023-11-05T19:09:57.136 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.89756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90924.log 2023-11-05T19:09:57.136 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89756.log.gz 2023-11-05T19:09:57.136 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.85922.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-05T19:09:57.136 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.85922.log.gz 2023-11-05T19:09:57.137 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.0.90924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90772.log 2023-11-05T19:09:57.137 INFO:teuthology.orchestra.run.smithi028.stderr: 83.5% -- replaced with /var/log/ceph/ceph-client.0.90924.log.gz 2023-11-05T19:09:57.137 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89312.log 2023-11-05T19:09:57.137 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.90772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90530.log 2023-11-05T19:09:57.138 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90772.log.gz 2023-11-05T19:09:57.138 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.89312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89568.log 2023-11-05T19:09:57.138 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89312.log.gz 2023-11-05T19:09:57.138 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.90530.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90530.log.gz 2023-11-05T19:09:57.138 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-05T19:09:57.138 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.89568.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-05T19:09:57.139 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89568.log.gz 2023-11-05T19:09:57.139 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89510.log 2023-11-05T19:09:57.139 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89762.log 2023-11-05T19:09:57.139 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.89510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90859.log 2023-11-05T19:09:57.139 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89510.log.gz 2023-11-05T19:09:57.140 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.89762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90402.log 2023-11-05T19:09:57.140 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89762.log.gz 2023-11-05T19:09:57.140 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.90859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89411.log 2023-11-05T19:09:57.140 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90859.log.gz 2023-11-05T19:09:57.140 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.90402.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-05T19:09:57.141 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90402.log.gz 2023-11-05T19:09:57.141 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.89411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90218.log 2023-11-05T19:09:57.141 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89411.log.gz 2023-11-05T19:09:57.141 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90369.log 2023-11-05T19:09:57.141 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.90218.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90218.log.gz 2023-11-05T19:09:57.142 INFO:teuthology.orchestra.run.smithi028.stderr: --verbose -- /var/log/ceph/ceph.log 2023-11-05T19:09:57.142 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.90369.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90369.log.gz 2023-11-05T19:09:57.142 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-05T19:09:57.142 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90469.log 2023-11-05T19:09:57.142 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89759.log 2023-11-05T19:09:57.143 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.90469.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90469.log.gz 2023-11-05T19:09:57.143 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90814.log 2023-11-05T19:09:57.143 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.89759.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89759.log.gz 2023-11-05T19:09:57.143 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90310.log 2023-11-05T19:09:57.143 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.90814.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90814.log.gz 2023-11-05T19:09:57.152 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90367.log 2023-11-05T19:09:57.152 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.90310.log: 93.7% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-05T19:09:57.152 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90310.log.gz 2023-11-05T19:09:57.153 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90056.log 2023-11-05T19:09:57.153 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.90367.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90367.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90370.log 2023-11-05T19:09:57.153 INFO:teuthology.orchestra.run.smithi028.stderr: 2023-11-05T19:09:57.153 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90730.log 2023-11-05T19:09:57.153 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.90056.log: /var/log/ceph/ceph-client.admin.90370.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90056.log.gz 2023-11-05T19:09:57.154 INFO:teuthology.orchestra.run.smithi028.stderr: -- replaced with /var/log/ceph/ceph-client.admin.90370.log.gz 2023-11-05T19:09:57.154 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-05T19:09:57.154 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.90730.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90730.log.gz 2023-11-05T19:09:57.155 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-11-05T19:09:57.155 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85939.log 2023-11-05T19:09:57.156 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85859.log 2023-11-05T19:09:57.156 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.85939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85819.log 2023-11-05T19:09:57.156 INFO:teuthology.orchestra.run.smithi031.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.85939.log.gz 2023-11-05T19:09:57.156 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.85859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86059.log 2023-11-05T19:09:57.156 INFO:teuthology.orchestra.run.smithi031.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.85859.log.gz 2023-11-05T19:09:57.157 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.85819.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-05T19:09:57.157 INFO:teuthology.orchestra.run.smithi031.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.85819.log.gz 2023-11-05T19:09:57.157 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.86059.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-05T19:09:57.157 INFO:teuthology.orchestra.run.smithi031.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.86059.log.gz 2023-11-05T19:09:57.157 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86019.log 2023-11-05T19:09:57.158 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-05T19:09:57.158 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.86019.log: 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-05T19:09:57.158 INFO:teuthology.orchestra.run.smithi031.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.86019.log.gz 2023-11-05T19:09:57.158 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-05T19:09:57.158 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85979.log 2023-11-05T19:09:57.158 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85779.log 2023-11-05T19:09:57.159 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.85979.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-05T19:09:57.159 INFO:teuthology.orchestra.run.smithi031.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.85979.log.gz 2023-11-05T19:09:57.159 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.85779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85899.log 2023-11-05T19:09:57.159 INFO:teuthology.orchestra.run.smithi031.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.85779.log.gz 2023-11-05T19:09:57.159 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-05T19:09:57.160 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.85899.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-05T19:09:57.160 INFO:teuthology.orchestra.run.smithi031.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.85899.log.gz 2023-11-05T19:09:57.160 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-mon.b.log: 88.9% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-05T19:09:57.160 INFO:teuthology.orchestra.run.smithi031.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-05T19:09:57.198 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-mon.c.log: 91.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-05T19:09:57.289 INFO:teuthology.orchestra.run.smithi031.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-05T19:09:57.327 INFO:teuthology.orchestra.run.smithi028.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-05T19:09:57.525 INFO:teuthology.orchestra.run.smithi031.stderr: 91.3% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-05T19:09:57.575 INFO:teuthology.orchestra.run.smithi028.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-05T19:09:57.807 INFO:teuthology.orchestra.run.smithi028.stderr: 91.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-05T19:09:58.170 INFO:teuthology.orchestra.run.smithi031.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-05T19:09:58.181 INFO:teuthology.orchestra.run.smithi028.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-05T19:09:58.262 INFO:teuthology.orchestra.run.smithi031.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-05T19:09:58.426 INFO:teuthology.orchestra.run.smithi028.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-05T19:09:58.833 INFO:teuthology.orchestra.run.smithi031.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-05T19:09:59.002 INFO:teuthology.orchestra.run.smithi028.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-05T19:09:59.004 DEBUG:teuthology.misc:Transferring archived files from smithi028:/var/log/ceph to /home/teuthworker/archive/benhanokh-2023-10-31_16:43:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442345/remote/smithi028/log 2023-11-05T19:09:59.005 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-05T19:09:59.939 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/log/ceph to /home/teuthworker/archive/benhanokh-2023-10-31_16:43:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442345/remote/smithi031/log 2023-11-05T19:09:59.940 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-05T19:10:00.702 INFO:teuthology.kill:No teuthology processes running 2023-11-05T19:10:01.529 INFO:teuthology.kill:Nuking machines: ['smithi028', 'smithi031'] 2023-11-05T19:10:02.282 INFO:teuthology.kill:2023-11-05 19:10:02,281.281 INFO:teuthology.nuke:targets: 2023-11-05T19:10:02.283 INFO:teuthology.kill: smithi028.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCga7xY0YFqeipOUxbUw+UR0s14PBLim6OCEzdUOcBDiqwLpGfkKAvIciCuAovVqf3fC6ynSUoYggNROD0Tr5DA= 2023-11-05T19:10:02.283 INFO:teuthology.kill: smithi031.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDdTq0x6rfYrmwYxA1Bmif4CA6EeqmMg4sv1RYRtmNCBslsdo31HCJ0jZlHq2fT/I7RY9qyBdGUHeIT/jgTN6jE= 2023-11-05T19:10:02.283 INFO:teuthology.kill:2023-11-05 19:10:02,282.282 INFO:teuthology.nuke:Checking targets against current locks 2023-11-05T19:10:02.337 INFO:teuthology.kill:2023-11-05 19:10:02,337.337 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-05T19:10:02.363 INFO:teuthology.kill:2023-11-05 19:10:02,363.363 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-05T19:10:02.420 INFO:teuthology.kill:2023-11-05 19:10:02,419.419 INFO:teuthology.orchestra.console.smithi028:Power off 2023-11-05T19:10:02.454 INFO:teuthology.kill:2023-11-05 19:10:02,454.454 INFO:teuthology.orchestra.console.smithi031:Power off 2023-11-05T19:10:10.816 INFO:teuthology.kill:2023-11-05 19:10:10,816.816 INFO:teuthology.orchestra.console.smithi028:Power off completed 2023-11-05T19:10:11.001 INFO:teuthology.kill:2023-11-05 19:10:11,000.000 INFO:teuthology.lock.ops:unlocked: smithi028.front.sepia.ceph.com 2023-11-05T19:10:14.932 INFO:teuthology.kill:2023-11-05 19:10:14,932.932 INFO:teuthology.orchestra.console.smithi031:Power off completed 2023-11-05T19:10:15.081 INFO:teuthology.kill:2023-11-05 19:10:15,081.081 INFO:teuthology.lock.ops:unlocked: smithi031.front.sepia.ceph.com 2023-11-05T19:10:15.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T19:12:15.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T19:12:15.398 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2023-11-05T19:12:15.487 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi028 but it was locked by another job: /home/teuthworker/archive/rishabh-2023-11-05_14:10:09-fs-rishabh-2023nov3-testing-default-smithi/7448168 2023-11-05T19:12:15.487 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi031 but it was locked by another job: /home/teuthworker/archive/rishabh-2023-11-05_14:10:09-fs-rishabh-2023nov3-testing-default-smithi/7448168