2024-02-05T09:30:29.495 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22 2024-02-05T09:30:29.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T09:30:29.642 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fde03d49c10>, signals=[15]) 2024-02-05T09:30:29.642 INFO:teuthology.lock.ops:Start node 'smithi123.front.sepia.ceph.com' reimaging 2024-02-05T09:30:29.643 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: reset os type and version on server 2024-02-05T09:30:29.643 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2024-02-05T09:30:29.669 INFO:teuthology.lock.ops:Start node 'smithi158.front.sepia.ceph.com' reimaging 2024-02-05T09:30:29.670 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: reset os type and version on server 2024-02-05T09:30:29.670 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2024-02-05T09:30:29.784 DEBUG:teuthology.provision.fog.smithi123:Requesting image smithi_centos_9.stream (ID 10) 2024-02-05T09:30:29.805 DEBUG:teuthology.provision.fog.smithi158:Requesting image smithi_centos_9.stream (ID 10) 2024-02-05T09:30:29.834 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of centos 9.stream 2024-02-05T09:30:29.849 INFO:teuthology.provision.fog.smithi158:Scheduling deploy of centos 9.stream 2024-02-05T09:30:30.073 INFO:teuthology.orchestra.console.smithi123:Power off 2024-02-05T09:30:30.073 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-05T09:30:30.086 INFO:teuthology.orchestra.console.smithi158:Power off 2024-02-05T09:30:30.087 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-05T09:30:30.095 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off 2024-02-05T09:30:30.095 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-05T09:30:30.106 DEBUG:teuthology.orchestra.console.smithi158:power off output: Chassis Power Control: Down/Off 2024-02-05T09:30:30.106 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-05T09:30:30.117 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2024-02-05T09:30:30.127 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off 2024-02-05T09:30:30.218 INFO:teuthology.orchestra.console.smithi123:Power off completed 2024-02-05T09:30:30.228 INFO:teuthology.orchestra.console.smithi158:Power off completed 2024-02-05T09:30:30.319 INFO:teuthology.orchestra.console.smithi123:Power on 2024-02-05T09:30:30.319 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-05T09:30:30.328 INFO:teuthology.orchestra.console.smithi158:Power on 2024-02-05T09:30:30.329 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-05T09:30:30.343 DEBUG:teuthology.orchestra.console.smithi123:power on output: Chassis Power Control: Up/On 2024-02-05T09:30:30.343 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-05T09:30:30.352 DEBUG:teuthology.orchestra.console.smithi158:power on output: Chassis Power Control: Up/On 2024-02-05T09:30:30.352 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-05T09:30:30.367 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2024-02-05T09:30:30.375 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off 2024-02-05T09:30:34.372 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-05T09:30:34.380 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-05T09:30:34.483 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2024-02-05T09:30:34.491 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on 2024-02-05T09:30:34.591 INFO:teuthology.orchestra.console.smithi158:Power on completed 2024-02-05T09:30:34.692 INFO:teuthology.provision.fog.smithi158:Waiting for deploy to finish 2024-02-05T09:30:38.484 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-05T09:30:38.593 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2024-02-05T09:30:38.694 INFO:teuthology.orchestra.console.smithi123:Power on completed 2024-02-05T09:30:38.795 INFO:teuthology.provision.fog.smithi123:Waiting for deploy to finish 2024-02-05T09:33:09.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T09:33:12.572 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2024-02-05T09:33:18.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T09:33:21.632 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2024-02-05T09:33:27.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T09:33:30.716 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2024-02-05T09:33:35.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T09:33:36.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T09:33:38.652 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2024-02-05T09:33:39.772 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2024-02-05T09:33:44.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T09:33:45.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T09:33:47.740 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2024-02-05T09:33:48.828 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2024-02-05T09:33:53.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T09:33:54.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T09:33:56.828 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2024-02-05T09:33:57.884 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2024-02-05T09:34:02.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T09:34:03.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T09:34:05.888 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2024-02-05T09:34:06.940 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2024-02-05T09:34:11.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T09:34:12.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T09:34:14.975 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2024-02-05T09:34:20.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T09:34:24.060 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2024-02-05T09:34:30.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T09:34:33.120 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2024-02-05T09:34:39.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T09:34:42.204 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2024-02-05T09:34:48.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T09:34:51.260 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2024-02-05T09:34:57.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T09:35:12.956 WARNING:teuthology.provision.fog.smithi123:timed out 2024-02-05T09:35:18.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T09:35:19.155 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-05T09:35:19.156 DEBUG:teuthology.orchestra.run.smithi123:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-05T09:35:19.479 INFO:teuthology.provision.fog.smithi123:Node is ready 2024-02-05T09:35:19.479 DEBUG:teuthology.orchestra.run.smithi123:> hostname 2024-02-05T09:35:19.494 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123.front.sepia.ceph.com 2024-02-05T09:35:19.495 DEBUG:teuthology.orchestra.run.smithi123:> grep smithi123.front.sepia.ceph.com /etc/hosts 2024-02-05T09:35:19.550 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123 smithi123.front.sepia.ceph.com smithi123 2024-02-05T09:35:19.551 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123 2024-02-05T09:35:19.649 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hosts 2024-02-05T09:35:19.678 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/172.21.15.123/172.21.15.123/g' /etc/hosts 2024-02-05T09:35:19.745 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hostname 2024-02-05T09:35:19.813 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123 2024-02-05T09:35:19.880 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2024-02-05T09:35:19.934 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="CentOS Stream" 2024-02-05T09:35:19.934 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="9" 2024-02-05T09:35:19.934 INFO:teuthology.orchestra.run.smithi123.stdout:ID="centos" 2024-02-05T09:35:19.934 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="rhel fedora" 2024-02-05T09:35:19.934 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="9" 2024-02-05T09:35:19.934 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el9" 2024-02-05T09:35:19.934 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-05T09:35:19.935 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2024-02-05T09:35:19.935 INFO:teuthology.orchestra.run.smithi123.stdout:LOGO="fedora-logo-icon" 2024-02-05T09:35:19.935 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-05T09:35:19.935 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://centos.org/" 2024-02-05T09:35:19.935 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-05T09:35:19.935 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-05T09:35:19.935 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-05T09:35:19.936 INFO:teuthology.provision.fog.smithi123:Deploy complete! 2024-02-05T09:35:19.937 DEBUG:teuthology.parallel:result is None 2024-02-05T09:35:57.304 WARNING:teuthology.provision.fog.smithi158:timed out 2024-02-05T09:36:03.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T09:36:03.518 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-05T09:36:03.519 DEBUG:teuthology.orchestra.run.smithi158:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-05T09:36:03.832 INFO:teuthology.provision.fog.smithi158:Node is ready 2024-02-05T09:36:03.833 DEBUG:teuthology.orchestra.run.smithi158:> hostname 2024-02-05T09:36:03.847 INFO:teuthology.orchestra.run.smithi158.stdout:smithi158.front.sepia.ceph.com 2024-02-05T09:36:03.848 DEBUG:teuthology.orchestra.run.smithi158:> grep smithi158.front.sepia.ceph.com /etc/hosts 2024-02-05T09:36:03.904 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.15.158 smithi158.front.sepia.ceph.com smithi158 2024-02-05T09:36:03.904 DEBUG:teuthology.orchestra.run.smithi158:> sudo hostname smithi158 2024-02-05T09:36:04.013 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/smithi158.front.sepia.ceph.com/smithi158/g' /etc/hosts 2024-02-05T09:36:04.042 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/172.21.15.158/172.21.15.158/g' /etc/hosts 2024-02-05T09:36:04.110 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/smithi158.front.sepia.ceph.com/smithi158/g' /etc/hostname 2024-02-05T09:36:04.177 DEBUG:teuthology.orchestra.run.smithi158:> sudo hostname smithi158 2024-02-05T09:36:04.243 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2024-02-05T09:36:04.297 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="CentOS Stream" 2024-02-05T09:36:04.297 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="9" 2024-02-05T09:36:04.298 INFO:teuthology.orchestra.run.smithi158.stdout:ID="centos" 2024-02-05T09:36:04.298 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE="rhel fedora" 2024-02-05T09:36:04.298 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="9" 2024-02-05T09:36:04.298 INFO:teuthology.orchestra.run.smithi158.stdout:PLATFORM_ID="platform:el9" 2024-02-05T09:36:04.298 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-05T09:36:04.298 INFO:teuthology.orchestra.run.smithi158.stdout:ANSI_COLOR="0;31" 2024-02-05T09:36:04.298 INFO:teuthology.orchestra.run.smithi158.stdout:LOGO="fedora-logo-icon" 2024-02-05T09:36:04.298 INFO:teuthology.orchestra.run.smithi158.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-05T09:36:04.298 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://centos.org/" 2024-02-05T09:36:04.298 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-05T09:36:04.298 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-05T09:36:04.298 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-05T09:36:04.299 INFO:teuthology.provision.fog.smithi158:Deploy complete! 2024-02-05T09:36:04.299 DEBUG:teuthology.parallel:result is None 2024-02-05T09:36:04.462 INFO:teuthology.lock.ops:Checking smithi123.front.sepia.ceph.com 2024-02-05T09:36:04.462 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-05T09:36:04.496 INFO:teuthology.lock.ops:Checking smithi158.front.sepia.ceph.com 2024-02-05T09:36:04.496 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-05T09:36:04.514 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: set os type and version on server 2024-02-05T09:36:04.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-02-05T09:36:04.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T09:36:04.605 DEBUG:teuthology.orchestra.run.smithi123:> true 2024-02-05T09:36:04.770 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-02-05T09:36:04.770 DEBUG:teuthology.orchestra.run.smithi123:> uname -m 2024-02-05T09:36:04.824 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2024-02-05T09:36:04.825 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2024-02-05T09:36:04.879 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="CentOS Stream" 2024-02-05T09:36:04.880 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="9" 2024-02-05T09:36:04.880 INFO:teuthology.orchestra.run.smithi123.stdout:ID="centos" 2024-02-05T09:36:04.880 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="rhel fedora" 2024-02-05T09:36:04.880 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="9" 2024-02-05T09:36:04.880 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el9" 2024-02-05T09:36:04.880 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-05T09:36:04.880 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2024-02-05T09:36:04.880 INFO:teuthology.orchestra.run.smithi123.stdout:LOGO="fedora-logo-icon" 2024-02-05T09:36:04.880 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-05T09:36:04.880 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://centos.org/" 2024-02-05T09:36:04.880 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-05T09:36:04.880 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-05T09:36:04.880 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-05T09:36:04.881 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2024-02-05T09:36:04.904 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: set os type and version on server 2024-02-05T09:36:04.905 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2024-02-05T09:36:04.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T09:36:04.988 DEBUG:teuthology.orchestra.run.smithi158:> true 2024-02-05T09:36:05.054 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi158.front.sepia.ceph.com' 2024-02-05T09:36:05.054 DEBUG:teuthology.orchestra.run.smithi158:> uname -m 2024-02-05T09:36:05.108 INFO:teuthology.orchestra.run.smithi158.stdout:x86_64 2024-02-05T09:36:05.109 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2024-02-05T09:36:05.163 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="CentOS Stream" 2024-02-05T09:36:05.163 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="9" 2024-02-05T09:36:05.163 INFO:teuthology.orchestra.run.smithi158.stdout:ID="centos" 2024-02-05T09:36:05.163 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE="rhel fedora" 2024-02-05T09:36:05.163 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="9" 2024-02-05T09:36:05.163 INFO:teuthology.orchestra.run.smithi158.stdout:PLATFORM_ID="platform:el9" 2024-02-05T09:36:05.163 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-05T09:36:05.163 INFO:teuthology.orchestra.run.smithi158.stdout:ANSI_COLOR="0;31" 2024-02-05T09:36:05.164 INFO:teuthology.orchestra.run.smithi158.stdout:LOGO="fedora-logo-icon" 2024-02-05T09:36:05.164 INFO:teuthology.orchestra.run.smithi158.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-05T09:36:05.164 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://centos.org/" 2024-02-05T09:36:05.164 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-05T09:36:05.164 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-05T09:36:05.164 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-05T09:36:05.164 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2024-02-05T09:36:05.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T09:36:05.285 INFO:teuthology.dispatcher.supervisor:Running job 7546485 2024-02-05T09:36:05.285 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/bin/teuthology -v --owner scheduled_sjust@teuthology --archive /home/teuthworker/archive/sjust-2024-02-05_05:32:10-rados-wip-sjust-msr-testing-2024-02-03-distro-default-smithi/7546485 --name sjust-2024-02-05_05:32:10-rados-wip-sjust-msr-testing-2024-02-03-distro-default-smithi --description rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/rados_api_tests} -- /home/teuthworker/archive/sjust-2024-02-05_05:32:10-rados-wip-sjust-msr-testing-2024-02-03-distro-default-smithi/7546485/orig.config.yaml 2024-02-05T09:36:05.289 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/sjust-2024-02-05_05:32:10-rados-wip-sjust-msr-testing-2024-02-03-distro-default-smithi/7546485 2024-02-05T09:36:05.290 INFO:teuthology.dispatcher.supervisor:Job PID: 1636801 2024-02-05T09:36:05.290 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-05T09:38:05.368 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T09:40:05.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T09:42:05.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T09:44:05.880 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T09:46:06.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T09:48:06.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T09:50:06.396 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T09:52:06.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T09:54:06.729 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T09:56:06.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T09:58:07.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T10:00:07.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T10:02:07.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T10:04:08.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T10:06:08.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T10:08:08.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T10:10:08.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T10:12:08.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T10:14:08.916 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T10:16:09.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T10:18:09.252 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T10:20:09.425 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T10:22:09.562 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T10:24:09.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T10:26:09.916 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T10:28:10.084 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T10:30:10.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T10:32:10.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T10:34:10.606 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T10:36:10.790 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T10:38:10.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T10:40:11.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T10:42:11.321 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T10:44:11.504 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T10:46:11.668 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T10:48:11.866 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T10:50:12.040 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T10:52:12.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T10:54:12.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T10:56:12.568 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T10:58:12.750 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T11:00:12.932 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T11:02:13.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T11:04:13.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T11:06:13.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T11:08:13.516 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T11:10:13.673 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T11:12:13.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T11:14:14.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T11:16:14.162 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T11:18:14.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T11:20:14.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T11:22:14.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T11:24:14.753 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T11:26:14.921 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T11:28:15.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T11:30:15.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T11:32:15.444 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T11:34:15.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T11:36:15.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T11:38:15.933 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T11:40:16.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T11:42:16.220 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T11:44:16.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T11:46:16.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T11:48:16.736 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T11:50:16.908 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T11:52:17.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T11:54:17.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T11:56:17.420 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T11:58:17.584 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T12:00:17.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T12:02:17.920 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T12:04:18.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T12:06:18.244 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T12:08:18.410 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T12:10:18.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T12:12:18.752 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T12:14:18.928 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T12:16:19.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T12:18:19.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T12:20:19.445 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T12:22:19.596 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T12:24:19.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T12:26:19.942 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T12:28:20.110 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T12:30:20.288 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T12:32:20.464 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T12:34:20.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T12:36:20.918 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T12:38:21.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T12:40:21.252 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T12:42:21.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T12:44:21.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T12:46:21.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T12:48:21.828 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T12:50:21.998 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T12:52:22.164 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T12:54:22.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T12:56:22.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T12:56:22.581 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1