2024-04-17T08:44:47.406 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-17T08:44:47.406 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T08:44:47.549 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f787c322c10>, signals=[15]) 2024-04-17T08:44:47.550 INFO:teuthology.lock.ops:Start node 'smithi023.front.sepia.ceph.com' reimaging 2024-04-17T08:44:47.550 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T08:44:47.551 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server 2024-04-17T08:44:47.570 INFO:teuthology.lock.ops:Start node 'smithi028.front.sepia.ceph.com' reimaging 2024-04-17T08:44:47.570 INFO:teuthology.lock.ops:Updating [smithi028.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T08:44:47.570 INFO:teuthology.lock.ops:Updating smithi028.front.sepia.ceph.com on lock server 2024-04-17T08:44:47.689 DEBUG:teuthology.provision.fog.smithi023:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T08:44:47.692 DEBUG:teuthology.provision.fog.smithi028:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T08:44:47.738 INFO:teuthology.provision.fog.smithi028:Scheduling deploy of centos 9.stream 2024-04-17T08:44:47.741 INFO:teuthology.provision.fog.smithi023:Scheduling deploy of centos 9.stream 2024-04-17T08:44:48.032 INFO:teuthology.orchestra.console.smithi023:Power off 2024-04-17T08:44:48.032 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T08:44:48.046 INFO:teuthology.orchestra.console.smithi028:Power off 2024-04-17T08:44:48.046 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T08:44:48.059 DEBUG:teuthology.orchestra.console.smithi023:power off output: Chassis Power Control: Down/Off 2024-04-17T08:44:48.059 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:44:48.069 DEBUG:teuthology.orchestra.console.smithi028:power off output: Chassis Power Control: Down/Off 2024-04-17T08:44:48.069 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:44:48.081 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off 2024-04-17T08:44:48.093 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is off 2024-04-17T08:44:48.182 INFO:teuthology.orchestra.console.smithi023:Power off completed 2024-04-17T08:44:48.194 INFO:teuthology.orchestra.console.smithi028:Power off completed 2024-04-17T08:44:48.283 INFO:teuthology.orchestra.console.smithi023:Power on 2024-04-17T08:44:48.283 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T08:44:48.295 INFO:teuthology.orchestra.console.smithi028:Power on 2024-04-17T08:44:48.295 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T08:44:48.305 DEBUG:teuthology.orchestra.console.smithi023:power on output: Chassis Power Control: Up/On 2024-04-17T08:44:48.306 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:44:48.317 DEBUG:teuthology.orchestra.console.smithi028:power on output: Chassis Power Control: Up/On 2024-04-17T08:44:48.318 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:44:48.331 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off 2024-04-17T08:44:48.340 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is off 2024-04-17T08:44:52.336 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:44:52.343 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:44:52.446 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off 2024-04-17T08:44:52.452 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is off 2024-04-17T08:44:56.450 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:44:56.458 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:44:56.561 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is on 2024-04-17T08:44:56.653 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is on 2024-04-17T08:44:56.662 INFO:teuthology.orchestra.console.smithi023:Power on completed 2024-04-17T08:44:56.754 INFO:teuthology.orchestra.console.smithi028:Power on completed 2024-04-17T08:44:56.763 INFO:teuthology.provision.fog.smithi023:Waiting for deploy to finish 2024-04-17T08:44:56.855 INFO:teuthology.provision.fog.smithi028:Waiting for deploy to finish 2024-04-17T08:47:13.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:47:16.158 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28 2024-04-17T08:47:22.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:47:25.278 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28 2024-04-17T08:47:31.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:47:34.334 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28 2024-04-17T08:47:40.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:47:43.422 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28 2024-04-17T08:47:49.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:47:52.478 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28 2024-04-17T08:47:58.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:48:01.534 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28 2024-04-17T08:48:07.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:48:13.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:48:16.510 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2024-04-17T08:48:22.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:48:25.570 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2024-04-17T08:48:31.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:48:34.654 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2024-04-17T08:48:40.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:48:43.742 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2024-04-17T08:48:49.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:48:52.798 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2024-04-17T08:48:58.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:49:01.886 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2024-04-17T08:49:07.542 WARNING:teuthology.provision.fog.smithi028:timed out 2024-04-17T08:49:07.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:49:10.942 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2024-04-17T08:49:13.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:49:13.817 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T08:49:13.818 DEBUG:teuthology.orchestra.run.smithi028:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T08:49:14.114 INFO:teuthology.provision.fog.smithi028:Node is ready 2024-04-17T08:49:14.114 DEBUG:teuthology.orchestra.run.smithi028:> hostname 2024-04-17T08:49:14.129 INFO:teuthology.orchestra.run.smithi028.stdout:smithi028.front.sepia.ceph.com 2024-04-17T08:49:14.129 DEBUG:teuthology.orchestra.run.smithi028:> grep smithi028.front.sepia.ceph.com /etc/hosts 2024-04-17T08:49:14.184 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.15.28 smithi028.front.sepia.ceph.com smithi028 2024-04-17T08:49:14.185 DEBUG:teuthology.orchestra.run.smithi028:> sudo hostname smithi028 2024-04-17T08:49:14.303 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i -e 's/smithi028.front.sepia.ceph.com/smithi028/g' /etc/hosts 2024-04-17T08:49:14.335 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i -e 's/172.21.15.28/172.21.15.28/g' /etc/hosts 2024-04-17T08:49:14.407 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i -e 's/smithi028.front.sepia.ceph.com/smithi028/g' /etc/hostname 2024-04-17T08:49:14.478 DEBUG:teuthology.orchestra.run.smithi028:> sudo hostname smithi028 2024-04-17T08:49:14.548 DEBUG:teuthology.orchestra.run.smithi028:> cat /etc/os-release 2024-04-17T08:49:14.602 INFO:teuthology.orchestra.run.smithi028.stdout:NAME="CentOS Stream" 2024-04-17T08:49:14.602 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION="9" 2024-04-17T08:49:14.603 INFO:teuthology.orchestra.run.smithi028.stdout:ID="centos" 2024-04-17T08:49:14.603 INFO:teuthology.orchestra.run.smithi028.stdout:ID_LIKE="rhel fedora" 2024-04-17T08:49:14.603 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_ID="9" 2024-04-17T08:49:14.603 INFO:teuthology.orchestra.run.smithi028.stdout:PLATFORM_ID="platform:el9" 2024-04-17T08:49:14.603 INFO:teuthology.orchestra.run.smithi028.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T08:49:14.603 INFO:teuthology.orchestra.run.smithi028.stdout:ANSI_COLOR="0;31" 2024-04-17T08:49:14.603 INFO:teuthology.orchestra.run.smithi028.stdout:LOGO="fedora-logo-icon" 2024-04-17T08:49:14.603 INFO:teuthology.orchestra.run.smithi028.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T08:49:14.603 INFO:teuthology.orchestra.run.smithi028.stdout:HOME_URL="https://centos.org/" 2024-04-17T08:49:14.603 INFO:teuthology.orchestra.run.smithi028.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T08:49:14.603 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T08:49:14.603 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T08:49:14.604 INFO:teuthology.provision.fog.smithi028:Deploy complete! 2024-04-17T08:49:14.605 DEBUG:teuthology.parallel:result is None 2024-04-17T08:49:16.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:49:19.998 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2024-04-17T08:49:26.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:49:29.054 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2024-04-17T08:49:35.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:49:38.110 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2024-04-17T08:49:44.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:50:44.171 WARNING:teuthology.provision.fog.smithi023:timed out 2024-04-17T08:50:50.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:50:50.446 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T08:50:50.446 DEBUG:teuthology.orchestra.run.smithi023:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T08:50:50.765 INFO:teuthology.provision.fog.smithi023:Node is ready 2024-04-17T08:50:50.765 DEBUG:teuthology.orchestra.run.smithi023:> hostname 2024-04-17T08:50:50.779 INFO:teuthology.orchestra.run.smithi023.stdout:smithi023.front.sepia.ceph.com 2024-04-17T08:50:50.781 DEBUG:teuthology.orchestra.run.smithi023:> grep smithi023.front.sepia.ceph.com /etc/hosts 2024-04-17T08:50:50.835 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23 smithi023.front.sepia.ceph.com smithi023 2024-04-17T08:50:50.836 DEBUG:teuthology.orchestra.run.smithi023:> sudo hostname smithi023 2024-04-17T08:50:50.956 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/smithi023.front.sepia.ceph.com/smithi023/g' /etc/hosts 2024-04-17T08:50:50.987 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/172.21.15.23/172.21.15.23/g' /etc/hosts 2024-04-17T08:50:51.059 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/smithi023.front.sepia.ceph.com/smithi023/g' /etc/hostname 2024-04-17T08:50:51.130 DEBUG:teuthology.orchestra.run.smithi023:> sudo hostname smithi023 2024-04-17T08:50:51.201 DEBUG:teuthology.orchestra.run.smithi023:> cat /etc/os-release 2024-04-17T08:50:51.256 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="CentOS Stream" 2024-04-17T08:50:51.256 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="9" 2024-04-17T08:50:51.256 INFO:teuthology.orchestra.run.smithi023.stdout:ID="centos" 2024-04-17T08:50:51.256 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE="rhel fedora" 2024-04-17T08:50:51.256 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="9" 2024-04-17T08:50:51.257 INFO:teuthology.orchestra.run.smithi023.stdout:PLATFORM_ID="platform:el9" 2024-04-17T08:50:51.257 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T08:50:51.257 INFO:teuthology.orchestra.run.smithi023.stdout:ANSI_COLOR="0;31" 2024-04-17T08:50:51.257 INFO:teuthology.orchestra.run.smithi023.stdout:LOGO="fedora-logo-icon" 2024-04-17T08:50:51.257 INFO:teuthology.orchestra.run.smithi023.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T08:50:51.257 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://centos.org/" 2024-04-17T08:50:51.257 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T08:50:51.257 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T08:50:51.257 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T08:50:51.257 INFO:teuthology.provision.fog.smithi023:Deploy complete! 2024-04-17T08:50:51.258 DEBUG:teuthology.parallel:result is None 2024-04-17T08:50:51.434 INFO:teuthology.lock.ops:Checking smithi023.front.sepia.ceph.com 2024-04-17T08:50:51.435 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T08:50:51.452 INFO:teuthology.lock.ops:Checking smithi028.front.sepia.ceph.com 2024-04-17T08:50:51.453 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T08:50:51.470 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: set os type and version on server 2024-04-17T08:50:51.470 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com' 2024-04-17T08:50:51.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:50:51.571 DEBUG:teuthology.orchestra.run.smithi023:> true 2024-04-17T08:50:51.636 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi023.front.sepia.ceph.com' 2024-04-17T08:50:51.636 DEBUG:teuthology.orchestra.run.smithi023:> uname -m 2024-04-17T08:50:51.690 INFO:teuthology.orchestra.run.smithi023.stdout:x86_64 2024-04-17T08:50:51.691 DEBUG:teuthology.orchestra.run.smithi023:> cat /etc/os-release 2024-04-17T08:50:51.745 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="CentOS Stream" 2024-04-17T08:50:51.746 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="9" 2024-04-17T08:50:51.746 INFO:teuthology.orchestra.run.smithi023.stdout:ID="centos" 2024-04-17T08:50:51.746 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE="rhel fedora" 2024-04-17T08:50:51.746 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="9" 2024-04-17T08:50:51.746 INFO:teuthology.orchestra.run.smithi023.stdout:PLATFORM_ID="platform:el9" 2024-04-17T08:50:51.746 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T08:50:51.746 INFO:teuthology.orchestra.run.smithi023.stdout:ANSI_COLOR="0;31" 2024-04-17T08:50:51.746 INFO:teuthology.orchestra.run.smithi023.stdout:LOGO="fedora-logo-icon" 2024-04-17T08:50:51.746 INFO:teuthology.orchestra.run.smithi023.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T08:50:51.746 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://centos.org/" 2024-04-17T08:50:51.746 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T08:50:51.746 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T08:50:51.746 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T08:50:51.747 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server 2024-04-17T08:50:51.769 INFO:teuthology.lock.ops:Updating [smithi028.front.sepia.ceph.com]: set os type and version on server 2024-04-17T08:50:51.769 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-04-17T08:50:51.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:50:51.872 DEBUG:teuthology.orchestra.run.smithi028:> true 2024-04-17T08:50:52.053 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-04-17T08:50:52.053 DEBUG:teuthology.orchestra.run.smithi028:> uname -m 2024-04-17T08:50:52.109 INFO:teuthology.orchestra.run.smithi028.stdout:x86_64 2024-04-17T08:50:52.110 DEBUG:teuthology.orchestra.run.smithi028:> cat /etc/os-release 2024-04-17T08:50:52.170 INFO:teuthology.orchestra.run.smithi028.stdout:NAME="CentOS Stream" 2024-04-17T08:50:52.171 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION="9" 2024-04-17T08:50:52.171 INFO:teuthology.orchestra.run.smithi028.stdout:ID="centos" 2024-04-17T08:50:52.171 INFO:teuthology.orchestra.run.smithi028.stdout:ID_LIKE="rhel fedora" 2024-04-17T08:50:52.171 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_ID="9" 2024-04-17T08:50:52.171 INFO:teuthology.orchestra.run.smithi028.stdout:PLATFORM_ID="platform:el9" 2024-04-17T08:50:52.171 INFO:teuthology.orchestra.run.smithi028.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T08:50:52.171 INFO:teuthology.orchestra.run.smithi028.stdout:ANSI_COLOR="0;31" 2024-04-17T08:50:52.171 INFO:teuthology.orchestra.run.smithi028.stdout:LOGO="fedora-logo-icon" 2024-04-17T08:50:52.171 INFO:teuthology.orchestra.run.smithi028.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T08:50:52.171 INFO:teuthology.orchestra.run.smithi028.stdout:HOME_URL="https://centos.org/" 2024-04-17T08:50:52.171 INFO:teuthology.orchestra.run.smithi028.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T08:50:52.171 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T08:50:52.171 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T08:50:52.172 INFO:teuthology.lock.ops:Updating smithi028.front.sepia.ceph.com on lock server 2024-04-17T08:50:52.194 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T08:50:52.307 INFO:teuthology.dispatcher.supervisor:Running job 7659969 2024-04-17T08:50:52.307 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659969 --name rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/fs/snaps}} -- /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659969/orig.config.yaml 2024-04-17T08:50:52.310 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659969 2024-04-17T08:50:52.310 INFO:teuthology.dispatcher.supervisor:Job PID: 469279 2024-04-17T08:50:52.311 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-17T08:52:52.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T08:54:52.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T08:56:52.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T08:58:52.928 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:00:53.081 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:00:53.152 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-04-17T09:00:53.268 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi023 but it was locked by another job: /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659984 2024-04-17T09:00:53.268 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi028 but it was locked by another job: /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659986