2024-04-17T10:17:34.213 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-17T10:17:34.213 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T10:17:34.389 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa7a1438c10>, signals=[15]) 2024-04-17T10:17:34.390 INFO:teuthology.lock.ops:Start node 'smithi106.front.sepia.ceph.com' reimaging 2024-04-17T10:17:34.390 INFO:teuthology.lock.ops:Updating [smithi106.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T10:17:34.390 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server 2024-04-17T10:17:34.410 INFO:teuthology.lock.ops:Start node 'smithi115.front.sepia.ceph.com' reimaging 2024-04-17T10:17:34.410 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T10:17:34.410 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2024-04-17T10:17:34.426 INFO:teuthology.lock.ops:Start node 'smithi129.front.sepia.ceph.com' reimaging 2024-04-17T10:17:34.426 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T10:17:34.427 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2024-04-17T10:17:34.520 DEBUG:teuthology.provision.fog.smithi115:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T10:17:34.523 DEBUG:teuthology.provision.fog.smithi106:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T10:17:34.552 DEBUG:teuthology.provision.fog.smithi129:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T10:17:34.560 INFO:teuthology.provision.fog.smithi106:Scheduling deploy of centos 9.stream 2024-04-17T10:17:34.567 INFO:teuthology.provision.fog.smithi115:Scheduling deploy of centos 9.stream 2024-04-17T10:17:34.591 INFO:teuthology.provision.fog.smithi129:Scheduling deploy of centos 9.stream 2024-04-17T10:17:34.900 INFO:teuthology.orchestra.console.smithi115:Power off 2024-04-17T10:17:34.901 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T10:17:34.914 INFO:teuthology.orchestra.console.smithi129:Power off 2024-04-17T10:17:34.914 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T10:17:34.925 INFO:teuthology.orchestra.console.smithi106:Power off 2024-04-17T10:17:34.925 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T10:17:34.934 DEBUG:teuthology.orchestra.console.smithi129:power off output: Chassis Power Control: Down/Off 2024-04-17T10:17:34.934 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T10:17:34.941 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off 2024-04-17T10:17:34.942 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T10:17:34.949 DEBUG:teuthology.orchestra.console.smithi106:power off output: Chassis Power Control: Down/Off 2024-04-17T10:17:34.949 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T10:17:34.956 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2024-04-17T10:17:34.961 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2024-04-17T10:17:34.968 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is off 2024-04-17T10:17:35.057 INFO:teuthology.orchestra.console.smithi129:Power off completed 2024-04-17T10:17:35.061 INFO:teuthology.orchestra.console.smithi115:Power off completed 2024-04-17T10:17:35.069 INFO:teuthology.orchestra.console.smithi106:Power off completed 2024-04-17T10:17:35.158 INFO:teuthology.orchestra.console.smithi129:Power on 2024-04-17T10:17:35.158 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T10:17:35.166 INFO:teuthology.orchestra.console.smithi115:Power on 2024-04-17T10:17:35.166 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T10:17:35.172 INFO:teuthology.orchestra.console.smithi106:Power on 2024-04-17T10:17:35.172 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T10:17:35.179 DEBUG:teuthology.orchestra.console.smithi129:power on output: Chassis Power Control: Up/On 2024-04-17T10:17:35.179 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T10:17:35.188 DEBUG:teuthology.orchestra.console.smithi115:power on output: Chassis Power Control: Up/On 2024-04-17T10:17:35.188 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T10:17:35.195 DEBUG:teuthology.orchestra.console.smithi106:power on output: Chassis Power Control: Up/On 2024-04-17T10:17:35.196 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T10:17:35.205 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2024-04-17T10:17:35.210 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2024-04-17T10:17:35.217 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is off 2024-04-17T10:17:39.207 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T10:17:39.214 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T10:17:39.221 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T10:17:39.317 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2024-04-17T10:17:39.322 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2024-04-17T10:17:39.328 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is off 2024-04-17T10:17:39.423 INFO:teuthology.orchestra.console.smithi115:Power on completed 2024-04-17T10:17:39.524 INFO:teuthology.provision.fog.smithi115:Waiting for deploy to finish 2024-04-17T10:17:43.321 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T10:17:43.328 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T10:17:43.431 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2024-04-17T10:17:43.436 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on 2024-04-17T10:17:43.532 INFO:teuthology.orchestra.console.smithi129:Power on completed 2024-04-17T10:17:43.537 INFO:teuthology.orchestra.console.smithi106:Power on completed 2024-04-17T10:17:43.633 INFO:teuthology.provision.fog.smithi129:Waiting for deploy to finish 2024-04-17T10:17:43.638 INFO:teuthology.provision.fog.smithi106:Waiting for deploy to finish 2024-04-17T10:21:00.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:21:03.422 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-04-17T10:21:09.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:21:12.510 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-04-17T10:21:18.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:21:21.566 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-04-17T10:21:27.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:21:30.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:21:30.622 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-04-17T10:21:33.599 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-04-17T10:21:36.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:21:39.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:21:39.678 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-04-17T10:21:41.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:21:42.654 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-04-17T10:21:44.638 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-04-17T10:21:45.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:21:48.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:21:48.734 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-04-17T10:21:50.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:21:51.710 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-04-17T10:21:53.694 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-04-17T10:21:54.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:21:57.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:21:57.790 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-04-17T10:21:59.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:22:00.766 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-04-17T10:22:02.750 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-04-17T10:22:03.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:22:06.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:22:08.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:22:09.822 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-04-17T10:22:11.806 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-04-17T10:22:15.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:22:17.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:22:18.882 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-04-17T10:22:20.862 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-04-17T10:22:24.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:22:26.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:22:27.966 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-04-17T10:22:29.918 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-04-17T10:22:33.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:22:35.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:22:38.974 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-04-17T10:22:44.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:23:03.458 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-04-17T10:23:03.794 WARNING:teuthology.provision.fog.smithi129:timed out 2024-04-17T10:23:09.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:23:09.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:23:10.015 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T10:23:10.016 DEBUG:teuthology.orchestra.run.smithi129:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T10:23:10.336 INFO:teuthology.provision.fog.smithi129:Node is ready 2024-04-17T10:23:10.337 DEBUG:teuthology.orchestra.run.smithi129:> hostname 2024-04-17T10:23:10.351 INFO:teuthology.orchestra.run.smithi129.stdout:smithi129.front.sepia.ceph.com 2024-04-17T10:23:10.351 DEBUG:teuthology.orchestra.run.smithi129:> grep smithi129.front.sepia.ceph.com /etc/hosts 2024-04-17T10:23:10.407 INFO:teuthology.orchestra.run.smithi129.stdout:172.21.15.129 smithi129.front.sepia.ceph.com smithi129 2024-04-17T10:23:10.407 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname smithi129 2024-04-17T10:23:10.547 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi129.front.sepia.ceph.com/smithi129/g' /etc/hosts 2024-04-17T10:23:10.576 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/172.21.15.129/172.21.15.129/g' /etc/hosts 2024-04-17T10:23:10.645 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi129.front.sepia.ceph.com/smithi129/g' /etc/hostname 2024-04-17T10:23:10.714 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname smithi129 2024-04-17T10:23:10.781 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2024-04-17T10:23:10.836 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream" 2024-04-17T10:23:10.836 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="9" 2024-04-17T10:23:10.836 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos" 2024-04-17T10:23:10.836 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora" 2024-04-17T10:23:10.836 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="9" 2024-04-17T10:23:10.836 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el9" 2024-04-17T10:23:10.836 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T10:23:10.836 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2024-04-17T10:23:10.836 INFO:teuthology.orchestra.run.smithi129.stdout:LOGO="fedora-logo-icon" 2024-04-17T10:23:10.837 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T10:23:10.837 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/" 2024-04-17T10:23:10.837 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T10:23:10.837 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T10:23:10.837 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T10:23:10.837 INFO:teuthology.provision.fog.smithi129:Deploy complete! 2024-04-17T10:23:10.838 DEBUG:teuthology.parallel:result is None 2024-04-17T10:23:12.542 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-04-17T10:23:18.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:23:21.630 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-04-17T10:23:27.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:23:27.945 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T10:23:27.945 DEBUG:teuthology.orchestra.run.smithi115:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T10:23:33.973 WARNING:teuthology.provision.fog.smithi106:timed out 2024-04-17T10:23:39.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:23:40.182 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T10:23:40.182 DEBUG:teuthology.orchestra.run.smithi106:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T10:23:40.503 INFO:teuthology.provision.fog.smithi106:Node is ready 2024-04-17T10:23:40.503 DEBUG:teuthology.orchestra.run.smithi106:> hostname 2024-04-17T10:23:40.517 INFO:teuthology.orchestra.run.smithi106.stdout:smithi106.front.sepia.ceph.com 2024-04-17T10:23:40.517 DEBUG:teuthology.orchestra.run.smithi106:> grep smithi106.front.sepia.ceph.com /etc/hosts 2024-04-17T10:23:40.572 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.15.106 smithi106.front.sepia.ceph.com smithi106 2024-04-17T10:23:40.572 DEBUG:teuthology.orchestra.run.smithi106:> sudo hostname smithi106 2024-04-17T10:23:40.674 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i -e 's/smithi106.front.sepia.ceph.com/smithi106/g' /etc/hosts 2024-04-17T10:23:40.701 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i -e 's/172.21.15.106/172.21.15.106/g' /etc/hosts 2024-04-17T10:23:40.768 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i -e 's/smithi106.front.sepia.ceph.com/smithi106/g' /etc/hostname 2024-04-17T10:23:40.835 DEBUG:teuthology.orchestra.run.smithi106:> sudo hostname smithi106 2024-04-17T10:23:40.901 DEBUG:teuthology.orchestra.run.smithi106:> cat /etc/os-release 2024-04-17T10:23:40.955 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="CentOS Stream" 2024-04-17T10:23:40.955 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="9" 2024-04-17T10:23:40.955 INFO:teuthology.orchestra.run.smithi106.stdout:ID="centos" 2024-04-17T10:23:40.955 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE="rhel fedora" 2024-04-17T10:23:40.955 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="9" 2024-04-17T10:23:40.955 INFO:teuthology.orchestra.run.smithi106.stdout:PLATFORM_ID="platform:el9" 2024-04-17T10:23:40.956 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T10:23:40.956 INFO:teuthology.orchestra.run.smithi106.stdout:ANSI_COLOR="0;31" 2024-04-17T10:23:40.956 INFO:teuthology.orchestra.run.smithi106.stdout:LOGO="fedora-logo-icon" 2024-04-17T10:23:40.956 INFO:teuthology.orchestra.run.smithi106.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T10:23:40.956 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://centos.org/" 2024-04-17T10:23:40.956 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T10:23:40.956 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T10:23:40.956 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T10:23:40.956 INFO:teuthology.provision.fog.smithi106:Deploy complete! 2024-04-17T10:23:40.957 DEBUG:teuthology.parallel:result is None 2024-04-17T10:23:48.258 INFO:teuthology.provision.fog.smithi115:Node is ready 2024-04-17T10:23:48.258 DEBUG:teuthology.orchestra.run.smithi115:> hostname 2024-04-17T10:23:48.276 INFO:teuthology.orchestra.run.smithi115.stdout:smithi115.front.sepia.ceph.com 2024-04-17T10:23:48.277 DEBUG:teuthology.orchestra.run.smithi115:> grep smithi115.front.sepia.ceph.com /etc/hosts 2024-04-17T10:23:48.334 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115 smithi115.front.sepia.ceph.com smithi115 2024-04-17T10:23:48.335 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115 2024-04-17T10:23:48.476 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hosts 2024-04-17T10:23:48.507 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/172.21.15.115/172.21.15.115/g' /etc/hosts 2024-04-17T10:23:48.578 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hostname 2024-04-17T10:23:48.649 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115 2024-04-17T10:23:48.717 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2024-04-17T10:23:48.773 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream" 2024-04-17T10:23:48.774 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="9" 2024-04-17T10:23:48.774 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos" 2024-04-17T10:23:48.774 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora" 2024-04-17T10:23:48.774 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="9" 2024-04-17T10:23:48.774 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el9" 2024-04-17T10:23:48.774 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T10:23:48.774 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2024-04-17T10:23:48.774 INFO:teuthology.orchestra.run.smithi115.stdout:LOGO="fedora-logo-icon" 2024-04-17T10:23:48.774 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T10:23:48.774 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/" 2024-04-17T10:23:48.774 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T10:23:48.774 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T10:23:48.774 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T10:23:48.775 INFO:teuthology.provision.fog.smithi115:Deploy complete! 2024-04-17T10:23:48.775 DEBUG:teuthology.parallel:result is None 2024-04-17T10:23:49.026 INFO:teuthology.lock.ops:Checking smithi106.front.sepia.ceph.com 2024-04-17T10:23:49.026 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T10:23:49.051 INFO:teuthology.lock.ops:Checking smithi115.front.sepia.ceph.com 2024-04-17T10:23:49.051 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T10:23:49.067 INFO:teuthology.lock.ops:Checking smithi129.front.sepia.ceph.com 2024-04-17T10:23:49.067 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T10:23:49.086 INFO:teuthology.lock.ops:Updating [smithi106.front.sepia.ceph.com]: set os type and version on server 2024-04-17T10:23:49.086 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-04-17T10:23:49.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:23:49.173 DEBUG:teuthology.orchestra.run.smithi106:> true 2024-04-17T10:23:49.243 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-04-17T10:23:49.243 DEBUG:teuthology.orchestra.run.smithi106:> uname -m 2024-04-17T10:23:49.299 INFO:teuthology.orchestra.run.smithi106.stdout:x86_64 2024-04-17T10:23:49.299 DEBUG:teuthology.orchestra.run.smithi106:> cat /etc/os-release 2024-04-17T10:23:49.355 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="CentOS Stream" 2024-04-17T10:23:49.355 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="9" 2024-04-17T10:23:49.355 INFO:teuthology.orchestra.run.smithi106.stdout:ID="centos" 2024-04-17T10:23:49.355 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE="rhel fedora" 2024-04-17T10:23:49.355 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="9" 2024-04-17T10:23:49.355 INFO:teuthology.orchestra.run.smithi106.stdout:PLATFORM_ID="platform:el9" 2024-04-17T10:23:49.355 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T10:23:49.356 INFO:teuthology.orchestra.run.smithi106.stdout:ANSI_COLOR="0;31" 2024-04-17T10:23:49.356 INFO:teuthology.orchestra.run.smithi106.stdout:LOGO="fedora-logo-icon" 2024-04-17T10:23:49.356 INFO:teuthology.orchestra.run.smithi106.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T10:23:49.356 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://centos.org/" 2024-04-17T10:23:49.356 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T10:23:49.356 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T10:23:49.356 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T10:23:49.356 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server 2024-04-17T10:23:49.376 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: set os type and version on server 2024-04-17T10:23:49.376 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-17T10:23:49.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:23:49.480 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-17T10:23:49.550 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-17T10:23:49.551 DEBUG:teuthology.orchestra.run.smithi115:> uname -m 2024-04-17T10:23:49.607 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2024-04-17T10:23:49.607 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2024-04-17T10:23:49.664 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream" 2024-04-17T10:23:49.664 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="9" 2024-04-17T10:23:49.664 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos" 2024-04-17T10:23:49.664 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora" 2024-04-17T10:23:49.664 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="9" 2024-04-17T10:23:49.664 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el9" 2024-04-17T10:23:49.665 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T10:23:49.665 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2024-04-17T10:23:49.665 INFO:teuthology.orchestra.run.smithi115.stdout:LOGO="fedora-logo-icon" 2024-04-17T10:23:49.665 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T10:23:49.665 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/" 2024-04-17T10:23:49.665 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T10:23:49.665 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T10:23:49.665 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T10:23:49.665 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2024-04-17T10:23:49.693 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: set os type and version on server 2024-04-17T10:23:49.693 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-04-17T10:23:49.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:23:49.783 DEBUG:teuthology.orchestra.run.smithi129:> true 2024-04-17T10:23:49.953 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-04-17T10:23:49.953 DEBUG:teuthology.orchestra.run.smithi129:> uname -m 2024-04-17T10:23:50.008 INFO:teuthology.orchestra.run.smithi129.stdout:x86_64 2024-04-17T10:23:50.008 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2024-04-17T10:23:50.062 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream" 2024-04-17T10:23:50.063 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="9" 2024-04-17T10:23:50.063 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos" 2024-04-17T10:23:50.063 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora" 2024-04-17T10:23:50.063 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="9" 2024-04-17T10:23:50.063 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el9" 2024-04-17T10:23:50.063 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T10:23:50.063 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2024-04-17T10:23:50.063 INFO:teuthology.orchestra.run.smithi129.stdout:LOGO="fedora-logo-icon" 2024-04-17T10:23:50.063 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T10:23:50.063 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/" 2024-04-17T10:23:50.063 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T10:23:50.063 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T10:23:50.063 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T10:23:50.064 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2024-04-17T10:23:50.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T10:23:50.188 INFO:teuthology.dispatcher.supervisor:Running job 7660063 2024-04-17T10:23:50.188 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660063 --name rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/suites/fsstress}} -- /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660063/orig.config.yaml 2024-04-17T10:23:50.191 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660063 2024-04-17T10:23:50.191 INFO:teuthology.dispatcher.supervisor:Job PID: 843630 2024-04-17T10:23:50.191 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-17T10:25:50.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T10:27:50.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T10:29:50.636 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T10:31:50.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T10:33:50.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T10:35:51.110 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T10:35:51.178 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1