2024-03-08T18:29:04.509 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-08T18:29:04.510 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-08T18:29:04.690 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2df087ac10>, signals=[15]) 2024-03-08T18:29:04.690 INFO:teuthology.lock.ops:Start node 'smithi143.front.sepia.ceph.com' reimaging 2024-03-08T18:29:04.690 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: reset os type and version on server 2024-03-08T18:29:04.690 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2024-03-08T18:29:04.709 INFO:teuthology.lock.ops:Start node 'smithi181.front.sepia.ceph.com' reimaging 2024-03-08T18:29:04.710 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: reset os type and version on server 2024-03-08T18:29:04.710 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2024-03-08T18:29:04.734 INFO:teuthology.lock.ops:Start node 'smithi184.front.sepia.ceph.com' reimaging 2024-03-08T18:29:04.734 INFO:teuthology.lock.ops:Updating [smithi184.front.sepia.ceph.com]: reset os type and version on server 2024-03-08T18:29:04.734 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2024-03-08T18:29:04.835 DEBUG:teuthology.provision.fog.smithi143:Requesting image smithi_centos_9.stream (ID 10) 2024-03-08T18:29:04.848 DEBUG:teuthology.provision.fog.smithi181:Requesting image smithi_centos_9.stream (ID 10) 2024-03-08T18:29:04.866 DEBUG:teuthology.provision.fog.smithi184:Requesting image smithi_centos_9.stream (ID 10) 2024-03-08T18:29:04.887 INFO:teuthology.provision.fog.smithi143:Scheduling deploy of centos 9.stream 2024-03-08T18:29:04.890 INFO:teuthology.provision.fog.smithi181:Scheduling deploy of centos 9.stream 2024-03-08T18:29:04.907 INFO:teuthology.provision.fog.smithi184:Scheduling deploy of centos 9.stream 2024-03-08T18:29:05.285 INFO:teuthology.orchestra.console.smithi181:Power off 2024-03-08T18:29:05.286 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-08T18:29:05.303 INFO:teuthology.orchestra.console.smithi143:Power off 2024-03-08T18:29:05.303 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-08T18:29:05.314 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off 2024-03-08T18:29:05.314 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T18:29:05.324 DEBUG:teuthology.orchestra.console.smithi143:power off output: Chassis Power Control: Down/Off 2024-03-08T18:29:05.324 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T18:29:05.337 INFO:teuthology.orchestra.console.smithi184:Power off 2024-03-08T18:29:05.338 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-08T18:29:05.348 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2024-03-08T18:29:05.348 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2024-03-08T18:29:05.360 DEBUG:teuthology.orchestra.console.smithi184:power off output: Chassis Power Control: Down/Off 2024-03-08T18:29:05.361 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T18:29:05.383 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2024-03-08T18:29:05.449 INFO:teuthology.orchestra.console.smithi143:Power off completed 2024-03-08T18:29:05.484 INFO:teuthology.orchestra.console.smithi184:Power off completed 2024-03-08T18:29:05.550 INFO:teuthology.orchestra.console.smithi143:Power on 2024-03-08T18:29:05.550 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-08T18:29:05.572 DEBUG:teuthology.orchestra.console.smithi143:power on output: Chassis Power Control: Up/On 2024-03-08T18:29:05.572 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T18:29:05.585 INFO:teuthology.orchestra.console.smithi184:Power on 2024-03-08T18:29:05.585 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-08T18:29:05.595 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2024-03-08T18:29:05.607 DEBUG:teuthology.orchestra.console.smithi184:power on output: Chassis Power Control: Up/On 2024-03-08T18:29:05.607 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T18:29:05.628 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2024-03-08T18:29:09.352 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T18:29:09.461 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2024-03-08T18:29:09.596 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T18:29:09.629 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T18:29:09.705 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2024-03-08T18:29:09.736 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2024-03-08T18:29:13.462 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T18:29:13.572 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2024-03-08T18:29:13.705 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T18:29:13.738 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T18:29:13.815 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on 2024-03-08T18:29:13.847 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2024-03-08T18:29:13.916 INFO:teuthology.orchestra.console.smithi143:Power on completed 2024-03-08T18:29:13.948 INFO:teuthology.orchestra.console.smithi184:Power on completed 2024-03-08T18:29:14.017 INFO:teuthology.provision.fog.smithi143:Waiting for deploy to finish 2024-03-08T18:29:14.048 INFO:teuthology.provision.fog.smithi184:Waiting for deploy to finish 2024-03-08T18:29:17.576 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T18:29:17.685 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2024-03-08T18:29:17.786 INFO:teuthology.orchestra.console.smithi181:Power off completed 2024-03-08T18:29:17.887 INFO:teuthology.orchestra.console.smithi181:Power on 2024-03-08T18:29:17.887 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-08T18:29:17.910 DEBUG:teuthology.orchestra.console.smithi181:power on output: Chassis Power Control: Up/On 2024-03-08T18:29:17.910 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T18:29:17.936 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2024-03-08T18:29:21.940 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T18:29:22.049 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2024-03-08T18:29:26.053 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T18:29:26.163 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2024-03-08T18:29:26.263 INFO:teuthology.orchestra.console.smithi181:Power on completed 2024-03-08T18:29:26.364 INFO:teuthology.provision.fog.smithi181:Waiting for deploy to finish 2024-03-08T18:31:44.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T18:31:47.938 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2024-03-08T18:31:53.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T18:31:57.024 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2024-03-08T18:31:57.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T18:31:59.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T18:32:00.350 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-03-08T18:32:03.006 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2024-03-08T18:32:03.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T18:32:06.078 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2024-03-08T18:32:06.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T18:32:09.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T18:32:09.406 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-03-08T18:32:12.066 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2024-03-08T18:32:12.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T18:32:15.134 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2024-03-08T18:32:15.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T18:32:18.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T18:32:18.462 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-03-08T18:32:21.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T18:32:21.154 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2024-03-08T18:32:24.194 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2024-03-08T18:32:24.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T18:32:27.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T18:32:27.522 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-03-08T18:32:30.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T18:32:30.242 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2024-03-08T18:32:33.283 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2024-03-08T18:32:33.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T18:32:36.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T18:32:36.578 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-03-08T18:32:39.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T18:32:39.326 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2024-03-08T18:32:42.370 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2024-03-08T18:32:42.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T18:32:45.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T18:32:45.630 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-03-08T18:32:48.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T18:32:48.382 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2024-03-08T18:32:51.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T18:32:54.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T18:32:54.686 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-03-08T18:33:00.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T18:33:48.423 WARNING:teuthology.provision.fog.smithi184:timed out 2024-03-08T18:33:54.394 WARNING:teuthology.provision.fog.smithi143:timed out 2024-03-08T18:33:54.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T18:33:54.733 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-08T18:33:54.734 DEBUG:teuthology.orchestra.run.smithi184:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-08T18:33:55.077 INFO:teuthology.provision.fog.smithi184:Node is ready 2024-03-08T18:33:55.077 DEBUG:teuthology.orchestra.run.smithi184:> hostname 2024-03-08T18:33:55.091 INFO:teuthology.orchestra.run.smithi184.stdout:smithi184.front.sepia.ceph.com 2024-03-08T18:33:55.092 DEBUG:teuthology.orchestra.run.smithi184:> grep smithi184.front.sepia.ceph.com /etc/hosts 2024-03-08T18:33:55.147 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.15.184 smithi184.front.sepia.ceph.com smithi184 2024-03-08T18:33:55.148 DEBUG:teuthology.orchestra.run.smithi184:> sudo hostname smithi184 2024-03-08T18:33:55.266 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/smithi184.front.sepia.ceph.com/smithi184/g' /etc/hosts 2024-03-08T18:33:55.294 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/172.21.15.184/172.21.15.184/g' /etc/hosts 2024-03-08T18:33:55.362 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/smithi184.front.sepia.ceph.com/smithi184/g' /etc/hostname 2024-03-08T18:33:55.430 DEBUG:teuthology.orchestra.run.smithi184:> sudo hostname smithi184 2024-03-08T18:33:55.497 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2024-03-08T18:33:55.551 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="CentOS Stream" 2024-03-08T18:33:55.551 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="9" 2024-03-08T18:33:55.551 INFO:teuthology.orchestra.run.smithi184.stdout:ID="centos" 2024-03-08T18:33:55.551 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="rhel fedora" 2024-03-08T18:33:55.552 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="9" 2024-03-08T18:33:55.552 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el9" 2024-03-08T18:33:55.552 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-08T18:33:55.552 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31" 2024-03-08T18:33:55.552 INFO:teuthology.orchestra.run.smithi184.stdout:LOGO="fedora-logo-icon" 2024-03-08T18:33:55.552 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-08T18:33:55.552 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://centos.org/" 2024-03-08T18:33:55.552 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-08T18:33:55.552 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-08T18:33:55.552 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-08T18:33:55.553 INFO:teuthology.provision.fog.smithi184:Deploy complete! 2024-03-08T18:33:55.554 DEBUG:teuthology.parallel:result is None 2024-03-08T18:34:00.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T18:34:00.696 WARNING:teuthology.provision.fog.smithi181:timed out 2024-03-08T18:34:00.750 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-08T18:34:00.750 DEBUG:teuthology.orchestra.run.smithi143:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-08T18:34:01.060 INFO:teuthology.provision.fog.smithi143:Node is ready 2024-03-08T18:34:01.060 DEBUG:teuthology.orchestra.run.smithi143:> hostname 2024-03-08T18:34:01.075 INFO:teuthology.orchestra.run.smithi143.stdout:smithi143.front.sepia.ceph.com 2024-03-08T18:34:01.075 DEBUG:teuthology.orchestra.run.smithi143:> grep smithi143.front.sepia.ceph.com /etc/hosts 2024-03-08T18:34:01.130 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.15.143 smithi143.front.sepia.ceph.com smithi143 2024-03-08T18:34:01.130 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143 2024-03-08T18:34:01.237 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi143.front.sepia.ceph.com/smithi143/g' /etc/hosts 2024-03-08T18:34:01.267 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/172.21.15.143/172.21.15.143/g' /etc/hosts 2024-03-08T18:34:01.332 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi143.front.sepia.ceph.com/smithi143/g' /etc/hostname 2024-03-08T18:34:01.400 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143 2024-03-08T18:34:01.466 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2024-03-08T18:34:01.519 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="CentOS Stream" 2024-03-08T18:34:01.519 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="9" 2024-03-08T18:34:01.519 INFO:teuthology.orchestra.run.smithi143.stdout:ID="centos" 2024-03-08T18:34:01.519 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="rhel fedora" 2024-03-08T18:34:01.519 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="9" 2024-03-08T18:34:01.519 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el9" 2024-03-08T18:34:01.519 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-08T18:34:01.519 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31" 2024-03-08T18:34:01.519 INFO:teuthology.orchestra.run.smithi143.stdout:LOGO="fedora-logo-icon" 2024-03-08T18:34:01.519 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-08T18:34:01.520 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://centos.org/" 2024-03-08T18:34:01.520 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-08T18:34:01.520 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-08T18:34:01.520 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-08T18:34:01.520 INFO:teuthology.provision.fog.smithi143:Deploy complete! 2024-03-08T18:34:01.520 DEBUG:teuthology.parallel:result is None 2024-03-08T18:34:06.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T18:34:07.054 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-08T18:34:07.054 DEBUG:teuthology.orchestra.run.smithi181:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-08T18:34:07.369 INFO:teuthology.provision.fog.smithi181:Node is ready 2024-03-08T18:34:07.369 DEBUG:teuthology.orchestra.run.smithi181:> hostname 2024-03-08T18:34:07.427 INFO:teuthology.orchestra.run.smithi181.stdout:smithi181.front.sepia.ceph.com 2024-03-08T18:34:07.428 DEBUG:teuthology.orchestra.run.smithi181:> grep smithi181.front.sepia.ceph.com /etc/hosts 2024-03-08T18:34:07.486 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.181 smithi181.front.sepia.ceph.com smithi181 2024-03-08T18:34:07.487 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181 2024-03-08T18:34:07.611 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181.front.sepia.ceph.com/smithi181/g' /etc/hosts 2024-03-08T18:34:07.638 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/172.21.15.181/172.21.15.181/g' /etc/hosts 2024-03-08T18:34:07.709 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181.front.sepia.ceph.com/smithi181/g' /etc/hostname 2024-03-08T18:34:07.780 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181 2024-03-08T18:34:07.850 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2024-03-08T18:34:07.908 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream" 2024-03-08T18:34:07.908 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="9" 2024-03-08T18:34:07.908 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos" 2024-03-08T18:34:07.908 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora" 2024-03-08T18:34:07.908 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="9" 2024-03-08T18:34:07.908 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el9" 2024-03-08T18:34:07.909 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-08T18:34:07.909 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2024-03-08T18:34:07.909 INFO:teuthology.orchestra.run.smithi181.stdout:LOGO="fedora-logo-icon" 2024-03-08T18:34:07.909 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-08T18:34:07.909 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/" 2024-03-08T18:34:07.909 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-08T18:34:07.909 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-08T18:34:07.909 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-08T18:34:07.909 INFO:teuthology.provision.fog.smithi181:Deploy complete! 2024-03-08T18:34:07.910 DEBUG:teuthology.parallel:result is None 2024-03-08T18:34:08.120 INFO:teuthology.lock.ops:Checking smithi143.front.sepia.ceph.com 2024-03-08T18:34:08.120 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-08T18:34:08.144 INFO:teuthology.lock.ops:Checking smithi181.front.sepia.ceph.com 2024-03-08T18:34:08.144 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-08T18:34:08.159 INFO:teuthology.lock.ops:Checking smithi184.front.sepia.ceph.com 2024-03-08T18:34:08.159 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-08T18:34:08.193 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: set os type and version on server 2024-03-08T18:34:08.194 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-03-08T18:34:08.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T18:34:08.282 DEBUG:teuthology.orchestra.run.smithi143:> true 2024-03-08T18:34:08.355 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-03-08T18:34:08.355 DEBUG:teuthology.orchestra.run.smithi143:> uname -m 2024-03-08T18:34:08.409 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64 2024-03-08T18:34:08.410 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2024-03-08T18:34:08.465 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="CentOS Stream" 2024-03-08T18:34:08.466 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="9" 2024-03-08T18:34:08.466 INFO:teuthology.orchestra.run.smithi143.stdout:ID="centos" 2024-03-08T18:34:08.466 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="rhel fedora" 2024-03-08T18:34:08.466 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="9" 2024-03-08T18:34:08.466 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el9" 2024-03-08T18:34:08.466 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-08T18:34:08.466 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31" 2024-03-08T18:34:08.466 INFO:teuthology.orchestra.run.smithi143.stdout:LOGO="fedora-logo-icon" 2024-03-08T18:34:08.466 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-08T18:34:08.467 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://centos.org/" 2024-03-08T18:34:08.467 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-08T18:34:08.467 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-08T18:34:08.467 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-08T18:34:08.467 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2024-03-08T18:34:08.493 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: set os type and version on server 2024-03-08T18:34:08.493 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-03-08T18:34:08.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T18:34:08.586 DEBUG:teuthology.orchestra.run.smithi181:> true 2024-03-08T18:34:08.652 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-03-08T18:34:08.652 DEBUG:teuthology.orchestra.run.smithi181:> uname -m 2024-03-08T18:34:08.711 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2024-03-08T18:34:08.712 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2024-03-08T18:34:08.769 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream" 2024-03-08T18:34:08.769 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="9" 2024-03-08T18:34:08.769 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos" 2024-03-08T18:34:08.769 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora" 2024-03-08T18:34:08.769 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="9" 2024-03-08T18:34:08.769 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el9" 2024-03-08T18:34:08.769 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-08T18:34:08.769 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2024-03-08T18:34:08.769 INFO:teuthology.orchestra.run.smithi181.stdout:LOGO="fedora-logo-icon" 2024-03-08T18:34:08.770 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-08T18:34:08.770 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/" 2024-03-08T18:34:08.770 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-08T18:34:08.770 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-08T18:34:08.770 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-08T18:34:08.770 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2024-03-08T18:34:08.794 INFO:teuthology.lock.ops:Updating [smithi184.front.sepia.ceph.com]: set os type and version on server 2024-03-08T18:34:08.794 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-03-08T18:34:08.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T18:34:08.929 DEBUG:teuthology.orchestra.run.smithi184:> true 2024-03-08T18:34:09.107 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-03-08T18:34:09.107 DEBUG:teuthology.orchestra.run.smithi184:> uname -m 2024-03-08T18:34:09.164 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64 2024-03-08T18:34:09.164 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2024-03-08T18:34:09.220 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="CentOS Stream" 2024-03-08T18:34:09.220 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="9" 2024-03-08T18:34:09.220 INFO:teuthology.orchestra.run.smithi184.stdout:ID="centos" 2024-03-08T18:34:09.220 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="rhel fedora" 2024-03-08T18:34:09.220 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="9" 2024-03-08T18:34:09.220 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el9" 2024-03-08T18:34:09.220 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-08T18:34:09.221 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31" 2024-03-08T18:34:09.221 INFO:teuthology.orchestra.run.smithi184.stdout:LOGO="fedora-logo-icon" 2024-03-08T18:34:09.221 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-08T18:34:09.221 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://centos.org/" 2024-03-08T18:34:09.221 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-08T18:34:09.221 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-08T18:34:09.221 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-08T18:34:09.221 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2024-03-08T18:34:09.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-08T18:34:09.350 INFO:teuthology.dispatcher.supervisor:Running job 7586017 2024-03-08T18:34:09.351 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-03-08_15:43:32-fs-squid-distro-default-smithi/7586017 --name yuriw-2024-03-08_15:43:32-fs-squid-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/dbench}} -- /home/teuthworker/archive/yuriw-2024-03-08_15:43:32-fs-squid-distro-default-smithi/7586017/orig.config.yaml 2024-03-08T18:34:09.354 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-03-08_15:43:32-fs-squid-distro-default-smithi/7586017 2024-03-08T18:34:09.354 INFO:teuthology.dispatcher.supervisor:Job PID: 1105556 2024-03-08T18:34:09.355 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-08T18:36:09.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-08T18:38:09.810 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-08T18:40:09.982 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-08T18:42:10.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-08T18:44:10.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-08T18:46:10.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-08T18:48:10.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-08T18:50:10.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-08T18:52:10.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-08T18:54:11.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-08T18:56:11.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-08T18:58:11.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-08T19:00:11.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-08T19:02:11.850 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-08T19:04:12.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-08T19:06:12.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-08T19:08:12.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-08T19:10:12.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-08T19:12:12.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-08T19:14:12.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-08T19:16:13.046 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-08T19:16:13.120 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-03-08T19:16:13.347 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi143 but it was locked by another job: /home/teuthworker/archive/yuriw-2024-03-08_15:43:32-fs-squid-distro-default-smithi/7586088 2024-03-08T19:16:13.347 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi181 but it was locked by another job: /home/teuthworker/archive/yuriw-2024-03-08_15:43:54-rados-squid-distro-default-smithi/7586093 2024-03-08T19:16:13.347 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi184 but it was locked by another job: /home/teuthworker/archive/yuriw-2024-03-08_15:43:32-fs-squid-distro-default-smithi/7586088