2024-04-17T10:33:12.277 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-17T10:33:12.278 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T10:33:12.451 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f06b8815c10>, signals=[15]) 2024-04-17T10:33:12.452 INFO:teuthology.lock.ops:Start node 'smithi047.front.sepia.ceph.com' reimaging 2024-04-17T10:33:12.452 INFO:teuthology.lock.ops:Updating [smithi047.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T10:33:12.452 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2024-04-17T10:33:12.472 INFO:teuthology.lock.ops:Start node 'smithi088.front.sepia.ceph.com' reimaging 2024-04-17T10:33:12.472 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T10:33:12.472 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2024-04-17T10:33:12.488 INFO:teuthology.lock.ops:Start node 'smithi150.front.sepia.ceph.com' reimaging 2024-04-17T10:33:12.488 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T10:33:12.488 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2024-04-17T10:33:12.586 DEBUG:teuthology.provision.fog.smithi047:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T10:33:12.606 DEBUG:teuthology.provision.fog.smithi088:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T10:33:12.610 DEBUG:teuthology.provision.fog.smithi150:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T10:33:12.628 INFO:teuthology.provision.fog.smithi047:Scheduling deploy of centos 9.stream 2024-04-17T10:33:12.654 INFO:teuthology.provision.fog.smithi150:Scheduling deploy of centos 9.stream 2024-04-17T10:33:12.657 INFO:teuthology.provision.fog.smithi088:Scheduling deploy of centos 9.stream 2024-04-17T10:33:12.967 INFO:teuthology.orchestra.console.smithi150:Power off 2024-04-17T10:33:12.967 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T10:33:12.982 INFO:teuthology.orchestra.console.smithi047:Power off 2024-04-17T10:33:12.982 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T10:33:12.994 INFO:teuthology.orchestra.console.smithi088:Power off 2024-04-17T10:33:12.994 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T10:33:13.002 DEBUG:teuthology.orchestra.console.smithi150:power off output: Chassis Power Control: Down/Off 2024-04-17T10:33:13.002 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T10:33:13.010 DEBUG:teuthology.orchestra.console.smithi047:power off output: Chassis Power Control: Down/Off 2024-04-17T10:33:13.010 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T10:33:13.018 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off 2024-04-17T10:33:13.018 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T10:33:13.026 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on 2024-04-17T10:33:13.030 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is off 2024-04-17T10:33:13.039 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2024-04-17T10:33:13.131 INFO:teuthology.orchestra.console.smithi047:Power off completed 2024-04-17T10:33:13.140 INFO:teuthology.orchestra.console.smithi088:Power off completed 2024-04-17T10:33:13.232 INFO:teuthology.orchestra.console.smithi047:Power on 2024-04-17T10:33:13.232 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T10:33:13.240 INFO:teuthology.orchestra.console.smithi088:Power on 2024-04-17T10:33:13.241 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T10:33:13.256 DEBUG:teuthology.orchestra.console.smithi047:power on output: Chassis Power Control: Up/On 2024-04-17T10:33:13.256 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T10:33:13.266 DEBUG:teuthology.orchestra.console.smithi088:power on output: Chassis Power Control: Up/On 2024-04-17T10:33:13.266 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T10:33:13.279 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is off 2024-04-17T10:33:13.287 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2024-04-17T10:33:17.031 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T10:33:17.140 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on 2024-04-17T10:33:17.280 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T10:33:17.290 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T10:33:17.392 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is on 2024-04-17T10:33:17.399 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2024-04-17T10:33:17.494 INFO:teuthology.orchestra.console.smithi047:Power on completed 2024-04-17T10:33:17.594 INFO:teuthology.provision.fog.smithi047:Waiting for deploy to finish 2024-04-17T10:33:21.145 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T10:33:21.254 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on 2024-04-17T10:33:21.401 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T10:33:21.510 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2024-04-17T10:33:21.610 INFO:teuthology.orchestra.console.smithi088:Power on completed 2024-04-17T10:33:21.711 INFO:teuthology.provision.fog.smithi088:Waiting for deploy to finish 2024-04-17T10:33:25.255 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T10:33:25.364 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off 2024-04-17T10:33:25.464 INFO:teuthology.orchestra.console.smithi150:Power off completed 2024-04-17T10:33:25.565 INFO:teuthology.orchestra.console.smithi150:Power on 2024-04-17T10:33:25.565 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T10:33:25.587 DEBUG:teuthology.orchestra.console.smithi150:power on output: Chassis Power Control: Up/On 2024-04-17T10:33:25.588 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T10:33:25.609 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off 2024-04-17T10:33:29.610 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T10:33:29.719 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on 2024-04-17T10:33:29.820 INFO:teuthology.orchestra.console.smithi150:Power on completed 2024-04-17T10:33:29.920 INFO:teuthology.provision.fog.smithi150:Waiting for deploy to finish 2024-04-17T10:36:07.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:36:11.070 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-04-17T10:36:17.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:36:20.126 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-04-17T10:36:26.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:36:29.182 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-04-17T10:36:31.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:36:34.398 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-04-17T10:36:35.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:36:38.238 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-04-17T10:36:40.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:36:43.454 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-04-17T10:36:44.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:36:47.294 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-04-17T10:36:49.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:36:52.510 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-04-17T10:36:53.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:36:56.350 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-04-17T10:36:58.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:37:01.566 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-04-17T10:37:02.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:37:05.410 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-04-17T10:37:07.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:37:10.623 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-04-17T10:37:11.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:37:14.494 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-04-17T10:37:16.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:37:19.678 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-04-17T10:37:20.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:37:25.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:37:28.734 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-04-17T10:37:34.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:37:34.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:37:37.534 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-04-17T10:37:38.974 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-04-17T10:37:43.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:37:44.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:37:46.590 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-04-17T10:37:48.030 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-04-17T10:37:52.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:37:53.058 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-04-17T10:37:54.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:37:55.678 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-04-17T10:37:57.086 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-04-17T10:37:59.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:38:01.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:38:02.146 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-04-17T10:38:03.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:38:03.292 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T10:38:03.292 DEBUG:teuthology.orchestra.run.smithi088:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T10:38:04.734 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-04-17T10:38:08.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:38:10.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:38:11.230 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-04-17T10:38:13.794 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-04-17T10:38:17.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:38:17.587 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T10:38:17.587 DEBUG:teuthology.orchestra.run.smithi150:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T10:38:18.664 INFO:teuthology.provision.fog.smithi088:Node is ready 2024-04-17T10:38:18.664 DEBUG:teuthology.orchestra.run.smithi088:> hostname 2024-04-17T10:38:18.721 INFO:teuthology.orchestra.run.smithi088.stdout:smithi046 2024-04-17T10:38:18.722 DEBUG:teuthology.orchestra.run.smithi088:> grep smithi046 /etc/hosts 2024-04-17T10:38:18.778 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-04-17T10:38:18.778 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088 2024-04-17T10:38:18.921 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi046/smithi088/g' /etc/hosts 2024-04-17T10:38:18.951 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/172.21.15.46/172.21.15.88/g' /etc/hosts 2024-04-17T10:38:19.021 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi046/smithi088/g' /etc/hostname 2024-04-17T10:38:19.090 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088 2024-04-17T10:38:19.158 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2024-04-17T10:38:19.213 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream" 2024-04-17T10:38:19.214 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="9" 2024-04-17T10:38:19.214 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos" 2024-04-17T10:38:19.214 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora" 2024-04-17T10:38:19.214 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="9" 2024-04-17T10:38:19.214 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el9" 2024-04-17T10:38:19.214 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T10:38:19.214 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2024-04-17T10:38:19.214 INFO:teuthology.orchestra.run.smithi088.stdout:LOGO="fedora-logo-icon" 2024-04-17T10:38:19.214 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T10:38:19.214 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/" 2024-04-17T10:38:19.214 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T10:38:19.215 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T10:38:19.215 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T10:38:19.215 INFO:teuthology.provision.fog.smithi088:Deploy complete! 2024-04-17T10:38:19.217 DEBUG:teuthology.parallel:result is None 2024-04-17T10:38:19.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:38:37.956 INFO:teuthology.provision.fog.smithi150:Node is ready 2024-04-17T10:38:37.956 DEBUG:teuthology.orchestra.run.smithi150:> hostname 2024-04-17T10:38:37.975 INFO:teuthology.orchestra.run.smithi150.stdout:smithi150.front.sepia.ceph.com 2024-04-17T10:38:37.975 DEBUG:teuthology.orchestra.run.smithi150:> grep smithi150.front.sepia.ceph.com /etc/hosts 2024-04-17T10:38:38.033 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.15.150 smithi150.front.sepia.ceph.com smithi150 2024-04-17T10:38:38.033 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150 2024-04-17T10:38:38.188 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hosts 2024-04-17T10:38:38.219 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/172.21.15.150/172.21.15.150/g' /etc/hosts 2024-04-17T10:38:38.289 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hostname 2024-04-17T10:38:38.358 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150 2024-04-17T10:38:38.426 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2024-04-17T10:38:38.482 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Stream" 2024-04-17T10:38:38.482 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="9" 2024-04-17T10:38:38.482 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos" 2024-04-17T10:38:38.482 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora" 2024-04-17T10:38:38.482 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="9" 2024-04-17T10:38:38.482 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el9" 2024-04-17T10:38:38.482 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T10:38:38.482 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31" 2024-04-17T10:38:38.482 INFO:teuthology.orchestra.run.smithi150.stdout:LOGO="fedora-logo-icon" 2024-04-17T10:38:38.482 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T10:38:38.482 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://centos.org/" 2024-04-17T10:38:38.482 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T10:38:38.482 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T10:38:38.483 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T10:38:38.483 INFO:teuthology.provision.fog.smithi150:Deploy complete! 2024-04-17T10:38:38.483 DEBUG:teuthology.parallel:result is None 2024-04-17T10:39:19.797 WARNING:teuthology.provision.fog.smithi047:timed out 2024-04-17T10:39:25.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:39:26.010 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T10:39:26.010 DEBUG:teuthology.orchestra.run.smithi047:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T10:39:26.365 INFO:teuthology.provision.fog.smithi047:Node is ready 2024-04-17T10:39:26.365 DEBUG:teuthology.orchestra.run.smithi047:> hostname 2024-04-17T10:39:26.381 INFO:teuthology.orchestra.run.smithi047.stdout:smithi047.front.sepia.ceph.com 2024-04-17T10:39:26.381 DEBUG:teuthology.orchestra.run.smithi047:> grep smithi047.front.sepia.ceph.com /etc/hosts 2024-04-17T10:39:26.438 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47 smithi047.front.sepia.ceph.com smithi047 2024-04-17T10:39:26.438 DEBUG:teuthology.orchestra.run.smithi047:> sudo hostname smithi047 2024-04-17T10:39:26.539 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i -e 's/smithi047.front.sepia.ceph.com/smithi047/g' /etc/hosts 2024-04-17T10:39:26.571 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i -e 's/172.21.15.47/172.21.15.47/g' /etc/hosts 2024-04-17T10:39:26.643 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i -e 's/smithi047.front.sepia.ceph.com/smithi047/g' /etc/hostname 2024-04-17T10:39:26.715 DEBUG:teuthology.orchestra.run.smithi047:> sudo hostname smithi047 2024-04-17T10:39:26.786 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release 2024-04-17T10:39:26.841 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="CentOS Stream" 2024-04-17T10:39:26.842 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="9" 2024-04-17T10:39:26.842 INFO:teuthology.orchestra.run.smithi047.stdout:ID="centos" 2024-04-17T10:39:26.842 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE="rhel fedora" 2024-04-17T10:39:26.842 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="9" 2024-04-17T10:39:26.842 INFO:teuthology.orchestra.run.smithi047.stdout:PLATFORM_ID="platform:el9" 2024-04-17T10:39:26.842 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T10:39:26.842 INFO:teuthology.orchestra.run.smithi047.stdout:ANSI_COLOR="0;31" 2024-04-17T10:39:26.842 INFO:teuthology.orchestra.run.smithi047.stdout:LOGO="fedora-logo-icon" 2024-04-17T10:39:26.842 INFO:teuthology.orchestra.run.smithi047.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T10:39:26.842 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://centos.org/" 2024-04-17T10:39:26.842 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T10:39:26.842 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T10:39:26.842 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T10:39:26.843 INFO:teuthology.provision.fog.smithi047:Deploy complete! 2024-04-17T10:39:26.843 DEBUG:teuthology.parallel:result is None 2024-04-17T10:39:27.063 INFO:teuthology.lock.ops:Checking smithi047.front.sepia.ceph.com 2024-04-17T10:39:27.064 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T10:39:27.088 INFO:teuthology.lock.ops:Checking smithi088.front.sepia.ceph.com 2024-04-17T10:39:27.088 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T10:39:27.111 INFO:teuthology.lock.ops:Checking smithi150.front.sepia.ceph.com 2024-04-17T10:39:27.111 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T10:39:27.137 INFO:teuthology.lock.ops:Updating [smithi047.front.sepia.ceph.com]: set os type and version on server 2024-04-17T10:39:27.137 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-04-17T10:39:27.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:39:27.236 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-04-17T10:39:27.301 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-04-17T10:39:27.301 DEBUG:teuthology.orchestra.run.smithi047:> uname -m 2024-04-17T10:39:27.355 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64 2024-04-17T10:39:27.356 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release 2024-04-17T10:39:27.411 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="CentOS Stream" 2024-04-17T10:39:27.411 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="9" 2024-04-17T10:39:27.411 INFO:teuthology.orchestra.run.smithi047.stdout:ID="centos" 2024-04-17T10:39:27.411 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE="rhel fedora" 2024-04-17T10:39:27.411 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="9" 2024-04-17T10:39:27.411 INFO:teuthology.orchestra.run.smithi047.stdout:PLATFORM_ID="platform:el9" 2024-04-17T10:39:27.411 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T10:39:27.411 INFO:teuthology.orchestra.run.smithi047.stdout:ANSI_COLOR="0;31" 2024-04-17T10:39:27.411 INFO:teuthology.orchestra.run.smithi047.stdout:LOGO="fedora-logo-icon" 2024-04-17T10:39:27.411 INFO:teuthology.orchestra.run.smithi047.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T10:39:27.411 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://centos.org/" 2024-04-17T10:39:27.412 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T10:39:27.412 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T10:39:27.412 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T10:39:27.412 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2024-04-17T10:39:27.437 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: set os type and version on server 2024-04-17T10:39:27.438 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-04-17T10:39:27.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:39:27.533 DEBUG:teuthology.orchestra.run.smithi088:> true 2024-04-17T10:39:27.700 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-04-17T10:39:27.700 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2024-04-17T10:39:27.755 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2024-04-17T10:39:27.755 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2024-04-17T10:39:27.810 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream" 2024-04-17T10:39:27.810 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="9" 2024-04-17T10:39:27.810 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos" 2024-04-17T10:39:27.810 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora" 2024-04-17T10:39:27.810 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="9" 2024-04-17T10:39:27.810 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el9" 2024-04-17T10:39:27.810 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T10:39:27.810 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2024-04-17T10:39:27.810 INFO:teuthology.orchestra.run.smithi088.stdout:LOGO="fedora-logo-icon" 2024-04-17T10:39:27.810 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T10:39:27.810 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/" 2024-04-17T10:39:27.811 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T10:39:27.811 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T10:39:27.811 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T10:39:27.811 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2024-04-17T10:39:27.836 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: set os type and version on server 2024-04-17T10:39:27.836 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-04-17T10:39:27.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T10:39:27.924 DEBUG:teuthology.orchestra.run.smithi150:> true 2024-04-17T10:39:27.994 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-04-17T10:39:27.994 DEBUG:teuthology.orchestra.run.smithi150:> uname -m 2024-04-17T10:39:28.050 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64 2024-04-17T10:39:28.050 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2024-04-17T10:39:28.105 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Stream" 2024-04-17T10:39:28.106 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="9" 2024-04-17T10:39:28.106 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos" 2024-04-17T10:39:28.106 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora" 2024-04-17T10:39:28.106 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="9" 2024-04-17T10:39:28.106 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el9" 2024-04-17T10:39:28.106 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T10:39:28.106 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31" 2024-04-17T10:39:28.106 INFO:teuthology.orchestra.run.smithi150.stdout:LOGO="fedora-logo-icon" 2024-04-17T10:39:28.106 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T10:39:28.106 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://centos.org/" 2024-04-17T10:39:28.106 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T10:39:28.106 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T10:39:28.107 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T10:39:28.107 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2024-04-17T10:39:28.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T10:39:28.230 INFO:teuthology.dispatcher.supervisor:Running job 7660077 2024-04-17T10:39:28.230 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660077 --name rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/suites/iogen}} -- /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660077/orig.config.yaml 2024-04-17T10:39:28.233 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660077 2024-04-17T10:39:28.233 INFO:teuthology.dispatcher.supervisor:Job PID: 920917 2024-04-17T10:39:28.233 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-17T10:41:28.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T10:43:28.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T10:45:28.666 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T10:47:28.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T10:49:29.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T10:49:29.072 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1