2024-03-18T00:11:59.524 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-18T00:11:59.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-18T00:11:59.701 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1c88fcdc10>, signals=[15]) 2024-03-18T00:11:59.702 INFO:teuthology.lock.ops:Start node 'smithi069.front.sepia.ceph.com' reimaging 2024-03-18T00:11:59.702 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: reset os type and version on server 2024-03-18T00:11:59.702 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2024-03-18T00:11:59.729 INFO:teuthology.lock.ops:Start node 'smithi083.front.sepia.ceph.com' reimaging 2024-03-18T00:11:59.729 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: reset os type and version on server 2024-03-18T00:11:59.729 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2024-03-18T00:11:59.745 INFO:teuthology.lock.ops:Start node 'smithi145.front.sepia.ceph.com' reimaging 2024-03-18T00:11:59.745 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: reset os type and version on server 2024-03-18T00:11:59.745 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2024-03-18T00:11:59.847 DEBUG:teuthology.provision.fog.smithi069:Requesting image smithi_centos_9.stream (ID 10) 2024-03-18T00:11:59.851 DEBUG:teuthology.provision.fog.smithi083:Requesting image smithi_centos_9.stream (ID 10) 2024-03-18T00:11:59.866 DEBUG:teuthology.provision.fog.smithi145:Requesting image smithi_centos_9.stream (ID 10) 2024-03-18T00:11:59.887 INFO:teuthology.provision.fog.smithi083:Scheduling deploy of centos 9.stream 2024-03-18T00:11:59.891 INFO:teuthology.provision.fog.smithi069:Scheduling deploy of centos 9.stream 2024-03-18T00:11:59.907 INFO:teuthology.provision.fog.smithi145:Scheduling deploy of centos 9.stream 2024-03-18T00:12:00.097 INFO:teuthology.orchestra.console.smithi069:Power off 2024-03-18T00:12:00.097 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-18T00:12:00.112 INFO:teuthology.orchestra.console.smithi145:Power off 2024-03-18T00:12:00.112 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-18T00:12:00.124 INFO:teuthology.orchestra.console.smithi083:Power off 2024-03-18T00:12:00.124 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-18T00:12:00.133 DEBUG:teuthology.orchestra.console.smithi069:power off output: Chassis Power Control: Down/Off 2024-03-18T00:12:00.133 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T00:12:00.141 DEBUG:teuthology.orchestra.console.smithi145:power off output: Chassis Power Control: Down/Off 2024-03-18T00:12:00.141 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T00:12:00.154 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2024-03-18T00:12:00.155 DEBUG:teuthology.orchestra.console.smithi083:power off output: Chassis Power Control: Down/Off 2024-03-18T00:12:00.155 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T00:12:00.171 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off 2024-03-18T00:12:00.175 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off 2024-03-18T00:12:00.255 INFO:teuthology.orchestra.console.smithi069:Power off completed 2024-03-18T00:12:00.272 INFO:teuthology.orchestra.console.smithi145:Power off completed 2024-03-18T00:12:00.276 INFO:teuthology.orchestra.console.smithi083:Power off completed 2024-03-18T00:12:00.357 INFO:teuthology.orchestra.console.smithi069:Power on 2024-03-18T00:12:00.357 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-18T00:12:00.374 INFO:teuthology.orchestra.console.smithi145:Power on 2024-03-18T00:12:00.374 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-18T00:12:00.382 INFO:teuthology.orchestra.console.smithi083:Power on 2024-03-18T00:12:00.382 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-18T00:12:00.389 DEBUG:teuthology.orchestra.console.smithi069:power on output: Chassis Power Control: Up/On 2024-03-18T00:12:00.389 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T00:12:00.400 DEBUG:teuthology.orchestra.console.smithi145:power on output: Chassis Power Control: Up/On 2024-03-18T00:12:00.400 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T00:12:00.408 DEBUG:teuthology.orchestra.console.smithi083:power on output: Chassis Power Control: Up/On 2024-03-18T00:12:00.409 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T00:12:00.417 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2024-03-18T00:12:00.421 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off 2024-03-18T00:12:00.431 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off 2024-03-18T00:12:04.418 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T00:12:04.425 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T00:12:04.432 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T00:12:04.527 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2024-03-18T00:12:04.534 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off 2024-03-18T00:12:04.541 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off 2024-03-18T00:12:08.532 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T00:12:08.540 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T00:12:08.547 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T00:12:08.642 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2024-03-18T00:12:08.649 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2024-03-18T00:12:08.735 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on 2024-03-18T00:12:08.743 INFO:teuthology.orchestra.console.smithi069:Power on completed 2024-03-18T00:12:08.750 INFO:teuthology.orchestra.console.smithi145:Power on completed 2024-03-18T00:12:08.836 INFO:teuthology.orchestra.console.smithi083:Power on completed 2024-03-18T00:12:08.844 INFO:teuthology.provision.fog.smithi069:Waiting for deploy to finish 2024-03-18T00:12:08.850 INFO:teuthology.provision.fog.smithi145:Waiting for deploy to finish 2024-03-18T00:12:08.938 INFO:teuthology.provision.fog.smithi083:Waiting for deploy to finish 2024-03-18T00:14:39.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T00:14:39.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T00:14:39.629 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T00:14:42.686 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-03-18T00:14:48.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T00:14:51.746 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-03-18T00:14:57.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T00:14:58.082 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2024-03-18T00:14:58.083 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-03-18T00:15:00.830 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-03-18T00:15:04.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T00:15:04.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T00:15:06.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T00:15:07.170 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2024-03-18T00:15:07.171 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-03-18T00:15:09.886 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-03-18T00:15:13.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T00:15:13.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T00:15:15.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T00:15:16.258 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2024-03-18T00:15:16.259 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-03-18T00:15:18.942 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-03-18T00:15:22.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T00:15:22.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T00:15:24.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T00:15:25.342 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2024-03-18T00:15:25.346 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-03-18T00:15:28.002 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-03-18T00:15:31.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T00:15:31.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T00:15:34.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T00:15:34.402 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-03-18T00:15:34.402 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2024-03-18T00:15:37.086 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-03-18T00:15:40.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T00:15:40.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T00:15:43.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T00:15:50.558 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2024-03-18T00:15:56.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T00:15:59.646 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2024-03-18T00:16:05.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T00:16:08.702 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2024-03-18T00:16:14.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T00:16:16.176 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-18T00:16:16.176 DEBUG:teuthology.orchestra.run.smithi083:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-18T00:16:36.507 INFO:teuthology.provision.fog.smithi083:Node is ready 2024-03-18T00:16:36.507 DEBUG:teuthology.orchestra.run.smithi083:> hostname 2024-03-18T00:16:36.525 INFO:teuthology.orchestra.run.smithi083.stdout:smithi083.front.sepia.ceph.com 2024-03-18T00:16:36.525 DEBUG:teuthology.orchestra.run.smithi083:> grep smithi083.front.sepia.ceph.com /etc/hosts 2024-03-18T00:16:36.582 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83 smithi083.front.sepia.ceph.com smithi083 2024-03-18T00:16:36.582 DEBUG:teuthology.orchestra.run.smithi083:> sudo hostname smithi083 2024-03-18T00:16:36.710 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/smithi083.front.sepia.ceph.com/smithi083/g' /etc/hosts 2024-03-18T00:16:36.741 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/172.21.15.83/172.21.15.83/g' /etc/hosts 2024-03-18T00:16:36.810 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/smithi083.front.sepia.ceph.com/smithi083/g' /etc/hostname 2024-03-18T00:16:36.879 DEBUG:teuthology.orchestra.run.smithi083:> sudo hostname smithi083 2024-03-18T00:16:36.946 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release 2024-03-18T00:16:37.001 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="CentOS Stream" 2024-03-18T00:16:37.001 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="9" 2024-03-18T00:16:37.001 INFO:teuthology.orchestra.run.smithi083.stdout:ID="centos" 2024-03-18T00:16:37.001 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="rhel fedora" 2024-03-18T00:16:37.001 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="9" 2024-03-18T00:16:37.001 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el9" 2024-03-18T00:16:37.002 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-18T00:16:37.002 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31" 2024-03-18T00:16:37.002 INFO:teuthology.orchestra.run.smithi083.stdout:LOGO="fedora-logo-icon" 2024-03-18T00:16:37.002 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-18T00:16:37.002 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://centos.org/" 2024-03-18T00:16:37.002 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-18T00:16:37.002 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-18T00:16:37.002 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-18T00:16:37.003 INFO:teuthology.provision.fog.smithi083:Deploy complete! 2024-03-18T00:16:37.004 DEBUG:teuthology.parallel:result is None 2024-03-18T00:16:40.410 WARNING:teuthology.provision.fog.smithi145:timed out 2024-03-18T00:16:43.094 WARNING:teuthology.provision.fog.smithi069:timed out 2024-03-18T00:16:46.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T00:16:46.668 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-18T00:16:46.668 DEBUG:teuthology.orchestra.run.smithi145:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-18T00:16:47.004 INFO:teuthology.provision.fog.smithi145:Node is ready 2024-03-18T00:16:47.004 DEBUG:teuthology.orchestra.run.smithi145:> hostname 2024-03-18T00:16:47.019 INFO:teuthology.orchestra.run.smithi145.stdout:smithi145.front.sepia.ceph.com 2024-03-18T00:16:47.019 DEBUG:teuthology.orchestra.run.smithi145:> grep smithi145.front.sepia.ceph.com /etc/hosts 2024-03-18T00:16:47.074 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.15.145 smithi145.front.sepia.ceph.com smithi145 2024-03-18T00:16:47.075 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145 2024-03-18T00:16:47.188 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145.front.sepia.ceph.com/smithi145/g' /etc/hosts 2024-03-18T00:16:47.216 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/172.21.15.145/172.21.15.145/g' /etc/hosts 2024-03-18T00:16:47.283 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145.front.sepia.ceph.com/smithi145/g' /etc/hostname 2024-03-18T00:16:47.351 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145 2024-03-18T00:16:47.417 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2024-03-18T00:16:47.471 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="CentOS Stream" 2024-03-18T00:16:47.471 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="9" 2024-03-18T00:16:47.471 INFO:teuthology.orchestra.run.smithi145.stdout:ID="centos" 2024-03-18T00:16:47.471 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="rhel fedora" 2024-03-18T00:16:47.472 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="9" 2024-03-18T00:16:47.472 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el9" 2024-03-18T00:16:47.472 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-18T00:16:47.472 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2024-03-18T00:16:47.472 INFO:teuthology.orchestra.run.smithi145.stdout:LOGO="fedora-logo-icon" 2024-03-18T00:16:47.472 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-18T00:16:47.472 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://centos.org/" 2024-03-18T00:16:47.472 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-18T00:16:47.472 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-18T00:16:47.472 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-18T00:16:47.472 INFO:teuthology.provision.fog.smithi145:Deploy complete! 2024-03-18T00:16:47.473 DEBUG:teuthology.parallel:result is None 2024-03-18T00:16:49.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T00:16:49.365 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-18T00:16:49.365 DEBUG:teuthology.orchestra.run.smithi069:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-18T00:16:49.692 INFO:teuthology.provision.fog.smithi069:Node is ready 2024-03-18T00:16:49.692 DEBUG:teuthology.orchestra.run.smithi069:> hostname 2024-03-18T00:16:49.707 INFO:teuthology.orchestra.run.smithi069.stdout:smithi069.front.sepia.ceph.com 2024-03-18T00:16:49.707 DEBUG:teuthology.orchestra.run.smithi069:> grep smithi069.front.sepia.ceph.com /etc/hosts 2024-03-18T00:16:49.762 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69 smithi069.front.sepia.ceph.com smithi069 2024-03-18T00:16:49.762 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname smithi069 2024-03-18T00:16:49.868 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/smithi069.front.sepia.ceph.com/smithi069/g' /etc/hosts 2024-03-18T00:16:49.895 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/172.21.15.69/172.21.15.69/g' /etc/hosts 2024-03-18T00:16:49.962 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/smithi069.front.sepia.ceph.com/smithi069/g' /etc/hostname 2024-03-18T00:16:50.030 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname smithi069 2024-03-18T00:16:50.096 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2024-03-18T00:16:50.151 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="CentOS Stream" 2024-03-18T00:16:50.151 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="9" 2024-03-18T00:16:50.151 INFO:teuthology.orchestra.run.smithi069.stdout:ID="centos" 2024-03-18T00:16:50.151 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="rhel fedora" 2024-03-18T00:16:50.152 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="9" 2024-03-18T00:16:50.152 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el9" 2024-03-18T00:16:50.152 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-18T00:16:50.152 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31" 2024-03-18T00:16:50.152 INFO:teuthology.orchestra.run.smithi069.stdout:LOGO="fedora-logo-icon" 2024-03-18T00:16:50.152 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-18T00:16:50.152 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://centos.org/" 2024-03-18T00:16:50.152 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-18T00:16:50.152 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-18T00:16:50.152 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-18T00:16:50.152 INFO:teuthology.provision.fog.smithi069:Deploy complete! 2024-03-18T00:16:50.153 DEBUG:teuthology.parallel:result is None 2024-03-18T00:16:50.367 INFO:teuthology.lock.ops:Checking smithi069.front.sepia.ceph.com 2024-03-18T00:16:50.367 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-18T00:16:50.395 INFO:teuthology.lock.ops:Checking smithi083.front.sepia.ceph.com 2024-03-18T00:16:50.395 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-18T00:16:50.411 INFO:teuthology.lock.ops:Checking smithi145.front.sepia.ceph.com 2024-03-18T00:16:50.411 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-18T00:16:50.429 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: set os type and version on server 2024-03-18T00:16:50.429 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2024-03-18T00:16:50.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T00:16:50.521 DEBUG:teuthology.orchestra.run.smithi069:> true 2024-03-18T00:16:50.584 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi069.front.sepia.ceph.com' 2024-03-18T00:16:50.584 DEBUG:teuthology.orchestra.run.smithi069:> uname -m 2024-03-18T00:16:50.638 INFO:teuthology.orchestra.run.smithi069.stdout:x86_64 2024-03-18T00:16:50.638 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2024-03-18T00:16:50.692 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="CentOS Stream" 2024-03-18T00:16:50.692 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="9" 2024-03-18T00:16:50.692 INFO:teuthology.orchestra.run.smithi069.stdout:ID="centos" 2024-03-18T00:16:50.692 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="rhel fedora" 2024-03-18T00:16:50.692 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="9" 2024-03-18T00:16:50.693 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el9" 2024-03-18T00:16:50.693 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-18T00:16:50.693 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31" 2024-03-18T00:16:50.693 INFO:teuthology.orchestra.run.smithi069.stdout:LOGO="fedora-logo-icon" 2024-03-18T00:16:50.693 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-18T00:16:50.693 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://centos.org/" 2024-03-18T00:16:50.693 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-18T00:16:50.693 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-18T00:16:50.693 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-18T00:16:50.694 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2024-03-18T00:16:50.712 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: set os type and version on server 2024-03-18T00:16:50.712 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-03-18T00:16:50.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T00:16:50.806 DEBUG:teuthology.orchestra.run.smithi083:> true 2024-03-18T00:16:50.977 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-03-18T00:16:50.977 DEBUG:teuthology.orchestra.run.smithi083:> uname -m 2024-03-18T00:16:51.032 INFO:teuthology.orchestra.run.smithi083.stdout:x86_64 2024-03-18T00:16:51.032 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release 2024-03-18T00:16:51.088 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="CentOS Stream" 2024-03-18T00:16:51.088 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="9" 2024-03-18T00:16:51.089 INFO:teuthology.orchestra.run.smithi083.stdout:ID="centos" 2024-03-18T00:16:51.089 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="rhel fedora" 2024-03-18T00:16:51.089 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="9" 2024-03-18T00:16:51.089 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el9" 2024-03-18T00:16:51.089 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-18T00:16:51.089 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31" 2024-03-18T00:16:51.089 INFO:teuthology.orchestra.run.smithi083.stdout:LOGO="fedora-logo-icon" 2024-03-18T00:16:51.089 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-18T00:16:51.089 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://centos.org/" 2024-03-18T00:16:51.089 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-18T00:16:51.089 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-18T00:16:51.089 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-18T00:16:51.090 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2024-03-18T00:16:51.111 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: set os type and version on server 2024-03-18T00:16:51.111 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-03-18T00:16:51.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T00:16:51.200 DEBUG:teuthology.orchestra.run.smithi145:> true 2024-03-18T00:16:51.271 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-03-18T00:16:51.271 DEBUG:teuthology.orchestra.run.smithi145:> uname -m 2024-03-18T00:16:51.332 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64 2024-03-18T00:16:51.332 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2024-03-18T00:16:51.392 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="CentOS Stream" 2024-03-18T00:16:51.392 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="9" 2024-03-18T00:16:51.392 INFO:teuthology.orchestra.run.smithi145.stdout:ID="centos" 2024-03-18T00:16:51.392 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="rhel fedora" 2024-03-18T00:16:51.392 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="9" 2024-03-18T00:16:51.392 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el9" 2024-03-18T00:16:51.392 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-18T00:16:51.392 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2024-03-18T00:16:51.392 INFO:teuthology.orchestra.run.smithi145.stdout:LOGO="fedora-logo-icon" 2024-03-18T00:16:51.392 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-18T00:16:51.393 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://centos.org/" 2024-03-18T00:16:51.393 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-18T00:16:51.393 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-18T00:16:51.393 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-18T00:16:51.393 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2024-03-18T00:16:51.420 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-18T00:16:51.523 INFO:teuthology.dispatcher.supervisor:Running job 7608525 2024-03-18T00:16:51.523 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608525 --name pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/fs/test_o_trunc}} -- /home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608525/orig.config.yaml 2024-03-18T00:16:51.527 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608525 2024-03-18T00:16:51.529 INFO:teuthology.dispatcher.supervisor:Job PID: 1105756 2024-03-18T00:16:51.529 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-18T00:18:51.630 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-18T00:20:51.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-18T00:22:51.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-18T00:24:52.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-18T00:26:52.285 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-18T00:28:52.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-18T00:30:52.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-18T00:32:52.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-18T00:34:52.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-18T00:36:53.146 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-18T00:38:53.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-18T00:40:53.484 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-18T00:42:53.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-18T00:44:53.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-18T00:46:54.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-18T00:48:54.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-18T00:50:54.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-18T00:52:54.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-18T00:54:54.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-18T00:54:54.816 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1