2024-04-01T16:04:20.476 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-04-01T16:04:20.476 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T16:04:20.655 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd108d8fc10>, signals=[15]) 2024-04-01T16:04:20.656 INFO:teuthology.lock.ops:Start node 'smithi081.front.sepia.ceph.com' reimaging 2024-04-01T16:04:20.656 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: reset os type and version on server 2024-04-01T16:04:20.656 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2024-04-01T16:04:20.681 INFO:teuthology.lock.ops:Start node 'smithi119.front.sepia.ceph.com' reimaging 2024-04-01T16:04:20.681 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: reset os type and version on server 2024-04-01T16:04:20.681 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2024-04-01T16:04:20.714 INFO:teuthology.lock.ops:Start node 'smithi188.front.sepia.ceph.com' reimaging 2024-04-01T16:04:20.714 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: reset os type and version on server 2024-04-01T16:04:20.714 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2024-04-01T16:04:20.794 DEBUG:teuthology.provision.fog.smithi081:Requesting image smithi_centos_9.stream (ID 10) 2024-04-01T16:04:20.831 DEBUG:teuthology.provision.fog.smithi119:Requesting image smithi_centos_9.stream (ID 10) 2024-04-01T16:04:20.838 INFO:teuthology.provision.fog.smithi081:Scheduling deploy of centos 9.stream 2024-04-01T16:04:20.862 DEBUG:teuthology.provision.fog.smithi188:Requesting image smithi_centos_9.stream (ID 10) 2024-04-01T16:04:20.868 INFO:teuthology.provision.fog.smithi119:Scheduling deploy of centos 9.stream 2024-04-01T16:04:20.917 INFO:teuthology.provision.fog.smithi188:Scheduling deploy of centos 9.stream 2024-04-01T16:04:21.070 INFO:teuthology.orchestra.console.smithi081:Power off 2024-04-01T16:04:21.071 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T16:04:21.093 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off 2024-04-01T16:04:21.093 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T16:04:21.112 INFO:teuthology.orchestra.console.smithi119:Power off 2024-04-01T16:04:21.113 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T16:04:21.123 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2024-04-01T16:04:21.148 INFO:teuthology.orchestra.console.smithi188:Power off 2024-04-01T16:04:21.148 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T16:04:21.157 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off 2024-04-01T16:04:21.158 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T16:04:21.172 DEBUG:teuthology.orchestra.console.smithi188:power off output: Chassis Power Control: Down/Off 2024-04-01T16:04:21.173 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T16:04:21.182 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2024-04-01T16:04:21.195 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2024-04-01T16:04:21.224 INFO:teuthology.orchestra.console.smithi081:Power off completed 2024-04-01T16:04:21.284 INFO:teuthology.orchestra.console.smithi119:Power off completed 2024-04-01T16:04:21.296 INFO:teuthology.orchestra.console.smithi188:Power off completed 2024-04-01T16:04:21.324 INFO:teuthology.orchestra.console.smithi081:Power on 2024-04-01T16:04:21.324 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-01T16:04:21.347 DEBUG:teuthology.orchestra.console.smithi081:power on output: Chassis Power Control: Up/On 2024-04-01T16:04:21.347 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T16:04:21.369 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2024-04-01T16:04:21.385 INFO:teuthology.orchestra.console.smithi119:Power on 2024-04-01T16:04:21.385 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-01T16:04:21.398 INFO:teuthology.orchestra.console.smithi188:Power on 2024-04-01T16:04:21.398 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-01T16:04:21.408 DEBUG:teuthology.orchestra.console.smithi119:power on output: Chassis Power Control: Up/On 2024-04-01T16:04:21.409 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T16:04:21.420 DEBUG:teuthology.orchestra.console.smithi188:power on output: Chassis Power Control: Up/On 2024-04-01T16:04:21.421 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T16:04:21.430 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2024-04-01T16:04:21.442 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2024-04-01T16:04:25.374 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T16:04:25.431 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T16:04:25.443 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T16:04:25.483 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2024-04-01T16:04:25.540 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2024-04-01T16:04:25.551 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2024-04-01T16:04:29.486 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T16:04:29.541 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T16:04:29.551 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T16:04:29.595 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2024-04-01T16:04:29.650 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2024-04-01T16:04:29.659 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2024-04-01T16:04:29.697 INFO:teuthology.orchestra.console.smithi081:Power on completed 2024-04-01T16:04:29.751 INFO:teuthology.orchestra.console.smithi119:Power on completed 2024-04-01T16:04:29.760 INFO:teuthology.orchestra.console.smithi188:Power on completed 2024-04-01T16:04:29.798 INFO:teuthology.provision.fog.smithi081:Waiting for deploy to finish 2024-04-01T16:04:29.852 INFO:teuthology.provision.fog.smithi119:Waiting for deploy to finish 2024-04-01T16:04:29.861 INFO:teuthology.provision.fog.smithi188:Waiting for deploy to finish 2024-04-01T16:07:00.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:07:03.998 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2024-04-01T16:07:10.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:07:13.054 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2024-04-01T16:07:16.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:07:16.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:07:19.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:07:22.110 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2024-04-01T16:07:28.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:07:31.198 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2024-04-01T16:07:34.430 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-04-01T16:07:34.431 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-04-01T16:07:37.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:07:40.254 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2024-04-01T16:07:40.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:07:40.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:07:43.486 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-04-01T16:07:43.487 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-04-01T16:07:46.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:07:49.310 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2024-04-01T16:07:49.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:07:49.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:07:52.542 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-04-01T16:07:52.543 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-04-01T16:07:55.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:07:58.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:07:58.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:08:01.598 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-04-01T16:08:01.599 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-04-01T16:08:07.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:08:07.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:08:55.352 WARNING:teuthology.provision.fog.smithi188:timed out 2024-04-01T16:09:01.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:09:01.577 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-01T16:09:01.578 DEBUG:teuthology.orchestra.run.smithi188:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-01T16:09:01.900 INFO:teuthology.provision.fog.smithi188:Node is ready 2024-04-01T16:09:01.900 DEBUG:teuthology.orchestra.run.smithi188:> hostname 2024-04-01T16:09:01.914 INFO:teuthology.orchestra.run.smithi188.stdout:smithi188.front.sepia.ceph.com 2024-04-01T16:09:01.914 DEBUG:teuthology.orchestra.run.smithi188:> grep smithi188.front.sepia.ceph.com /etc/hosts 2024-04-01T16:09:01.969 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.15.188 smithi188.front.sepia.ceph.com smithi188 2024-04-01T16:09:01.969 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188 2024-04-01T16:09:02.094 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188.front.sepia.ceph.com/smithi188/g' /etc/hosts 2024-04-01T16:09:02.122 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/172.21.15.188/172.21.15.188/g' /etc/hosts 2024-04-01T16:09:02.189 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188.front.sepia.ceph.com/smithi188/g' /etc/hostname 2024-04-01T16:09:02.256 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188 2024-04-01T16:09:02.322 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2024-04-01T16:09:02.376 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="CentOS Stream" 2024-04-01T16:09:02.376 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="9" 2024-04-01T16:09:02.376 INFO:teuthology.orchestra.run.smithi188.stdout:ID="centos" 2024-04-01T16:09:02.376 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="rhel fedora" 2024-04-01T16:09:02.376 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="9" 2024-04-01T16:09:02.376 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el9" 2024-04-01T16:09:02.376 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T16:09:02.376 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31" 2024-04-01T16:09:02.376 INFO:teuthology.orchestra.run.smithi188.stdout:LOGO="fedora-logo-icon" 2024-04-01T16:09:02.377 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T16:09:02.377 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://centos.org/" 2024-04-01T16:09:02.377 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T16:09:02.377 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T16:09:02.377 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T16:09:02.377 INFO:teuthology.provision.fog.smithi188:Deploy complete! 2024-04-01T16:09:02.379 DEBUG:teuthology.parallel:result is None 2024-04-01T16:09:07.614 WARNING:teuthology.provision.fog.smithi081:timed out 2024-04-01T16:09:07.615 WARNING:teuthology.provision.fog.smithi119:timed out 2024-04-01T16:09:13.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:09:13.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:09:13.835 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-01T16:09:13.835 DEBUG:teuthology.orchestra.run.smithi119:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-01T16:09:13.932 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-01T16:09:13.932 DEBUG:teuthology.orchestra.run.smithi081:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-01T16:09:14.168 INFO:teuthology.provision.fog.smithi119:Node is ready 2024-04-01T16:09:14.168 DEBUG:teuthology.orchestra.run.smithi119:> hostname 2024-04-01T16:09:14.183 INFO:teuthology.orchestra.run.smithi119.stdout:smithi119.front.sepia.ceph.com 2024-04-01T16:09:14.183 DEBUG:teuthology.orchestra.run.smithi119:> grep smithi119.front.sepia.ceph.com /etc/hosts 2024-04-01T16:09:14.237 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119 smithi119.front.sepia.ceph.com smithi119 2024-04-01T16:09:14.238 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119 2024-04-01T16:09:14.241 INFO:teuthology.provision.fog.smithi081:Node is ready 2024-04-01T16:09:14.241 DEBUG:teuthology.orchestra.run.smithi081:> hostname 2024-04-01T16:09:14.256 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081.front.sepia.ceph.com 2024-04-01T16:09:14.256 DEBUG:teuthology.orchestra.run.smithi081:> grep smithi081.front.sepia.ceph.com /etc/hosts 2024-04-01T16:09:14.312 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81 smithi081.front.sepia.ceph.com smithi081 2024-04-01T16:09:14.313 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081 2024-04-01T16:09:14.378 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119.front.sepia.ceph.com/smithi119/g' /etc/hosts 2024-04-01T16:09:14.408 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/172.21.15.119/172.21.15.119/g' /etc/hosts 2024-04-01T16:09:14.440 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hosts 2024-04-01T16:09:14.468 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/172.21.15.81/172.21.15.81/g' /etc/hosts 2024-04-01T16:09:14.476 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119.front.sepia.ceph.com/smithi119/g' /etc/hostname 2024-04-01T16:09:14.535 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hostname 2024-04-01T16:09:14.543 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119 2024-04-01T16:09:14.603 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081 2024-04-01T16:09:14.609 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2024-04-01T16:09:14.663 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream" 2024-04-01T16:09:14.663 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="9" 2024-04-01T16:09:14.663 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos" 2024-04-01T16:09:14.663 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora" 2024-04-01T16:09:14.663 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="9" 2024-04-01T16:09:14.664 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el9" 2024-04-01T16:09:14.664 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T16:09:14.664 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2024-04-01T16:09:14.664 INFO:teuthology.orchestra.run.smithi119.stdout:LOGO="fedora-logo-icon" 2024-04-01T16:09:14.664 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T16:09:14.664 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/" 2024-04-01T16:09:14.664 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T16:09:14.664 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T16:09:14.664 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T16:09:14.664 INFO:teuthology.provision.fog.smithi119:Deploy complete! 2024-04-01T16:09:14.665 DEBUG:teuthology.parallel:result is None 2024-04-01T16:09:14.669 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2024-04-01T16:09:14.723 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream" 2024-04-01T16:09:14.723 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="9" 2024-04-01T16:09:14.723 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos" 2024-04-01T16:09:14.723 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora" 2024-04-01T16:09:14.723 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="9" 2024-04-01T16:09:14.723 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el9" 2024-04-01T16:09:14.723 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T16:09:14.724 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2024-04-01T16:09:14.724 INFO:teuthology.orchestra.run.smithi081.stdout:LOGO="fedora-logo-icon" 2024-04-01T16:09:14.724 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T16:09:14.724 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/" 2024-04-01T16:09:14.724 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T16:09:14.724 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T16:09:14.724 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T16:09:14.724 INFO:teuthology.provision.fog.smithi081:Deploy complete! 2024-04-01T16:09:14.724 DEBUG:teuthology.parallel:result is None 2024-04-01T16:09:14.926 INFO:teuthology.lock.ops:Checking smithi081.front.sepia.ceph.com 2024-04-01T16:09:14.926 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-01T16:09:14.948 INFO:teuthology.lock.ops:Checking smithi119.front.sepia.ceph.com 2024-04-01T16:09:14.948 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-01T16:09:14.964 INFO:teuthology.lock.ops:Checking smithi188.front.sepia.ceph.com 2024-04-01T16:09:14.964 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-01T16:09:14.982 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: set os type and version on server 2024-04-01T16:09:14.982 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-04-01T16:09:14.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:09:15.070 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-04-01T16:09:15.136 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-04-01T16:09:15.136 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2024-04-01T16:09:15.190 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2024-04-01T16:09:15.190 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2024-04-01T16:09:15.244 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream" 2024-04-01T16:09:15.244 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="9" 2024-04-01T16:09:15.244 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos" 2024-04-01T16:09:15.244 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora" 2024-04-01T16:09:15.244 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="9" 2024-04-01T16:09:15.244 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el9" 2024-04-01T16:09:15.244 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T16:09:15.245 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2024-04-01T16:09:15.245 INFO:teuthology.orchestra.run.smithi081.stdout:LOGO="fedora-logo-icon" 2024-04-01T16:09:15.245 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T16:09:15.245 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/" 2024-04-01T16:09:15.245 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T16:09:15.245 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T16:09:15.245 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T16:09:15.245 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2024-04-01T16:09:15.265 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: set os type and version on server 2024-04-01T16:09:15.265 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-04-01T16:09:15.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:09:15.350 DEBUG:teuthology.orchestra.run.smithi119:> true 2024-04-01T16:09:15.416 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-04-01T16:09:15.416 DEBUG:teuthology.orchestra.run.smithi119:> uname -m 2024-04-01T16:09:15.470 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2024-04-01T16:09:15.470 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2024-04-01T16:09:15.524 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream" 2024-04-01T16:09:15.524 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="9" 2024-04-01T16:09:15.524 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos" 2024-04-01T16:09:15.524 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora" 2024-04-01T16:09:15.524 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="9" 2024-04-01T16:09:15.524 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el9" 2024-04-01T16:09:15.524 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T16:09:15.524 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2024-04-01T16:09:15.525 INFO:teuthology.orchestra.run.smithi119.stdout:LOGO="fedora-logo-icon" 2024-04-01T16:09:15.525 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T16:09:15.525 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/" 2024-04-01T16:09:15.525 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T16:09:15.525 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T16:09:15.525 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T16:09:15.525 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2024-04-01T16:09:15.556 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: set os type and version on server 2024-04-01T16:09:15.556 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-04-01T16:09:15.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:09:15.641 DEBUG:teuthology.orchestra.run.smithi188:> true 2024-04-01T16:09:15.808 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-04-01T16:09:15.808 DEBUG:teuthology.orchestra.run.smithi188:> uname -m 2024-04-01T16:09:15.862 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64 2024-04-01T16:09:15.862 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2024-04-01T16:09:15.917 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="CentOS Stream" 2024-04-01T16:09:15.917 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="9" 2024-04-01T16:09:15.917 INFO:teuthology.orchestra.run.smithi188.stdout:ID="centos" 2024-04-01T16:09:15.917 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="rhel fedora" 2024-04-01T16:09:15.917 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="9" 2024-04-01T16:09:15.917 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el9" 2024-04-01T16:09:15.917 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T16:09:15.917 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31" 2024-04-01T16:09:15.917 INFO:teuthology.orchestra.run.smithi188.stdout:LOGO="fedora-logo-icon" 2024-04-01T16:09:15.917 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T16:09:15.917 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://centos.org/" 2024-04-01T16:09:15.917 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T16:09:15.918 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T16:09:15.918 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T16:09:15.918 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2024-04-01T16:09:15.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T16:09:16.023 INFO:teuthology.dispatcher.supervisor:Running job 7633956 2024-04-01T16:09:16.023 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633956 --name vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/pjd}} -- /home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633956/orig.config.yaml 2024-04-01T16:09:16.026 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633956 2024-04-01T16:09:16.026 INFO:teuthology.dispatcher.supervisor:Job PID: 3320502 2024-04-01T16:09:16.026 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-01T16:11:16.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T16:13:16.244 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T16:15:16.410 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T16:17:16.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T16:19:16.770 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T16:21:16.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T16:23:17.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T16:25:17.266 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T16:27:17.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T16:29:17.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T16:29:17.665 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1