2024-04-01T16:35:13.814 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-04-01T16:35:13.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T16:35:13.989 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f312eba9c10>, signals=[15]) 2024-04-01T16:35:13.990 INFO:teuthology.lock.ops:Start node 'smithi112.front.sepia.ceph.com' reimaging 2024-04-01T16:35:13.990 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: reset os type and version on server 2024-04-01T16:35:13.990 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2024-04-01T16:35:14.014 INFO:teuthology.lock.ops:Start node 'smithi138.front.sepia.ceph.com' reimaging 2024-04-01T16:35:14.014 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: reset os type and version on server 2024-04-01T16:35:14.014 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2024-04-01T16:35:14.038 INFO:teuthology.lock.ops:Start node 'smithi187.front.sepia.ceph.com' reimaging 2024-04-01T16:35:14.038 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: reset os type and version on server 2024-04-01T16:35:14.038 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2024-04-01T16:35:14.124 DEBUG:teuthology.provision.fog.smithi112:Requesting image smithi_centos_9.stream (ID 10) 2024-04-01T16:35:14.135 DEBUG:teuthology.provision.fog.smithi138:Requesting image smithi_centos_9.stream (ID 10) 2024-04-01T16:35:14.175 INFO:teuthology.provision.fog.smithi112:Scheduling deploy of centos 9.stream 2024-04-01T16:35:14.178 DEBUG:teuthology.provision.fog.smithi187:Requesting image smithi_centos_9.stream (ID 10) 2024-04-01T16:35:14.181 INFO:teuthology.provision.fog.smithi138:Scheduling deploy of centos 9.stream 2024-04-01T16:35:14.220 INFO:teuthology.provision.fog.smithi187:Scheduling deploy of centos 9.stream 2024-04-01T16:35:14.492 INFO:teuthology.orchestra.console.smithi138:Power off 2024-04-01T16:35:14.493 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T16:35:14.508 INFO:teuthology.orchestra.console.smithi112:Power off 2024-04-01T16:35:14.509 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T16:35:14.524 DEBUG:teuthology.orchestra.console.smithi138:power off output: Chassis Power Control: Down/Off 2024-04-01T16:35:14.525 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T16:35:14.534 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off 2024-04-01T16:35:14.534 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T16:35:14.546 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2024-04-01T16:35:14.559 INFO:teuthology.orchestra.console.smithi187:Power off 2024-04-01T16:35:14.560 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T16:35:14.567 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2024-04-01T16:35:14.580 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off 2024-04-01T16:35:14.580 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T16:35:14.600 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2024-04-01T16:35:14.648 INFO:teuthology.orchestra.console.smithi138:Power off completed 2024-04-01T16:35:14.668 INFO:teuthology.orchestra.console.smithi112:Power off completed 2024-04-01T16:35:14.701 INFO:teuthology.orchestra.console.smithi187:Power off completed 2024-04-01T16:35:14.749 INFO:teuthology.orchestra.console.smithi138:Power on 2024-04-01T16:35:14.749 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-01T16:35:14.769 INFO:teuthology.orchestra.console.smithi112:Power on 2024-04-01T16:35:14.770 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-01T16:35:14.780 DEBUG:teuthology.orchestra.console.smithi138:power on output: Chassis Power Control: Up/On 2024-04-01T16:35:14.781 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T16:35:14.794 DEBUG:teuthology.orchestra.console.smithi112:power on output: Chassis Power Control: Up/On 2024-04-01T16:35:14.795 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T16:35:14.802 INFO:teuthology.orchestra.console.smithi187:Power on 2024-04-01T16:35:14.802 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-01T16:35:14.811 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2024-04-01T16:35:14.814 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2024-04-01T16:35:14.824 DEBUG:teuthology.orchestra.console.smithi187:power on output: Chassis Power Control: Up/On 2024-04-01T16:35:14.824 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T16:35:14.847 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2024-04-01T16:35:18.815 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T16:35:18.822 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T16:35:18.849 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T16:35:18.925 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2024-04-01T16:35:18.931 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2024-04-01T16:35:18.957 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2024-04-01T16:35:22.927 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T16:35:22.935 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T16:35:22.959 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T16:35:23.038 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2024-04-01T16:35:23.044 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2024-04-01T16:35:23.139 INFO:teuthology.orchestra.console.smithi138:Power on completed 2024-04-01T16:35:23.144 INFO:teuthology.orchestra.console.smithi112:Power on completed 2024-04-01T16:35:23.180 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2024-04-01T16:35:23.240 INFO:teuthology.provision.fog.smithi138:Waiting for deploy to finish 2024-04-01T16:35:23.245 INFO:teuthology.provision.fog.smithi112:Waiting for deploy to finish 2024-04-01T16:35:23.281 INFO:teuthology.orchestra.console.smithi187:Power on completed 2024-04-01T16:35:23.382 INFO:teuthology.provision.fog.smithi187:Waiting for deploy to finish 2024-04-01T16:37:54.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:37:57.502 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-04-01T16:38:03.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:38:06.590 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-04-01T16:38:12.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:38:15.646 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-04-01T16:38:21.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:38:24.702 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-04-01T16:38:30.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:38:33.790 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-04-01T16:38:39.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:38:42.846 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-04-01T16:38:48.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:38:54.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:38:57.726 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-04-01T16:39:03.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:39:06.782 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-04-01T16:39:07.294 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-04-01T16:39:12.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:39:13.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:39:15.838 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-04-01T16:39:16.350 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-04-01T16:39:21.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:39:22.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:39:24.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:39:24.926 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-04-01T16:39:25.406 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-04-01T16:39:27.838 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-04-01T16:39:30.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:39:31.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:39:32.460 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-01T16:39:32.460 DEBUG:teuthology.orchestra.run.smithi138:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-01T16:39:33.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:39:33.982 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-04-01T16:39:36.894 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-04-01T16:39:39.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:39:42.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:39:45.954 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-04-01T16:39:51.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:39:52.802 INFO:teuthology.provision.fog.smithi138:Node is ready 2024-04-01T16:39:52.802 DEBUG:teuthology.orchestra.run.smithi138:> hostname 2024-04-01T16:39:52.861 INFO:teuthology.orchestra.run.smithi138.stdout:smithi046 2024-04-01T16:39:52.861 DEBUG:teuthology.orchestra.run.smithi138:> grep smithi046 /etc/hosts 2024-04-01T16:39:52.918 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-04-01T16:39:52.919 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138 2024-04-01T16:39:53.081 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi046/smithi138/g' /etc/hosts 2024-04-01T16:39:53.112 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/172.21.15.46/172.21.15.138/g' /etc/hosts 2024-04-01T16:39:53.180 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi046/smithi138/g' /etc/hostname 2024-04-01T16:39:53.250 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138 2024-04-01T16:39:53.318 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2024-04-01T16:39:53.377 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="CentOS Stream" 2024-04-01T16:39:53.377 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="9" 2024-04-01T16:39:53.377 INFO:teuthology.orchestra.run.smithi138.stdout:ID="centos" 2024-04-01T16:39:53.377 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="rhel fedora" 2024-04-01T16:39:53.377 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="9" 2024-04-01T16:39:53.377 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el9" 2024-04-01T16:39:53.378 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T16:39:53.378 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31" 2024-04-01T16:39:53.378 INFO:teuthology.orchestra.run.smithi138.stdout:LOGO="fedora-logo-icon" 2024-04-01T16:39:53.378 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T16:39:53.378 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://centos.org/" 2024-04-01T16:39:53.378 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T16:39:53.378 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T16:39:53.378 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T16:39:53.379 INFO:teuthology.provision.fog.smithi138:Deploy complete! 2024-04-01T16:39:53.380 DEBUG:teuthology.parallel:result is None 2024-04-01T16:39:55.006 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-04-01T16:40:01.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:40:04.094 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-04-01T16:40:10.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:40:13.182 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-04-01T16:40:19.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:40:40.004 WARNING:teuthology.provision.fog.smithi187:timed out 2024-04-01T16:40:46.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:40:46.271 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-01T16:40:46.271 DEBUG:teuthology.orchestra.run.smithi187:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-01T16:40:46.610 INFO:teuthology.provision.fog.smithi187:Node is ready 2024-04-01T16:40:46.611 DEBUG:teuthology.orchestra.run.smithi187:> hostname 2024-04-01T16:40:46.625 INFO:teuthology.orchestra.run.smithi187.stdout:smithi187.front.sepia.ceph.com 2024-04-01T16:40:46.625 DEBUG:teuthology.orchestra.run.smithi187:> grep smithi187.front.sepia.ceph.com /etc/hosts 2024-04-01T16:40:46.680 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.15.187 smithi187.front.sepia.ceph.com smithi187 2024-04-01T16:40:46.681 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2024-04-01T16:40:46.777 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hosts 2024-04-01T16:40:46.805 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/172.21.15.187/172.21.15.187/g' /etc/hosts 2024-04-01T16:40:46.872 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hostname 2024-04-01T16:40:46.939 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2024-04-01T16:40:47.005 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2024-04-01T16:40:47.059 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream" 2024-04-01T16:40:47.059 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="9" 2024-04-01T16:40:47.059 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos" 2024-04-01T16:40:47.059 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora" 2024-04-01T16:40:47.059 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="9" 2024-04-01T16:40:47.059 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el9" 2024-04-01T16:40:47.059 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T16:40:47.059 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2024-04-01T16:40:47.059 INFO:teuthology.orchestra.run.smithi187.stdout:LOGO="fedora-logo-icon" 2024-04-01T16:40:47.059 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T16:40:47.060 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/" 2024-04-01T16:40:47.060 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T16:40:47.060 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T16:40:47.060 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T16:40:47.060 INFO:teuthology.provision.fog.smithi187:Deploy complete! 2024-04-01T16:40:47.061 DEBUG:teuthology.parallel:result is None 2024-04-01T16:41:19.211 WARNING:teuthology.provision.fog.smithi112:timed out 2024-04-01T16:41:25.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:41:25.458 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-01T16:41:25.458 DEBUG:teuthology.orchestra.run.smithi112:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-01T16:41:25.783 INFO:teuthology.provision.fog.smithi112:Node is ready 2024-04-01T16:41:25.783 DEBUG:teuthology.orchestra.run.smithi112:> hostname 2024-04-01T16:41:25.797 INFO:teuthology.orchestra.run.smithi112.stdout:smithi112.front.sepia.ceph.com 2024-04-01T16:41:25.798 DEBUG:teuthology.orchestra.run.smithi112:> grep smithi112.front.sepia.ceph.com /etc/hosts 2024-04-01T16:41:25.853 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112 smithi112.front.sepia.ceph.com smithi112 2024-04-01T16:41:25.853 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112 2024-04-01T16:41:25.952 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hosts 2024-04-01T16:41:25.980 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/172.21.15.112/172.21.15.112/g' /etc/hosts 2024-04-01T16:41:26.049 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hostname 2024-04-01T16:41:26.117 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112 2024-04-01T16:41:26.183 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2024-04-01T16:41:26.237 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2024-04-01T16:41:26.237 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="9" 2024-04-01T16:41:26.237 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2024-04-01T16:41:26.237 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2024-04-01T16:41:26.237 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="9" 2024-04-01T16:41:26.237 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el9" 2024-04-01T16:41:26.237 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T16:41:26.238 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2024-04-01T16:41:26.238 INFO:teuthology.orchestra.run.smithi112.stdout:LOGO="fedora-logo-icon" 2024-04-01T16:41:26.238 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T16:41:26.238 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2024-04-01T16:41:26.238 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T16:41:26.238 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T16:41:26.238 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T16:41:26.238 INFO:teuthology.provision.fog.smithi112:Deploy complete! 2024-04-01T16:41:26.239 DEBUG:teuthology.parallel:result is None 2024-04-01T16:41:26.467 INFO:teuthology.lock.ops:Checking smithi112.front.sepia.ceph.com 2024-04-01T16:41:26.467 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-01T16:41:26.485 INFO:teuthology.lock.ops:Checking smithi138.front.sepia.ceph.com 2024-04-01T16:41:26.485 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-01T16:41:26.501 INFO:teuthology.lock.ops:Checking smithi187.front.sepia.ceph.com 2024-04-01T16:41:26.501 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-01T16:41:26.519 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: set os type and version on server 2024-04-01T16:41:26.519 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-04-01T16:41:26.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:41:26.607 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-04-01T16:41:26.672 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-04-01T16:41:26.672 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2024-04-01T16:41:26.726 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2024-04-01T16:41:26.727 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2024-04-01T16:41:26.780 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2024-04-01T16:41:26.780 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="9" 2024-04-01T16:41:26.780 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2024-04-01T16:41:26.780 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2024-04-01T16:41:26.780 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="9" 2024-04-01T16:41:26.780 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el9" 2024-04-01T16:41:26.781 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T16:41:26.781 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2024-04-01T16:41:26.781 INFO:teuthology.orchestra.run.smithi112.stdout:LOGO="fedora-logo-icon" 2024-04-01T16:41:26.781 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T16:41:26.781 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2024-04-01T16:41:26.781 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T16:41:26.781 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T16:41:26.781 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T16:41:26.782 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2024-04-01T16:41:26.801 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: set os type and version on server 2024-04-01T16:41:26.802 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-04-01T16:41:26.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:41:26.889 DEBUG:teuthology.orchestra.run.smithi138:> true 2024-04-01T16:41:27.060 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-04-01T16:41:27.061 DEBUG:teuthology.orchestra.run.smithi138:> uname -m 2024-04-01T16:41:27.115 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2024-04-01T16:41:27.115 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2024-04-01T16:41:27.169 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="CentOS Stream" 2024-04-01T16:41:27.169 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="9" 2024-04-01T16:41:27.169 INFO:teuthology.orchestra.run.smithi138.stdout:ID="centos" 2024-04-01T16:41:27.169 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="rhel fedora" 2024-04-01T16:41:27.169 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="9" 2024-04-01T16:41:27.169 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el9" 2024-04-01T16:41:27.169 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T16:41:27.169 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31" 2024-04-01T16:41:27.170 INFO:teuthology.orchestra.run.smithi138.stdout:LOGO="fedora-logo-icon" 2024-04-01T16:41:27.170 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T16:41:27.170 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://centos.org/" 2024-04-01T16:41:27.170 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T16:41:27.170 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T16:41:27.170 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T16:41:27.170 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2024-04-01T16:41:27.193 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: set os type and version on server 2024-04-01T16:41:27.193 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-04-01T16:41:27.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:41:27.281 DEBUG:teuthology.orchestra.run.smithi187:> true 2024-04-01T16:41:27.448 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-04-01T16:41:27.448 DEBUG:teuthology.orchestra.run.smithi187:> uname -m 2024-04-01T16:41:27.503 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2024-04-01T16:41:27.503 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2024-04-01T16:41:27.559 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream" 2024-04-01T16:41:27.559 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="9" 2024-04-01T16:41:27.559 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos" 2024-04-01T16:41:27.559 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora" 2024-04-01T16:41:27.559 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="9" 2024-04-01T16:41:27.559 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el9" 2024-04-01T16:41:27.559 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T16:41:27.559 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2024-04-01T16:41:27.559 INFO:teuthology.orchestra.run.smithi187.stdout:LOGO="fedora-logo-icon" 2024-04-01T16:41:27.559 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T16:41:27.560 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/" 2024-04-01T16:41:27.560 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T16:41:27.560 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T16:41:27.560 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T16:41:27.560 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2024-04-01T16:41:27.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T16:41:27.684 INFO:teuthology.dispatcher.supervisor:Running job 7633989 2024-04-01T16:41:27.684 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-04-01_14:11:32-fs-wip-vshankar-testing-20240330.172700-testing-default-smithi/7633989 --name vshankar-2024-04-01_14:11:32-fs-wip-vshankar-testing-20240330.172700-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/fs/misc}} -- /home/teuthworker/archive/vshankar-2024-04-01_14:11:32-fs-wip-vshankar-testing-20240330.172700-testing-default-smithi/7633989/orig.config.yaml 2024-04-01T16:41:27.687 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-04-01_14:11:32-fs-wip-vshankar-testing-20240330.172700-testing-default-smithi/7633989 2024-04-01T16:41:27.687 INFO:teuthology.dispatcher.supervisor:Job PID: 3455750 2024-04-01T16:41:27.687 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-01T16:43:27.780 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T16:45:27.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T16:47:28.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T16:49:28.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T16:51:28.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T16:53:28.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T16:55:31.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T16:57:31.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T16:59:31.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T16:59:31.873 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1