2024-04-17T14:39:45.780 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-17T14:39:45.780 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T14:39:45.948 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f355ded9c10>, signals=[15]) 2024-04-17T14:39:45.948 INFO:teuthology.lock.ops:Start node 'smithi122.front.sepia.ceph.com' reimaging 2024-04-17T14:39:45.949 INFO:teuthology.lock.ops:Updating [smithi122.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T14:39:45.949 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server 2024-04-17T14:39:45.966 INFO:teuthology.lock.ops:Start node 'smithi139.front.sepia.ceph.com' reimaging 2024-04-17T14:39:45.966 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T14:39:45.966 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2024-04-17T14:39:45.990 INFO:teuthology.lock.ops:Start node 'smithi189.front.sepia.ceph.com' reimaging 2024-04-17T14:39:45.991 INFO:teuthology.lock.ops:Updating [smithi189.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T14:39:45.991 INFO:teuthology.lock.ops:Updating smithi189.front.sepia.ceph.com on lock server 2024-04-17T14:39:46.063 DEBUG:teuthology.provision.fog.smithi122:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T14:39:46.092 DEBUG:teuthology.provision.fog.smithi139:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T14:39:46.102 DEBUG:teuthology.provision.fog.smithi189:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T14:39:46.111 INFO:teuthology.provision.fog.smithi122:Scheduling deploy of centos 9.stream 2024-04-17T14:39:46.138 INFO:teuthology.provision.fog.smithi139:Scheduling deploy of centos 9.stream 2024-04-17T14:39:46.142 INFO:teuthology.provision.fog.smithi189:Scheduling deploy of centos 9.stream 2024-04-17T14:39:46.408 INFO:teuthology.orchestra.console.smithi122:Power off 2024-04-17T14:39:46.408 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T14:39:46.421 INFO:teuthology.orchestra.console.smithi139:Power off 2024-04-17T14:39:46.422 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T14:39:46.435 INFO:teuthology.orchestra.console.smithi189:Power off 2024-04-17T14:39:46.435 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T14:39:46.442 DEBUG:teuthology.orchestra.console.smithi122:power off output: Chassis Power Control: Down/Off 2024-04-17T14:39:46.443 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:39:46.450 DEBUG:teuthology.orchestra.console.smithi139:power off output: Chassis Power Control: Down/Off 2024-04-17T14:39:46.450 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:39:46.458 DEBUG:teuthology.orchestra.console.smithi189:power off output: Chassis Power Control: Down/Off 2024-04-17T14:39:46.459 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:39:46.466 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is off 2024-04-17T14:39:46.473 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2024-04-17T14:39:46.478 DEBUG:teuthology.orchestra.console.smithi189:check power output: Chassis Power is off 2024-04-17T14:39:46.567 INFO:teuthology.orchestra.console.smithi122:Power off completed 2024-04-17T14:39:46.574 INFO:teuthology.orchestra.console.smithi139:Power off completed 2024-04-17T14:39:46.579 INFO:teuthology.orchestra.console.smithi189:Power off completed 2024-04-17T14:39:46.668 INFO:teuthology.orchestra.console.smithi122:Power on 2024-04-17T14:39:46.668 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T14:39:46.679 INFO:teuthology.orchestra.console.smithi139:Power on 2024-04-17T14:39:46.680 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T14:39:46.687 INFO:teuthology.orchestra.console.smithi189:Power on 2024-04-17T14:39:46.687 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T14:39:46.696 DEBUG:teuthology.orchestra.console.smithi122:power on output: Chassis Power Control: Up/On 2024-04-17T14:39:46.696 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:39:46.704 DEBUG:teuthology.orchestra.console.smithi139:power on output: Chassis Power Control: Up/On 2024-04-17T14:39:46.705 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:39:46.711 DEBUG:teuthology.orchestra.console.smithi189:power on output: Chassis Power Control: Up/On 2024-04-17T14:39:46.712 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:39:46.720 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is off 2024-04-17T14:39:46.726 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2024-04-17T14:39:46.733 DEBUG:teuthology.orchestra.console.smithi189:check power output: Chassis Power is off 2024-04-17T14:39:50.725 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:39:50.733 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:39:50.740 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:39:50.835 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is on 2024-04-17T14:39:50.842 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2024-04-17T14:39:50.849 DEBUG:teuthology.orchestra.console.smithi189:check power output: Chassis Power is on 2024-04-17T14:39:50.936 INFO:teuthology.orchestra.console.smithi122:Power on completed 2024-04-17T14:39:50.943 INFO:teuthology.orchestra.console.smithi139:Power on completed 2024-04-17T14:39:50.950 INFO:teuthology.orchestra.console.smithi189:Power on completed 2024-04-17T14:39:51.037 INFO:teuthology.provision.fog.smithi122:Waiting for deploy to finish 2024-04-17T14:39:51.043 INFO:teuthology.provision.fog.smithi139:Waiting for deploy to finish 2024-04-17T14:39:51.051 INFO:teuthology.provision.fog.smithi189:Waiting for deploy to finish 2024-04-17T14:43:10.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:43:13.822 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-04-17T14:43:19.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:43:22.910 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-04-17T14:43:28.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:43:31.966 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-04-17T14:43:37.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:43:41.054 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-04-17T14:43:47.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:43:50.142 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-04-17T14:43:56.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:43:59.198 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-04-17T14:44:05.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:44:08.254 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-04-17T14:44:14.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:44:32.670 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-04-17T14:44:38.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:44:41.758 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-04-17T14:44:47.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:44:50.846 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-04-17T14:44:56.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:44:57.064 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T14:44:57.064 DEBUG:teuthology.orchestra.run.smithi189:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T14:45:12.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:45:15.294 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2024-04-17T14:45:17.485 INFO:teuthology.provision.fog.smithi189:Node is ready 2024-04-17T14:45:17.485 DEBUG:teuthology.orchestra.run.smithi189:> hostname 2024-04-17T14:45:17.544 INFO:teuthology.orchestra.run.smithi189.stdout:smithi189.front.sepia.ceph.com 2024-04-17T14:45:17.544 DEBUG:teuthology.orchestra.run.smithi189:> grep smithi189.front.sepia.ceph.com /etc/hosts 2024-04-17T14:45:17.602 INFO:teuthology.orchestra.run.smithi189.stdout:172.21.15.189 smithi189.front.sepia.ceph.com smithi189 2024-04-17T14:45:17.602 DEBUG:teuthology.orchestra.run.smithi189:> sudo hostname smithi189 2024-04-17T14:45:17.902 DEBUG:teuthology.orchestra.run.smithi189:> sudo sed -i -e 's/smithi189.front.sepia.ceph.com/smithi189/g' /etc/hosts 2024-04-17T14:45:17.933 DEBUG:teuthology.orchestra.run.smithi189:> sudo sed -i -e 's/172.21.15.189/172.21.15.189/g' /etc/hosts 2024-04-17T14:45:18.003 DEBUG:teuthology.orchestra.run.smithi189:> sudo sed -i -e 's/smithi189.front.sepia.ceph.com/smithi189/g' /etc/hostname 2024-04-17T14:45:18.072 DEBUG:teuthology.orchestra.run.smithi189:> sudo hostname smithi189 2024-04-17T14:45:18.142 DEBUG:teuthology.orchestra.run.smithi189:> cat /etc/os-release 2024-04-17T14:45:18.197 INFO:teuthology.orchestra.run.smithi189.stdout:NAME="CentOS Stream" 2024-04-17T14:45:18.197 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION="9" 2024-04-17T14:45:18.198 INFO:teuthology.orchestra.run.smithi189.stdout:ID="centos" 2024-04-17T14:45:18.198 INFO:teuthology.orchestra.run.smithi189.stdout:ID_LIKE="rhel fedora" 2024-04-17T14:45:18.198 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION_ID="9" 2024-04-17T14:45:18.198 INFO:teuthology.orchestra.run.smithi189.stdout:PLATFORM_ID="platform:el9" 2024-04-17T14:45:18.198 INFO:teuthology.orchestra.run.smithi189.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T14:45:18.198 INFO:teuthology.orchestra.run.smithi189.stdout:ANSI_COLOR="0;31" 2024-04-17T14:45:18.198 INFO:teuthology.orchestra.run.smithi189.stdout:LOGO="fedora-logo-icon" 2024-04-17T14:45:18.198 INFO:teuthology.orchestra.run.smithi189.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T14:45:18.198 INFO:teuthology.orchestra.run.smithi189.stdout:HOME_URL="https://centos.org/" 2024-04-17T14:45:18.198 INFO:teuthology.orchestra.run.smithi189.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T14:45:18.198 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T14:45:18.198 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T14:45:18.199 INFO:teuthology.provision.fog.smithi189:Deploy complete! 2024-04-17T14:45:18.200 DEBUG:teuthology.parallel:result is None 2024-04-17T14:45:21.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:45:24.350 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2024-04-17T14:45:30.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:45:33.406 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2024-04-17T14:45:39.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:45:42.494 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2024-04-17T14:45:48.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:45:51.582 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2024-04-17T14:45:57.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:46:00.642 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2024-04-17T14:46:06.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:46:25.054 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2024-04-17T14:46:31.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:46:34.110 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2024-04-17T14:46:40.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:46:43.198 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2024-04-17T14:46:49.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:46:49.461 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T14:46:49.461 DEBUG:teuthology.orchestra.run.smithi139:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T14:47:05.002 INFO:teuthology.provision.fog.smithi139:Node is ready 2024-04-17T14:47:05.002 DEBUG:teuthology.orchestra.run.smithi139:> hostname 2024-04-17T14:47:05.019 INFO:teuthology.orchestra.run.smithi139.stdout:smithi046 2024-04-17T14:47:05.020 DEBUG:teuthology.orchestra.run.smithi139:> grep smithi046 /etc/hosts 2024-04-17T14:47:05.077 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-04-17T14:47:05.077 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2024-04-17T14:47:05.206 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi046/smithi139/g' /etc/hosts 2024-04-17T14:47:05.236 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/172.21.15.46/172.21.15.139/g' /etc/hosts 2024-04-17T14:47:05.306 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi046/smithi139/g' /etc/hostname 2024-04-17T14:47:05.374 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2024-04-17T14:47:05.441 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2024-04-17T14:47:05.496 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="CentOS Stream" 2024-04-17T14:47:05.496 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="9" 2024-04-17T14:47:05.496 INFO:teuthology.orchestra.run.smithi139.stdout:ID="centos" 2024-04-17T14:47:05.496 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="rhel fedora" 2024-04-17T14:47:05.496 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="9" 2024-04-17T14:47:05.496 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el9" 2024-04-17T14:47:05.496 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T14:47:05.496 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2024-04-17T14:47:05.496 INFO:teuthology.orchestra.run.smithi139.stdout:LOGO="fedora-logo-icon" 2024-04-17T14:47:05.496 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T14:47:05.496 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://centos.org/" 2024-04-17T14:47:05.496 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T14:47:05.497 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T14:47:05.497 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T14:47:05.497 INFO:teuthology.provision.fog.smithi139:Deploy complete! 2024-04-17T14:47:05.497 DEBUG:teuthology.parallel:result is None 2024-04-17T14:47:28.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:47:31.230 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-04-17T14:47:37.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:47:40.286 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-04-17T14:47:46.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:47:49.342 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-04-17T14:47:55.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:47:58.402 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-04-17T14:48:04.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:48:07.454 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-04-17T14:48:13.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:48:16.510 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-04-17T14:48:22.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:49:22.514 WARNING:teuthology.provision.fog.smithi122:timed out 2024-04-17T14:49:28.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:49:28.703 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T14:49:28.703 DEBUG:teuthology.orchestra.run.smithi122:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T14:49:29.023 INFO:teuthology.provision.fog.smithi122:Node is ready 2024-04-17T14:49:29.023 DEBUG:teuthology.orchestra.run.smithi122:> hostname 2024-04-17T14:49:29.038 INFO:teuthology.orchestra.run.smithi122.stdout:smithi122.front.sepia.ceph.com 2024-04-17T14:49:29.038 DEBUG:teuthology.orchestra.run.smithi122:> grep smithi122.front.sepia.ceph.com /etc/hosts 2024-04-17T14:49:29.093 INFO:teuthology.orchestra.run.smithi122.stdout:172.21.15.122 smithi122.front.sepia.ceph.com smithi122 2024-04-17T14:49:29.093 DEBUG:teuthology.orchestra.run.smithi122:> sudo hostname smithi122 2024-04-17T14:49:29.203 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i -e 's/smithi122.front.sepia.ceph.com/smithi122/g' /etc/hosts 2024-04-17T14:49:29.230 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i -e 's/172.21.15.122/172.21.15.122/g' /etc/hosts 2024-04-17T14:49:29.297 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i -e 's/smithi122.front.sepia.ceph.com/smithi122/g' /etc/hostname 2024-04-17T14:49:29.363 DEBUG:teuthology.orchestra.run.smithi122:> sudo hostname smithi122 2024-04-17T14:49:29.429 DEBUG:teuthology.orchestra.run.smithi122:> cat /etc/os-release 2024-04-17T14:49:29.484 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="CentOS Stream" 2024-04-17T14:49:29.484 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="9" 2024-04-17T14:49:29.484 INFO:teuthology.orchestra.run.smithi122.stdout:ID="centos" 2024-04-17T14:49:29.484 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE="rhel fedora" 2024-04-17T14:49:29.484 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="9" 2024-04-17T14:49:29.484 INFO:teuthology.orchestra.run.smithi122.stdout:PLATFORM_ID="platform:el9" 2024-04-17T14:49:29.484 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T14:49:29.484 INFO:teuthology.orchestra.run.smithi122.stdout:ANSI_COLOR="0;31" 2024-04-17T14:49:29.484 INFO:teuthology.orchestra.run.smithi122.stdout:LOGO="fedora-logo-icon" 2024-04-17T14:49:29.485 INFO:teuthology.orchestra.run.smithi122.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T14:49:29.485 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://centos.org/" 2024-04-17T14:49:29.485 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T14:49:29.485 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T14:49:29.485 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T14:49:29.485 INFO:teuthology.provision.fog.smithi122:Deploy complete! 2024-04-17T14:49:29.486 DEBUG:teuthology.parallel:result is None 2024-04-17T14:49:29.696 INFO:teuthology.lock.ops:Checking smithi122.front.sepia.ceph.com 2024-04-17T14:49:29.697 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T14:49:29.727 INFO:teuthology.lock.ops:Checking smithi139.front.sepia.ceph.com 2024-04-17T14:49:29.727 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T14:49:29.751 INFO:teuthology.lock.ops:Checking smithi189.front.sepia.ceph.com 2024-04-17T14:49:29.751 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T14:49:29.769 INFO:teuthology.lock.ops:Updating [smithi122.front.sepia.ceph.com]: set os type and version on server 2024-04-17T14:49:29.769 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-04-17T14:49:29.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:49:29.860 DEBUG:teuthology.orchestra.run.smithi122:> true 2024-04-17T14:49:29.928 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-04-17T14:49:29.928 DEBUG:teuthology.orchestra.run.smithi122:> uname -m 2024-04-17T14:49:29.982 INFO:teuthology.orchestra.run.smithi122.stdout:x86_64 2024-04-17T14:49:29.986 DEBUG:teuthology.orchestra.run.smithi122:> cat /etc/os-release 2024-04-17T14:49:30.036 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="CentOS Stream" 2024-04-17T14:49:30.036 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="9" 2024-04-17T14:49:30.036 INFO:teuthology.orchestra.run.smithi122.stdout:ID="centos" 2024-04-17T14:49:30.036 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE="rhel fedora" 2024-04-17T14:49:30.036 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="9" 2024-04-17T14:49:30.036 INFO:teuthology.orchestra.run.smithi122.stdout:PLATFORM_ID="platform:el9" 2024-04-17T14:49:30.037 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T14:49:30.037 INFO:teuthology.orchestra.run.smithi122.stdout:ANSI_COLOR="0;31" 2024-04-17T14:49:30.037 INFO:teuthology.orchestra.run.smithi122.stdout:LOGO="fedora-logo-icon" 2024-04-17T14:49:30.037 INFO:teuthology.orchestra.run.smithi122.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T14:49:30.037 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://centos.org/" 2024-04-17T14:49:30.037 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T14:49:30.037 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T14:49:30.037 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T14:49:30.037 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server 2024-04-17T14:49:30.068 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: set os type and version on server 2024-04-17T14:49:30.068 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-04-17T14:49:30.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:49:30.157 DEBUG:teuthology.orchestra.run.smithi139:> true 2024-04-17T14:49:30.228 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-04-17T14:49:30.228 DEBUG:teuthology.orchestra.run.smithi139:> uname -m 2024-04-17T14:49:30.285 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2024-04-17T14:49:30.285 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2024-04-17T14:49:30.342 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="CentOS Stream" 2024-04-17T14:49:30.342 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="9" 2024-04-17T14:49:30.342 INFO:teuthology.orchestra.run.smithi139.stdout:ID="centos" 2024-04-17T14:49:30.342 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="rhel fedora" 2024-04-17T14:49:30.342 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="9" 2024-04-17T14:49:30.342 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el9" 2024-04-17T14:49:30.342 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T14:49:30.342 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2024-04-17T14:49:30.342 INFO:teuthology.orchestra.run.smithi139.stdout:LOGO="fedora-logo-icon" 2024-04-17T14:49:30.342 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T14:49:30.342 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://centos.org/" 2024-04-17T14:49:30.343 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T14:49:30.343 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T14:49:30.343 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T14:49:30.343 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2024-04-17T14:49:30.368 INFO:teuthology.lock.ops:Updating [smithi189.front.sepia.ceph.com]: set os type and version on server 2024-04-17T14:49:30.368 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-04-17T14:49:30.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:49:30.458 DEBUG:teuthology.orchestra.run.smithi189:> true 2024-04-17T14:49:30.629 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-04-17T14:49:30.629 DEBUG:teuthology.orchestra.run.smithi189:> uname -m 2024-04-17T14:49:30.683 INFO:teuthology.orchestra.run.smithi189.stdout:x86_64 2024-04-17T14:49:30.683 DEBUG:teuthology.orchestra.run.smithi189:> cat /etc/os-release 2024-04-17T14:49:30.738 INFO:teuthology.orchestra.run.smithi189.stdout:NAME="CentOS Stream" 2024-04-17T14:49:30.738 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION="9" 2024-04-17T14:49:30.738 INFO:teuthology.orchestra.run.smithi189.stdout:ID="centos" 2024-04-17T14:49:30.738 INFO:teuthology.orchestra.run.smithi189.stdout:ID_LIKE="rhel fedora" 2024-04-17T14:49:30.738 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION_ID="9" 2024-04-17T14:49:30.739 INFO:teuthology.orchestra.run.smithi189.stdout:PLATFORM_ID="platform:el9" 2024-04-17T14:49:30.739 INFO:teuthology.orchestra.run.smithi189.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T14:49:30.739 INFO:teuthology.orchestra.run.smithi189.stdout:ANSI_COLOR="0;31" 2024-04-17T14:49:30.739 INFO:teuthology.orchestra.run.smithi189.stdout:LOGO="fedora-logo-icon" 2024-04-17T14:49:30.739 INFO:teuthology.orchestra.run.smithi189.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T14:49:30.739 INFO:teuthology.orchestra.run.smithi189.stdout:HOME_URL="https://centos.org/" 2024-04-17T14:49:30.739 INFO:teuthology.orchestra.run.smithi189.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T14:49:30.739 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T14:49:30.739 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T14:49:30.739 INFO:teuthology.lock.ops:Updating smithi189.front.sepia.ceph.com on lock server 2024-04-17T14:49:30.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T14:49:30.881 INFO:teuthology.dispatcher.supervisor:Running job 7660346 2024-04-17T14:49:30.881 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660346 --name rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/fs/test_o_trunc}} -- /home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660346/orig.config.yaml 2024-04-17T14:49:30.884 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660346 2024-04-17T14:49:30.885 INFO:teuthology.dispatcher.supervisor:Job PID: 1519346 2024-04-17T14:49:30.885 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-17T14:51:30.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T14:53:31.150 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T14:55:31.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T14:57:31.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T14:59:31.652 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T15:01:31.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T15:03:32.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T15:05:32.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T15:05:32.261 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1