2024-04-18T09:15:21.652 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-18T09:15:21.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T09:15:21.814 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fed8fc28c10>, signals=[15]) 2024-04-18T09:15:21.814 INFO:teuthology.lock.ops:Start node 'smithi006.front.sepia.ceph.com' reimaging 2024-04-18T09:15:21.815 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T09:15:21.815 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2024-04-18T09:15:21.835 INFO:teuthology.lock.ops:Start node 'smithi118.front.sepia.ceph.com' reimaging 2024-04-18T09:15:21.835 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T09:15:21.836 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2024-04-18T09:15:21.860 INFO:teuthology.lock.ops:Start node 'smithi122.front.sepia.ceph.com' reimaging 2024-04-18T09:15:21.860 INFO:teuthology.lock.ops:Updating [smithi122.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T09:15:21.860 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server 2024-04-18T09:15:21.946 DEBUG:teuthology.provision.fog.smithi006:Requesting image smithi_centos_9.stream (ID 10) 2024-04-18T09:15:21.964 DEBUG:teuthology.provision.fog.smithi118:Requesting image smithi_centos_9.stream (ID 10) 2024-04-18T09:15:21.980 DEBUG:teuthology.provision.fog.smithi122:Requesting image smithi_centos_9.stream (ID 10) 2024-04-18T09:15:21.987 INFO:teuthology.provision.fog.smithi006:Scheduling deploy of centos 9.stream 2024-04-18T09:15:22.011 INFO:teuthology.provision.fog.smithi118:Scheduling deploy of centos 9.stream 2024-04-18T09:15:22.015 INFO:teuthology.provision.fog.smithi122:Scheduling deploy of centos 9.stream 2024-04-18T09:15:22.342 INFO:teuthology.orchestra.console.smithi006:Power off 2024-04-18T09:15:22.343 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T09:15:22.360 INFO:teuthology.orchestra.console.smithi118:Power off 2024-04-18T09:15:22.361 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T09:15:22.374 INFO:teuthology.orchestra.console.smithi122:Power off 2024-04-18T09:15:22.375 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T09:15:22.383 DEBUG:teuthology.orchestra.console.smithi118:power off output: Chassis Power Control: Down/Off 2024-04-18T09:15:22.384 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T09:15:22.391 DEBUG:teuthology.orchestra.console.smithi006:power off output: Chassis Power Control: Down/Off 2024-04-18T09:15:22.391 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T09:15:22.400 DEBUG:teuthology.orchestra.console.smithi122:power off output: Chassis Power Control: Down/Off 2024-04-18T09:15:22.400 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T09:15:22.410 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off 2024-04-18T09:15:22.413 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2024-04-18T09:15:22.421 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is off 2024-04-18T09:15:22.512 INFO:teuthology.orchestra.console.smithi118:Power off completed 2024-04-18T09:15:22.514 INFO:teuthology.orchestra.console.smithi006:Power off completed 2024-04-18T09:15:22.523 INFO:teuthology.orchestra.console.smithi122:Power off completed 2024-04-18T09:15:22.613 INFO:teuthology.orchestra.console.smithi118:Power on 2024-04-18T09:15:22.613 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T09:15:22.621 INFO:teuthology.orchestra.console.smithi006:Power on 2024-04-18T09:15:22.621 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T09:15:22.628 INFO:teuthology.orchestra.console.smithi122:Power on 2024-04-18T09:15:22.628 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T09:15:22.638 DEBUG:teuthology.orchestra.console.smithi118:power on output: Chassis Power Control: Up/On 2024-04-18T09:15:22.639 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T09:15:22.648 DEBUG:teuthology.orchestra.console.smithi006:power on output: Chassis Power Control: Up/On 2024-04-18T09:15:22.649 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T09:15:22.658 DEBUG:teuthology.orchestra.console.smithi122:power on output: Chassis Power Control: Up/On 2024-04-18T09:15:22.658 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T09:15:22.668 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off 2024-04-18T09:15:22.671 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2024-04-18T09:15:22.683 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is off 2024-04-18T09:15:26.670 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T09:15:26.677 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T09:15:26.684 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T09:15:26.779 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on 2024-04-18T09:15:26.787 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2024-04-18T09:15:26.793 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is on 2024-04-18T09:15:26.880 INFO:teuthology.orchestra.console.smithi118:Power on completed 2024-04-18T09:15:26.894 INFO:teuthology.orchestra.console.smithi122:Power on completed 2024-04-18T09:15:26.981 INFO:teuthology.provision.fog.smithi118:Waiting for deploy to finish 2024-04-18T09:15:26.995 INFO:teuthology.provision.fog.smithi122:Waiting for deploy to finish 2024-04-18T09:15:30.790 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T09:15:30.978 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2024-04-18T09:15:31.079 INFO:teuthology.orchestra.console.smithi006:Power on completed 2024-04-18T09:15:31.180 INFO:teuthology.provision.fog.smithi006:Waiting for deploy to finish 2024-04-18T09:17:47.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:17:47.849 ERROR:teuthology.orchestra.connection:Error authenticating with smithi006.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-04-18T09:18:51.853 WARNING:teuthology.provision.fog.smithi006:timed out 2024-04-18T09:18:57.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:18:59.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:18:59.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:19:02.370 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-04-18T09:19:02.370 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-04-18T09:19:08.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:19:08.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:19:11.422 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-04-18T09:19:11.454 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-04-18T09:19:16.254 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-04-18T09:19:17.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:19:17.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:19:20.478 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-04-18T09:19:20.510 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-04-18T09:19:22.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:19:25.622 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T09:19:25.622 DEBUG:teuthology.orchestra.run.smithi006:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T09:19:26.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:19:26.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:19:29.534 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-04-18T09:19:29.566 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-04-18T09:19:35.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:19:35.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:19:38.594 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-04-18T09:19:38.622 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-04-18T09:19:41.841 INFO:teuthology.provision.fog.smithi006:Node is ready 2024-04-18T09:19:41.841 DEBUG:teuthology.orchestra.run.smithi006:> hostname 2024-04-18T09:19:41.860 INFO:teuthology.orchestra.run.smithi006.stdout:smithi046 2024-04-18T09:19:41.860 DEBUG:teuthology.orchestra.run.smithi006:> grep smithi046 /etc/hosts 2024-04-18T09:19:41.919 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-04-18T09:19:41.919 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname smithi006 2024-04-18T09:19:42.083 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi046/smithi006/g' /etc/hosts 2024-04-18T09:19:42.120 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/172.21.15.46/172.21.15.6/g' /etc/hosts 2024-04-18T09:19:42.194 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi046/smithi006/g' /etc/hostname 2024-04-18T09:19:42.268 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname smithi006 2024-04-18T09:19:42.340 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2024-04-18T09:19:42.395 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="CentOS Stream" 2024-04-18T09:19:42.396 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="9" 2024-04-18T09:19:42.396 INFO:teuthology.orchestra.run.smithi006.stdout:ID="centos" 2024-04-18T09:19:42.396 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="rhel fedora" 2024-04-18T09:19:42.396 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="9" 2024-04-18T09:19:42.396 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el9" 2024-04-18T09:19:42.396 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T09:19:42.396 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2024-04-18T09:19:42.396 INFO:teuthology.orchestra.run.smithi006.stdout:LOGO="fedora-logo-icon" 2024-04-18T09:19:42.396 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T09:19:42.396 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://centos.org/" 2024-04-18T09:19:42.396 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T09:19:42.396 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T09:19:42.396 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T09:19:42.397 INFO:teuthology.provision.fog.smithi006:Deploy complete! 2024-04-18T09:19:42.398 DEBUG:teuthology.parallel:result is None 2024-04-18T09:19:44.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:19:44.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:19:47.646 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-04-18T09:19:47.678 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-04-18T09:19:53.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:19:53.679 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:19:56.734 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-04-18T09:20:02.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:20:05.790 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-04-18T09:20:11.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:20:53.650 WARNING:teuthology.provision.fog.smithi122:timed out 2024-04-18T09:20:59.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:20:59.968 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T09:20:59.968 DEBUG:teuthology.orchestra.run.smithi122:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T09:21:00.314 INFO:teuthology.provision.fog.smithi122:Node is ready 2024-04-18T09:21:00.314 DEBUG:teuthology.orchestra.run.smithi122:> hostname 2024-04-18T09:21:00.331 INFO:teuthology.orchestra.run.smithi122.stdout:smithi122.front.sepia.ceph.com 2024-04-18T09:21:00.331 DEBUG:teuthology.orchestra.run.smithi122:> grep smithi122.front.sepia.ceph.com /etc/hosts 2024-04-18T09:21:00.388 INFO:teuthology.orchestra.run.smithi122.stdout:172.21.15.122 smithi122.front.sepia.ceph.com smithi122 2024-04-18T09:21:00.388 DEBUG:teuthology.orchestra.run.smithi122:> sudo hostname smithi122 2024-04-18T09:21:00.501 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i -e 's/smithi122.front.sepia.ceph.com/smithi122/g' /etc/hosts 2024-04-18T09:21:00.531 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i -e 's/172.21.15.122/172.21.15.122/g' /etc/hosts 2024-04-18T09:21:00.603 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i -e 's/smithi122.front.sepia.ceph.com/smithi122/g' /etc/hostname 2024-04-18T09:21:00.676 DEBUG:teuthology.orchestra.run.smithi122:> sudo hostname smithi122 2024-04-18T09:21:00.747 DEBUG:teuthology.orchestra.run.smithi122:> cat /etc/os-release 2024-04-18T09:21:00.805 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="CentOS Stream" 2024-04-18T09:21:00.805 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="9" 2024-04-18T09:21:00.805 INFO:teuthology.orchestra.run.smithi122.stdout:ID="centos" 2024-04-18T09:21:00.806 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE="rhel fedora" 2024-04-18T09:21:00.806 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="9" 2024-04-18T09:21:00.806 INFO:teuthology.orchestra.run.smithi122.stdout:PLATFORM_ID="platform:el9" 2024-04-18T09:21:00.806 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T09:21:00.806 INFO:teuthology.orchestra.run.smithi122.stdout:ANSI_COLOR="0;31" 2024-04-18T09:21:00.806 INFO:teuthology.orchestra.run.smithi122.stdout:LOGO="fedora-logo-icon" 2024-04-18T09:21:00.806 INFO:teuthology.orchestra.run.smithi122.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T09:21:00.806 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://centos.org/" 2024-04-18T09:21:00.806 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T09:21:00.806 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T09:21:00.806 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T09:21:00.807 INFO:teuthology.provision.fog.smithi122:Deploy complete! 2024-04-18T09:21:00.807 DEBUG:teuthology.parallel:result is None 2024-04-18T09:21:11.795 WARNING:teuthology.provision.fog.smithi118:timed out 2024-04-18T09:21:17.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:21:18.059 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T09:21:18.060 DEBUG:teuthology.orchestra.run.smithi118:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T09:21:18.415 INFO:teuthology.provision.fog.smithi118:Node is ready 2024-04-18T09:21:18.415 DEBUG:teuthology.orchestra.run.smithi118:> hostname 2024-04-18T09:21:18.430 INFO:teuthology.orchestra.run.smithi118.stdout:smithi118.front.sepia.ceph.com 2024-04-18T09:21:18.430 DEBUG:teuthology.orchestra.run.smithi118:> grep smithi118.front.sepia.ceph.com /etc/hosts 2024-04-18T09:21:18.486 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118 smithi118.front.sepia.ceph.com smithi118 2024-04-18T09:21:18.486 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname smithi118 2024-04-18T09:21:18.603 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/smithi118.front.sepia.ceph.com/smithi118/g' /etc/hosts 2024-04-18T09:21:18.632 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/172.21.15.118/172.21.15.118/g' /etc/hosts 2024-04-18T09:21:18.699 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/smithi118.front.sepia.ceph.com/smithi118/g' /etc/hostname 2024-04-18T09:21:18.768 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname smithi118 2024-04-18T09:21:18.835 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2024-04-18T09:21:18.889 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="CentOS Stream" 2024-04-18T09:21:18.890 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="9" 2024-04-18T09:21:18.890 INFO:teuthology.orchestra.run.smithi118.stdout:ID="centos" 2024-04-18T09:21:18.890 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="rhel fedora" 2024-04-18T09:21:18.890 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="9" 2024-04-18T09:21:18.890 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el9" 2024-04-18T09:21:18.890 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T09:21:18.890 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31" 2024-04-18T09:21:18.890 INFO:teuthology.orchestra.run.smithi118.stdout:LOGO="fedora-logo-icon" 2024-04-18T09:21:18.890 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T09:21:18.891 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://centos.org/" 2024-04-18T09:21:18.891 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T09:21:18.891 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T09:21:18.891 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T09:21:18.891 INFO:teuthology.provision.fog.smithi118:Deploy complete! 2024-04-18T09:21:18.891 DEBUG:teuthology.parallel:result is None 2024-04-18T09:21:19.107 INFO:teuthology.lock.ops:Checking smithi006.front.sepia.ceph.com 2024-04-18T09:21:19.108 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T09:21:19.136 INFO:teuthology.lock.ops:Checking smithi118.front.sepia.ceph.com 2024-04-18T09:21:19.136 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T09:21:19.152 INFO:teuthology.lock.ops:Checking smithi122.front.sepia.ceph.com 2024-04-18T09:21:19.152 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T09:21:19.170 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: set os type and version on server 2024-04-18T09:21:19.171 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-04-18T09:21:19.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:21:19.284 DEBUG:teuthology.orchestra.run.smithi006:> true 2024-04-18T09:21:19.470 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-04-18T09:21:19.470 DEBUG:teuthology.orchestra.run.smithi006:> uname -m 2024-04-18T09:21:19.525 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2024-04-18T09:21:19.525 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2024-04-18T09:21:19.580 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="CentOS Stream" 2024-04-18T09:21:19.580 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="9" 2024-04-18T09:21:19.580 INFO:teuthology.orchestra.run.smithi006.stdout:ID="centos" 2024-04-18T09:21:19.580 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="rhel fedora" 2024-04-18T09:21:19.580 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="9" 2024-04-18T09:21:19.580 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el9" 2024-04-18T09:21:19.580 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T09:21:19.580 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2024-04-18T09:21:19.580 INFO:teuthology.orchestra.run.smithi006.stdout:LOGO="fedora-logo-icon" 2024-04-18T09:21:19.580 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T09:21:19.580 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://centos.org/" 2024-04-18T09:21:19.580 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T09:21:19.580 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T09:21:19.581 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T09:21:19.581 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2024-04-18T09:21:19.602 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: set os type and version on server 2024-04-18T09:21:19.602 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-04-18T09:21:19.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:21:19.692 DEBUG:teuthology.orchestra.run.smithi118:> true 2024-04-18T09:21:19.764 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-04-18T09:21:19.764 DEBUG:teuthology.orchestra.run.smithi118:> uname -m 2024-04-18T09:21:19.822 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64 2024-04-18T09:21:19.822 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2024-04-18T09:21:19.879 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="CentOS Stream" 2024-04-18T09:21:19.879 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="9" 2024-04-18T09:21:19.879 INFO:teuthology.orchestra.run.smithi118.stdout:ID="centos" 2024-04-18T09:21:19.879 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="rhel fedora" 2024-04-18T09:21:19.880 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="9" 2024-04-18T09:21:19.880 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el9" 2024-04-18T09:21:19.880 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T09:21:19.880 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31" 2024-04-18T09:21:19.880 INFO:teuthology.orchestra.run.smithi118.stdout:LOGO="fedora-logo-icon" 2024-04-18T09:21:19.880 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T09:21:19.880 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://centos.org/" 2024-04-18T09:21:19.880 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T09:21:19.880 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T09:21:19.880 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T09:21:19.881 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2024-04-18T09:21:19.902 INFO:teuthology.lock.ops:Updating [smithi122.front.sepia.ceph.com]: set os type and version on server 2024-04-18T09:21:19.902 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-04-18T09:21:19.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:21:19.992 DEBUG:teuthology.orchestra.run.smithi122:> true 2024-04-18T09:21:20.062 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-04-18T09:21:20.062 DEBUG:teuthology.orchestra.run.smithi122:> uname -m 2024-04-18T09:21:20.118 INFO:teuthology.orchestra.run.smithi122.stdout:x86_64 2024-04-18T09:21:20.119 DEBUG:teuthology.orchestra.run.smithi122:> cat /etc/os-release 2024-04-18T09:21:20.174 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="CentOS Stream" 2024-04-18T09:21:20.174 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="9" 2024-04-18T09:21:20.174 INFO:teuthology.orchestra.run.smithi122.stdout:ID="centos" 2024-04-18T09:21:20.174 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE="rhel fedora" 2024-04-18T09:21:20.174 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="9" 2024-04-18T09:21:20.174 INFO:teuthology.orchestra.run.smithi122.stdout:PLATFORM_ID="platform:el9" 2024-04-18T09:21:20.174 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T09:21:20.174 INFO:teuthology.orchestra.run.smithi122.stdout:ANSI_COLOR="0;31" 2024-04-18T09:21:20.174 INFO:teuthology.orchestra.run.smithi122.stdout:LOGO="fedora-logo-icon" 2024-04-18T09:21:20.174 INFO:teuthology.orchestra.run.smithi122.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T09:21:20.175 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://centos.org/" 2024-04-18T09:21:20.175 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T09:21:20.175 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T09:21:20.175 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T09:21:20.179 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server 2024-04-18T09:21:20.202 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T09:21:20.307 INFO:teuthology.dispatcher.supervisor:Running job 7660875 2024-04-18T09:21:20.307 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi/7660875 --name teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/suites/iogen}} -- /home/teuthworker/archive/teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi/7660875/orig.config.yaml 2024-04-18T09:21:20.310 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi/7660875 2024-04-18T09:21:20.310 INFO:teuthology.dispatcher.supervisor:Job PID: 2987818 2024-04-18T09:21:20.310 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-18T09:23:20.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T09:25:20.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T09:27:20.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T09:29:20.540 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T09:31:20.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T09:33:20.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T09:33:20.763 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1