2024-02-08T12:38:11.073 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22 2024-02-08T12:38:11.074 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-08T12:38:11.254 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f457bbaac10>, signals=[15]) 2024-02-08T12:38:11.255 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging 2024-02-08T12:38:11.256 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server 2024-02-08T12:38:11.257 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-02-08T12:38:11.281 INFO:teuthology.lock.ops:Start node 'smithi106.front.sepia.ceph.com' reimaging 2024-02-08T12:38:11.281 INFO:teuthology.lock.ops:Updating [smithi106.front.sepia.ceph.com]: reset os type and version on server 2024-02-08T12:38:11.281 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server 2024-02-08T12:38:11.314 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging 2024-02-08T12:38:11.314 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server 2024-02-08T12:38:11.314 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-02-08T12:38:11.393 DEBUG:teuthology.provision.fog.smithi099:Requesting image smithi_centos_8.stream (ID 3) 2024-02-08T12:38:11.426 DEBUG:teuthology.provision.fog.smithi106:Requesting image smithi_centos_8.stream (ID 3) 2024-02-08T12:38:11.435 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_centos_8.stream (ID 3) 2024-02-08T12:38:11.443 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of centos 8.stream 2024-02-08T12:38:11.471 INFO:teuthology.provision.fog.smithi106:Scheduling deploy of centos 8.stream 2024-02-08T12:38:11.482 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of centos 8.stream 2024-02-08T12:38:11.759 INFO:teuthology.orchestra.console.smithi099:Power off 2024-02-08T12:38:11.759 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-08T12:38:11.770 INFO:teuthology.orchestra.console.smithi106:Power off 2024-02-08T12:38:11.770 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-08T12:38:11.789 INFO:teuthology.orchestra.console.smithi161:Power off 2024-02-08T12:38:11.789 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-08T12:38:11.796 DEBUG:teuthology.orchestra.console.smithi106:power off output: Chassis Power Control: Down/Off 2024-02-08T12:38:11.797 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T12:38:11.804 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2024-02-08T12:38:11.804 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T12:38:11.813 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2024-02-08T12:38:11.813 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T12:38:11.823 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is off 2024-02-08T12:38:11.826 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2024-02-08T12:38:11.837 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-02-08T12:38:11.924 INFO:teuthology.orchestra.console.smithi106:Power off completed 2024-02-08T12:38:11.928 INFO:teuthology.orchestra.console.smithi099:Power off completed 2024-02-08T12:38:12.025 INFO:teuthology.orchestra.console.smithi106:Power on 2024-02-08T12:38:12.025 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-08T12:38:12.033 INFO:teuthology.orchestra.console.smithi099:Power on 2024-02-08T12:38:12.034 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-08T12:38:12.047 DEBUG:teuthology.orchestra.console.smithi106:power on output: Chassis Power Control: Up/On 2024-02-08T12:38:12.047 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T12:38:12.056 DEBUG:teuthology.orchestra.console.smithi099:power on output: Chassis Power Control: Up/On 2024-02-08T12:38:12.056 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T12:38:12.070 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is off 2024-02-08T12:38:12.077 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2024-02-08T12:38:15.840 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T12:38:15.949 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-02-08T12:38:16.071 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T12:38:16.079 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T12:38:16.181 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is off 2024-02-08T12:38:16.188 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-02-08T12:38:16.289 INFO:teuthology.orchestra.console.smithi099:Power on completed 2024-02-08T12:38:16.389 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish 2024-02-08T12:38:19.955 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T12:38:20.064 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-02-08T12:38:20.182 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T12:38:20.406 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on 2024-02-08T12:38:20.507 INFO:teuthology.orchestra.console.smithi106:Power on completed 2024-02-08T12:38:20.607 INFO:teuthology.provision.fog.smithi106:Waiting for deploy to finish 2024-02-08T12:38:24.068 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T12:38:24.177 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-02-08T12:38:24.277 INFO:teuthology.orchestra.console.smithi161:Power off completed 2024-02-08T12:38:24.378 INFO:teuthology.orchestra.console.smithi161:Power on 2024-02-08T12:38:24.378 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-08T12:38:24.400 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On 2024-02-08T12:38:24.400 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T12:38:24.421 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-02-08T12:38:28.424 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T12:38:28.533 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-02-08T12:38:28.634 INFO:teuthology.orchestra.console.smithi161:Power on completed 2024-02-08T12:38:28.735 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish 2024-02-08T12:41:02.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T12:41:05.596 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-02-08T12:41:06.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T12:41:09.792 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-02-08T12:41:11.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T12:41:14.652 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-02-08T12:41:14.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T12:41:15.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T12:41:17.916 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-02-08T12:41:18.876 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-02-08T12:41:20.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T12:41:23.708 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-02-08T12:41:23.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T12:41:24.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T12:41:26.972 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-02-08T12:41:27.932 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-02-08T12:41:29.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T12:41:32.764 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-02-08T12:41:32.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T12:41:33.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T12:41:36.028 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-02-08T12:41:36.992 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-02-08T12:41:38.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T12:41:41.820 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-02-08T12:41:42.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T12:41:42.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T12:41:45.088 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-02-08T12:41:46.076 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-02-08T12:41:47.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T12:41:50.876 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-02-08T12:41:51.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T12:41:52.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T12:41:54.140 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-02-08T12:41:56.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T12:42:00.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T12:42:03.196 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-02-08T12:42:09.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T12:42:12.252 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-02-08T12:42:18.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T12:42:21.312 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-02-08T12:42:27.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T12:42:45.692 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-02-08T12:42:51.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T12:42:52.081 WARNING:teuthology.provision.fog.smithi106:timed out 2024-02-08T12:42:54.748 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-02-08T12:42:56.884 WARNING:teuthology.provision.fog.smithi099:timed out 2024-02-08T12:42:58.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T12:42:58.302 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-08T12:42:58.303 DEBUG:teuthology.orchestra.run.smithi106:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-08T12:42:58.619 INFO:teuthology.provision.fog.smithi106:Node is ready 2024-02-08T12:42:58.619 DEBUG:teuthology.orchestra.run.smithi106:> hostname 2024-02-08T12:42:58.640 INFO:teuthology.orchestra.run.smithi106.stdout:smithi106.front.sepia.ceph.com 2024-02-08T12:42:58.641 DEBUG:teuthology.orchestra.run.smithi106:> grep smithi106.front.sepia.ceph.com /etc/hosts 2024-02-08T12:42:58.703 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.15.106 smithi106.front.sepia.ceph.com smithi106 2024-02-08T12:42:58.703 DEBUG:teuthology.orchestra.run.smithi106:> sudo hostname smithi106 2024-02-08T12:42:58.807 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i -e 's/smithi106.front.sepia.ceph.com/smithi106/g' /etc/hosts 2024-02-08T12:42:58.842 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i -e 's/172.21.15.106/172.21.15.106/g' /etc/hosts 2024-02-08T12:42:58.913 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i -e 's/smithi106.front.sepia.ceph.com/smithi106/g' /etc/hostname 2024-02-08T12:42:58.982 DEBUG:teuthology.orchestra.run.smithi106:> sudo hostname smithi106 2024-02-08T12:42:59.050 DEBUG:teuthology.orchestra.run.smithi106:> cat /etc/os-release 2024-02-08T12:42:59.109 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="CentOS Stream" 2024-02-08T12:42:59.110 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="8" 2024-02-08T12:42:59.110 INFO:teuthology.orchestra.run.smithi106.stdout:ID="centos" 2024-02-08T12:42:59.110 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE="rhel fedora" 2024-02-08T12:42:59.110 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="8" 2024-02-08T12:42:59.110 INFO:teuthology.orchestra.run.smithi106.stdout:PLATFORM_ID="platform:el8" 2024-02-08T12:42:59.110 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-08T12:42:59.110 INFO:teuthology.orchestra.run.smithi106.stdout:ANSI_COLOR="0;31" 2024-02-08T12:42:59.110 INFO:teuthology.orchestra.run.smithi106.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-08T12:42:59.110 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://centos.org/" 2024-02-08T12:42:59.110 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-08T12:42:59.110 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-08T12:42:59.110 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-08T12:42:59.111 INFO:teuthology.provision.fog.smithi106:Deploy complete! 2024-02-08T12:42:59.113 DEBUG:teuthology.parallel:result is None 2024-02-08T12:43:00.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T12:43:02.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T12:43:03.189 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-08T12:43:03.189 DEBUG:teuthology.orchestra.run.smithi099:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-08T12:43:03.448 INFO:teuthology.provision.fog.smithi099:Node is ready 2024-02-08T12:43:03.448 DEBUG:teuthology.orchestra.run.smithi099:> hostname 2024-02-08T12:43:03.467 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com 2024-02-08T12:43:03.467 DEBUG:teuthology.orchestra.run.smithi099:> grep smithi099.front.sepia.ceph.com /etc/hosts 2024-02-08T12:43:03.526 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099 2024-02-08T12:43:03.527 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2024-02-08T12:43:03.616 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hosts 2024-02-08T12:43:03.644 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/172.21.15.99/172.21.15.99/g' /etc/hosts 2024-02-08T12:43:03.712 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hostname 2024-02-08T12:43:03.779 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2024-02-08T12:43:03.859 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-02-08T12:43:03.917 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2024-02-08T12:43:03.917 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8" 2024-02-08T12:43:03.917 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2024-02-08T12:43:03.917 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2024-02-08T12:43:03.917 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8" 2024-02-08T12:43:03.917 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8" 2024-02-08T12:43:03.917 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-08T12:43:03.917 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2024-02-08T12:43:03.917 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-08T12:43:03.917 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2024-02-08T12:43:03.918 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-08T12:43:03.918 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-08T12:43:03.918 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-08T12:43:03.918 INFO:teuthology.provision.fog.smithi099:Deploy complete! 2024-02-08T12:43:03.918 DEBUG:teuthology.parallel:result is None 2024-02-08T12:43:04.052 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-08T12:43:04.052 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-08T12:43:29.416 INFO:teuthology.provision.fog.smithi161:Node is ready 2024-02-08T12:43:29.417 DEBUG:teuthology.orchestra.run.smithi161:> hostname 2024-02-08T12:43:29.441 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com 2024-02-08T12:43:29.441 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161.front.sepia.ceph.com /etc/hosts 2024-02-08T12:43:29.501 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161 2024-02-08T12:43:29.502 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2024-02-08T12:43:29.629 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hosts 2024-02-08T12:43:29.660 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts 2024-02-08T12:43:29.729 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hostname 2024-02-08T12:43:29.799 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2024-02-08T12:43:29.868 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-02-08T12:43:29.926 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2024-02-08T12:43:29.927 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8" 2024-02-08T12:43:29.927 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2024-02-08T12:43:29.927 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2024-02-08T12:43:29.927 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8" 2024-02-08T12:43:29.927 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8" 2024-02-08T12:43:29.927 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-08T12:43:29.927 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2024-02-08T12:43:29.927 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-08T12:43:29.927 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2024-02-08T12:43:29.927 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-08T12:43:29.927 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-08T12:43:29.927 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-08T12:43:29.928 INFO:teuthology.provision.fog.smithi161:Deploy complete! 2024-02-08T12:43:29.928 DEBUG:teuthology.parallel:result is None 2024-02-08T12:43:30.121 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com 2024-02-08T12:43:30.122 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-08T12:43:30.145 INFO:teuthology.lock.ops:Checking smithi106.front.sepia.ceph.com 2024-02-08T12:43:30.145 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-08T12:43:30.162 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com 2024-02-08T12:43:30.162 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-08T12:43:30.179 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server 2024-02-08T12:43:30.179 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-02-08T12:43:30.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T12:43:30.256 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-02-08T12:43:30.395 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-02-08T12:43:30.395 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2024-02-08T12:43:30.454 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2024-02-08T12:43:30.455 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-02-08T12:43:30.513 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2024-02-08T12:43:30.513 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8" 2024-02-08T12:43:30.513 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2024-02-08T12:43:30.513 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2024-02-08T12:43:30.513 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8" 2024-02-08T12:43:30.513 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8" 2024-02-08T12:43:30.513 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-08T12:43:30.513 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2024-02-08T12:43:30.513 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-08T12:43:30.513 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2024-02-08T12:43:30.513 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-08T12:43:30.513 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-08T12:43:30.514 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-08T12:43:30.514 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-02-08T12:43:30.536 INFO:teuthology.lock.ops:Updating [smithi106.front.sepia.ceph.com]: set os type and version on server 2024-02-08T12:43:30.537 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-02-08T12:43:30.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T12:43:30.609 DEBUG:teuthology.orchestra.run.smithi106:> true 2024-02-08T12:43:30.743 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-02-08T12:43:30.744 DEBUG:teuthology.orchestra.run.smithi106:> uname -m 2024-02-08T12:43:30.803 INFO:teuthology.orchestra.run.smithi106.stdout:x86_64 2024-02-08T12:43:30.803 DEBUG:teuthology.orchestra.run.smithi106:> cat /etc/os-release 2024-02-08T12:43:30.862 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="CentOS Stream" 2024-02-08T12:43:30.862 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="8" 2024-02-08T12:43:30.862 INFO:teuthology.orchestra.run.smithi106.stdout:ID="centos" 2024-02-08T12:43:30.862 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE="rhel fedora" 2024-02-08T12:43:30.862 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="8" 2024-02-08T12:43:30.862 INFO:teuthology.orchestra.run.smithi106.stdout:PLATFORM_ID="platform:el8" 2024-02-08T12:43:30.862 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-08T12:43:30.862 INFO:teuthology.orchestra.run.smithi106.stdout:ANSI_COLOR="0;31" 2024-02-08T12:43:30.862 INFO:teuthology.orchestra.run.smithi106.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-08T12:43:30.862 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://centos.org/" 2024-02-08T12:43:30.863 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-08T12:43:30.863 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-08T12:43:30.863 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-08T12:43:30.863 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server 2024-02-08T12:43:30.887 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server 2024-02-08T12:43:30.887 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-02-08T12:43:30.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T12:43:30.960 DEBUG:teuthology.orchestra.run.smithi161:> true 2024-02-08T12:43:31.034 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-02-08T12:43:31.034 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2024-02-08T12:43:31.094 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2024-02-08T12:43:31.095 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-02-08T12:43:31.156 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2024-02-08T12:43:31.156 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8" 2024-02-08T12:43:31.156 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2024-02-08T12:43:31.156 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2024-02-08T12:43:31.156 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8" 2024-02-08T12:43:31.156 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8" 2024-02-08T12:43:31.156 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-08T12:43:31.156 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2024-02-08T12:43:31.156 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-08T12:43:31.156 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2024-02-08T12:43:31.156 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-08T12:43:31.157 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-08T12:43:31.157 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-08T12:43:31.157 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-02-08T12:43:31.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-08T12:43:31.268 INFO:teuthology.dispatcher.supervisor:Running job 7551121 2024-02-08T12:43:31.268 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-02-08_00:19:25-rados-wip-yuri3-testing-2024-02-07-1233-distro-default-smithi/7551121 --name yuriw-2024-02-08_00:19:25-rados-wip-yuri3-testing-2024-02-07-1233-distro-default-smithi --description rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/quincy backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/test_rbd_api} -- /home/teuthworker/archive/yuriw-2024-02-08_00:19:25-rados-wip-yuri3-testing-2024-02-07-1233-distro-default-smithi/7551121/orig.config.yaml 2024-02-08T12:43:31.271 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-02-08_00:19:25-rados-wip-yuri3-testing-2024-02-07-1233-distro-default-smithi/7551121 2024-02-08T12:43:31.271 INFO:teuthology.dispatcher.supervisor:Job PID: 381805 2024-02-08T12:43:31.271 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-08T12:45:31.369 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-08T12:47:31.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-08T12:49:31.706 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-08T12:51:31.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-08T12:53:32.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-08T12:55:32.234 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-08T12:57:32.400 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-08T12:59:32.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-08T13:01:32.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-08T13:03:32.924 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-08T13:05:33.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-08T13:07:33.273 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-08T13:09:33.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-08T13:11:33.650 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-08T13:13:33.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-08T13:13:33.899 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1