2024-03-08T00:19:24.434 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-08T00:19:24.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-08T00:19:24.621 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd7aeb37c10>, signals=[15]) 2024-03-08T00:19:24.621 INFO:teuthology.lock.ops:Start node 'smithi047.front.sepia.ceph.com' reimaging 2024-03-08T00:19:24.622 INFO:teuthology.lock.ops:Updating [smithi047.front.sepia.ceph.com]: reset os type and version on server 2024-03-08T00:19:24.622 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2024-03-08T00:19:24.648 INFO:teuthology.lock.ops:Start node 'smithi084.front.sepia.ceph.com' reimaging 2024-03-08T00:19:24.649 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: reset os type and version on server 2024-03-08T00:19:24.649 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2024-03-08T00:19:24.673 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging 2024-03-08T00:19:24.673 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server 2024-03-08T00:19:24.673 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-03-08T00:19:24.773 DEBUG:teuthology.provision.fog.smithi047:Requesting image smithi_centos_9.stream (ID 10) 2024-03-08T00:19:24.783 DEBUG:teuthology.provision.fog.smithi084:Requesting image smithi_centos_9.stream (ID 10) 2024-03-08T00:19:24.812 INFO:teuthology.provision.fog.smithi047:Scheduling deploy of centos 9.stream 2024-03-08T00:19:24.829 DEBUG:teuthology.provision.fog.smithi099:Requesting image smithi_centos_9.stream (ID 10) 2024-03-08T00:19:24.837 INFO:teuthology.provision.fog.smithi084:Scheduling deploy of centos 9.stream 2024-03-08T00:19:24.881 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of centos 9.stream 2024-03-08T00:19:25.091 INFO:teuthology.orchestra.console.smithi047:Power off 2024-03-08T00:19:25.091 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-08T00:19:25.116 DEBUG:teuthology.orchestra.console.smithi047:power off output: Chassis Power Control: Down/Off 2024-03-08T00:19:25.116 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T00:19:25.136 INFO:teuthology.orchestra.console.smithi084:Power off 2024-03-08T00:19:25.137 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-08T00:19:25.145 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is off 2024-03-08T00:19:25.157 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off 2024-03-08T00:19:25.158 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T00:19:25.179 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2024-03-08T00:19:25.199 INFO:teuthology.orchestra.console.smithi099:Power off 2024-03-08T00:19:25.199 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-08T00:19:25.222 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2024-03-08T00:19:25.223 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T00:19:25.245 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2024-03-08T00:19:25.246 INFO:teuthology.orchestra.console.smithi047:Power off completed 2024-03-08T00:19:25.279 INFO:teuthology.orchestra.console.smithi084:Power off completed 2024-03-08T00:19:25.347 INFO:teuthology.orchestra.console.smithi099:Power off completed 2024-03-08T00:19:25.347 INFO:teuthology.orchestra.console.smithi047:Power on 2024-03-08T00:19:25.347 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-08T00:19:25.380 INFO:teuthology.orchestra.console.smithi084:Power on 2024-03-08T00:19:25.381 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-08T00:19:25.396 DEBUG:teuthology.orchestra.console.smithi047:power on output: Chassis Power Control: Up/On 2024-03-08T00:19:25.396 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T00:19:25.404 DEBUG:teuthology.orchestra.console.smithi084:power on output: Chassis Power Control: Up/On 2024-03-08T00:19:25.404 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T00:19:25.415 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is off 2024-03-08T00:19:25.426 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2024-03-08T00:19:25.448 INFO:teuthology.orchestra.console.smithi099:Power on 2024-03-08T00:19:25.448 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-08T00:19:25.468 DEBUG:teuthology.orchestra.console.smithi099:power on output: Chassis Power Control: Up/On 2024-03-08T00:19:25.469 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T00:19:25.490 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2024-03-08T00:19:29.421 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T00:19:29.428 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T00:19:29.491 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T00:19:29.530 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is on 2024-03-08T00:19:29.537 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2024-03-08T00:19:29.601 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2024-03-08T00:19:29.631 INFO:teuthology.orchestra.console.smithi047:Power on completed 2024-03-08T00:19:29.732 INFO:teuthology.provision.fog.smithi047:Waiting for deploy to finish 2024-03-08T00:19:33.538 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T00:19:33.602 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T00:19:33.647 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2024-03-08T00:19:33.711 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-03-08T00:19:33.749 INFO:teuthology.orchestra.console.smithi084:Power on completed 2024-03-08T00:19:33.812 INFO:teuthology.orchestra.console.smithi099:Power on completed 2024-03-08T00:19:33.850 INFO:teuthology.provision.fog.smithi084:Waiting for deploy to finish 2024-03-08T00:19:33.913 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish 2024-03-08T00:22:00.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T00:22:03.902 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-03-08T00:22:04.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T00:22:07.966 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-03-08T00:22:09.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T00:22:12.958 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-03-08T00:22:13.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T00:22:17.026 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-03-08T00:22:18.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T00:22:19.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T00:22:22.018 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-03-08T00:22:23.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T00:22:23.038 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-03-08T00:22:26.078 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-03-08T00:22:28.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T00:22:29.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T00:22:31.070 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-03-08T00:22:32.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T00:22:32.094 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-03-08T00:22:35.134 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-03-08T00:22:37.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T00:22:38.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T00:22:40.126 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-03-08T00:22:41.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T00:22:41.150 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-03-08T00:22:44.190 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-03-08T00:22:46.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T00:22:47.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T00:22:49.182 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-03-08T00:22:50.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T00:22:50.206 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-03-08T00:22:53.246 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-03-08T00:22:55.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T00:22:56.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T00:22:59.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T00:22:59.262 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-03-08T00:23:02.302 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-03-08T00:23:05.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T00:23:08.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T00:23:08.322 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-03-08T00:23:14.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T00:23:17.374 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-03-08T00:23:23.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T00:23:26.434 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-03-08T00:23:32.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T00:23:55.207 WARNING:teuthology.provision.fog.smithi047:timed out 2024-03-08T00:24:01.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T00:24:01.474 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-08T00:24:01.474 DEBUG:teuthology.orchestra.run.smithi047:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-08T00:24:01.828 INFO:teuthology.provision.fog.smithi047:Node is ready 2024-03-08T00:24:01.829 DEBUG:teuthology.orchestra.run.smithi047:> hostname 2024-03-08T00:24:01.844 INFO:teuthology.orchestra.run.smithi047.stdout:smithi047.front.sepia.ceph.com 2024-03-08T00:24:01.844 DEBUG:teuthology.orchestra.run.smithi047:> grep smithi047.front.sepia.ceph.com /etc/hosts 2024-03-08T00:24:01.899 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47 smithi047.front.sepia.ceph.com smithi047 2024-03-08T00:24:01.900 DEBUG:teuthology.orchestra.run.smithi047:> sudo hostname smithi047 2024-03-08T00:24:02.003 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i -e 's/smithi047.front.sepia.ceph.com/smithi047/g' /etc/hosts 2024-03-08T00:24:02.034 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i -e 's/172.21.15.47/172.21.15.47/g' /etc/hosts 2024-03-08T00:24:02.105 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i -e 's/smithi047.front.sepia.ceph.com/smithi047/g' /etc/hostname 2024-03-08T00:24:02.179 DEBUG:teuthology.orchestra.run.smithi047:> sudo hostname smithi047 2024-03-08T00:24:02.259 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release 2024-03-08T00:24:02.322 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="CentOS Stream" 2024-03-08T00:24:02.322 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="9" 2024-03-08T00:24:02.322 INFO:teuthology.orchestra.run.smithi047.stdout:ID="centos" 2024-03-08T00:24:02.322 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE="rhel fedora" 2024-03-08T00:24:02.323 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="9" 2024-03-08T00:24:02.323 INFO:teuthology.orchestra.run.smithi047.stdout:PLATFORM_ID="platform:el9" 2024-03-08T00:24:02.323 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-08T00:24:02.323 INFO:teuthology.orchestra.run.smithi047.stdout:ANSI_COLOR="0;31" 2024-03-08T00:24:02.324 INFO:teuthology.orchestra.run.smithi047.stdout:LOGO="fedora-logo-icon" 2024-03-08T00:24:02.324 INFO:teuthology.orchestra.run.smithi047.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-08T00:24:02.324 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://centos.org/" 2024-03-08T00:24:02.324 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-08T00:24:02.324 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-08T00:24:02.325 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-08T00:24:02.326 INFO:teuthology.provision.fog.smithi047:Deploy complete! 2024-03-08T00:24:02.329 DEBUG:teuthology.parallel:result is None 2024-03-08T00:24:08.317 WARNING:teuthology.provision.fog.smithi084:timed out 2024-03-08T00:24:14.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T00:24:14.600 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-08T00:24:14.600 DEBUG:teuthology.orchestra.run.smithi084:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-08T00:24:14.920 INFO:teuthology.provision.fog.smithi084:Node is ready 2024-03-08T00:24:14.920 DEBUG:teuthology.orchestra.run.smithi084:> hostname 2024-03-08T00:24:14.935 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084.front.sepia.ceph.com 2024-03-08T00:24:14.935 DEBUG:teuthology.orchestra.run.smithi084:> grep smithi084.front.sepia.ceph.com /etc/hosts 2024-03-08T00:24:14.990 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84 smithi084.front.sepia.ceph.com smithi084 2024-03-08T00:24:14.990 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2024-03-08T00:24:15.094 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hosts 2024-03-08T00:24:15.123 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/172.21.15.84/172.21.15.84/g' /etc/hosts 2024-03-08T00:24:15.190 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hostname 2024-03-08T00:24:15.257 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2024-03-08T00:24:15.323 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2024-03-08T00:24:15.378 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream" 2024-03-08T00:24:15.378 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="9" 2024-03-08T00:24:15.378 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2024-03-08T00:24:15.378 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2024-03-08T00:24:15.378 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="9" 2024-03-08T00:24:15.378 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el9" 2024-03-08T00:24:15.378 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-08T00:24:15.378 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2024-03-08T00:24:15.378 INFO:teuthology.orchestra.run.smithi084.stdout:LOGO="fedora-logo-icon" 2024-03-08T00:24:15.378 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-08T00:24:15.378 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/" 2024-03-08T00:24:15.378 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-08T00:24:15.379 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-08T00:24:15.379 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-08T00:24:15.379 INFO:teuthology.provision.fog.smithi084:Deploy complete! 2024-03-08T00:24:15.379 DEBUG:teuthology.parallel:result is None 2024-03-08T00:24:32.449 WARNING:teuthology.provision.fog.smithi099:timed out 2024-03-08T00:24:38.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T00:24:38.685 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-08T00:24:38.686 DEBUG:teuthology.orchestra.run.smithi099:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-08T00:24:39.021 INFO:teuthology.provision.fog.smithi099:Node is ready 2024-03-08T00:24:39.021 DEBUG:teuthology.orchestra.run.smithi099:> hostname 2024-03-08T00:24:39.036 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com 2024-03-08T00:24:39.036 DEBUG:teuthology.orchestra.run.smithi099:> grep smithi099.front.sepia.ceph.com /etc/hosts 2024-03-08T00:24:39.091 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099 2024-03-08T00:24:39.091 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2024-03-08T00:24:39.197 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hosts 2024-03-08T00:24:39.225 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/172.21.15.99/172.21.15.99/g' /etc/hosts 2024-03-08T00:24:39.292 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hostname 2024-03-08T00:24:39.359 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2024-03-08T00:24:39.426 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-03-08T00:24:39.480 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2024-03-08T00:24:39.480 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="9" 2024-03-08T00:24:39.480 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2024-03-08T00:24:39.480 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2024-03-08T00:24:39.480 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="9" 2024-03-08T00:24:39.481 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el9" 2024-03-08T00:24:39.481 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-08T00:24:39.481 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2024-03-08T00:24:39.481 INFO:teuthology.orchestra.run.smithi099.stdout:LOGO="fedora-logo-icon" 2024-03-08T00:24:39.481 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-08T00:24:39.481 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2024-03-08T00:24:39.481 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-08T00:24:39.481 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-08T00:24:39.481 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-08T00:24:39.481 INFO:teuthology.provision.fog.smithi099:Deploy complete! 2024-03-08T00:24:39.482 DEBUG:teuthology.parallel:result is None 2024-03-08T00:24:39.728 INFO:teuthology.lock.ops:Checking smithi047.front.sepia.ceph.com 2024-03-08T00:24:39.729 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-08T00:24:39.749 INFO:teuthology.lock.ops:Checking smithi084.front.sepia.ceph.com 2024-03-08T00:24:39.749 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-08T00:24:39.765 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com 2024-03-08T00:24:39.765 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-08T00:24:39.783 INFO:teuthology.lock.ops:Updating [smithi047.front.sepia.ceph.com]: set os type and version on server 2024-03-08T00:24:39.784 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-03-08T00:24:39.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T00:24:39.887 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-03-08T00:24:40.068 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-03-08T00:24:40.069 DEBUG:teuthology.orchestra.run.smithi047:> uname -m 2024-03-08T00:24:40.124 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64 2024-03-08T00:24:40.124 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release 2024-03-08T00:24:40.178 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="CentOS Stream" 2024-03-08T00:24:40.179 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="9" 2024-03-08T00:24:40.179 INFO:teuthology.orchestra.run.smithi047.stdout:ID="centos" 2024-03-08T00:24:40.179 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE="rhel fedora" 2024-03-08T00:24:40.179 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="9" 2024-03-08T00:24:40.179 INFO:teuthology.orchestra.run.smithi047.stdout:PLATFORM_ID="platform:el9" 2024-03-08T00:24:40.179 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-08T00:24:40.179 INFO:teuthology.orchestra.run.smithi047.stdout:ANSI_COLOR="0;31" 2024-03-08T00:24:40.179 INFO:teuthology.orchestra.run.smithi047.stdout:LOGO="fedora-logo-icon" 2024-03-08T00:24:40.179 INFO:teuthology.orchestra.run.smithi047.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-08T00:24:40.179 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://centos.org/" 2024-03-08T00:24:40.179 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-08T00:24:40.179 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-08T00:24:40.179 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-08T00:24:40.180 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2024-03-08T00:24:40.208 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: set os type and version on server 2024-03-08T00:24:40.208 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-03-08T00:24:40.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T00:24:40.298 DEBUG:teuthology.orchestra.run.smithi084:> true 2024-03-08T00:24:40.468 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-03-08T00:24:40.468 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2024-03-08T00:24:40.522 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2024-03-08T00:24:40.523 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2024-03-08T00:24:40.576 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream" 2024-03-08T00:24:40.576 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="9" 2024-03-08T00:24:40.576 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2024-03-08T00:24:40.576 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2024-03-08T00:24:40.577 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="9" 2024-03-08T00:24:40.577 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el9" 2024-03-08T00:24:40.577 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-08T00:24:40.577 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2024-03-08T00:24:40.577 INFO:teuthology.orchestra.run.smithi084.stdout:LOGO="fedora-logo-icon" 2024-03-08T00:24:40.577 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-08T00:24:40.577 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/" 2024-03-08T00:24:40.577 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-08T00:24:40.577 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-08T00:24:40.577 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-08T00:24:40.578 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2024-03-08T00:24:40.599 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server 2024-03-08T00:24:40.599 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-03-08T00:24:40.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T00:24:40.686 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-03-08T00:24:40.754 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-03-08T00:24:40.754 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2024-03-08T00:24:40.811 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2024-03-08T00:24:40.811 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-03-08T00:24:40.868 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2024-03-08T00:24:40.868 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="9" 2024-03-08T00:24:40.868 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2024-03-08T00:24:40.868 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2024-03-08T00:24:40.868 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="9" 2024-03-08T00:24:40.868 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el9" 2024-03-08T00:24:40.868 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-08T00:24:40.868 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2024-03-08T00:24:40.868 INFO:teuthology.orchestra.run.smithi099.stdout:LOGO="fedora-logo-icon" 2024-03-08T00:24:40.868 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-08T00:24:40.868 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2024-03-08T00:24:40.869 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-08T00:24:40.869 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-08T00:24:40.869 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-08T00:24:40.869 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-03-08T00:24:40.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-08T00:24:40.978 INFO:teuthology.dispatcher.supervisor:Running job 7584878 2024-03-08T00:24:40.978 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_sjust@teuthology --archive /home/teuthworker/archive/sjust-2024-03-07_23:09:46-rados-wip-sjust-testing-2024-03-06-distro-default-smithi/7584878 --name sjust-2024-03-07_23:09:46-rados-wip-sjust-testing-2024-03-06-distro-default-smithi --description rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} tasks/mon_clock_with_skews} -- /home/teuthworker/archive/sjust-2024-03-07_23:09:46-rados-wip-sjust-testing-2024-03-06-distro-default-smithi/7584878/orig.config.yaml 2024-03-08T00:24:40.981 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/sjust-2024-03-07_23:09:46-rados-wip-sjust-testing-2024-03-06-distro-default-smithi/7584878 2024-03-08T00:24:40.981 INFO:teuthology.dispatcher.supervisor:Job PID: 2094307 2024-03-08T00:24:40.982 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-08T00:26:41.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-08T00:28:41.246 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-08T00:30:41.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-08T00:32:41.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-08T00:34:41.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-08T00:36:41.938 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-08T00:38:42.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-08T00:38:42.171 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1