2024-02-07T01:06:58.246 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22 2024-02-07T01:06:58.246 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T01:06:58.422 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8921413c10>, signals=[15]) 2024-02-07T01:06:58.423 INFO:teuthology.lock.ops:Start node 'smithi006.front.sepia.ceph.com' reimaging 2024-02-07T01:06:58.423 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: reset os type and version on server 2024-02-07T01:06:58.423 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2024-02-07T01:06:58.450 INFO:teuthology.lock.ops:Start node 'smithi113.front.sepia.ceph.com' reimaging 2024-02-07T01:06:58.450 INFO:teuthology.lock.ops:Updating [smithi113.front.sepia.ceph.com]: reset os type and version on server 2024-02-07T01:06:58.450 INFO:teuthology.lock.ops:Updating smithi113.front.sepia.ceph.com on lock server 2024-02-07T01:06:58.474 INFO:teuthology.lock.ops:Start node 'smithi151.front.sepia.ceph.com' reimaging 2024-02-07T01:06:58.475 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: reset os type and version on server 2024-02-07T01:06:58.475 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2024-02-07T01:06:58.573 DEBUG:teuthology.provision.fog.smithi006:Requesting image smithi_centos_9.stream (ID 10) 2024-02-07T01:06:58.601 DEBUG:teuthology.provision.fog.smithi151:Requesting image smithi_centos_9.stream (ID 10) 2024-02-07T01:06:58.619 DEBUG:teuthology.provision.fog.smithi113:Requesting image smithi_centos_9.stream (ID 10) 2024-02-07T01:06:58.628 INFO:teuthology.provision.fog.smithi006:Scheduling deploy of centos 9.stream 2024-02-07T01:06:58.647 INFO:teuthology.provision.fog.smithi151:Scheduling deploy of centos 9.stream 2024-02-07T01:06:58.658 INFO:teuthology.provision.fog.smithi113:Scheduling deploy of centos 9.stream 2024-02-07T01:06:58.870 INFO:teuthology.orchestra.console.smithi113:Power off 2024-02-07T01:06:58.870 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-07T01:06:58.884 INFO:teuthology.orchestra.console.smithi151:Power off 2024-02-07T01:06:58.885 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-07T01:06:58.894 INFO:teuthology.orchestra.console.smithi006:Power off 2024-02-07T01:06:58.895 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-07T01:06:58.902 DEBUG:teuthology.orchestra.console.smithi113:power off output: Chassis Power Control: Down/Off 2024-02-07T01:06:58.902 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T01:06:58.910 DEBUG:teuthology.orchestra.console.smithi151:power off output: Chassis Power Control: Down/Off 2024-02-07T01:06:58.910 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T01:06:58.918 DEBUG:teuthology.orchestra.console.smithi006:power off output: Chassis Power Control: Down/Off 2024-02-07T01:06:58.918 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T01:06:58.926 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2024-02-07T01:06:58.931 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2024-02-07T01:06:58.939 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2024-02-07T01:07:02.928 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T01:07:02.935 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T01:07:02.942 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T01:07:03.036 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2024-02-07T01:07:03.043 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2024-02-07T01:07:03.050 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2024-02-07T01:07:07.042 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T01:07:07.050 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T01:07:07.056 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T01:07:07.152 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2024-02-07T01:07:07.157 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2024-02-07T01:07:07.164 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2024-02-07T01:07:07.258 INFO:teuthology.orchestra.console.smithi151:Power off completed 2024-02-07T01:07:07.359 INFO:teuthology.orchestra.console.smithi151:Power on 2024-02-07T01:07:07.359 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-07T01:07:07.383 DEBUG:teuthology.orchestra.console.smithi151:power on output: Chassis Power Control: Up/On 2024-02-07T01:07:07.383 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T01:07:07.409 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2024-02-07T01:07:11.156 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T01:07:11.164 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T01:07:11.266 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off 2024-02-07T01:07:11.273 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2024-02-07T01:07:11.367 INFO:teuthology.orchestra.console.smithi113:Power off completed 2024-02-07T01:07:11.373 INFO:teuthology.orchestra.console.smithi006:Power off completed 2024-02-07T01:07:11.410 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T01:07:11.468 INFO:teuthology.orchestra.console.smithi113:Power on 2024-02-07T01:07:11.469 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-07T01:07:11.479 INFO:teuthology.orchestra.console.smithi006:Power on 2024-02-07T01:07:11.480 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-07T01:07:11.494 DEBUG:teuthology.orchestra.console.smithi113:power on output: Chassis Power Control: Up/On 2024-02-07T01:07:11.495 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T01:07:11.504 DEBUG:teuthology.orchestra.console.smithi006:power on output: Chassis Power Control: Up/On 2024-02-07T01:07:11.504 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T01:07:11.517 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2024-02-07T01:07:11.517 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off 2024-02-07T01:07:11.525 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2024-02-07T01:07:15.520 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T01:07:15.527 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T01:07:15.534 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T01:07:15.630 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2024-02-07T01:07:15.636 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2024-02-07T01:07:15.643 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2024-02-07T01:07:15.731 INFO:teuthology.orchestra.console.smithi151:Power on completed 2024-02-07T01:07:15.737 INFO:teuthology.orchestra.console.smithi113:Power on completed 2024-02-07T01:07:15.832 INFO:teuthology.provision.fog.smithi151:Waiting for deploy to finish 2024-02-07T01:07:15.838 INFO:teuthology.provision.fog.smithi113:Waiting for deploy to finish 2024-02-07T01:07:19.646 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T01:07:19.761 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2024-02-07T01:07:19.862 INFO:teuthology.orchestra.console.smithi006:Power on completed 2024-02-07T01:07:19.963 INFO:teuthology.provision.fog.smithi006:Waiting for deploy to finish 2024-02-07T01:09:50.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T01:09:53.852 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-02-07T01:09:59.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T01:10:01.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T01:10:02.908 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-02-07T01:10:04.861 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-02-07T01:10:08.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T01:10:10.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T01:10:11.964 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-02-07T01:10:13.916 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-02-07T01:10:16.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T01:10:17.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T01:10:19.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T01:10:19.932 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-02-07T01:10:21.020 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-02-07T01:10:22.976 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-02-07T01:10:25.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T01:10:27.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T01:10:28.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T01:10:28.992 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-02-07T01:10:30.076 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-02-07T01:10:32.060 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-02-07T01:10:34.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T01:10:36.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T01:10:38.048 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-02-07T01:10:38.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T01:10:39.132 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-02-07T01:10:41.116 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-02-07T01:10:44.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T01:10:45.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T01:10:47.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T01:10:47.136 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-02-07T01:10:50.176 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-02-07T01:10:53.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T01:10:56.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T01:10:56.223 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-02-07T01:11:02.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T01:11:05.308 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-02-07T01:11:11.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T01:11:14.368 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-02-07T01:11:20.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T01:11:23.456 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-02-07T01:11:29.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T01:11:45.152 WARNING:teuthology.provision.fog.smithi006:timed out 2024-02-07T01:11:51.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T01:11:51.459 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-07T01:11:51.459 DEBUG:teuthology.orchestra.run.smithi006:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-07T01:11:51.793 INFO:teuthology.provision.fog.smithi006:Node is ready 2024-02-07T01:11:51.793 DEBUG:teuthology.orchestra.run.smithi006:> hostname 2024-02-07T01:11:51.809 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006.front.sepia.ceph.com 2024-02-07T01:11:51.809 DEBUG:teuthology.orchestra.run.smithi006:> grep smithi006.front.sepia.ceph.com /etc/hosts 2024-02-07T01:11:51.865 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6 smithi006.front.sepia.ceph.com smithi006 2024-02-07T01:11:51.866 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname smithi006 2024-02-07T01:11:51.985 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hosts 2024-02-07T01:11:52.017 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/172.21.15.6/172.21.15.6/g' /etc/hosts 2024-02-07T01:11:52.090 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hostname 2024-02-07T01:11:52.163 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname smithi006 2024-02-07T01:11:52.234 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2024-02-07T01:11:52.289 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="CentOS Stream" 2024-02-07T01:11:52.289 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="9" 2024-02-07T01:11:52.289 INFO:teuthology.orchestra.run.smithi006.stdout:ID="centos" 2024-02-07T01:11:52.289 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="rhel fedora" 2024-02-07T01:11:52.290 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="9" 2024-02-07T01:11:52.290 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el9" 2024-02-07T01:11:52.290 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-07T01:11:52.290 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2024-02-07T01:11:52.290 INFO:teuthology.orchestra.run.smithi006.stdout:LOGO="fedora-logo-icon" 2024-02-07T01:11:52.290 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-07T01:11:52.290 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://centos.org/" 2024-02-07T01:11:52.290 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-07T01:11:52.291 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-07T01:11:52.291 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-07T01:11:52.291 INFO:teuthology.provision.fog.smithi006:Deploy complete! 2024-02-07T01:11:52.293 DEBUG:teuthology.parallel:result is None 2024-02-07T01:11:56.184 WARNING:teuthology.provision.fog.smithi151:timed out 2024-02-07T01:12:02.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T01:12:02.599 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-07T01:12:02.600 DEBUG:teuthology.orchestra.run.smithi151:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-07T01:12:02.922 INFO:teuthology.provision.fog.smithi151:Node is ready 2024-02-07T01:12:02.923 DEBUG:teuthology.orchestra.run.smithi151:> hostname 2024-02-07T01:12:02.937 INFO:teuthology.orchestra.run.smithi151.stdout:smithi151.front.sepia.ceph.com 2024-02-07T01:12:02.937 DEBUG:teuthology.orchestra.run.smithi151:> grep smithi151.front.sepia.ceph.com /etc/hosts 2024-02-07T01:12:02.992 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151 smithi151.front.sepia.ceph.com smithi151 2024-02-07T01:12:02.993 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151 2024-02-07T01:12:03.097 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151.front.sepia.ceph.com/smithi151/g' /etc/hosts 2024-02-07T01:12:03.125 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/172.21.15.151/172.21.15.151/g' /etc/hosts 2024-02-07T01:12:03.193 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151.front.sepia.ceph.com/smithi151/g' /etc/hostname 2024-02-07T01:12:03.261 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151 2024-02-07T01:12:03.327 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2024-02-07T01:12:03.382 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="CentOS Stream" 2024-02-07T01:12:03.382 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="9" 2024-02-07T01:12:03.383 INFO:teuthology.orchestra.run.smithi151.stdout:ID="centos" 2024-02-07T01:12:03.383 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="rhel fedora" 2024-02-07T01:12:03.383 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="9" 2024-02-07T01:12:03.383 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el9" 2024-02-07T01:12:03.383 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-07T01:12:03.383 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31" 2024-02-07T01:12:03.383 INFO:teuthology.orchestra.run.smithi151.stdout:LOGO="fedora-logo-icon" 2024-02-07T01:12:03.383 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-07T01:12:03.383 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://centos.org/" 2024-02-07T01:12:03.383 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-07T01:12:03.383 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-07T01:12:03.383 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-07T01:12:03.384 INFO:teuthology.provision.fog.smithi151:Deploy complete! 2024-02-07T01:12:03.384 DEBUG:teuthology.parallel:result is None 2024-02-07T01:12:29.489 WARNING:teuthology.provision.fog.smithi113:timed out 2024-02-07T01:12:35.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T01:12:35.863 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-07T01:12:35.864 DEBUG:teuthology.orchestra.run.smithi113:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-07T01:12:36.203 INFO:teuthology.provision.fog.smithi113:Node is ready 2024-02-07T01:12:36.204 DEBUG:teuthology.orchestra.run.smithi113:> hostname 2024-02-07T01:12:36.221 INFO:teuthology.orchestra.run.smithi113.stdout:smithi113.front.sepia.ceph.com 2024-02-07T01:12:36.221 DEBUG:teuthology.orchestra.run.smithi113:> grep smithi113.front.sepia.ceph.com /etc/hosts 2024-02-07T01:12:36.276 INFO:teuthology.orchestra.run.smithi113.stdout:172.21.15.113 smithi113.front.sepia.ceph.com smithi113 2024-02-07T01:12:36.276 DEBUG:teuthology.orchestra.run.smithi113:> sudo hostname smithi113 2024-02-07T01:12:36.396 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/smithi113.front.sepia.ceph.com/smithi113/g' /etc/hosts 2024-02-07T01:12:36.425 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/172.21.15.113/172.21.15.113/g' /etc/hosts 2024-02-07T01:12:36.494 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/smithi113.front.sepia.ceph.com/smithi113/g' /etc/hostname 2024-02-07T01:12:36.561 DEBUG:teuthology.orchestra.run.smithi113:> sudo hostname smithi113 2024-02-07T01:12:36.628 DEBUG:teuthology.orchestra.run.smithi113:> cat /etc/os-release 2024-02-07T01:12:36.682 INFO:teuthology.orchestra.run.smithi113.stdout:NAME="CentOS Stream" 2024-02-07T01:12:36.682 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION="9" 2024-02-07T01:12:36.682 INFO:teuthology.orchestra.run.smithi113.stdout:ID="centos" 2024-02-07T01:12:36.682 INFO:teuthology.orchestra.run.smithi113.stdout:ID_LIKE="rhel fedora" 2024-02-07T01:12:36.682 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_ID="9" 2024-02-07T01:12:36.682 INFO:teuthology.orchestra.run.smithi113.stdout:PLATFORM_ID="platform:el9" 2024-02-07T01:12:36.682 INFO:teuthology.orchestra.run.smithi113.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-07T01:12:36.682 INFO:teuthology.orchestra.run.smithi113.stdout:ANSI_COLOR="0;31" 2024-02-07T01:12:36.682 INFO:teuthology.orchestra.run.smithi113.stdout:LOGO="fedora-logo-icon" 2024-02-07T01:12:36.682 INFO:teuthology.orchestra.run.smithi113.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-07T01:12:36.683 INFO:teuthology.orchestra.run.smithi113.stdout:HOME_URL="https://centos.org/" 2024-02-07T01:12:36.683 INFO:teuthology.orchestra.run.smithi113.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-07T01:12:36.683 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-07T01:12:36.683 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-07T01:12:36.683 INFO:teuthology.provision.fog.smithi113:Deploy complete! 2024-02-07T01:12:36.684 DEBUG:teuthology.parallel:result is None 2024-02-07T01:12:36.904 INFO:teuthology.lock.ops:Checking smithi006.front.sepia.ceph.com 2024-02-07T01:12:36.904 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-07T01:12:36.936 INFO:teuthology.lock.ops:Checking smithi113.front.sepia.ceph.com 2024-02-07T01:12:36.936 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-07T01:12:36.961 INFO:teuthology.lock.ops:Checking smithi151.front.sepia.ceph.com 2024-02-07T01:12:36.961 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-07T01:12:36.979 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: set os type and version on server 2024-02-07T01:12:36.979 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-02-07T01:12:36.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T01:12:37.087 DEBUG:teuthology.orchestra.run.smithi006:> true 2024-02-07T01:12:37.270 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-02-07T01:12:37.270 DEBUG:teuthology.orchestra.run.smithi006:> uname -m 2024-02-07T01:12:37.325 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2024-02-07T01:12:37.325 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2024-02-07T01:12:37.381 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="CentOS Stream" 2024-02-07T01:12:37.381 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="9" 2024-02-07T01:12:37.381 INFO:teuthology.orchestra.run.smithi006.stdout:ID="centos" 2024-02-07T01:12:37.381 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="rhel fedora" 2024-02-07T01:12:37.381 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="9" 2024-02-07T01:12:37.381 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el9" 2024-02-07T01:12:37.381 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-07T01:12:37.381 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2024-02-07T01:12:37.381 INFO:teuthology.orchestra.run.smithi006.stdout:LOGO="fedora-logo-icon" 2024-02-07T01:12:37.381 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-07T01:12:37.381 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://centos.org/" 2024-02-07T01:12:37.381 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-07T01:12:37.382 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-07T01:12:37.382 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-07T01:12:37.382 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2024-02-07T01:12:37.411 INFO:teuthology.lock.ops:Updating [smithi113.front.sepia.ceph.com]: set os type and version on server 2024-02-07T01:12:37.411 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi113.front.sepia.ceph.com' 2024-02-07T01:12:37.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T01:12:37.505 DEBUG:teuthology.orchestra.run.smithi113:> true 2024-02-07T01:12:37.571 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi113.front.sepia.ceph.com' 2024-02-07T01:12:37.571 DEBUG:teuthology.orchestra.run.smithi113:> uname -m 2024-02-07T01:12:37.625 INFO:teuthology.orchestra.run.smithi113.stdout:x86_64 2024-02-07T01:12:37.626 DEBUG:teuthology.orchestra.run.smithi113:> cat /etc/os-release 2024-02-07T01:12:37.681 INFO:teuthology.orchestra.run.smithi113.stdout:NAME="CentOS Stream" 2024-02-07T01:12:37.681 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION="9" 2024-02-07T01:12:37.681 INFO:teuthology.orchestra.run.smithi113.stdout:ID="centos" 2024-02-07T01:12:37.681 INFO:teuthology.orchestra.run.smithi113.stdout:ID_LIKE="rhel fedora" 2024-02-07T01:12:37.681 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_ID="9" 2024-02-07T01:12:37.681 INFO:teuthology.orchestra.run.smithi113.stdout:PLATFORM_ID="platform:el9" 2024-02-07T01:12:37.681 INFO:teuthology.orchestra.run.smithi113.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-07T01:12:37.681 INFO:teuthology.orchestra.run.smithi113.stdout:ANSI_COLOR="0;31" 2024-02-07T01:12:37.682 INFO:teuthology.orchestra.run.smithi113.stdout:LOGO="fedora-logo-icon" 2024-02-07T01:12:37.682 INFO:teuthology.orchestra.run.smithi113.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-07T01:12:37.682 INFO:teuthology.orchestra.run.smithi113.stdout:HOME_URL="https://centos.org/" 2024-02-07T01:12:37.682 INFO:teuthology.orchestra.run.smithi113.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-07T01:12:37.682 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-07T01:12:37.682 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-07T01:12:37.682 INFO:teuthology.lock.ops:Updating smithi113.front.sepia.ceph.com on lock server 2024-02-07T01:12:37.703 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: set os type and version on server 2024-02-07T01:12:37.703 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-02-07T01:12:37.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T01:12:37.794 DEBUG:teuthology.orchestra.run.smithi151:> true 2024-02-07T01:12:37.958 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-02-07T01:12:37.958 DEBUG:teuthology.orchestra.run.smithi151:> uname -m 2024-02-07T01:12:38.013 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2024-02-07T01:12:38.013 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2024-02-07T01:12:38.066 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="CentOS Stream" 2024-02-07T01:12:38.066 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="9" 2024-02-07T01:12:38.067 INFO:teuthology.orchestra.run.smithi151.stdout:ID="centos" 2024-02-07T01:12:38.067 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="rhel fedora" 2024-02-07T01:12:38.067 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="9" 2024-02-07T01:12:38.067 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el9" 2024-02-07T01:12:38.067 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-07T01:12:38.067 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31" 2024-02-07T01:12:38.067 INFO:teuthology.orchestra.run.smithi151.stdout:LOGO="fedora-logo-icon" 2024-02-07T01:12:38.067 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-07T01:12:38.067 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://centos.org/" 2024-02-07T01:12:38.067 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-07T01:12:38.067 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-07T01:12:38.067 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-07T01:12:38.068 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2024-02-07T01:12:38.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T01:12:38.182 INFO:teuthology.dispatcher.supervisor:Running job 7549357 2024-02-07T01:12:38.182 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-02-07_00:12:44-rados-wip-yuri2-testing-2024-02-06-1154-distro-default-smithi/7549357 --name yuriw-2024-02-07_00:12:44-rados-wip-yuri2-testing-2024-02-06-1154-distro-default-smithi --description rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_monitoring_stack_basic} -- /home/teuthworker/archive/yuriw-2024-02-07_00:12:44-rados-wip-yuri2-testing-2024-02-06-1154-distro-default-smithi/7549357/orig.config.yaml 2024-02-07T01:12:38.185 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-02-07_00:12:44-rados-wip-yuri2-testing-2024-02-06-1154-distro-default-smithi/7549357 2024-02-07T01:12:38.186 INFO:teuthology.dispatcher.supervisor:Job PID: 681485 2024-02-07T01:12:38.186 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-07T01:14:38.285 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T01:16:38.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T01:18:38.641 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T01:20:38.818 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T01:22:38.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T01:24:39.164 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T01:26:39.490 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T01:28:39.666 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T01:30:39.858 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T01:32:40.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T01:34:40.185 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T01:36:40.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T01:36:40.431 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1