2024-04-14T09:21:04.540 INFO:root:teuthology version: 0.0.1.dev265+gd7d6e60 2024-04-14T09:21:04.540 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-14T09:21:04.721 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa2ee25bc10>, signals=[15]) 2024-04-14T09:21:04.721 INFO:teuthology.lock.ops:Start node 'smithi006.front.sepia.ceph.com' reimaging 2024-04-14T09:21:04.721 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: reset os type and version on server 2024-04-14T09:21:04.721 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2024-04-14T09:21:04.748 INFO:teuthology.lock.ops:Start node 'smithi159.front.sepia.ceph.com' reimaging 2024-04-14T09:21:04.748 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: reset os type and version on server 2024-04-14T09:21:04.748 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2024-04-14T09:21:04.772 INFO:teuthology.lock.ops:Start node 'smithi194.front.sepia.ceph.com' reimaging 2024-04-14T09:21:04.773 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: reset os type and version on server 2024-04-14T09:21:04.773 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2024-04-14T09:21:04.867 DEBUG:teuthology.provision.fog.smithi006:Requesting image smithi_centos_9.stream (ID 10) 2024-04-14T09:21:04.884 DEBUG:teuthology.provision.fog.smithi159:Requesting image smithi_centos_9.stream (ID 10) 2024-04-14T09:21:04.902 DEBUG:teuthology.provision.fog.smithi194:Requesting image smithi_centos_9.stream (ID 10) 2024-04-14T09:21:04.915 INFO:teuthology.provision.fog.smithi006:Scheduling deploy of centos 9.stream 2024-04-14T09:21:04.925 INFO:teuthology.provision.fog.smithi159:Scheduling deploy of centos 9.stream 2024-04-14T09:21:04.947 INFO:teuthology.provision.fog.smithi194:Scheduling deploy of centos 9.stream 2024-04-14T09:21:05.254 INFO:teuthology.orchestra.console.smithi006:Power off 2024-04-14T09:21:05.255 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-14T09:21:05.273 INFO:teuthology.orchestra.console.smithi159:Power off 2024-04-14T09:21:05.273 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-14T09:21:05.287 INFO:teuthology.orchestra.console.smithi194:Power off 2024-04-14T09:21:05.287 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-14T09:21:05.294 DEBUG:teuthology.orchestra.console.smithi006:power off output: Chassis Power Control: Down/Off 2024-04-14T09:21:05.295 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T09:21:05.302 DEBUG:teuthology.orchestra.console.smithi159:power off output: Chassis Power Control: Down/Off 2024-04-14T09:21:05.302 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T09:21:05.311 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off 2024-04-14T09:21:05.312 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T09:21:05.319 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2024-04-14T09:21:05.324 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off 2024-04-14T09:21:05.332 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2024-04-14T09:21:05.421 INFO:teuthology.orchestra.console.smithi006:Power off completed 2024-04-14T09:21:05.425 INFO:teuthology.orchestra.console.smithi159:Power off completed 2024-04-14T09:21:05.432 INFO:teuthology.orchestra.console.smithi194:Power off completed 2024-04-14T09:21:05.522 INFO:teuthology.orchestra.console.smithi006:Power on 2024-04-14T09:21:05.522 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-14T09:21:05.531 INFO:teuthology.orchestra.console.smithi159:Power on 2024-04-14T09:21:05.531 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-14T09:21:05.539 INFO:teuthology.orchestra.console.smithi194:Power on 2024-04-14T09:21:05.539 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-14T09:21:05.550 DEBUG:teuthology.orchestra.console.smithi006:power on output: Chassis Power Control: Up/On 2024-04-14T09:21:05.551 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T09:21:05.560 DEBUG:teuthology.orchestra.console.smithi159:power on output: Chassis Power Control: Up/On 2024-04-14T09:21:05.560 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T09:21:05.569 DEBUG:teuthology.orchestra.console.smithi194:power on output: Chassis Power Control: Up/On 2024-04-14T09:21:05.569 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T09:21:05.576 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2024-04-14T09:21:05.585 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off 2024-04-14T09:21:05.589 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2024-04-14T09:21:09.581 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T09:21:09.589 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T09:21:09.595 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T09:21:09.691 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2024-04-14T09:21:09.697 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off 2024-04-14T09:21:09.704 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2024-04-14T09:21:09.793 INFO:teuthology.orchestra.console.smithi006:Power on completed 2024-04-14T09:21:09.893 INFO:teuthology.provision.fog.smithi006:Waiting for deploy to finish 2024-04-14T09:21:13.700 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T09:21:13.707 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T09:21:13.809 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on 2024-04-14T09:21:13.815 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2024-04-14T09:21:13.911 INFO:teuthology.orchestra.console.smithi159:Power on completed 2024-04-14T09:21:13.916 INFO:teuthology.orchestra.console.smithi194:Power on completed 2024-04-14T09:21:14.012 INFO:teuthology.provision.fog.smithi159:Waiting for deploy to finish 2024-04-14T09:21:14.017 INFO:teuthology.provision.fog.smithi194:Waiting for deploy to finish 2024-04-14T09:23:41.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:23:44.354 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-04-14T09:23:45.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:23:48.446 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-04-14T09:23:50.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:23:53.438 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-04-14T09:23:54.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:23:57.506 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-04-14T09:23:59.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:24:02.494 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-04-14T09:24:03.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:24:06.558 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-04-14T09:24:08.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:24:11.550 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-04-14T09:24:12.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:24:15.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:24:15.618 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-04-14T09:24:17.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:24:18.622 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2024-04-14T09:24:20.606 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-04-14T09:24:21.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:24:24.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:24:24.670 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-04-14T09:24:26.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:24:27.678 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2024-04-14T09:24:30.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:24:33.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:24:33.726 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-04-14T09:24:36.734 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2024-04-14T09:24:39.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:24:42.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:24:45.790 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2024-04-14T09:24:51.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:24:54.878 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2024-04-14T09:25:00.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:25:03.966 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2024-04-14T09:25:09.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:25:13.022 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2024-04-14T09:25:19.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:25:26.618 WARNING:teuthology.provision.fog.smithi006:timed out 2024-04-14T09:25:32.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:25:32.900 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-14T09:25:32.901 DEBUG:teuthology.orchestra.run.smithi006:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-14T09:25:33.225 INFO:teuthology.provision.fog.smithi006:Node is ready 2024-04-14T09:25:33.225 DEBUG:teuthology.orchestra.run.smithi006:> hostname 2024-04-14T09:25:33.240 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006.front.sepia.ceph.com 2024-04-14T09:25:33.240 DEBUG:teuthology.orchestra.run.smithi006:> grep smithi006.front.sepia.ceph.com /etc/hosts 2024-04-14T09:25:33.295 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6 smithi006.front.sepia.ceph.com smithi006 2024-04-14T09:25:33.295 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname smithi006 2024-04-14T09:25:33.418 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hosts 2024-04-14T09:25:33.450 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/172.21.15.6/172.21.15.6/g' /etc/hosts 2024-04-14T09:25:33.522 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hostname 2024-04-14T09:25:33.594 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname smithi006 2024-04-14T09:25:33.664 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2024-04-14T09:25:33.719 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="CentOS Stream" 2024-04-14T09:25:33.719 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="9" 2024-04-14T09:25:33.719 INFO:teuthology.orchestra.run.smithi006.stdout:ID="centos" 2024-04-14T09:25:33.719 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="rhel fedora" 2024-04-14T09:25:33.719 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="9" 2024-04-14T09:25:33.720 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el9" 2024-04-14T09:25:33.720 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-14T09:25:33.720 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2024-04-14T09:25:33.720 INFO:teuthology.orchestra.run.smithi006.stdout:LOGO="fedora-logo-icon" 2024-04-14T09:25:33.720 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-14T09:25:33.720 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://centos.org/" 2024-04-14T09:25:33.720 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-14T09:25:33.720 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-14T09:25:33.720 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-14T09:25:33.721 INFO:teuthology.provision.fog.smithi006:Deploy complete! 2024-04-14T09:25:33.722 DEBUG:teuthology.parallel:result is None 2024-04-14T09:25:39.738 WARNING:teuthology.provision.fog.smithi194:timed out 2024-04-14T09:25:45.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:25:46.004 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-14T09:25:46.004 DEBUG:teuthology.orchestra.run.smithi194:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-14T09:25:46.320 INFO:teuthology.provision.fog.smithi194:Node is ready 2024-04-14T09:25:46.320 DEBUG:teuthology.orchestra.run.smithi194:> hostname 2024-04-14T09:25:46.335 INFO:teuthology.orchestra.run.smithi194.stdout:smithi194.front.sepia.ceph.com 2024-04-14T09:25:46.335 DEBUG:teuthology.orchestra.run.smithi194:> grep smithi194.front.sepia.ceph.com /etc/hosts 2024-04-14T09:25:46.391 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.194 smithi194.front.sepia.ceph.com smithi194 2024-04-14T09:25:46.391 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194 2024-04-14T09:25:46.517 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194.front.sepia.ceph.com/smithi194/g' /etc/hosts 2024-04-14T09:25:46.546 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/172.21.15.194/172.21.15.194/g' /etc/hosts 2024-04-14T09:25:46.613 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194.front.sepia.ceph.com/smithi194/g' /etc/hostname 2024-04-14T09:25:46.681 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194 2024-04-14T09:25:46.748 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2024-04-14T09:25:46.803 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream" 2024-04-14T09:25:46.803 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="9" 2024-04-14T09:25:46.803 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos" 2024-04-14T09:25:46.803 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora" 2024-04-14T09:25:46.803 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="9" 2024-04-14T09:25:46.804 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el9" 2024-04-14T09:25:46.804 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-14T09:25:46.804 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2024-04-14T09:25:46.804 INFO:teuthology.orchestra.run.smithi194.stdout:LOGO="fedora-logo-icon" 2024-04-14T09:25:46.804 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-14T09:25:46.804 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/" 2024-04-14T09:25:46.804 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-14T09:25:46.804 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-14T09:25:46.804 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-14T09:25:46.804 INFO:teuthology.provision.fog.smithi194:Deploy complete! 2024-04-14T09:25:46.805 DEBUG:teuthology.parallel:result is None 2024-04-14T09:26:19.059 WARNING:teuthology.provision.fog.smithi159:timed out 2024-04-14T09:26:25.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:26:25.330 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-14T09:26:25.330 DEBUG:teuthology.orchestra.run.smithi159:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-14T09:26:25.647 INFO:teuthology.provision.fog.smithi159:Node is ready 2024-04-14T09:26:25.647 DEBUG:teuthology.orchestra.run.smithi159:> hostname 2024-04-14T09:26:25.662 INFO:teuthology.orchestra.run.smithi159.stdout:smithi159.front.sepia.ceph.com 2024-04-14T09:26:25.663 DEBUG:teuthology.orchestra.run.smithi159:> grep smithi159.front.sepia.ceph.com /etc/hosts 2024-04-14T09:26:25.719 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159 smithi159.front.sepia.ceph.com smithi159 2024-04-14T09:26:25.719 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159 2024-04-14T09:26:25.826 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hosts 2024-04-14T09:26:25.855 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/172.21.15.159/172.21.15.159/g' /etc/hosts 2024-04-14T09:26:25.923 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hostname 2024-04-14T09:26:25.991 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159 2024-04-14T09:26:26.057 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2024-04-14T09:26:26.111 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream" 2024-04-14T09:26:26.111 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="9" 2024-04-14T09:26:26.111 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos" 2024-04-14T09:26:26.111 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora" 2024-04-14T09:26:26.112 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="9" 2024-04-14T09:26:26.112 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el9" 2024-04-14T09:26:26.112 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-14T09:26:26.112 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2024-04-14T09:26:26.112 INFO:teuthology.orchestra.run.smithi159.stdout:LOGO="fedora-logo-icon" 2024-04-14T09:26:26.112 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-14T09:26:26.112 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/" 2024-04-14T09:26:26.112 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-14T09:26:26.112 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-14T09:26:26.113 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-14T09:26:26.113 INFO:teuthology.provision.fog.smithi159:Deploy complete! 2024-04-14T09:26:26.113 DEBUG:teuthology.parallel:result is None 2024-04-14T09:26:26.366 INFO:teuthology.lock.ops:Checking smithi006.front.sepia.ceph.com 2024-04-14T09:26:26.366 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-14T09:26:26.388 INFO:teuthology.lock.ops:Checking smithi159.front.sepia.ceph.com 2024-04-14T09:26:26.389 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-14T09:26:26.412 INFO:teuthology.lock.ops:Checking smithi194.front.sepia.ceph.com 2024-04-14T09:26:26.413 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-14T09:26:26.430 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: set os type and version on server 2024-04-14T09:26:26.430 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-04-14T09:26:26.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:26:26.534 DEBUG:teuthology.orchestra.run.smithi006:> true 2024-04-14T09:26:26.717 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-04-14T09:26:26.717 DEBUG:teuthology.orchestra.run.smithi006:> uname -m 2024-04-14T09:26:26.772 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2024-04-14T09:26:26.773 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2024-04-14T09:26:26.828 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="CentOS Stream" 2024-04-14T09:26:26.828 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="9" 2024-04-14T09:26:26.828 INFO:teuthology.orchestra.run.smithi006.stdout:ID="centos" 2024-04-14T09:26:26.828 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="rhel fedora" 2024-04-14T09:26:26.828 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="9" 2024-04-14T09:26:26.828 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el9" 2024-04-14T09:26:26.828 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-14T09:26:26.828 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2024-04-14T09:26:26.828 INFO:teuthology.orchestra.run.smithi006.stdout:LOGO="fedora-logo-icon" 2024-04-14T09:26:26.829 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-14T09:26:26.829 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://centos.org/" 2024-04-14T09:26:26.829 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-14T09:26:26.829 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-14T09:26:26.829 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-14T09:26:26.829 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2024-04-14T09:26:26.855 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: set os type and version on server 2024-04-14T09:26:26.855 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-04-14T09:26:26.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:26:26.943 DEBUG:teuthology.orchestra.run.smithi159:> true 2024-04-14T09:26:27.010 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-04-14T09:26:27.010 DEBUG:teuthology.orchestra.run.smithi159:> uname -m 2024-04-14T09:26:27.065 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64 2024-04-14T09:26:27.066 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2024-04-14T09:26:27.121 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream" 2024-04-14T09:26:27.121 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="9" 2024-04-14T09:26:27.121 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos" 2024-04-14T09:26:27.121 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora" 2024-04-14T09:26:27.121 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="9" 2024-04-14T09:26:27.121 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el9" 2024-04-14T09:26:27.121 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-14T09:26:27.121 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2024-04-14T09:26:27.121 INFO:teuthology.orchestra.run.smithi159.stdout:LOGO="fedora-logo-icon" 2024-04-14T09:26:27.121 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-14T09:26:27.122 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/" 2024-04-14T09:26:27.122 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-14T09:26:27.122 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-14T09:26:27.122 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-14T09:26:27.122 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2024-04-14T09:26:27.138 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: set os type and version on server 2024-04-14T09:26:27.138 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-04-14T09:26:27.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:26:27.228 DEBUG:teuthology.orchestra.run.smithi194:> true 2024-04-14T09:26:27.397 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-04-14T09:26:27.397 DEBUG:teuthology.orchestra.run.smithi194:> uname -m 2024-04-14T09:26:27.452 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2024-04-14T09:26:27.452 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2024-04-14T09:26:27.507 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream" 2024-04-14T09:26:27.507 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="9" 2024-04-14T09:26:27.507 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos" 2024-04-14T09:26:27.508 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora" 2024-04-14T09:26:27.508 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="9" 2024-04-14T09:26:27.508 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el9" 2024-04-14T09:26:27.508 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-14T09:26:27.508 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2024-04-14T09:26:27.508 INFO:teuthology.orchestra.run.smithi194.stdout:LOGO="fedora-logo-icon" 2024-04-14T09:26:27.508 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-14T09:26:27.508 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/" 2024-04-14T09:26:27.508 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-14T09:26:27.508 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-14T09:26:27.508 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-14T09:26:27.509 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2024-04-14T09:26:27.530 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-14T09:26:27.790 INFO:teuthology.dispatcher.supervisor:Running job 7638471 2024-04-14T09:26:27.790 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638471 --name teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/suites/dbench}} -- /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638471/orig.config.yaml 2024-04-14T09:26:27.795 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638471 2024-04-14T09:26:27.795 INFO:teuthology.dispatcher.supervisor:Job PID: 2461007 2024-04-14T09:26:27.795 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-14T09:28:27.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-14T09:30:28.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-14T09:32:28.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-14T09:34:28.394 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-14T09:36:28.568 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-14T09:38:28.732 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-14T09:40:28.904 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-14T09:40:28.974 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1