2024-04-13T17:04:51.705 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-13T17:04:51.706 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T17:04:51.891 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1ac4d9ec10>, signals=[15]) 2024-04-13T17:04:51.892 INFO:teuthology.lock.ops:Start node 'smithi132.front.sepia.ceph.com' reimaging 2024-04-13T17:04:51.892 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: reset os type and version on server 2024-04-13T17:04:51.892 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2024-04-13T17:04:51.918 INFO:teuthology.lock.ops:Start node 'smithi142.front.sepia.ceph.com' reimaging 2024-04-13T17:04:51.918 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: reset os type and version on server 2024-04-13T17:04:51.918 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2024-04-13T17:04:51.942 INFO:teuthology.lock.ops:Start node 'smithi190.front.sepia.ceph.com' reimaging 2024-04-13T17:04:51.943 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: reset os type and version on server 2024-04-13T17:04:51.943 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2024-04-13T17:04:52.042 DEBUG:teuthology.provision.fog.smithi132:Requesting image smithi_rhel_8.6 (ID 5) 2024-04-13T17:04:52.059 DEBUG:teuthology.provision.fog.smithi142:Requesting image smithi_rhel_8.6 (ID 5) 2024-04-13T17:04:52.067 DEBUG:teuthology.provision.fog.smithi190:Requesting image smithi_rhel_8.6 (ID 5) 2024-04-13T17:04:52.105 INFO:teuthology.provision.fog.smithi132:Scheduling deploy of rhel 8.6 2024-04-13T17:04:52.114 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of rhel 8.6 2024-04-13T17:04:52.120 INFO:teuthology.provision.fog.smithi190:Scheduling deploy of rhel 8.6 2024-04-13T17:04:52.387 INFO:teuthology.orchestra.console.smithi132:Power off 2024-04-13T17:04:52.388 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-13T17:04:52.405 INFO:teuthology.orchestra.console.smithi190:Power off 2024-04-13T17:04:52.405 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-13T17:04:52.419 INFO:teuthology.orchestra.console.smithi142:Power off 2024-04-13T17:04:52.419 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-13T17:04:52.426 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off 2024-04-13T17:04:52.427 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T17:04:52.435 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off 2024-04-13T17:04:52.436 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T17:04:52.451 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off 2024-04-13T17:04:52.452 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T17:04:52.463 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2024-04-13T17:04:52.466 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2024-04-13T17:04:52.484 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2024-04-13T17:04:52.564 INFO:teuthology.orchestra.console.smithi190:Power off completed 2024-04-13T17:04:52.585 INFO:teuthology.orchestra.console.smithi142:Power off completed 2024-04-13T17:04:52.665 INFO:teuthology.orchestra.console.smithi190:Power on 2024-04-13T17:04:52.666 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-13T17:04:52.686 INFO:teuthology.orchestra.console.smithi142:Power on 2024-04-13T17:04:52.687 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-13T17:04:52.698 DEBUG:teuthology.orchestra.console.smithi190:power on output: Chassis Power Control: Up/On 2024-04-13T17:04:52.699 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T17:04:52.714 DEBUG:teuthology.orchestra.console.smithi142:power on output: Chassis Power Control: Up/On 2024-04-13T17:04:52.714 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T17:04:52.725 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2024-04-13T17:04:52.738 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2024-04-13T17:04:56.470 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T17:04:56.601 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2024-04-13T17:04:56.728 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T17:04:56.741 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T17:04:56.843 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2024-04-13T17:04:56.859 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2024-04-13T17:04:56.944 INFO:teuthology.orchestra.console.smithi190:Power on completed 2024-04-13T17:04:57.045 INFO:teuthology.provision.fog.smithi190:Waiting for deploy to finish 2024-04-13T17:05:00.606 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T17:05:00.716 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2024-04-13T17:05:00.860 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T17:05:00.972 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-04-13T17:05:01.072 INFO:teuthology.orchestra.console.smithi142:Power on completed 2024-04-13T17:05:01.173 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish 2024-04-13T17:05:04.718 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T17:05:04.829 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2024-04-13T17:05:04.930 INFO:teuthology.orchestra.console.smithi132:Power off completed 2024-04-13T17:05:05.031 INFO:teuthology.orchestra.console.smithi132:Power on 2024-04-13T17:05:05.031 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-13T17:05:05.053 DEBUG:teuthology.orchestra.console.smithi132:power on output: Chassis Power Control: Up/On 2024-04-13T17:05:05.053 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T17:05:05.075 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2024-04-13T17:05:09.078 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T17:05:09.188 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2024-04-13T17:05:13.190 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T17:05:13.300 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2024-04-13T17:05:13.401 INFO:teuthology.orchestra.console.smithi132:Power on completed 2024-04-13T17:05:13.502 INFO:teuthology.provision.fog.smithi132:Waiting for deploy to finish 2024-04-13T17:07:32.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T17:07:35.262 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-04-13T17:07:41.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T17:07:43.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T17:07:44.318 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-04-13T17:07:46.370 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2024-04-13T17:07:50.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T17:07:52.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T17:07:53.378 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-04-13T17:07:55.458 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2024-04-13T17:07:59.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T17:08:01.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T17:08:02.462 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-04-13T17:08:04.542 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2024-04-13T17:08:08.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T17:08:10.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T17:08:11.518 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-04-13T17:08:13.598 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2024-04-13T17:08:17.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T17:08:19.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T17:08:20.578 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-04-13T17:08:22.654 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2024-04-13T17:08:26.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T17:08:28.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T17:08:44.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T17:08:48.002 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-04-13T17:08:54.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T17:08:57.086 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-04-13T17:09:03.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T17:09:06.178 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-04-13T17:09:12.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T17:09:15.262 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-04-13T17:09:21.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T17:09:24.322 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-04-13T17:09:26.586 WARNING:teuthology.provision.fog.smithi142:timed out 2024-04-13T17:09:28.661 WARNING:teuthology.provision.fog.smithi190:timed out 2024-04-13T17:09:30.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T17:09:32.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T17:09:32.845 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-13T17:09:32.846 DEBUG:teuthology.orchestra.run.smithi142:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-13T17:09:33.103 INFO:teuthology.provision.fog.smithi142:Node is ready 2024-04-13T17:09:33.104 DEBUG:teuthology.orchestra.run.smithi142:> hostname 2024-04-13T17:09:33.127 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142 2024-04-13T17:09:33.127 DEBUG:teuthology.orchestra.run.smithi142:> grep smithi142 /etc/hosts 2024-04-13T17:09:33.190 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142 2024-04-13T17:09:33.190 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142 2024-04-13T17:09:33.299 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142/smithi142/g' /etc/hosts 2024-04-13T17:09:33.330 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/172.21.15.142/172.21.15.142/g' /etc/hosts 2024-04-13T17:09:33.400 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142/smithi142/g' /etc/hostname 2024-04-13T17:09:33.406 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-04-13T17:09:33.472 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142 2024-04-13T17:09:33.542 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2024-04-13T17:09:33.601 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Red Hat Enterprise Linux" 2024-04-13T17:09:33.601 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8.6 (Ootpa)" 2024-04-13T17:09:33.601 INFO:teuthology.orchestra.run.smithi142.stdout:ID="rhel" 2024-04-13T17:09:33.601 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="fedora" 2024-04-13T17:09:33.602 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8.6" 2024-04-13T17:09:33.602 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8" 2024-04-13T17:09:33.602 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-13T17:09:33.602 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2024-04-13T17:09:33.602 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-13T17:09:33.602 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.redhat.com/" 2024-04-13T17:09:33.602 INFO:teuthology.orchestra.run.smithi142.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-13T17:09:33.602 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-13T17:09:33.602 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-13T17:09:33.602 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-13T17:09:33.602 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-13T17:09:33.602 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-13T17:09:33.602 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-13T17:09:33.603 INFO:teuthology.provision.fog.smithi142:Deploy complete! 2024-04-13T17:09:33.605 DEBUG:teuthology.parallel:result is None 2024-04-13T17:09:34.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T17:09:34.924 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-13T17:09:34.924 DEBUG:teuthology.orchestra.run.smithi190:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-13T17:09:35.163 INFO:teuthology.provision.fog.smithi190:Node is ready 2024-04-13T17:09:35.164 DEBUG:teuthology.orchestra.run.smithi190:> hostname 2024-04-13T17:09:35.181 INFO:teuthology.orchestra.run.smithi190.stdout:smithi190.front.sepia.ceph.com 2024-04-13T17:09:35.181 DEBUG:teuthology.orchestra.run.smithi190:> grep smithi190.front.sepia.ceph.com /etc/hosts 2024-04-13T17:09:35.239 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.15.190 smithi190.front.sepia.ceph.com smithi190 2024-04-13T17:09:35.239 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2024-04-13T17:09:35.351 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190.front.sepia.ceph.com/smithi190/g' /etc/hosts 2024-04-13T17:09:35.378 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/172.21.15.190/172.21.15.190/g' /etc/hosts 2024-04-13T17:09:35.445 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190.front.sepia.ceph.com/smithi190/g' /etc/hostname 2024-04-13T17:09:35.512 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2024-04-13T17:09:35.578 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2024-04-13T17:09:35.635 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Red Hat Enterprise Linux" 2024-04-13T17:09:35.635 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8.6 (Ootpa)" 2024-04-13T17:09:35.635 INFO:teuthology.orchestra.run.smithi190.stdout:ID="rhel" 2024-04-13T17:09:35.635 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="fedora" 2024-04-13T17:09:35.635 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8.6" 2024-04-13T17:09:35.635 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8" 2024-04-13T17:09:35.635 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-13T17:09:35.635 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2024-04-13T17:09:35.636 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-13T17:09:35.636 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.redhat.com/" 2024-04-13T17:09:35.636 INFO:teuthology.orchestra.run.smithi190.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-13T17:09:35.636 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-13T17:09:35.636 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-04-13T17:09:35.636 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-13T17:09:35.636 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-13T17:09:35.636 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-13T17:09:35.636 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-13T17:09:35.636 INFO:teuthology.provision.fog.smithi190:Deploy complete! 2024-04-13T17:09:35.637 DEBUG:teuthology.parallel:result is None 2024-04-13T17:09:39.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T17:09:57.919 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-04-13T17:10:03.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T17:10:06.978 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-04-13T17:10:12.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T17:10:16.062 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-04-13T17:10:22.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T17:10:23.389 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-13T17:10:23.389 DEBUG:teuthology.orchestra.run.smithi132:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-13T17:10:38.780 INFO:teuthology.provision.fog.smithi132:Node is ready 2024-04-13T17:10:38.781 DEBUG:teuthology.orchestra.run.smithi132:> hostname 2024-04-13T17:10:38.803 INFO:teuthology.orchestra.run.smithi132.stdout:smithi132.front.sepia.ceph.com 2024-04-13T17:10:38.803 DEBUG:teuthology.orchestra.run.smithi132:> grep smithi132.front.sepia.ceph.com /etc/hosts 2024-04-13T17:10:38.861 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.15.132 smithi132.front.sepia.ceph.com smithi132 2024-04-13T17:10:38.862 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2024-04-13T17:10:38.999 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hosts 2024-04-13T17:10:39.029 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/172.21.15.132/172.21.15.132/g' /etc/hosts 2024-04-13T17:10:39.097 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hostname 2024-04-13T17:10:39.166 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2024-04-13T17:10:39.234 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2024-04-13T17:10:39.291 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="Red Hat Enterprise Linux" 2024-04-13T17:10:39.291 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8.6 (Ootpa)" 2024-04-13T17:10:39.291 INFO:teuthology.orchestra.run.smithi132.stdout:ID="rhel" 2024-04-13T17:10:39.291 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="fedora" 2024-04-13T17:10:39.291 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8.6" 2024-04-13T17:10:39.291 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8" 2024-04-13T17:10:39.291 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-13T17:10:39.291 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2024-04-13T17:10:39.292 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-13T17:10:39.292 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://www.redhat.com/" 2024-04-13T17:10:39.292 INFO:teuthology.orchestra.run.smithi132.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-13T17:10:39.292 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-13T17:10:39.292 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-13T17:10:39.292 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-13T17:10:39.292 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-13T17:10:39.292 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-13T17:10:39.292 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-13T17:10:39.292 INFO:teuthology.provision.fog.smithi132:Deploy complete! 2024-04-13T17:10:39.293 DEBUG:teuthology.parallel:result is None 2024-04-13T17:10:39.486 INFO:teuthology.lock.ops:Checking smithi132.front.sepia.ceph.com 2024-04-13T17:10:39.487 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-13T17:10:39.510 INFO:teuthology.lock.ops:Checking smithi142.front.sepia.ceph.com 2024-04-13T17:10:39.510 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-13T17:10:39.526 INFO:teuthology.lock.ops:Checking smithi190.front.sepia.ceph.com 2024-04-13T17:10:39.526 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-13T17:10:39.552 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: set os type and version on server 2024-04-13T17:10:39.552 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-04-13T17:10:39.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T17:10:39.622 DEBUG:teuthology.orchestra.run.smithi132:> true 2024-04-13T17:10:39.646 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-04-13T17:10:39.647 DEBUG:teuthology.orchestra.run.smithi132:> uname -m 2024-04-13T17:10:39.703 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2024-04-13T17:10:39.704 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2024-04-13T17:10:39.760 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="Red Hat Enterprise Linux" 2024-04-13T17:10:39.760 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8.6 (Ootpa)" 2024-04-13T17:10:39.760 INFO:teuthology.orchestra.run.smithi132.stdout:ID="rhel" 2024-04-13T17:10:39.760 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="fedora" 2024-04-13T17:10:39.760 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8.6" 2024-04-13T17:10:39.760 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8" 2024-04-13T17:10:39.760 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-13T17:10:39.760 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2024-04-13T17:10:39.760 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-13T17:10:39.761 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://www.redhat.com/" 2024-04-13T17:10:39.761 INFO:teuthology.orchestra.run.smithi132.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-13T17:10:39.761 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-13T17:10:39.761 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-13T17:10:39.761 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-13T17:10:39.761 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-13T17:10:39.761 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-13T17:10:39.761 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-13T17:10:39.761 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2024-04-13T17:10:39.776 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: set os type and version on server 2024-04-13T17:10:39.776 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-04-13T17:10:39.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T17:10:39.849 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-04-13T17:10:39.983 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-04-13T17:10:39.983 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2024-04-13T17:10:40.041 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2024-04-13T17:10:40.041 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2024-04-13T17:10:40.098 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Red Hat Enterprise Linux" 2024-04-13T17:10:40.098 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8.6 (Ootpa)" 2024-04-13T17:10:40.098 INFO:teuthology.orchestra.run.smithi142.stdout:ID="rhel" 2024-04-13T17:10:40.098 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="fedora" 2024-04-13T17:10:40.098 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8.6" 2024-04-13T17:10:40.098 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8" 2024-04-13T17:10:40.099 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-13T17:10:40.099 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2024-04-13T17:10:40.099 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-13T17:10:40.099 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.redhat.com/" 2024-04-13T17:10:40.099 INFO:teuthology.orchestra.run.smithi142.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-13T17:10:40.099 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-13T17:10:40.099 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-13T17:10:40.099 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-13T17:10:40.099 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-13T17:10:40.099 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-13T17:10:40.099 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-13T17:10:40.100 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2024-04-13T17:10:40.118 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: set os type and version on server 2024-04-13T17:10:40.118 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-04-13T17:10:40.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T17:10:40.191 DEBUG:teuthology.orchestra.run.smithi190:> true 2024-04-13T17:10:40.327 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-04-13T17:10:40.328 DEBUG:teuthology.orchestra.run.smithi190:> uname -m 2024-04-13T17:10:40.384 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2024-04-13T17:10:40.384 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2024-04-13T17:10:40.441 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Red Hat Enterprise Linux" 2024-04-13T17:10:40.441 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8.6 (Ootpa)" 2024-04-13T17:10:40.441 INFO:teuthology.orchestra.run.smithi190.stdout:ID="rhel" 2024-04-13T17:10:40.441 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="fedora" 2024-04-13T17:10:40.441 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8.6" 2024-04-13T17:10:40.441 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8" 2024-04-13T17:10:40.442 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-13T17:10:40.442 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2024-04-13T17:10:40.442 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-13T17:10:40.442 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.redhat.com/" 2024-04-13T17:10:40.442 INFO:teuthology.orchestra.run.smithi190.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-13T17:10:40.442 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-13T17:10:40.442 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-04-13T17:10:40.442 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-13T17:10:40.442 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-13T17:10:40.442 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-13T17:10:40.442 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-13T17:10:40.443 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2024-04-13T17:10:40.468 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T17:10:40.553 INFO:teuthology.dispatcher.supervisor:Running job 7651463 2024-04-13T17:10:40.553 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-10_22:24:02-fs-reef-distro-default-smithi/7651463 --name teuthology-2024-04-10_22:24:02-fs-reef-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/suites/dbench}} -- /home/teuthworker/archive/teuthology-2024-04-10_22:24:02-fs-reef-distro-default-smithi/7651463/orig.config.yaml 2024-04-13T17:10:40.556 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-10_22:24:02-fs-reef-distro-default-smithi/7651463 2024-04-13T17:10:40.556 INFO:teuthology.dispatcher.supervisor:Job PID: 1305893 2024-04-13T17:10:40.556 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-13T17:12:40.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T17:14:40.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T17:16:40.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T17:18:41.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T17:20:41.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T17:22:41.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T17:24:41.732 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T17:24:41.806 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1