2024-02-28T09:34:01.480 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55
2024-02-28T09:34:01.480 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T09:34:01.667 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f27f6398f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f27f73f9c10>, signals=[15])
2024-02-28T09:34:01.667 INFO:teuthology.lock.ops:Start node 'smithi026.front.sepia.ceph.com' reimaging
2024-02-28T09:34:01.667 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: reset os type and version on server
2024-02-28T09:34:01.667 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server
2024-02-28T09:34:01.685 INFO:teuthology.lock.ops:Start node 'smithi098.front.sepia.ceph.com' reimaging
2024-02-28T09:34:01.685 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: reset os type and version on server
2024-02-28T09:34:01.685 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server
2024-02-28T09:34:01.702 INFO:teuthology.lock.ops:Start node 'smithi163.front.sepia.ceph.com' reimaging
2024-02-28T09:34:01.702 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: reset os type and version on server
2024-02-28T09:34:01.702 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server
2024-02-28T09:34:01.792 DEBUG:teuthology.provision.fog.smithi026:Requesting image smithi_rhel_8.6 (ID 5)
2024-02-28T09:34:01.808 DEBUG:teuthology.provision.fog.smithi098:Requesting image smithi_rhel_8.6 (ID 5)
2024-02-28T09:34:01.834 INFO:teuthology.provision.fog.smithi026:Scheduling deploy of rhel 8.6
2024-02-28T09:34:01.841 DEBUG:teuthology.provision.fog.smithi163:Requesting image smithi_rhel_8.6 (ID 5)
2024-02-28T09:34:01.857 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of rhel 8.6
2024-02-28T09:34:01.886 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of rhel 8.6
2024-02-28T09:34:02.171 INFO:teuthology.orchestra.console.smithi098:Power off
2024-02-28T09:34:02.171 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-28T09:34:02.184 INFO:teuthology.orchestra.console.smithi163:Power off
2024-02-28T09:34:02.185 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-28T09:34:02.196 INFO:teuthology.orchestra.console.smithi026:Power off
2024-02-28T09:34:02.196 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-28T09:34:02.204 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off
2024-02-28T09:34:02.205 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T09:34:02.212 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off
2024-02-28T09:34:02.212 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T09:34:02.220 DEBUG:teuthology.orchestra.console.smithi026:power off output: Chassis Power Control: Down/Off
2024-02-28T09:34:02.220 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T09:34:02.229 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off
2024-02-28T09:34:02.232 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on
2024-02-28T09:34:02.241 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off
2024-02-28T09:34:02.330 INFO:teuthology.orchestra.console.smithi098:Power off completed
2024-02-28T09:34:02.343 INFO:teuthology.orchestra.console.smithi026:Power off completed
2024-02-28T09:34:02.432 INFO:teuthology.orchestra.console.smithi098:Power on
2024-02-28T09:34:02.432 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-28T09:34:02.444 INFO:teuthology.orchestra.console.smithi026:Power on
2024-02-28T09:34:02.444 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-28T09:34:02.452 DEBUG:teuthology.orchestra.console.smithi098:power on output: Chassis Power Control: Up/On
2024-02-28T09:34:02.452 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T09:34:02.468 DEBUG:teuthology.orchestra.console.smithi026:power on output: Chassis Power Control: Up/On
2024-02-28T09:34:02.468 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T09:34:02.477 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off
2024-02-28T09:34:02.491 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off
2024-02-28T09:34:06.239 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T09:34:06.348 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on
2024-02-28T09:34:06.478 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T09:34:06.492 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T09:34:06.587 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off
2024-02-28T09:34:06.602 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on
2024-02-28T09:34:06.702 INFO:teuthology.orchestra.console.smithi026:Power on completed
2024-02-28T09:34:06.803 INFO:teuthology.provision.fog.smithi026:Waiting for deploy to finish
2024-02-28T09:34:10.352 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T09:34:10.461 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on
2024-02-28T09:34:10.588 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T09:34:10.696 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on
2024-02-28T09:34:10.796 INFO:teuthology.orchestra.console.smithi098:Power on completed
2024-02-28T09:34:10.897 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish
2024-02-28T09:34:14.464 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T09:34:14.572 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off
2024-02-28T09:34:14.673 INFO:teuthology.orchestra.console.smithi163:Power off completed
2024-02-28T09:34:14.774 INFO:teuthology.orchestra.console.smithi163:Power on
2024-02-28T09:34:14.774 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-28T09:34:14.795 DEBUG:teuthology.orchestra.console.smithi163:power on output: Chassis Power Control: Up/On
2024-02-28T09:34:14.796 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T09:34:14.818 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off
2024-02-28T09:34:18.820 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T09:34:18.928 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on
2024-02-28T09:34:19.029 INFO:teuthology.orchestra.console.smithi163:Power on completed
2024-02-28T09:34:19.129 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish
2024-02-28T09:37:10.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:37:28.636 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2024-02-28T09:37:34.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:37:53.212 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2024-02-28T09:37:59.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:38:02.300 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2024-02-28T09:38:08.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:38:09.671 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-28T09:38:09.672 DEBUG:teuthology.orchestra.run.smithi026:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-28T09:38:25.211 INFO:teuthology.provision.fog.smithi026:Node is ready
2024-02-28T09:38:25.211 DEBUG:teuthology.orchestra.run.smithi026:> hostname
2024-02-28T09:38:25.235 INFO:teuthology.orchestra.run.smithi026.stdout:smithi045
2024-02-28T09:38:25.235 DEBUG:teuthology.orchestra.run.smithi026:> grep smithi045 /etc/hosts
2024-02-28T09:38:25.296 DEBUG:teuthology.orchestra.run:got remote process result: 1
2024-02-28T09:38:25.297 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi045/smithi026/g' /etc/hostname
2024-02-28T09:38:25.441 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026
2024-02-28T09:38:25.475 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release
2024-02-28T09:38:25.537 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="Red Hat Enterprise Linux"
2024-02-28T09:38:25.537 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="8.6 (Ootpa)"
2024-02-28T09:38:25.537 INFO:teuthology.orchestra.run.smithi026.stdout:ID="rhel"
2024-02-28T09:38:25.537 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="fedora"
2024-02-28T09:38:25.538 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="8.6"
2024-02-28T09:38:25.538 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el8"
2024-02-28T09:38:25.538 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-02-28T09:38:25.538 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31"
2024-02-28T09:38:25.538 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-02-28T09:38:25.538 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://www.redhat.com/"
2024-02-28T09:38:25.538 INFO:teuthology.orchestra.run.smithi026.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-02-28T09:38:25.538 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-28T09:38:25.538 INFO:teuthology.orchestra.run.smithi026.stdout:
2024-02-28T09:38:25.538 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-28T09:38:25.539 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-02-28T09:38:25.539 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-02-28T09:38:25.539 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-02-28T09:38:25.540 INFO:teuthology.provision.fog.smithi026:Deploy complete!
2024-02-28T09:38:25.541 DEBUG:teuthology.parallel:result is None
2024-02-28T09:39:20.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:39:23.100 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2024-02-28T09:39:29.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:39:32.188 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2024-02-28T09:39:38.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:39:41.276 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2024-02-28T09:39:47.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:39:50.332 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2024-02-28T09:39:56.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:39:59.388 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2024-02-28T09:40:05.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:40:08.476 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2024-02-28T09:40:14.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:40:32.956 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2024-02-28T09:40:38.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:40:42.044 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2024-02-28T09:40:48.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:40:51.137 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2024-02-28T09:40:54.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:40:57.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:40:57.410 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-28T09:40:57.410 DEBUG:teuthology.orchestra.run.smithi098:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-28T09:40:58.045 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-28T09:41:04.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:41:07.100 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-28T09:41:13.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:41:16.156 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-28T09:41:17.675 INFO:teuthology.provision.fog.smithi098:Node is ready
2024-02-28T09:41:17.675 DEBUG:teuthology.orchestra.run.smithi098:> hostname
2024-02-28T09:41:17.697 INFO:teuthology.orchestra.run.smithi098.stdout:smithi098.front.sepia.ceph.com
2024-02-28T09:41:17.698 DEBUG:teuthology.orchestra.run.smithi098:> grep smithi098.front.sepia.ceph.com /etc/hosts
2024-02-28T09:41:17.757 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98 smithi098.front.sepia.ceph.com smithi098
2024-02-28T09:41:17.757 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098
2024-02-28T09:41:17.880 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hosts
2024-02-28T09:41:17.909 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/172.21.15.98/172.21.15.98/g' /etc/hosts
2024-02-28T09:41:17.977 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hostname
2024-02-28T09:41:18.045 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098
2024-02-28T09:41:18.112 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release
2024-02-28T09:41:18.169 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="Red Hat Enterprise Linux"
2024-02-28T09:41:18.169 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="8.6 (Ootpa)"
2024-02-28T09:41:18.169 INFO:teuthology.orchestra.run.smithi098.stdout:ID="rhel"
2024-02-28T09:41:18.169 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="fedora"
2024-02-28T09:41:18.169 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="8.6"
2024-02-28T09:41:18.169 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el8"
2024-02-28T09:41:18.169 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-02-28T09:41:18.169 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31"
2024-02-28T09:41:18.169 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-02-28T09:41:18.169 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://www.redhat.com/"
2024-02-28T09:41:18.169 INFO:teuthology.orchestra.run.smithi098.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-02-28T09:41:18.169 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-28T09:41:18.170 INFO:teuthology.orchestra.run.smithi098.stdout:
2024-02-28T09:41:18.170 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-28T09:41:18.170 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-02-28T09:41:18.170 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-02-28T09:41:18.170 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-02-28T09:41:18.170 INFO:teuthology.provision.fog.smithi098:Deploy complete!
2024-02-28T09:41:18.171 DEBUG:teuthology.parallel:result is None
2024-02-28T09:41:22.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:41:25.244 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-28T09:41:31.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:41:34.332 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-28T09:41:40.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:41:43.420 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-28T09:41:49.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:41:52.476 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-28T09:41:58.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:42:01.532 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-28T09:42:07.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:42:10.592 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-28T09:42:16.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:43:16.659 WARNING:teuthology.provision.fog.smithi163:timed out
2024-02-28T09:43:22.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:43:22.922 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-28T09:43:22.922 DEBUG:teuthology.orchestra.run.smithi163:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-28T09:43:23.213 INFO:teuthology.provision.fog.smithi163:Node is ready
2024-02-28T09:43:23.213 DEBUG:teuthology.orchestra.run.smithi163:> hostname
2024-02-28T09:43:23.232 INFO:teuthology.orchestra.run.smithi163.stdout:smithi163
2024-02-28T09:43:23.232 DEBUG:teuthology.orchestra.run.smithi163:> grep smithi163 /etc/hosts
2024-02-28T09:43:23.291 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163 smithi163.front.sepia.ceph.com smithi163
2024-02-28T09:43:23.291 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163
2024-02-28T09:43:23.409 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163/smithi163/g' /etc/hosts
2024-02-28T09:43:23.439 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/172.21.15.163/172.21.15.163/g' /etc/hosts
2024-02-28T09:43:23.505 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163/smithi163/g' /etc/hostname
2024-02-28T09:43:23.573 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163
2024-02-28T09:43:23.637 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release
2024-02-28T09:43:23.692 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="Red Hat Enterprise Linux"
2024-02-28T09:43:23.692 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="8.6 (Ootpa)"
2024-02-28T09:43:23.692 INFO:teuthology.orchestra.run.smithi163.stdout:ID="rhel"
2024-02-28T09:43:23.692 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="fedora"
2024-02-28T09:43:23.692 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="8.6"
2024-02-28T09:43:23.692 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el8"
2024-02-28T09:43:23.692 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-02-28T09:43:23.692 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31"
2024-02-28T09:43:23.692 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-02-28T09:43:23.693 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://www.redhat.com/"
2024-02-28T09:43:23.693 INFO:teuthology.orchestra.run.smithi163.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-02-28T09:43:23.693 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-28T09:43:23.693 INFO:teuthology.orchestra.run.smithi163.stdout:
2024-02-28T09:43:23.693 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-28T09:43:23.693 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-02-28T09:43:23.693 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-02-28T09:43:23.693 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-02-28T09:43:23.693 INFO:teuthology.provision.fog.smithi163:Deploy complete!
2024-02-28T09:43:23.694 DEBUG:teuthology.parallel:result is None
2024-02-28T09:43:23.887 INFO:teuthology.lock.ops:Checking smithi026.front.sepia.ceph.com
2024-02-28T09:43:23.887 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-28T09:43:23.910 INFO:teuthology.lock.ops:Checking smithi098.front.sepia.ceph.com
2024-02-28T09:43:23.910 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-28T09:43:23.926 INFO:teuthology.lock.ops:Checking smithi163.front.sepia.ceph.com
2024-02-28T09:43:23.926 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-28T09:43:23.944 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: set os type and version on server
2024-02-28T09:43:23.944 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com'
2024-02-28T09:43:23.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:43:24.025 DEBUG:teuthology.orchestra.run.smithi026:> true
2024-02-28T09:43:24.172 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com'
2024-02-28T09:43:24.172 DEBUG:teuthology.orchestra.run.smithi026:> uname -m
2024-02-28T09:43:24.233 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64
2024-02-28T09:43:24.233 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release
2024-02-28T09:43:24.294 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="Red Hat Enterprise Linux"
2024-02-28T09:43:24.294 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="8.6 (Ootpa)"
2024-02-28T09:43:24.294 INFO:teuthology.orchestra.run.smithi026.stdout:ID="rhel"
2024-02-28T09:43:24.294 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="fedora"
2024-02-28T09:43:24.294 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="8.6"
2024-02-28T09:43:24.294 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el8"
2024-02-28T09:43:24.295 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-02-28T09:43:24.295 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31"
2024-02-28T09:43:24.295 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-02-28T09:43:24.295 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://www.redhat.com/"
2024-02-28T09:43:24.295 INFO:teuthology.orchestra.run.smithi026.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-02-28T09:43:24.295 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-28T09:43:24.295 INFO:teuthology.orchestra.run.smithi026.stdout:
2024-02-28T09:43:24.295 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-28T09:43:24.295 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-02-28T09:43:24.295 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-02-28T09:43:24.295 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-02-28T09:43:24.296 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server
2024-02-28T09:43:24.318 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: set os type and version on server
2024-02-28T09:43:24.319 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com'
2024-02-28T09:43:24.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:43:24.398 DEBUG:teuthology.orchestra.run.smithi098:> true
2024-02-28T09:43:24.538 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com'
2024-02-28T09:43:24.539 DEBUG:teuthology.orchestra.run.smithi098:> uname -m
2024-02-28T09:43:24.597 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64
2024-02-28T09:43:24.597 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release
2024-02-28T09:43:24.655 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="Red Hat Enterprise Linux"
2024-02-28T09:43:24.655 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="8.6 (Ootpa)"
2024-02-28T09:43:24.655 INFO:teuthology.orchestra.run.smithi098.stdout:ID="rhel"
2024-02-28T09:43:24.655 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="fedora"
2024-02-28T09:43:24.655 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="8.6"
2024-02-28T09:43:24.655 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el8"
2024-02-28T09:43:24.655 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-02-28T09:43:24.656 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31"
2024-02-28T09:43:24.656 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-02-28T09:43:24.656 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://www.redhat.com/"
2024-02-28T09:43:24.656 INFO:teuthology.orchestra.run.smithi098.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-02-28T09:43:24.656 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-28T09:43:24.656 INFO:teuthology.orchestra.run.smithi098.stdout:
2024-02-28T09:43:24.656 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-28T09:43:24.656 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-02-28T09:43:24.656 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-02-28T09:43:24.656 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-02-28T09:43:24.657 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server
2024-02-28T09:43:24.735 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: set os type and version on server
2024-02-28T09:43:24.735 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com'
2024-02-28T09:43:24.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:43:24.811 DEBUG:teuthology.orchestra.run.smithi163:> true
2024-02-28T09:43:24.883 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com'
2024-02-28T09:43:24.884 DEBUG:teuthology.orchestra.run.smithi163:> uname -m
2024-02-28T09:43:24.942 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64
2024-02-28T09:43:24.942 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release
2024-02-28T09:43:25.000 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="Red Hat Enterprise Linux"
2024-02-28T09:43:25.000 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="8.6 (Ootpa)"
2024-02-28T09:43:25.000 INFO:teuthology.orchestra.run.smithi163.stdout:ID="rhel"
2024-02-28T09:43:25.000 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="fedora"
2024-02-28T09:43:25.000 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="8.6"
2024-02-28T09:43:25.001 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el8"
2024-02-28T09:43:25.001 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-02-28T09:43:25.001 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31"
2024-02-28T09:43:25.001 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-02-28T09:43:25.001 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://www.redhat.com/"
2024-02-28T09:43:25.001 INFO:teuthology.orchestra.run.smithi163.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-02-28T09:43:25.001 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-28T09:43:25.001 INFO:teuthology.orchestra.run.smithi163.stdout:
2024-02-28T09:43:25.001 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-28T09:43:25.001 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-02-28T09:43:25.001 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-02-28T09:43:25.001 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-02-28T09:43:25.002 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server
2024-02-28T09:43:25.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T09:43:25.118 INFO:teuthology.dispatcher.supervisor:Running job 7575185
2024-02-28T09:43:25.118 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-02-28_09:32:44-fs-wip-vshankar-testing1-reef-2024-02-28-1133-testing-default-smithi/7575185 --name vshankar-2024-02-28_09:32:44-fs-wip-vshankar-testing1-reef-2024-02-28-1133-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/suites/fsync-tester}} -- /home/teuthworker/archive/vshankar-2024-02-28_09:32:44-fs-wip-vshankar-testing1-reef-2024-02-28-1133-testing-default-smithi/7575185/orig.config.yaml
2024-02-28T09:43:25.121 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-02-28_09:32:44-fs-wip-vshankar-testing1-reef-2024-02-28-1133-testing-default-smithi/7575185
2024-02-28T09:43:25.122 INFO:teuthology.dispatcher.supervisor:Job PID: 891462
2024-02-28T09:43:25.122 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-02-28T09:45:25.220 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T09:47:25.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T09:49:25.556 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T09:51:25.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T09:53:25.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T09:55:26.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T09:57:26.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T09:59:26.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T10:01:26.570 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T10:03:26.736 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T10:05:26.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T10:07:27.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T10:09:27.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T10:11:27.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T10:13:27.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T10:15:27.677 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T10:17:27.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T10:17:27.926 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1