2023-11-28T18:44:11.379 INFO:root:teuthology version: 0.0.1.dev209+g5ae09a5
2023-11-28T18:44:11.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T18:44:11.531 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f45e97cdd30>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f45e94d4e50>, signals=[15])
2023-11-28T18:44:11.531 INFO:teuthology.lock.ops:Start node 'smithi103.front.sepia.ceph.com' reimaging
2023-11-28T18:44:11.531 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: reset os type and version on server
2023-11-28T18:44:11.532 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server
2023-11-28T18:44:11.551 INFO:teuthology.lock.ops:Start node 'smithi148.front.sepia.ceph.com' reimaging
2023-11-28T18:44:11.551 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: reset os type and version on server
2023-11-28T18:44:11.551 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server
2023-11-28T18:44:11.575 INFO:teuthology.lock.ops:Start node 'smithi167.front.sepia.ceph.com' reimaging
2023-11-28T18:44:11.576 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: reset os type and version on server
2023-11-28T18:44:11.576 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server
2023-11-28T18:44:11.673 DEBUG:teuthology.provision.fog.smithi103:Requesting image smithi_rhel_8.6 (ID 5)
2023-11-28T18:44:11.693 DEBUG:teuthology.provision.fog.smithi148:Requesting image smithi_rhel_8.6 (ID 5)
2023-11-28T18:44:11.716 DEBUG:teuthology.provision.fog.smithi167:Requesting image smithi_rhel_8.6 (ID 5)
2023-11-28T18:44:11.739 INFO:teuthology.provision.fog.smithi148:Scheduling deploy of rhel 8.6
2023-11-28T18:44:11.743 INFO:teuthology.provision.fog.smithi103:Scheduling deploy of rhel 8.6
2023-11-28T18:44:11.767 INFO:teuthology.provision.fog.smithi167:Scheduling deploy of rhel 8.6
2023-11-28T18:44:11.998 INFO:teuthology.orchestra.console.smithi148:Power off
2023-11-28T18:44:11.998 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-28T18:44:12.009 INFO:teuthology.orchestra.console.smithi103:Power off
2023-11-28T18:44:12.009 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-28T18:44:12.021 INFO:teuthology.orchestra.console.smithi167:Power off
2023-11-28T18:44:12.021 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-28T18:44:12.028 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off
2023-11-28T18:44:12.028 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T18:44:12.035 DEBUG:teuthology.orchestra.console.smithi103:power off output: Chassis Power Control: Down/Off
2023-11-28T18:44:12.035 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T18:44:12.044 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off
2023-11-28T18:44:12.044 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T18:44:12.052 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off
2023-11-28T18:44:12.055 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on
2023-11-28T18:44:12.065 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on
2023-11-28T18:44:12.153 INFO:teuthology.orchestra.console.smithi148:Power off completed
2023-11-28T18:44:12.254 INFO:teuthology.orchestra.console.smithi148:Power on
2023-11-28T18:44:12.254 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-28T18:44:12.274 DEBUG:teuthology.orchestra.console.smithi148:power on output: Chassis Power Control: Up/On
2023-11-28T18:44:12.274 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T18:44:12.295 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off
2023-11-28T18:44:16.058 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T18:44:16.066 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T18:44:16.169 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on
2023-11-28T18:44:16.174 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on
2023-11-28T18:44:16.296 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T18:44:16.406 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off
2023-11-28T18:44:20.174 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T18:44:20.181 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T18:44:20.283 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off
2023-11-28T18:44:20.289 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on
2023-11-28T18:44:20.385 INFO:teuthology.orchestra.console.smithi103:Power off completed
2023-11-28T18:44:20.407 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T18:44:20.486 INFO:teuthology.orchestra.console.smithi103:Power on
2023-11-28T18:44:20.486 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-28T18:44:20.508 DEBUG:teuthology.orchestra.console.smithi103:power on output: Chassis Power Control: Up/On
2023-11-28T18:44:20.508 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T18:44:20.516 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on
2023-11-28T18:44:20.533 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off
2023-11-28T18:44:20.618 INFO:teuthology.orchestra.console.smithi148:Power on completed
2023-11-28T18:44:20.718 INFO:teuthology.provision.fog.smithi148:Waiting for deploy to finish
2023-11-28T18:44:24.294 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T18:44:24.403 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off
2023-11-28T18:44:24.504 INFO:teuthology.orchestra.console.smithi167:Power off completed
2023-11-28T18:44:24.534 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T18:44:24.605 INFO:teuthology.orchestra.console.smithi167:Power on
2023-11-28T18:44:24.605 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-28T18:44:24.626 DEBUG:teuthology.orchestra.console.smithi167:power on output: Chassis Power Control: Up/On
2023-11-28T18:44:24.626 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T18:44:24.643 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off
2023-11-28T18:44:24.649 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off
2023-11-28T18:44:28.648 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T18:44:28.656 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T18:44:28.758 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on
2023-11-28T18:44:28.763 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off
2023-11-28T18:44:28.860 INFO:teuthology.orchestra.console.smithi103:Power on completed
2023-11-28T18:44:28.960 INFO:teuthology.provision.fog.smithi103:Waiting for deploy to finish
2023-11-28T18:44:32.766 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T18:44:32.875 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on
2023-11-28T18:44:32.975 INFO:teuthology.orchestra.console.smithi167:Power on completed
2023-11-28T18:44:33.076 INFO:teuthology.provision.fog.smithi167:Waiting for deploy to finish
2023-11-28T18:47:06.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T18:47:09.794 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148
2023-11-28T18:47:15.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T18:47:18.854 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148
2023-11-28T18:47:19.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T18:47:22.114 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-11-28T18:47:24.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T18:47:27.906 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148
2023-11-28T18:47:28.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T18:47:30.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T18:47:31.170 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-11-28T18:47:33.186 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2023-11-28T18:47:33.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T18:47:36.966 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148
2023-11-28T18:47:37.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T18:47:39.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T18:47:40.226 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-11-28T18:47:42.246 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2023-11-28T18:47:42.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T18:47:46.018 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148
2023-11-28T18:47:46.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T18:47:48.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T18:47:49.282 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-11-28T18:47:51.330 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2023-11-28T18:47:52.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T18:47:55.074 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148
2023-11-28T18:47:55.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T18:47:57.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T18:47:58.338 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-11-28T18:48:00.386 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2023-11-28T18:48:01.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T18:48:04.134 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148
2023-11-28T18:48:04.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T18:48:06.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T18:48:07.458 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-11-28T18:48:09.446 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2023-11-28T18:48:10.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T18:48:13.218 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148
2023-11-28T18:48:13.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T18:48:15.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T18:48:16.518 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-11-28T18:48:18.534 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2023-11-28T18:48:19.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T18:48:22.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T18:48:24.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T18:48:27.618 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2023-11-28T18:48:33.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T18:48:36.674 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2023-11-28T18:48:42.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T18:49:01.026 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2023-11-28T18:49:07.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T18:49:10.114 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2023-11-28T18:49:16.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T18:49:18.757 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-28T18:49:18.758 DEBUG:teuthology.orchestra.run.smithi103:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-28T18:49:19.004 INFO:teuthology.provision.fog.smithi103:Node is ready
2023-11-28T18:49:19.004 DEBUG:teuthology.orchestra.run.smithi103:> hostname
2023-11-28T18:49:19.020 INFO:teuthology.orchestra.run.smithi103.stdout:smithi022
2023-11-28T18:49:19.021 DEBUG:teuthology.orchestra.run.smithi103:> grep smithi022 /etc/hosts
2023-11-28T18:49:19.079 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022
2023-11-28T18:49:19.080 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103
2023-11-28T18:49:19.191 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi022/smithi103/g' /etc/hosts
2023-11-28T18:49:19.218 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/172.21.15.22/172.21.15.103/g' /etc/hosts
2023-11-28T18:49:19.223 WARNING:teuthology.provision.fog.smithi148:timed out
2023-11-28T18:49:19.287 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi022/smithi103/g' /etc/hostname
2023-11-28T18:49:19.356 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103
2023-11-28T18:49:19.421 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release
2023-11-28T18:49:19.479 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="Red Hat Enterprise Linux"
2023-11-28T18:49:19.479 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="8.6 (Ootpa)"
2023-11-28T18:49:19.480 INFO:teuthology.orchestra.run.smithi103.stdout:ID="rhel"
2023-11-28T18:49:19.480 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="fedora"
2023-11-28T18:49:19.480 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="8.6"
2023-11-28T18:49:19.480 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el8"
2023-11-28T18:49:19.480 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-28T18:49:19.481 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31"
2023-11-28T18:49:19.481 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-28T18:49:19.481 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://www.redhat.com/"
2023-11-28T18:49:19.481 INFO:teuthology.orchestra.run.smithi103.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-28T18:49:19.481 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-28T18:49:19.482 INFO:teuthology.orchestra.run.smithi103.stdout:
2023-11-28T18:49:19.482 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-28T18:49:19.482 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-28T18:49:19.482 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-28T18:49:19.482 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-28T18:49:19.483 INFO:teuthology.provision.fog.smithi103:Deploy complete!
2023-11-28T18:49:19.485 DEBUG:teuthology.parallel:result is None
2023-11-28T18:49:22.526 WARNING:teuthology.provision.fog.smithi167:timed out
2023-11-28T18:49:25.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T18:49:25.457 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-28T18:49:25.457 DEBUG:teuthology.orchestra.run.smithi148:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-28T18:49:25.810 INFO:teuthology.provision.fog.smithi148:Node is ready
2023-11-28T18:49:25.810 DEBUG:teuthology.orchestra.run.smithi148:> hostname
2023-11-28T18:49:25.828 INFO:teuthology.orchestra.run.smithi148.stdout:smithi148.front.sepia.ceph.com
2023-11-28T18:49:25.829 DEBUG:teuthology.orchestra.run.smithi148:> grep smithi148.front.sepia.ceph.com /etc/hosts
2023-11-28T18:49:25.886 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148 smithi148.front.sepia.ceph.com smithi148
2023-11-28T18:49:25.887 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148
2023-11-28T18:49:26.007 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hosts
2023-11-28T18:49:26.035 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/172.21.15.148/172.21.15.148/g' /etc/hosts
2023-11-28T18:49:26.103 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hostname
2023-11-28T18:49:26.170 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148
2023-11-28T18:49:26.236 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release
2023-11-28T18:49:26.293 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="Red Hat Enterprise Linux"
2023-11-28T18:49:26.293 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="8.6 (Ootpa)"
2023-11-28T18:49:26.293 INFO:teuthology.orchestra.run.smithi148.stdout:ID="rhel"
2023-11-28T18:49:26.293 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="fedora"
2023-11-28T18:49:26.293 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="8.6"
2023-11-28T18:49:26.293 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el8"
2023-11-28T18:49:26.294 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-28T18:49:26.294 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31"
2023-11-28T18:49:26.294 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-28T18:49:26.294 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://www.redhat.com/"
2023-11-28T18:49:26.294 INFO:teuthology.orchestra.run.smithi148.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-28T18:49:26.294 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-28T18:49:26.294 INFO:teuthology.orchestra.run.smithi148.stdout:
2023-11-28T18:49:26.294 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-28T18:49:26.294 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-28T18:49:26.294 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-28T18:49:26.294 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-28T18:49:26.295 INFO:teuthology.provision.fog.smithi148:Deploy complete!
2023-11-28T18:49:26.295 DEBUG:teuthology.parallel:result is None
2023-11-28T18:49:28.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T18:49:28.877 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-28T18:49:28.877 DEBUG:teuthology.orchestra.run.smithi167:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-28T18:49:29.162 INFO:teuthology.provision.fog.smithi167:Node is ready
2023-11-28T18:49:29.163 DEBUG:teuthology.orchestra.run.smithi167:> hostname
2023-11-28T18:49:29.180 INFO:teuthology.orchestra.run.smithi167.stdout:smithi167.front.sepia.ceph.com
2023-11-28T18:49:29.180 DEBUG:teuthology.orchestra.run.smithi167:> grep smithi167.front.sepia.ceph.com /etc/hosts
2023-11-28T18:49:29.241 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.167 smithi167.front.sepia.ceph.com smithi167
2023-11-28T18:49:29.242 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167
2023-11-28T18:49:29.357 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167.front.sepia.ceph.com/smithi167/g' /etc/hosts
2023-11-28T18:49:29.385 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/172.21.15.167/172.21.15.167/g' /etc/hosts
2023-11-28T18:49:29.457 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167.front.sepia.ceph.com/smithi167/g' /etc/hostname
2023-11-28T18:49:29.527 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167
2023-11-28T18:49:29.596 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release
2023-11-28T18:49:29.656 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Red Hat Enterprise Linux"
2023-11-28T18:49:29.656 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="8.6 (Ootpa)"
2023-11-28T18:49:29.656 INFO:teuthology.orchestra.run.smithi167.stdout:ID="rhel"
2023-11-28T18:49:29.656 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="fedora"
2023-11-28T18:49:29.656 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="8.6"
2023-11-28T18:49:29.656 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el8"
2023-11-28T18:49:29.656 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-28T18:49:29.656 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31"
2023-11-28T18:49:29.656 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-28T18:49:29.657 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.redhat.com/"
2023-11-28T18:49:29.657 INFO:teuthology.orchestra.run.smithi167.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-28T18:49:29.657 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-28T18:49:29.657 INFO:teuthology.orchestra.run.smithi167.stdout:
2023-11-28T18:49:29.657 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-28T18:49:29.657 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-28T18:49:29.657 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-28T18:49:29.657 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-28T18:49:29.657 INFO:teuthology.provision.fog.smithi167:Deploy complete!
2023-11-28T18:49:29.658 DEBUG:teuthology.parallel:result is None
2023-11-28T18:49:29.847 INFO:teuthology.lock.ops:Checking smithi103.front.sepia.ceph.com
2023-11-28T18:49:29.848 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-28T18:49:29.868 INFO:teuthology.lock.ops:Checking smithi148.front.sepia.ceph.com
2023-11-28T18:49:29.868 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-28T18:49:29.884 INFO:teuthology.lock.ops:Checking smithi167.front.sepia.ceph.com
2023-11-28T18:49:29.884 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-28T18:49:29.902 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: set os type and version on server
2023-11-28T18:49:29.902 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com'
2023-11-28T18:49:29.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T18:49:29.970 DEBUG:teuthology.orchestra.run.smithi103:> true
2023-11-28T18:49:30.099 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com'
2023-11-28T18:49:30.099 DEBUG:teuthology.orchestra.run.smithi103:> uname -m
2023-11-28T18:49:30.155 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64
2023-11-28T18:49:30.156 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release
2023-11-28T18:49:30.212 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="Red Hat Enterprise Linux"
2023-11-28T18:49:30.212 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="8.6 (Ootpa)"
2023-11-28T18:49:30.213 INFO:teuthology.orchestra.run.smithi103.stdout:ID="rhel"
2023-11-28T18:49:30.213 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="fedora"
2023-11-28T18:49:30.213 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="8.6"
2023-11-28T18:49:30.213 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el8"
2023-11-28T18:49:30.213 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-28T18:49:30.213 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31"
2023-11-28T18:49:30.213 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-28T18:49:30.213 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://www.redhat.com/"
2023-11-28T18:49:30.213 INFO:teuthology.orchestra.run.smithi103.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-28T18:49:30.213 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-28T18:49:30.213 INFO:teuthology.orchestra.run.smithi103.stdout:
2023-11-28T18:49:30.213 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-28T18:49:30.213 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-28T18:49:30.214 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-28T18:49:30.214 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-28T18:49:30.214 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server
2023-11-28T18:49:30.235 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: set os type and version on server
2023-11-28T18:49:30.235 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com'
2023-11-28T18:49:30.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T18:49:30.302 DEBUG:teuthology.orchestra.run.smithi148:> true
2023-11-28T18:49:30.376 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com'
2023-11-28T18:49:30.376 DEBUG:teuthology.orchestra.run.smithi148:> uname -m
2023-11-28T18:49:30.432 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64
2023-11-28T18:49:30.432 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release
2023-11-28T18:49:30.488 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="Red Hat Enterprise Linux"
2023-11-28T18:49:30.488 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="8.6 (Ootpa)"
2023-11-28T18:49:30.488 INFO:teuthology.orchestra.run.smithi148.stdout:ID="rhel"
2023-11-28T18:49:30.488 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="fedora"
2023-11-28T18:49:30.488 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="8.6"
2023-11-28T18:49:30.488 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el8"
2023-11-28T18:49:30.488 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-28T18:49:30.488 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31"
2023-11-28T18:49:30.488 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-28T18:49:30.488 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://www.redhat.com/"
2023-11-28T18:49:30.488 INFO:teuthology.orchestra.run.smithi148.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-28T18:49:30.489 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-28T18:49:30.489 INFO:teuthology.orchestra.run.smithi148.stdout:
2023-11-28T18:49:30.489 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-28T18:49:30.489 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-28T18:49:30.489 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-28T18:49:30.489 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-28T18:49:30.489 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server
2023-11-28T18:49:30.510 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: set os type and version on server
2023-11-28T18:49:30.510 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com'
2023-11-28T18:49:30.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T18:49:30.580 DEBUG:teuthology.orchestra.run.smithi167:> true
2023-11-28T18:49:30.655 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com'
2023-11-28T18:49:30.655 DEBUG:teuthology.orchestra.run.smithi167:> uname -m
2023-11-28T18:49:30.718 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64
2023-11-28T18:49:30.719 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release
2023-11-28T18:49:30.781 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Red Hat Enterprise Linux"
2023-11-28T18:49:30.781 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="8.6 (Ootpa)"
2023-11-28T18:49:30.782 INFO:teuthology.orchestra.run.smithi167.stdout:ID="rhel"
2023-11-28T18:49:30.782 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="fedora"
2023-11-28T18:49:30.782 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="8.6"
2023-11-28T18:49:30.782 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el8"
2023-11-28T18:49:30.782 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-28T18:49:30.782 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31"
2023-11-28T18:49:30.783 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-28T18:49:30.783 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.redhat.com/"
2023-11-28T18:49:30.783 INFO:teuthology.orchestra.run.smithi167.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-28T18:49:30.783 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-28T18:49:30.783 INFO:teuthology.orchestra.run.smithi167.stdout:
2023-11-28T18:49:30.783 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-28T18:49:30.783 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-28T18:49:30.784 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-28T18:49:30.784 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-28T18:49:30.784 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server
2023-11-28T18:49:30.810 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T18:49:30.911 INFO:teuthology.dispatcher.supervisor:Running job 7469536
2023-11-28T18:49:30.911 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469536 --name vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/fsync-tester}} -- /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469536/orig.config.yaml
2023-11-28T18:49:30.914 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469536
2023-11-28T18:49:30.915 INFO:teuthology.dispatcher.supervisor:Job PID: 338669
2023-11-28T18:49:30.915 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-28T18:51:31.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T18:53:31.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T18:55:31.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T18:57:31.534 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T18:59:31.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T19:01:31.868 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T19:03:32.042 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T19:05:32.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T19:07:32.376 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T19:09:32.550 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T19:09:32.654 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-11-28T19:09:32.798 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-28T19:09:32.798 INFO:teuthology.nuke:Checking targets against current locks
2023-11-28T19:09:32.844 DEBUG:teuthology.nuke:shortname: smithi103
2023-11-28T19:09:32.845 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-28T19:09:32.873 DEBUG:teuthology.nuke:shortname: smithi148
2023-11-28T19:09:32.873 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-28T19:09:32.875 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi103.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469536', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 18:44:10.456563', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-11-28T19:09:32.897 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469536', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 18:44:10.459732', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-11-28T19:09:32.901 DEBUG:teuthology.nuke:shortname: smithi167
2023-11-28T19:09:32.901 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-28T19:09:32.928 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469536', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 18:44:10.458271', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-11-28T19:09:32.937 INFO:teuthology.orchestra.console.smithi103:Power off
2023-11-28T19:09:32.937 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-28T19:09:32.962 DEBUG:teuthology.orchestra.console.smithi103:power off output: Chassis Power Control: Down/Off
2023-11-28T19:09:32.962 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T19:09:32.978 INFO:teuthology.orchestra.console.smithi148:Power off
2023-11-28T19:09:32.978 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-28T19:09:32.990 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off
2023-11-28T19:09:33.002 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off
2023-11-28T19:09:33.002 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T19:09:33.017 INFO:teuthology.orchestra.console.smithi167:Power off
2023-11-28T19:09:33.017 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-28T19:09:33.026 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off
2023-11-28T19:09:33.041 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off
2023-11-28T19:09:33.041 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T19:09:33.063 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off
2023-11-28T19:09:33.091 INFO:teuthology.orchestra.console.smithi103:Power off completed
2023-11-28T19:09:33.128 INFO:teuthology.orchestra.console.smithi148:Power off completed
2023-11-28T19:09:33.164 INFO:teuthology.orchestra.console.smithi167:Power off completed
2023-11-28T19:09:33.249 INFO:teuthology.lock.ops:unlocked: smithi103.front.sepia.ceph.com
2023-11-28T19:09:33.283 INFO:teuthology.lock.ops:unlocked: smithi148.front.sepia.ceph.com
2023-11-28T19:09:33.307 INFO:teuthology.lock.ops:unlocked: smithi167.front.sepia.ceph.com