2023-12-14T18:00:43.187 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e
2023-12-14T18:00:43.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:00:43.508 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fc7020195b0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fc702f74940>, signals=[15])
2023-12-14T18:00:43.508 INFO:teuthology.lock.ops:Start node 'smithi093.front.sepia.ceph.com' reimaging
2023-12-14T18:00:43.508 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: reset os type and version on server
2023-12-14T18:00:43.508 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server
2023-12-14T18:00:43.534 INFO:teuthology.lock.ops:Start node 'smithi097.front.sepia.ceph.com' reimaging
2023-12-14T18:00:43.534 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: reset os type and version on server
2023-12-14T18:00:43.534 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server
2023-12-14T18:00:43.558 INFO:teuthology.lock.ops:Start node 'smithi160.front.sepia.ceph.com' reimaging
2023-12-14T18:00:43.558 INFO:teuthology.lock.ops:Updating [smithi160.front.sepia.ceph.com]: reset os type and version on server
2023-12-14T18:00:43.558 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server
2023-12-14T18:00:43.786 DEBUG:teuthology.provision.fog.smithi093:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-14T18:00:43.840 DEBUG:teuthology.provision.fog.smithi097:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-14T18:00:43.855 DEBUG:teuthology.provision.fog.smithi160:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-14T18:00:43.948 INFO:teuthology.provision.fog.smithi093:Scheduling deploy of rhel 8.6
2023-12-14T18:00:43.963 INFO:teuthology.provision.fog.smithi097:Scheduling deploy of rhel 8.6
2023-12-14T18:00:44.008 INFO:teuthology.provision.fog.smithi160:Scheduling deploy of rhel 8.6
2023-12-14T18:00:44.556 INFO:teuthology.orchestra.console.smithi093:Power off
2023-12-14T18:00:44.556 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-14T18:00:44.579 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off
2023-12-14T18:00:44.580 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:00:44.600 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on
2023-12-14T18:00:44.672 INFO:teuthology.orchestra.console.smithi097:Power off
2023-12-14T18:00:44.672 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-14T18:00:44.684 INFO:teuthology.orchestra.console.smithi160:Power off
2023-12-14T18:00:44.684 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-14T18:00:44.692 DEBUG:teuthology.orchestra.console.smithi097:power off output: Chassis Power Control: Down/Off
2023-12-14T18:00:44.692 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:00:44.708 DEBUG:teuthology.orchestra.console.smithi160:power off output: Chassis Power Control: Down/Off
2023-12-14T18:00:44.708 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:00:44.716 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off
2023-12-14T18:00:44.729 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on
2023-12-14T18:00:44.817 INFO:teuthology.orchestra.console.smithi097:Power off completed
2023-12-14T18:00:44.918 INFO:teuthology.orchestra.console.smithi097:Power on
2023-12-14T18:00:44.918 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-14T18:00:44.940 DEBUG:teuthology.orchestra.console.smithi097:power on output: Chassis Power Control: Up/On
2023-12-14T18:00:44.940 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:00:44.960 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off
2023-12-14T18:00:48.605 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:00:48.712 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on
2023-12-14T18:00:48.730 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:00:48.839 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on
2023-12-14T18:00:48.962 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:00:49.070 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on
2023-12-14T18:00:49.170 INFO:teuthology.orchestra.console.smithi097:Power on completed
2023-12-14T18:00:49.271 INFO:teuthology.provision.fog.smithi097:Waiting for deploy to finish
2023-12-14T18:00:52.717 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:00:52.825 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on
2023-12-14T18:00:52.840 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:00:52.948 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on
2023-12-14T18:00:56.830 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:00:56.938 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off
2023-12-14T18:00:56.949 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:00:57.039 INFO:teuthology.orchestra.console.smithi093:Power off completed
2023-12-14T18:00:57.057 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off
2023-12-14T18:00:57.140 INFO:teuthology.orchestra.console.smithi093:Power on
2023-12-14T18:00:57.141 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-14T18:00:57.158 INFO:teuthology.orchestra.console.smithi160:Power off completed
2023-12-14T18:00:57.179 DEBUG:teuthology.orchestra.console.smithi093:power on output: Chassis Power Control: Up/On
2023-12-14T18:00:57.179 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:00:57.202 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off
2023-12-14T18:00:57.259 INFO:teuthology.orchestra.console.smithi160:Power on
2023-12-14T18:00:57.259 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-14T18:00:57.280 DEBUG:teuthology.orchestra.console.smithi160:power on output: Chassis Power Control: Up/On
2023-12-14T18:00:57.280 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:00:57.298 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off
2023-12-14T18:01:01.206 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:01:01.299 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:01:01.318 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on
2023-12-14T18:01:01.409 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on
2023-12-14T18:01:01.419 INFO:teuthology.orchestra.console.smithi093:Power on completed
2023-12-14T18:01:01.511 INFO:teuthology.orchestra.console.smithi160:Power on completed
2023-12-14T18:01:01.520 INFO:teuthology.provision.fog.smithi093:Waiting for deploy to finish
2023-12-14T18:01:01.612 INFO:teuthology.provision.fog.smithi160:Waiting for deploy to finish
2023-12-14T18:03:35.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:03:38.578 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2023-12-14T18:03:44.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:03:47.666 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2023-12-14T18:03:53.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:03:56.754 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2023-12-14T18:04:02.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:04:05.842 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2023-12-14T18:04:11.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:04:14.930 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2023-12-14T18:04:18.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:04:20.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:04:23.986 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2023-12-14T18:04:29.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:04:33.042 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2023-12-14T18:04:33.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:04:36.178 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160
2023-12-14T18:04:36.498 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-12-14T18:04:39.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:04:42.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:04:42.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:04:45.266 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160
2023-12-14T18:04:45.557 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-12-14T18:04:51.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:04:51.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:04:54.322 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160
2023-12-14T18:04:54.610 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-12-14T18:04:57.490 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2023-12-14T18:05:00.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:05:00.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:05:03.378 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160
2023-12-14T18:05:03.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:05:03.666 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-12-14T18:05:06.545 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2023-12-14T18:05:09.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:05:09.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:05:12.466 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160
2023-12-14T18:05:12.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:05:15.602 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2023-12-14T18:05:18.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:05:21.554 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160
2023-12-14T18:05:21.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:05:22.165 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-14T18:05:22.166 DEBUG:teuthology.orchestra.run.smithi097:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-14T18:05:27.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:05:38.065 INFO:teuthology.provision.fog.smithi097:Node is ready
2023-12-14T18:05:38.065 DEBUG:teuthology.orchestra.run.smithi097:> hostname
2023-12-14T18:05:38.087 INFO:teuthology.orchestra.run.smithi097.stdout:smithi097.front.sepia.ceph.com
2023-12-14T18:05:38.087 DEBUG:teuthology.orchestra.run.smithi097:> grep smithi097.front.sepia.ceph.com /etc/hosts
2023-12-14T18:05:38.148 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.15.97 smithi097.front.sepia.ceph.com smithi097
2023-12-14T18:05:38.149 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname smithi097
2023-12-14T18:05:38.276 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi097.front.sepia.ceph.com/smithi097/g' /etc/hosts
2023-12-14T18:05:38.307 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/172.21.15.97/172.21.15.97/g' /etc/hosts
2023-12-14T18:05:38.376 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi097.front.sepia.ceph.com/smithi097/g' /etc/hostname
2023-12-14T18:05:38.444 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname smithi097
2023-12-14T18:05:38.511 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release
2023-12-14T18:05:38.568 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="Red Hat Enterprise Linux"
2023-12-14T18:05:38.568 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="8.6 (Ootpa)"
2023-12-14T18:05:38.568 INFO:teuthology.orchestra.run.smithi097.stdout:ID="rhel"
2023-12-14T18:05:38.568 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="fedora"
2023-12-14T18:05:38.568 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="8.6"
2023-12-14T18:05:38.569 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el8"
2023-12-14T18:05:38.569 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-14T18:05:38.569 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31"
2023-12-14T18:05:38.569 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-14T18:05:38.569 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://www.redhat.com/"
2023-12-14T18:05:38.569 INFO:teuthology.orchestra.run.smithi097.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-14T18:05:38.569 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-14T18:05:38.569 INFO:teuthology.orchestra.run.smithi097.stdout:
2023-12-14T18:05:38.569 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-14T18:05:38.570 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-14T18:05:38.570 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-14T18:05:38.570 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-14T18:05:38.570 INFO:teuthology.provision.fog.smithi097:Deploy complete!
2023-12-14T18:05:38.572 DEBUG:teuthology.parallel:result is None
2023-12-14T18:06:09.677 WARNING:teuthology.provision.fog.smithi093:timed out
2023-12-14T18:06:15.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:06:16.023 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-14T18:06:16.023 DEBUG:teuthology.orchestra.run.smithi093:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-14T18:06:16.316 INFO:teuthology.provision.fog.smithi093:Node is ready
2023-12-14T18:06:16.316 DEBUG:teuthology.orchestra.run.smithi093:> hostname
2023-12-14T18:06:16.335 INFO:teuthology.orchestra.run.smithi093.stdout:smithi093
2023-12-14T18:06:16.335 DEBUG:teuthology.orchestra.run.smithi093:> grep smithi093 /etc/hosts
2023-12-14T18:06:16.393 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93 smithi093.front.sepia.ceph.com smithi093
2023-12-14T18:06:16.393 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093
2023-12-14T18:06:16.522 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093/smithi093/g' /etc/hosts
2023-12-14T18:06:16.552 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/172.21.15.93/172.21.15.93/g' /etc/hosts
2023-12-14T18:06:16.620 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093/smithi093/g' /etc/hostname
2023-12-14T18:06:16.688 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093
2023-12-14T18:06:16.754 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release
2023-12-14T18:06:16.812 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="Red Hat Enterprise Linux"
2023-12-14T18:06:16.812 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8.6 (Ootpa)"
2023-12-14T18:06:16.812 INFO:teuthology.orchestra.run.smithi093.stdout:ID="rhel"
2023-12-14T18:06:16.812 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="fedora"
2023-12-14T18:06:16.812 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8.6"
2023-12-14T18:06:16.812 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8"
2023-12-14T18:06:16.812 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-14T18:06:16.813 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31"
2023-12-14T18:06:16.813 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-14T18:06:16.813 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://www.redhat.com/"
2023-12-14T18:06:16.813 INFO:teuthology.orchestra.run.smithi093.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-14T18:06:16.813 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-14T18:06:16.813 INFO:teuthology.orchestra.run.smithi093.stdout:
2023-12-14T18:06:16.813 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-14T18:06:16.813 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-14T18:06:16.813 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-14T18:06:16.813 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-14T18:06:16.813 INFO:teuthology.provision.fog.smithi093:Deploy complete!
2023-12-14T18:06:16.814 DEBUG:teuthology.parallel:result is None
2023-12-14T18:06:27.570 WARNING:teuthology.provision.fog.smithi160:timed out
2023-12-14T18:06:33.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:06:33.916 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-14T18:06:33.917 DEBUG:teuthology.orchestra.run.smithi160:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-14T18:06:34.245 INFO:teuthology.provision.fog.smithi160:Node is ready
2023-12-14T18:06:34.246 DEBUG:teuthology.orchestra.run.smithi160:> hostname
2023-12-14T18:06:34.265 INFO:teuthology.orchestra.run.smithi160.stdout:smithi160.front.sepia.ceph.com
2023-12-14T18:06:34.266 DEBUG:teuthology.orchestra.run.smithi160:> grep smithi160.front.sepia.ceph.com /etc/hosts
2023-12-14T18:06:34.324 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.15.160 smithi160.front.sepia.ceph.com smithi160
2023-12-14T18:06:34.325 DEBUG:teuthology.orchestra.run.smithi160:> sudo hostname smithi160
2023-12-14T18:06:34.433 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/smithi160.front.sepia.ceph.com/smithi160/g' /etc/hosts
2023-12-14T18:06:34.462 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/172.21.15.160/172.21.15.160/g' /etc/hosts
2023-12-14T18:06:34.531 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/smithi160.front.sepia.ceph.com/smithi160/g' /etc/hostname
2023-12-14T18:06:34.599 DEBUG:teuthology.orchestra.run.smithi160:> sudo hostname smithi160
2023-12-14T18:06:34.666 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release
2023-12-14T18:06:34.723 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="Red Hat Enterprise Linux"
2023-12-14T18:06:34.724 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="8.6 (Ootpa)"
2023-12-14T18:06:34.724 INFO:teuthology.orchestra.run.smithi160.stdout:ID="rhel"
2023-12-14T18:06:34.724 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE="fedora"
2023-12-14T18:06:34.724 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="8.6"
2023-12-14T18:06:34.725 INFO:teuthology.orchestra.run.smithi160.stdout:PLATFORM_ID="platform:el8"
2023-12-14T18:06:34.725 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-14T18:06:34.725 INFO:teuthology.orchestra.run.smithi160.stdout:ANSI_COLOR="0;31"
2023-12-14T18:06:34.725 INFO:teuthology.orchestra.run.smithi160.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-14T18:06:34.726 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://www.redhat.com/"
2023-12-14T18:06:34.726 INFO:teuthology.orchestra.run.smithi160.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-14T18:06:34.726 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-14T18:06:34.726 INFO:teuthology.orchestra.run.smithi160.stdout:
2023-12-14T18:06:34.726 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-14T18:06:34.726 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-14T18:06:34.727 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-14T18:06:34.727 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-14T18:06:34.727 INFO:teuthology.provision.fog.smithi160:Deploy complete!
2023-12-14T18:06:34.727 DEBUG:teuthology.parallel:result is None
2023-12-14T18:06:34.912 INFO:teuthology.lock.ops:Checking smithi093.front.sepia.ceph.com
2023-12-14T18:06:34.912 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-14T18:06:34.934 INFO:teuthology.lock.ops:Checking smithi097.front.sepia.ceph.com
2023-12-14T18:06:34.935 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-14T18:06:34.959 INFO:teuthology.lock.ops:Checking smithi160.front.sepia.ceph.com
2023-12-14T18:06:34.960 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-14T18:06:34.978 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: set os type and version on server
2023-12-14T18:06:34.978 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com'
2023-12-14T18:06:34.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:06:35.046 DEBUG:teuthology.orchestra.run.smithi093:> true
2023-12-14T18:06:35.180 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi093.front.sepia.ceph.com'
2023-12-14T18:06:35.180 DEBUG:teuthology.orchestra.run.smithi093:> uname -m
2023-12-14T18:06:35.238 INFO:teuthology.orchestra.run.smithi093.stdout:x86_64
2023-12-14T18:06:35.238 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release
2023-12-14T18:06:35.296 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="Red Hat Enterprise Linux"
2023-12-14T18:06:35.296 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8.6 (Ootpa)"
2023-12-14T18:06:35.296 INFO:teuthology.orchestra.run.smithi093.stdout:ID="rhel"
2023-12-14T18:06:35.296 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="fedora"
2023-12-14T18:06:35.296 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8.6"
2023-12-14T18:06:35.296 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8"
2023-12-14T18:06:35.296 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-14T18:06:35.296 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31"
2023-12-14T18:06:35.296 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-14T18:06:35.297 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://www.redhat.com/"
2023-12-14T18:06:35.297 INFO:teuthology.orchestra.run.smithi093.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-14T18:06:35.297 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-14T18:06:35.297 INFO:teuthology.orchestra.run.smithi093.stdout:
2023-12-14T18:06:35.297 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-14T18:06:35.297 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-14T18:06:35.297 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-14T18:06:35.297 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-14T18:06:35.300 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server
2023-12-14T18:06:35.318 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: set os type and version on server
2023-12-14T18:06:35.318 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com'
2023-12-14T18:06:35.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:06:35.384 DEBUG:teuthology.orchestra.run.smithi097:> true
2023-12-14T18:06:35.523 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com'
2023-12-14T18:06:35.524 DEBUG:teuthology.orchestra.run.smithi097:> uname -m
2023-12-14T18:06:35.581 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64
2023-12-14T18:06:35.581 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release
2023-12-14T18:06:35.638 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="Red Hat Enterprise Linux"
2023-12-14T18:06:35.639 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="8.6 (Ootpa)"
2023-12-14T18:06:35.639 INFO:teuthology.orchestra.run.smithi097.stdout:ID="rhel"
2023-12-14T18:06:35.639 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="fedora"
2023-12-14T18:06:35.639 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="8.6"
2023-12-14T18:06:35.639 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el8"
2023-12-14T18:06:35.639 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-14T18:06:35.639 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31"
2023-12-14T18:06:35.639 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-14T18:06:35.639 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://www.redhat.com/"
2023-12-14T18:06:35.639 INFO:teuthology.orchestra.run.smithi097.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-14T18:06:35.639 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-14T18:06:35.639 INFO:teuthology.orchestra.run.smithi097.stdout:
2023-12-14T18:06:35.640 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-14T18:06:35.640 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-14T18:06:35.640 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-14T18:06:35.640 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-14T18:06:35.640 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server
2023-12-14T18:06:35.659 INFO:teuthology.lock.ops:Updating [smithi160.front.sepia.ceph.com]: set os type and version on server
2023-12-14T18:06:35.660 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com'
2023-12-14T18:06:35.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:06:35.726 DEBUG:teuthology.orchestra.run.smithi160:> true
2023-12-14T18:06:35.752 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi160.front.sepia.ceph.com'
2023-12-14T18:06:35.752 DEBUG:teuthology.orchestra.run.smithi160:> uname -m
2023-12-14T18:06:35.810 INFO:teuthology.orchestra.run.smithi160.stdout:x86_64
2023-12-14T18:06:35.810 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release
2023-12-14T18:06:35.867 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="Red Hat Enterprise Linux"
2023-12-14T18:06:35.868 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="8.6 (Ootpa)"
2023-12-14T18:06:35.868 INFO:teuthology.orchestra.run.smithi160.stdout:ID="rhel"
2023-12-14T18:06:35.868 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE="fedora"
2023-12-14T18:06:35.868 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="8.6"
2023-12-14T18:06:35.868 INFO:teuthology.orchestra.run.smithi160.stdout:PLATFORM_ID="platform:el8"
2023-12-14T18:06:35.868 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-14T18:06:35.868 INFO:teuthology.orchestra.run.smithi160.stdout:ANSI_COLOR="0;31"
2023-12-14T18:06:35.868 INFO:teuthology.orchestra.run.smithi160.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-14T18:06:35.868 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://www.redhat.com/"
2023-12-14T18:06:35.868 INFO:teuthology.orchestra.run.smithi160.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-14T18:06:35.868 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-14T18:06:35.868 INFO:teuthology.orchestra.run.smithi160.stdout:
2023-12-14T18:06:35.868 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-14T18:06:35.869 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-14T18:06:35.869 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-14T18:06:35.869 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-14T18:06:35.869 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server
2023-12-14T18:06:35.893 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:06:35.988 INFO:teuthology.dispatcher.supervisor:Running job 7491435
2023-12-14T18:06:35.988 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_choffman@teuthology --archive /home/teuthworker/archive/choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi/7491435 --name choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/fs/misc}} -- /home/teuthworker/archive/choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi/7491435/orig.config.yaml
2023-12-14T18:06:35.991 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi/7491435
2023-12-14T18:06:35.991 INFO:teuthology.dispatcher.supervisor:Job PID: 1292806
2023-12-14T18:06:35.992 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-14T18:08:36.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:10:36.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:12:36.374 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:14:36.514 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:16:36.678 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:18:36.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:20:36.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:22:37.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:24:37.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:26:37.321 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:28:37.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:30:37.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:32:37.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:34:38.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:36:38.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:38:38.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:40:38.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:42:38.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:44:38.642 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:46:38.792 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:48:38.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:50:39.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:50:39.159 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-14T18:50:39.304 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-14T18:50:39.305 INFO:teuthology.nuke:Checking targets against current locks
2023-12-14T18:50:39.359 DEBUG:teuthology.nuke:shortname: smithi093
2023-12-14T18:50:39.359 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-14T18:50:39.378 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi093.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi/7491435', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 18:00:32.467048', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK0OZ7Zu/Fbt8VVGDDt1T2PvUhU4fESkuZbiUfSgTrPk3/rXRSJoWSk61bsJ8gYyqxF4U5YRHRR4zvtYnG87JB0='}
2023-12-14T18:50:39.383 DEBUG:teuthology.nuke:shortname: smithi097
2023-12-14T18:50:39.383 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-14T18:50:39.407 DEBUG:teuthology.nuke:shortname: smithi160
2023-12-14T18:50:39.408 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-14T18:50:39.414 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi097.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi/7491435', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 18:00:32.470154', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBInchYnEXB0mnlv+DG8qY+0DrB4YSZgRo8hrpqJg86p8xIVlwQ42sEF39oDtpwBjjvB0oejWS6OZRCTPycQcfN8='}
2023-12-14T18:50:39.444 INFO:teuthology.orchestra.console.smithi093:Power off
2023-12-14T18:50:39.444 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-14T18:50:39.454 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi160.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi/7491435', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 18:00:32.468462', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNa3qnlFw6f2pdh2OPpaLbJoAkPVdlYJBUYmURBR4LnG+TLB5eIVTAAVAIbzVakwuVbMUo9U2cKgGdoRuPGp2AY='}
2023-12-14T18:50:39.467 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off
2023-12-14T18:50:39.467 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:50:39.489 INFO:teuthology.orchestra.console.smithi097:Power off
2023-12-14T18:50:39.490 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-14T18:50:39.498 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off
2023-12-14T18:50:39.511 DEBUG:teuthology.orchestra.console.smithi097:power off output: Chassis Power Control: Down/Off
2023-12-14T18:50:39.511 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:50:39.524 INFO:teuthology.orchestra.console.smithi160:Power off
2023-12-14T18:50:39.524 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-14T18:50:39.533 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off
2023-12-14T18:50:39.545 DEBUG:teuthology.orchestra.console.smithi160:power off output: Chassis Power Control: Down/Off
2023-12-14T18:50:39.545 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:50:39.565 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off
2023-12-14T18:50:39.599 INFO:teuthology.orchestra.console.smithi093:Power off completed
2023-12-14T18:50:39.633 INFO:teuthology.orchestra.console.smithi097:Power off completed
2023-12-14T18:50:39.667 INFO:teuthology.orchestra.console.smithi160:Power off completed
2023-12-14T18:50:39.750 INFO:teuthology.lock.ops:unlocked: smithi093.front.sepia.ceph.com
2023-12-14T18:50:39.774 INFO:teuthology.lock.ops:unlocked: smithi097.front.sepia.ceph.com
2023-12-14T18:50:39.807 INFO:teuthology.lock.ops:unlocked: smithi160.front.sepia.ceph.com