2023-08-30T22:40:07.550 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556
2023-08-30T22:40:07.552 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-30T22:40:07.718 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f5c031bfb80>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f5c03c71670>, signals=[15])
2023-08-30T22:40:07.720 INFO:teuthology.lock.ops:Start node 'smithi064.front.sepia.ceph.com' reimaging
2023-08-30T22:40:07.720 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: reset os type and version on server
2023-08-30T22:40:07.720 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server
2023-08-30T22:40:07.747 INFO:teuthology.lock.ops:Start node 'smithi123.front.sepia.ceph.com' reimaging
2023-08-30T22:40:07.747 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: reset os type and version on server
2023-08-30T22:40:07.747 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server
2023-08-30T22:40:07.751 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /host {"name": "smithi064"}
2023-08-30T22:40:07.793 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /host {"name": "smithi123"}
2023-08-30T22:40:07.857 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-08-30T22:40:07.905 DEBUG:teuthology.provision.fog.smithi064:Requesting image smithi_rhel_8.6 (ID 5)
2023-08-30T22:40:07.906 DEBUG:teuthology.provision.fog.smithi064:FOG request: PUT /host/169 {"imageID": 5}
2023-08-30T22:40:07.911 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-08-30T22:40:07.956 DEBUG:teuthology.provision.fog.smithi123:Requesting image smithi_rhel_8.6 (ID 5)
2023-08-30T22:40:07.956 DEBUG:teuthology.provision.fog.smithi123:FOG request: PUT /host/228 {"imageID": 5}
2023-08-30T22:40:07.962 INFO:teuthology.provision.fog.smithi064:Scheduling deploy of rhel 8.6
2023-08-30T22:40:07.963 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-08-30T22:40:08.020 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /tasktype {"name": "deploy"}
2023-08-30T22:40:08.027 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of rhel 8.6
2023-08-30T22:40:08.027 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-30T22:40:08.071 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /tasktype {"name": "deploy"}
2023-08-30T22:40:08.073 DEBUG:teuthology.provision.fog.smithi064:FOG request: POST /host/169/task {"taskTypeID": 1}
2023-08-30T22:40:08.116 DEBUG:teuthology.provision.fog.smithi123:FOG request: POST /host/228/task {"taskTypeID": 1}
2023-08-30T22:40:08.164 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-08-30T22:40:08.174 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-30T22:40:08.256 INFO:teuthology.orchestra.console.smithi064:Power off
2023-08-30T22:40:08.257 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-30T22:40:08.279 INFO:teuthology.orchestra.console.smithi123:Power off
2023-08-30T22:40:08.280 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-30T22:40:08.290 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off
2023-08-30T22:40:08.290 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-30T22:40:08.300 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off
2023-08-30T22:40:08.301 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-30T22:40:08.314 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off
2023-08-30T22:40:08.327 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off
2023-08-30T22:40:08.416 INFO:teuthology.orchestra.console.smithi064:Power off completed
2023-08-30T22:40:08.429 INFO:teuthology.orchestra.console.smithi123:Power off completed
2023-08-30T22:40:08.519 INFO:teuthology.orchestra.console.smithi064:Power on
2023-08-30T22:40:08.520 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-30T22:40:08.530 INFO:teuthology.orchestra.console.smithi123:Power on
2023-08-30T22:40:08.531 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-30T22:40:08.546 DEBUG:teuthology.orchestra.console.smithi064:power on output: Chassis Power Control: Up/On
2023-08-30T22:40:08.547 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-30T22:40:08.556 DEBUG:teuthology.orchestra.console.smithi123:power on output: Chassis Power Control: Up/On
2023-08-30T22:40:08.556 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-30T22:40:08.574 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off
2023-08-30T22:40:08.589 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off
2023-08-30T22:40:12.578 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-30T22:40:12.590 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-30T22:40:12.688 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off
2023-08-30T22:40:12.706 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off
2023-08-30T22:40:16.694 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-30T22:40:16.711 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-30T22:40:16.809 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on
2023-08-30T22:40:16.911 INFO:teuthology.orchestra.console.smithi064:Power on completed
2023-08-30T22:40:16.925 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on
2023-08-30T22:40:17.018 INFO:teuthology.provision.fog.smithi064:Waiting for deploy to finish
2023-08-30T22:40:17.019 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-08-30T22:40:17.027 INFO:teuthology.orchestra.console.smithi123:Power on completed
2023-08-30T22:40:17.128 INFO:teuthology.provision.fog.smithi123:Waiting for deploy to finish
2023-08-30T22:40:17.128 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-30T22:40:32.097 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-08-30T22:40:32.188 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-30T22:40:47.181 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-08-30T22:40:47.249 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-30T22:41:02.258 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-08-30T22:41:02.323 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-30T22:41:17.330 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-08-30T22:41:17.374 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-30T22:41:32.398 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-08-30T22:41:32.427 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-30T22:41:47.482 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-08-30T22:41:47.489 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-30T22:42:02.558 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-08-30T22:42:02.560 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-30T22:42:17.635 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-30T22:42:17.636 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-08-30T22:42:32.732 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-30T22:42:32.734 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-08-30T22:42:47.816 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-30T22:42:47.817 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-08-30T22:43:02.902 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-08-30T22:43:02.904 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-08-30T22:43:02.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T22:43:02.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T22:43:06.046 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-08-30T22:43:06.074 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64
2023-08-30T22:43:12.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T22:43:12.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T22:43:15.132 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-08-30T22:43:15.132 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64
2023-08-30T22:43:21.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T22:43:21.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T22:43:24.218 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-08-30T22:43:24.221 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64
2023-08-30T22:43:30.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T22:43:30.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T22:43:33.306 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64
2023-08-30T22:43:33.310 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-08-30T22:43:39.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T22:43:39.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T22:43:42.364 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64
2023-08-30T22:43:42.394 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-08-30T22:43:48.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T22:43:48.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T22:43:51.450 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-08-30T22:43:51.451 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64
2023-08-30T22:43:57.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T22:43:57.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T22:44:15.898 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-08-30T22:44:21.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T22:44:24.957 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-08-30T22:44:30.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T22:44:34.042 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-08-30T22:44:40.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T22:44:40.390 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-30T22:44:40.391 DEBUG:teuthology.orchestra.run.smithi123:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-30T22:44:40.753 INFO:teuthology.provision.fog.smithi123:Node is ready
2023-08-30T22:44:40.753 DEBUG:teuthology.orchestra.run.smithi123:> hostname
2023-08-30T22:44:40.769 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123.front.sepia.ceph.com
2023-08-30T22:44:40.769 DEBUG:teuthology.orchestra.run.smithi123:> grep smithi123.front.sepia.ceph.com /etc/hosts
2023-08-30T22:44:40.828 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123 smithi123.front.sepia.ceph.com smithi123
2023-08-30T22:44:40.829 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123
2023-08-30T22:44:40.967 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hosts
2023-08-30T22:44:40.994 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/172.21.15.123/172.21.15.123/g' /etc/hosts
2023-08-30T22:44:41.061 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hostname
2023-08-30T22:44:41.131 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123
2023-08-30T22:44:41.197 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release
2023-08-30T22:44:41.252 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Red Hat Enterprise Linux"
2023-08-30T22:44:41.253 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="8.6 (Ootpa)"
2023-08-30T22:44:41.253 INFO:teuthology.orchestra.run.smithi123.stdout:ID="rhel"
2023-08-30T22:44:41.253 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="fedora"
2023-08-30T22:44:41.253 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="8.6"
2023-08-30T22:44:41.254 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el8"
2023-08-30T22:44:41.254 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-08-30T22:44:41.254 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31"
2023-08-30T22:44:41.254 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-08-30T22:44:41.255 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.redhat.com/"
2023-08-30T22:44:41.255 INFO:teuthology.orchestra.run.smithi123.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-30T22:44:41.255 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-30T22:44:41.255 INFO:teuthology.orchestra.run.smithi123.stdout:
2023-08-30T22:44:41.255 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-30T22:44:41.256 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-08-30T22:44:41.256 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-30T22:44:41.256 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-08-30T22:44:41.257 INFO:teuthology.provision.fog.smithi123:Deploy complete!
2023-08-30T22:44:41.258 DEBUG:teuthology.parallel:result is None
2023-08-30T22:44:57.474 WARNING:teuthology.provision.fog.smithi064:timed out
2023-08-30T22:45:03.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T22:45:03.720 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-30T22:45:03.721 DEBUG:teuthology.orchestra.run.smithi064:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-30T22:45:03.995 INFO:teuthology.provision.fog.smithi064:Node is ready
2023-08-30T22:45:03.996 DEBUG:teuthology.orchestra.run.smithi064:> hostname
2023-08-30T22:45:04.055 INFO:teuthology.orchestra.run.smithi064.stdout:smithi064
2023-08-30T22:45:04.056 DEBUG:teuthology.orchestra.run.smithi064:> grep smithi064 /etc/hosts
2023-08-30T22:45:04.115 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64 smithi064.front.sepia.ceph.com smithi064
2023-08-30T22:45:04.115 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064
2023-08-30T22:45:04.234 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064/smithi064/g' /etc/hosts
2023-08-30T22:45:04.264 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/172.21.15.64/172.21.15.64/g' /etc/hosts
2023-08-30T22:45:04.333 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064/smithi064/g' /etc/hostname
2023-08-30T22:45:04.401 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064
2023-08-30T22:45:04.468 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release
2023-08-30T22:45:04.525 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="Red Hat Enterprise Linux"
2023-08-30T22:45:04.525 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="8.6 (Ootpa)"
2023-08-30T22:45:04.526 INFO:teuthology.orchestra.run.smithi064.stdout:ID="rhel"
2023-08-30T22:45:04.526 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="fedora"
2023-08-30T22:45:04.527 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="8.6"
2023-08-30T22:45:04.527 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el8"
2023-08-30T22:45:04.527 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-08-30T22:45:04.528 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31"
2023-08-30T22:45:04.528 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-08-30T22:45:04.528 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://www.redhat.com/"
2023-08-30T22:45:04.528 INFO:teuthology.orchestra.run.smithi064.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-30T22:45:04.529 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-30T22:45:04.529 INFO:teuthology.orchestra.run.smithi064.stdout:
2023-08-30T22:45:04.529 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-30T22:45:04.530 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-08-30T22:45:04.530 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-30T22:45:04.530 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-08-30T22:45:04.530 INFO:teuthology.provision.fog.smithi064:Deploy complete!
2023-08-30T22:45:04.531 DEBUG:teuthology.parallel:result is None
2023-08-30T22:45:04.685 INFO:teuthology.lock.ops:Checking smithi064.front.sepia.ceph.com
2023-08-30T22:45:04.686 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-30T22:45:04.709 INFO:teuthology.lock.ops:Checking smithi123.front.sepia.ceph.com
2023-08-30T22:45:04.711 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: set os type and version on server
2023-08-30T22:45:04.711 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com'
2023-08-30T22:45:04.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T22:45:04.778 DEBUG:teuthology.orchestra.run.smithi064:> true
2023-08-30T22:45:04.803 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi064.front.sepia.ceph.com'
2023-08-30T22:45:04.804 DEBUG:teuthology.orchestra.run.smithi064:> uname -m
2023-08-30T22:45:04.861 INFO:teuthology.orchestra.run.smithi064.stdout:x86_64
2023-08-30T22:45:04.862 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release
2023-08-30T22:45:04.919 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="Red Hat Enterprise Linux"
2023-08-30T22:45:04.919 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="8.6 (Ootpa)"
2023-08-30T22:45:04.919 INFO:teuthology.orchestra.run.smithi064.stdout:ID="rhel"
2023-08-30T22:45:04.919 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="fedora"
2023-08-30T22:45:04.920 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="8.6"
2023-08-30T22:45:04.920 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el8"
2023-08-30T22:45:04.921 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-08-30T22:45:04.921 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31"
2023-08-30T22:45:04.921 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-08-30T22:45:04.921 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://www.redhat.com/"
2023-08-30T22:45:04.922 INFO:teuthology.orchestra.run.smithi064.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-30T22:45:04.922 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-30T22:45:04.922 INFO:teuthology.orchestra.run.smithi064.stdout:
2023-08-30T22:45:04.922 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-30T22:45:04.923 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-08-30T22:45:04.923 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-30T22:45:04.923 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-08-30T22:45:04.924 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server
2023-08-30T22:45:04.942 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: set os type and version on server
2023-08-30T22:45:04.942 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com'
2023-08-30T22:45:04.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T22:45:05.010 DEBUG:teuthology.orchestra.run.smithi123:> true
2023-08-30T22:45:05.149 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com'
2023-08-30T22:45:05.150 DEBUG:teuthology.orchestra.run.smithi123:> uname -m
2023-08-30T22:45:05.209 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64
2023-08-30T22:45:05.210 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release
2023-08-30T22:45:05.267 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Red Hat Enterprise Linux"
2023-08-30T22:45:05.268 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="8.6 (Ootpa)"
2023-08-30T22:45:05.268 INFO:teuthology.orchestra.run.smithi123.stdout:ID="rhel"
2023-08-30T22:45:05.269 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="fedora"
2023-08-30T22:45:05.269 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="8.6"
2023-08-30T22:45:05.270 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el8"
2023-08-30T22:45:05.270 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-08-30T22:45:05.270 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31"
2023-08-30T22:45:05.271 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-08-30T22:45:05.271 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.redhat.com/"
2023-08-30T22:45:05.272 INFO:teuthology.orchestra.run.smithi123.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-30T22:45:05.272 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-30T22:45:05.272 INFO:teuthology.orchestra.run.smithi123.stdout:
2023-08-30T22:45:05.272 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-30T22:45:05.273 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-08-30T22:45:05.273 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-30T22:45:05.273 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-08-30T22:45:05.274 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server
2023-08-30T22:45:05.300 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-30T22:45:05.396 INFO:teuthology.dispatcher.supervisor:Running job 7384781
2023-08-30T22:45:05.397 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384781 --name pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi --description fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_dbench_iozone} -- /home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384781/orig.config.yaml
2023-08-30T22:45:05.400 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384781
2023-08-30T22:45:05.400 INFO:teuthology.dispatcher.supervisor:Job PID: 2978825
2023-08-30T22:45:05.401 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-08-30T22:47:05.498 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-30T22:49:05.666 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-30T22:51:05.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-30T22:53:05.993 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-30T22:55:06.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-30T22:57:06.334 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-30T22:59:06.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-30T22:59:06.565 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-08-30T22:59:06.675 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-08-30T22:59:06.675 INFO:teuthology.nuke:Checking targets against current locks
2023-08-30T22:59:06.722 DEBUG:teuthology.nuke:shortname: smithi064
2023-08-30T22:59:06.722 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-30T22:59:06.748 DEBUG:teuthology.nuke:shortname: smithi123
2023-08-30T22:59:06.749 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-30T22:59:06.753 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi064.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384781', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 22:40:06.279041', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-08-30T22:59:06.774 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384781', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 22:40:06.277467', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-08-30T22:59:06.801 INFO:teuthology.orchestra.console.smithi064:Power off
2023-08-30T22:59:06.802 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-30T22:59:06.822 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off
2023-08-30T22:59:06.823 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-30T22:59:06.846 INFO:teuthology.orchestra.console.smithi123:Power off
2023-08-30T22:59:06.847 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-30T22:59:06.861 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off
2023-08-30T22:59:06.875 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off
2023-08-30T22:59:06.875 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-30T22:59:06.900 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off
2023-08-30T22:59:06.963 INFO:teuthology.orchestra.console.smithi064:Power off completed
2023-08-30T22:59:07.001 INFO:teuthology.orchestra.console.smithi123:Power off completed
2023-08-30T22:59:07.113 INFO:teuthology.lock.ops:unlocked: smithi064.front.sepia.ceph.com
2023-08-30T22:59:07.147 INFO:teuthology.lock.ops:unlocked: smithi123.front.sepia.ceph.com