2023-08-30T22:59:17.367 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556
2023-08-30T22:59:17.368 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-30T22:59:17.530 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f9c24533d30>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f9c25026670>, signals=[15])
2023-08-30T22:59:17.532 INFO:teuthology.lock.ops:Start node 'smithi066.front.sepia.ceph.com' reimaging
2023-08-30T22:59:17.533 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: reset os type and version on server
2023-08-30T22:59:17.533 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server
2023-08-30T22:59:17.584 INFO:teuthology.lock.ops:Start node 'smithi111.front.sepia.ceph.com' reimaging
2023-08-30T22:59:17.584 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: reset os type and version on server
2023-08-30T22:59:17.584 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2023-08-30T22:59:17.586 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /host {"name": "smithi066"}
2023-08-30T22:59:17.620 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /host {"name": "smithi111"}
2023-08-30T22:59:17.664 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-08-30T22:59:17.710 DEBUG:teuthology.provision.fog.smithi066:Requesting image smithi_rhel_8.6 (ID 5)
2023-08-30T22:59:17.710 DEBUG:teuthology.provision.fog.smithi066:FOG request: PUT /host/171 {"imageID": 5}
2023-08-30T22:59:17.711 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-08-30T22:59:17.753 DEBUG:teuthology.provision.fog.smithi111:Requesting image smithi_rhel_8.6 (ID 5)
2023-08-30T22:59:17.754 DEBUG:teuthology.provision.fog.smithi111:FOG request: PUT /host/216 {"imageID": 5}
2023-08-30T22:59:17.759 INFO:teuthology.provision.fog.smithi066:Scheduling deploy of rhel 8.6
2023-08-30T22:59:17.759 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-08-30T22:59:17.796 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of rhel 8.6
2023-08-30T22:59:17.797 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-08-30T22:59:17.810 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /tasktype {"name": "deploy"}
2023-08-30T22:59:17.844 DEBUG:teuthology.provision.fog.smithi066:FOG request: POST /host/171/task {"taskTypeID": 1}
2023-08-30T22:59:17.852 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /tasktype {"name": "deploy"}
2023-08-30T22:59:17.890 DEBUG:teuthology.provision.fog.smithi111:FOG request: POST /host/216/task {"taskTypeID": 1}
2023-08-30T22:59:17.909 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-08-30T22:59:17.941 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-08-30T22:59:17.998 INFO:teuthology.orchestra.console.smithi066:Power off
2023-08-30T22:59:17.999 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-30T22:59:18.025 DEBUG:teuthology.orchestra.console.smithi066:power off output: Chassis Power Control: Down/Off
2023-08-30T22:59:18.025 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-30T22:59:18.047 INFO:teuthology.orchestra.console.smithi111:Power off
2023-08-30T22:59:18.048 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-30T22:59:18.063 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off
2023-08-30T22:59:18.079 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off
2023-08-30T22:59:18.080 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-30T22:59:18.107 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2023-08-30T22:59:18.164 INFO:teuthology.orchestra.console.smithi066:Power off completed
2023-08-30T22:59:18.209 INFO:teuthology.orchestra.console.smithi111:Power off completed
2023-08-30T22:59:18.266 INFO:teuthology.orchestra.console.smithi066:Power on
2023-08-30T22:59:18.266 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-30T22:59:18.288 DEBUG:teuthology.orchestra.console.smithi066:power on output: Chassis Power Control: Up/On
2023-08-30T22:59:18.288 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-30T22:59:18.309 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off
2023-08-30T22:59:18.310 INFO:teuthology.orchestra.console.smithi111:Power on
2023-08-30T22:59:18.310 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-30T22:59:18.330 DEBUG:teuthology.orchestra.console.smithi111:power on output: Chassis Power Control: Up/On
2023-08-30T22:59:18.331 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-30T22:59:18.354 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2023-08-30T22:59:22.314 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-30T22:59:22.356 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-30T22:59:22.425 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on
2023-08-30T22:59:22.466 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2023-08-30T22:59:22.526 INFO:teuthology.orchestra.console.smithi066:Power on completed
2023-08-30T22:59:22.627 INFO:teuthology.provision.fog.smithi066:Waiting for deploy to finish
2023-08-30T22:59:22.627 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-08-30T22:59:26.470 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-30T22:59:26.579 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on
2023-08-30T22:59:26.681 INFO:teuthology.orchestra.console.smithi111:Power on completed
2023-08-30T22:59:26.782 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish
2023-08-30T22:59:26.782 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-08-30T22:59:37.698 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-08-30T22:59:41.846 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-08-30T22:59:52.770 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-08-30T22:59:56.906 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-08-30T23:00:07.835 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-08-30T23:00:11.965 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-08-30T23:00:22.910 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-08-30T23:00:27.026 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-08-30T23:00:37.994 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-08-30T23:00:42.102 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-08-30T23:00:53.079 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-08-30T23:00:57.174 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-08-30T23:01:08.164 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-08-30T23:01:12.274 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-08-30T23:01:23.242 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-08-30T23:01:27.354 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-08-30T23:01:38.326 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-08-30T23:01:42.442 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-08-30T23:01:53.410 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-08-30T23:01:57.530 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-08-30T23:02:08.510 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-08-30T23:02:12.618 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-08-30T23:02:23.594 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-08-30T23:02:27.694 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-08-30T23:02:27.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T23:02:30.849 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-08-30T23:02:36.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T23:02:38.684 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-08-30T23:02:38.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T23:02:38.842 ERROR:teuthology.orchestra.connection:Error authenticating with smithi066.front.sepia.ceph.com: Authentication failed.
2023-08-30T23:02:38.846 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-30T23:02:38.847 DEBUG:teuthology.orchestra.run.smithi066:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-30T23:02:38.848 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-30T23:02:39.934 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-08-30T23:02:45.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T23:02:49.022 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-08-30T23:02:55.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T23:02:58.074 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-08-30T23:03:04.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T23:03:07.134 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-08-30T23:03:13.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T23:03:16.192 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-08-30T23:03:22.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T23:03:25.274 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-08-30T23:03:31.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T23:04:31.281 WARNING:teuthology.provision.fog.smithi111:timed out
2023-08-30T23:04:37.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T23:04:37.619 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-30T23:04:37.620 DEBUG:teuthology.orchestra.run.smithi111:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-30T23:04:37.918 INFO:teuthology.provision.fog.smithi111:Node is ready
2023-08-30T23:04:37.919 DEBUG:teuthology.orchestra.run.smithi111:> hostname
2023-08-30T23:04:37.936 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111.front.sepia.ceph.com
2023-08-30T23:04:37.937 DEBUG:teuthology.orchestra.run.smithi111:> grep smithi111.front.sepia.ceph.com /etc/hosts
2023-08-30T23:04:37.995 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111
2023-08-30T23:04:37.995 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111
2023-08-30T23:04:38.115 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hosts
2023-08-30T23:04:38.143 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/172.21.15.111/172.21.15.111/g' /etc/hosts
2023-08-30T23:04:38.211 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hostname
2023-08-30T23:04:38.277 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111
2023-08-30T23:04:38.343 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release
2023-08-30T23:04:38.404 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Red Hat Enterprise Linux"
2023-08-30T23:04:38.405 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="8.6 (Ootpa)"
2023-08-30T23:04:38.405 INFO:teuthology.orchestra.run.smithi111.stdout:ID="rhel"
2023-08-30T23:04:38.405 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="fedora"
2023-08-30T23:04:38.405 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="8.6"
2023-08-30T23:04:38.405 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el8"
2023-08-30T23:04:38.406 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-08-30T23:04:38.406 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31"
2023-08-30T23:04:38.406 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-08-30T23:04:38.406 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.redhat.com/"
2023-08-30T23:04:38.406 INFO:teuthology.orchestra.run.smithi111.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-30T23:04:38.407 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-30T23:04:38.407 INFO:teuthology.orchestra.run.smithi111.stdout:
2023-08-30T23:04:38.407 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-30T23:04:38.408 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-08-30T23:04:38.408 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-30T23:04:38.408 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-08-30T23:04:38.409 INFO:teuthology.provision.fog.smithi111:Deploy complete!
2023-08-30T23:04:38.410 DEBUG:teuthology.parallel:result is None
2023-08-30T23:05:23.610 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-08-30T23:05:23.612 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi066
2023-08-30T23:05:32.618 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com'
2023-08-30T23:05:32.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T23:05:32.970 DEBUG:teuthology.orchestra.run.smithi066:> true
2023-08-30T23:05:33.411 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com'
2023-08-30T23:05:33.411 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-30T23:05:33.412 DEBUG:teuthology.orchestra.run.smithi066:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-30T23:05:33.431 INFO:teuthology.provision.fog.smithi066:Node is ready
2023-08-30T23:05:33.432 DEBUG:teuthology.orchestra.run.smithi066:> hostname
2023-08-30T23:05:33.492 INFO:teuthology.orchestra.run.smithi066.stdout:smithi066
2023-08-30T23:05:33.492 DEBUG:teuthology.orchestra.run.smithi066:> grep smithi066 /etc/hosts
2023-08-30T23:05:33.552 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66 smithi066.front.sepia.ceph.com smithi066
2023-08-30T23:05:33.552 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname smithi066
2023-08-30T23:05:33.669 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi066/smithi066/g' /etc/hosts
2023-08-30T23:05:33.700 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/172.21.15.66/172.21.15.66/g' /etc/hosts
2023-08-30T23:05:33.769 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi066/smithi066/g' /etc/hostname
2023-08-30T23:05:33.838 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname smithi066
2023-08-30T23:05:33.906 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release
2023-08-30T23:05:33.963 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="Red Hat Enterprise Linux"
2023-08-30T23:05:33.964 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="8.6 (Ootpa)"
2023-08-30T23:05:33.964 INFO:teuthology.orchestra.run.smithi066.stdout:ID="rhel"
2023-08-30T23:05:33.964 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="fedora"
2023-08-30T23:05:33.964 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="8.6"
2023-08-30T23:05:33.965 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el8"
2023-08-30T23:05:33.965 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-08-30T23:05:33.965 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31"
2023-08-30T23:05:33.965 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-08-30T23:05:33.965 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://www.redhat.com/"
2023-08-30T23:05:33.966 INFO:teuthology.orchestra.run.smithi066.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-30T23:05:33.966 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-30T23:05:33.966 INFO:teuthology.orchestra.run.smithi066.stdout:
2023-08-30T23:05:33.966 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-30T23:05:33.966 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-08-30T23:05:33.967 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-30T23:05:33.967 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-08-30T23:05:33.967 INFO:teuthology.provision.fog.smithi066:Deploy complete!
2023-08-30T23:05:33.968 DEBUG:teuthology.parallel:result is None
2023-08-30T23:05:34.119 INFO:teuthology.lock.ops:Checking smithi066.front.sepia.ceph.com
2023-08-30T23:05:34.120 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-30T23:05:34.140 INFO:teuthology.lock.ops:Checking smithi111.front.sepia.ceph.com
2023-08-30T23:05:34.140 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-30T23:05:34.166 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: set os type and version on server
2023-08-30T23:05:34.166 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com'
2023-08-30T23:05:34.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T23:05:34.236 DEBUG:teuthology.orchestra.run.smithi066:> true
2023-08-30T23:05:34.306 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com'
2023-08-30T23:05:34.307 DEBUG:teuthology.orchestra.run.smithi066:> uname -m
2023-08-30T23:05:34.363 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64
2023-08-30T23:05:34.364 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release
2023-08-30T23:05:34.421 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="Red Hat Enterprise Linux"
2023-08-30T23:05:34.421 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="8.6 (Ootpa)"
2023-08-30T23:05:34.421 INFO:teuthology.orchestra.run.smithi066.stdout:ID="rhel"
2023-08-30T23:05:34.422 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="fedora"
2023-08-30T23:05:34.422 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="8.6"
2023-08-30T23:05:34.422 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el8"
2023-08-30T23:05:34.422 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-08-30T23:05:34.423 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31"
2023-08-30T23:05:34.423 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-08-30T23:05:34.423 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://www.redhat.com/"
2023-08-30T23:05:34.424 INFO:teuthology.orchestra.run.smithi066.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-30T23:05:34.424 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-30T23:05:34.424 INFO:teuthology.orchestra.run.smithi066.stdout:
2023-08-30T23:05:34.424 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-30T23:05:34.424 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-08-30T23:05:34.425 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-30T23:05:34.425 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-08-30T23:05:34.425 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server
2023-08-30T23:05:34.448 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: set os type and version on server
2023-08-30T23:05:34.448 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com'
2023-08-30T23:05:34.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T23:05:34.517 DEBUG:teuthology.orchestra.run.smithi111:> true
2023-08-30T23:05:34.651 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com'
2023-08-30T23:05:34.652 DEBUG:teuthology.orchestra.run.smithi111:> uname -m
2023-08-30T23:05:34.710 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64
2023-08-30T23:05:34.710 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release
2023-08-30T23:05:34.767 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Red Hat Enterprise Linux"
2023-08-30T23:05:34.768 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="8.6 (Ootpa)"
2023-08-30T23:05:34.768 INFO:teuthology.orchestra.run.smithi111.stdout:ID="rhel"
2023-08-30T23:05:34.768 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="fedora"
2023-08-30T23:05:34.768 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="8.6"
2023-08-30T23:05:34.769 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el8"
2023-08-30T23:05:34.769 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-08-30T23:05:34.769 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31"
2023-08-30T23:05:34.769 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-08-30T23:05:34.769 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.redhat.com/"
2023-08-30T23:05:34.770 INFO:teuthology.orchestra.run.smithi111.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-30T23:05:34.770 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-30T23:05:34.770 INFO:teuthology.orchestra.run.smithi111.stdout:
2023-08-30T23:05:34.770 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-30T23:05:34.771 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-08-30T23:05:34.771 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-30T23:05:34.771 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-08-30T23:05:34.772 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2023-08-30T23:05:34.798 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-30T23:05:34.891 INFO:teuthology.dispatcher.supervisor:Running job 7384846
2023-08-30T23:05:34.891 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384846 --name pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi --description fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_fsstress}} -- /home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384846/orig.config.yaml
2023-08-30T23:05:34.895 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384846
2023-08-30T23:05:34.896 INFO:teuthology.dispatcher.supervisor:Job PID: 3528908
2023-08-30T23:05:34.896 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-08-30T23:07:34.994 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-30T23:09:35.166 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-30T23:11:35.338 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-30T23:13:35.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-30T23:15:35.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-30T23:17:35.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-30T23:19:36.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-30T23:19:36.096 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-08-30T23:19:36.328 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-08-30T23:19:36.330 INFO:teuthology.nuke:Checking targets against current locks
2023-08-30T23:19:36.399 DEBUG:teuthology.nuke:shortname: smithi066
2023-08-30T23:19:36.400 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-30T23:19:36.435 DEBUG:teuthology.nuke:shortname: smithi111
2023-08-30T23:19:36.435 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-30T23:19:36.455 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi066.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384846', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 22:59:16.383212', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-08-30T23:19:36.501 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384846', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 22:59:16.381476', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-08-30T23:19:36.550 INFO:teuthology.orchestra.console.smithi066:Power off
2023-08-30T23:19:36.551 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-30T23:19:36.592 DEBUG:teuthology.orchestra.console.smithi066:power off output: Chassis Power Control: Down/Off
2023-08-30T23:19:36.593 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-30T23:19:36.642 INFO:teuthology.orchestra.console.smithi111:Power off
2023-08-30T23:19:36.644 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-30T23:19:36.657 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off
2023-08-30T23:19:36.675 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off
2023-08-30T23:19:36.676 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-30T23:19:36.698 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2023-08-30T23:19:36.758 INFO:teuthology.orchestra.console.smithi066:Power off completed
2023-08-30T23:19:36.800 INFO:teuthology.orchestra.console.smithi111:Power off completed
2023-08-30T23:19:36.936 INFO:teuthology.lock.ops:unlocked: smithi066.front.sepia.ceph.com
2023-08-30T23:19:36.952 INFO:teuthology.lock.ops:unlocked: smithi111.front.sepia.ceph.com