2023-08-17T15:16:07.866 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc
2023-08-17T15:16:07.868 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T15:16:08.015 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f350c2c67f0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f350d7c1310>, signals=[15])
2023-08-17T15:16:08.017 INFO:teuthology.lock.ops:Start node 'smithi105.front.sepia.ceph.com' reimaging
2023-08-17T15:16:08.017 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: reset os type and version on server
2023-08-17T15:16:08.017 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server
2023-08-17T15:16:08.038 INFO:teuthology.lock.ops:Start node 'smithi111.front.sepia.ceph.com' reimaging
2023-08-17T15:16:08.039 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: reset os type and version on server
2023-08-17T15:16:08.039 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2023-08-17T15:16:08.040 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /host {"name": "smithi105"}
2023-08-17T15:16:08.064 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /host {"name": "smithi111"}
2023-08-17T15:16:08.118 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-08-17T15:16:08.134 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-08-17T15:16:08.161 DEBUG:teuthology.provision.fog.smithi105:Requesting image smithi_rhel_8.4 (ID 7)
2023-08-17T15:16:08.162 DEBUG:teuthology.provision.fog.smithi105:FOG request: PUT /host/210 {"imageID": 7}
2023-08-17T15:16:08.179 DEBUG:teuthology.provision.fog.smithi111:Requesting image smithi_rhel_8.4 (ID 7)
2023-08-17T15:16:08.179 DEBUG:teuthology.provision.fog.smithi111:FOG request: PUT /host/216 {"imageID": 7}
2023-08-17T15:16:08.217 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of rhel 8.4
2023-08-17T15:16:08.217 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-08-17T15:16:08.236 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of rhel 8.4
2023-08-17T15:16:08.236 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-08-17T15:16:08.294 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /tasktype {"name": "deploy"}
2023-08-17T15:16:08.298 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /tasktype {"name": "deploy"}
2023-08-17T15:16:08.323 DEBUG:teuthology.provision.fog.smithi105:FOG request: POST /host/210/task {"taskTypeID": 1}
2023-08-17T15:16:08.337 DEBUG:teuthology.provision.fog.smithi111:FOG request: POST /host/216/task {"taskTypeID": 1}
2023-08-17T15:16:08.381 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-08-17T15:16:08.554 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-08-17T15:16:08.608 INFO:teuthology.orchestra.console.smithi105:Power off
2023-08-17T15:16:08.609 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-17T15:16:08.633 DEBUG:teuthology.orchestra.console.smithi105:power off output: Chassis Power Control: Down/Off
2023-08-17T15:16:08.634 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T15:16:08.658 INFO:teuthology.orchestra.console.smithi111:Power off
2023-08-17T15:16:08.659 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-17T15:16:08.668 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on
2023-08-17T15:16:08.681 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off
2023-08-17T15:16:08.681 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T15:16:08.705 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on
2023-08-17T15:16:12.672 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T15:16:12.706 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T15:16:12.783 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on
2023-08-17T15:16:12.817 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on
2023-08-17T15:16:16.788 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T15:16:16.818 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T15:16:16.899 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on
2023-08-17T15:16:16.928 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2023-08-17T15:16:17.028 INFO:teuthology.orchestra.console.smithi111:Power off completed
2023-08-17T15:16:17.130 INFO:teuthology.orchestra.console.smithi111:Power on
2023-08-17T15:16:17.130 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-17T15:16:17.154 DEBUG:teuthology.orchestra.console.smithi111:power on output: Chassis Power Control: Up/On
2023-08-17T15:16:17.155 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T15:16:17.179 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2023-08-17T15:16:20.904 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T15:16:21.017 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off
2023-08-17T15:16:21.118 INFO:teuthology.orchestra.console.smithi105:Power off completed
2023-08-17T15:16:21.180 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T15:16:21.220 INFO:teuthology.orchestra.console.smithi105:Power on
2023-08-17T15:16:21.220 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-17T15:16:21.246 DEBUG:teuthology.orchestra.console.smithi105:power on output: Chassis Power Control: Up/On
2023-08-17T15:16:21.246 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T15:16:21.269 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off
2023-08-17T15:16:21.293 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2023-08-17T15:16:25.274 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T15:16:25.295 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T15:16:25.385 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on
2023-08-17T15:16:25.405 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on
2023-08-17T15:16:25.486 INFO:teuthology.orchestra.console.smithi105:Power on completed
2023-08-17T15:16:25.507 INFO:teuthology.orchestra.console.smithi111:Power on completed
2023-08-17T15:16:25.587 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish
2023-08-17T15:16:25.588 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-08-17T15:16:25.609 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish
2023-08-17T15:16:25.609 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-08-17T15:16:40.686 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-08-17T15:16:40.691 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-08-17T15:16:55.776 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-08-17T15:16:55.777 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-08-17T15:17:10.857 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-08-17T15:17:10.858 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-08-17T15:17:25.936 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-08-17T15:17:25.938 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-08-17T15:17:41.017 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-08-17T15:17:41.019 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-08-17T15:17:56.094 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-08-17T15:17:56.096 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-08-17T15:18:11.176 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-08-17T15:18:11.177 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-08-17T15:18:26.262 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-08-17T15:18:26.263 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-08-17T15:18:41.344 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-08-17T15:18:41.345 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-08-17T15:18:56.424 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-08-17T15:18:56.425 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-08-17T15:19:11.508 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-08-17T15:19:11.510 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-08-17T15:19:11.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T15:19:14.644 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2023-08-17T15:19:20.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T15:19:23.728 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2023-08-17T15:19:26.574 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-08-17T15:19:26.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T15:19:29.712 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-08-17T15:19:29.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T15:19:32.784 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2023-08-17T15:19:35.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T15:19:38.772 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-08-17T15:19:38.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T15:19:41.840 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2023-08-17T15:19:44.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T15:19:47.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T15:19:47.860 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-08-17T15:19:50.896 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2023-08-17T15:19:53.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T15:19:56.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T15:19:56.944 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-08-17T15:19:59.956 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2023-08-17T15:20:02.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T15:20:05.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T15:20:06.004 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-08-17T15:20:12.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T15:20:15.088 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-08-17T15:20:21.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T15:20:24.144 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-08-17T15:20:30.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T15:20:33.200 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-08-17T15:20:39.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T15:20:57.712 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-08-17T15:21:03.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T15:21:05.965 WARNING:teuthology.provision.fog.smithi105:timed out
2023-08-17T15:21:06.801 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-08-17T15:21:11.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T15:21:12.238 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-17T15:21:12.239 DEBUG:teuthology.orchestra.run.smithi105:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-17T15:21:12.502 INFO:teuthology.provision.fog.smithi105:Node is ready
2023-08-17T15:21:12.502 DEBUG:teuthology.orchestra.run.smithi105:> hostname
2023-08-17T15:21:12.558 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105.front.sepia.ceph.com
2023-08-17T15:21:12.559 DEBUG:teuthology.orchestra.run.smithi105:> grep smithi105.front.sepia.ceph.com /etc/hosts
2023-08-17T15:21:12.614 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105.front.sepia.ceph.com smithi105
2023-08-17T15:21:12.615 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105
2023-08-17T15:21:12.722 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hosts
2023-08-17T15:21:12.754 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/172.21.15.105/172.21.15.105/g' /etc/hosts
2023-08-17T15:21:12.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T15:21:12.819 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hostname
2023-08-17T15:21:12.884 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105
2023-08-17T15:21:12.947 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release
2023-08-17T15:21:13.001 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="Red Hat Enterprise Linux"
2023-08-17T15:21:13.001 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8.4 (Ootpa)"
2023-08-17T15:21:13.001 INFO:teuthology.orchestra.run.smithi105.stdout:ID="rhel"
2023-08-17T15:21:13.001 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="fedora"
2023-08-17T15:21:13.001 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8.4"
2023-08-17T15:21:13.002 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8"
2023-08-17T15:21:13.002 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-08-17T15:21:13.002 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31"
2023-08-17T15:21:13.002 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-08-17T15:21:13.002 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://www.redhat.com/"
2023-08-17T15:21:13.002 INFO:teuthology.orchestra.run.smithi105.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-17T15:21:13.002 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-17T15:21:13.002 INFO:teuthology.orchestra.run.smithi105.stdout:
2023-08-17T15:21:13.003 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-17T15:21:13.003 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-08-17T15:21:13.003 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-17T15:21:13.003 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-08-17T15:21:13.004 INFO:teuthology.provision.fog.smithi105:Deploy complete!
2023-08-17T15:21:13.005 DEBUG:teuthology.parallel:result is None
2023-08-17T15:21:15.132 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-17T15:21:15.133 DEBUG:teuthology.orchestra.run.smithi111:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-17T15:21:40.812 INFO:teuthology.provision.fog.smithi111:Node is ready
2023-08-17T15:21:40.813 DEBUG:teuthology.orchestra.run.smithi111:> hostname
2023-08-17T15:21:40.829 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111.front.sepia.ceph.com
2023-08-17T15:21:40.829 DEBUG:teuthology.orchestra.run.smithi111:> grep smithi111.front.sepia.ceph.com /etc/hosts
2023-08-17T15:21:40.883 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111
2023-08-17T15:21:40.883 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111
2023-08-17T15:21:41.066 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hosts
2023-08-17T15:21:41.092 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/172.21.15.111/172.21.15.111/g' /etc/hosts
2023-08-17T15:21:41.156 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hostname
2023-08-17T15:21:41.221 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111
2023-08-17T15:21:41.284 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release
2023-08-17T15:21:41.340 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Red Hat Enterprise Linux"
2023-08-17T15:21:41.340 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="8.4 (Ootpa)"
2023-08-17T15:21:41.341 INFO:teuthology.orchestra.run.smithi111.stdout:ID="rhel"
2023-08-17T15:21:41.341 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="fedora"
2023-08-17T15:21:41.341 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="8.4"
2023-08-17T15:21:41.341 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el8"
2023-08-17T15:21:41.341 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-08-17T15:21:41.341 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31"
2023-08-17T15:21:41.341 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-08-17T15:21:41.342 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.redhat.com/"
2023-08-17T15:21:41.342 INFO:teuthology.orchestra.run.smithi111.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-17T15:21:41.342 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-17T15:21:41.342 INFO:teuthology.orchestra.run.smithi111.stdout:
2023-08-17T15:21:41.342 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-17T15:21:41.342 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-08-17T15:21:41.342 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-17T15:21:41.343 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-08-17T15:21:41.343 INFO:teuthology.provision.fog.smithi111:Deploy complete!
2023-08-17T15:21:41.344 DEBUG:teuthology.parallel:result is None
2023-08-17T15:21:41.501 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com
2023-08-17T15:21:41.502 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-17T15:21:41.524 INFO:teuthology.lock.ops:Checking smithi111.front.sepia.ceph.com
2023-08-17T15:21:41.524 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-17T15:21:41.550 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server
2023-08-17T15:21:41.551 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com'
2023-08-17T15:21:41.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T15:21:41.628 DEBUG:teuthology.orchestra.run.smithi105:> true
2023-08-17T15:21:41.751 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com'
2023-08-17T15:21:41.751 DEBUG:teuthology.orchestra.run.smithi105:> uname -m
2023-08-17T15:21:41.806 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64
2023-08-17T15:21:41.807 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release
2023-08-17T15:21:41.861 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="Red Hat Enterprise Linux"
2023-08-17T15:21:41.862 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8.4 (Ootpa)"
2023-08-17T15:21:41.862 INFO:teuthology.orchestra.run.smithi105.stdout:ID="rhel"
2023-08-17T15:21:41.862 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="fedora"
2023-08-17T15:21:41.862 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8.4"
2023-08-17T15:21:41.862 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8"
2023-08-17T15:21:41.863 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-08-17T15:21:41.863 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31"
2023-08-17T15:21:41.863 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-08-17T15:21:41.863 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://www.redhat.com/"
2023-08-17T15:21:41.863 INFO:teuthology.orchestra.run.smithi105.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-17T15:21:41.863 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-17T15:21:41.864 INFO:teuthology.orchestra.run.smithi105.stdout:
2023-08-17T15:21:41.864 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-17T15:21:41.864 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-08-17T15:21:41.864 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-17T15:21:41.864 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-08-17T15:21:41.867 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server
2023-08-17T15:21:41.890 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: set os type and version on server
2023-08-17T15:21:41.891 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com'
2023-08-17T15:21:41.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T15:21:41.959 DEBUG:teuthology.orchestra.run.smithi111:> true
2023-08-17T15:21:42.018 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com'
2023-08-17T15:21:42.018 DEBUG:teuthology.orchestra.run.smithi111:> uname -m
2023-08-17T15:21:42.071 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64
2023-08-17T15:21:42.072 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release
2023-08-17T15:21:42.124 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Red Hat Enterprise Linux"
2023-08-17T15:21:42.124 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="8.4 (Ootpa)"
2023-08-17T15:21:42.124 INFO:teuthology.orchestra.run.smithi111.stdout:ID="rhel"
2023-08-17T15:21:42.125 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="fedora"
2023-08-17T15:21:42.125 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="8.4"
2023-08-17T15:21:42.125 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el8"
2023-08-17T15:21:42.125 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-08-17T15:21:42.125 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31"
2023-08-17T15:21:42.125 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-08-17T15:21:42.125 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.redhat.com/"
2023-08-17T15:21:42.126 INFO:teuthology.orchestra.run.smithi111.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-17T15:21:42.126 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-17T15:21:42.126 INFO:teuthology.orchestra.run.smithi111.stdout:
2023-08-17T15:21:42.126 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-17T15:21:42.126 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-08-17T15:21:42.126 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-17T15:21:42.126 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-08-17T15:21:42.127 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2023-08-17T15:21:42.149 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T15:21:42.258 INFO:teuthology.dispatcher.supervisor:Running job 7371818
2023-08-17T15:21:42.259 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-17_14:36:27-fs-wip-yuri7-testing-2023-08-16-1309-pacific-distro-default-smithi/7371818 --name yuriw-2023-08-17_14:36:27-fs-wip-yuri7-testing-2023-08-16-1309-pacific-distro-default-smithi --description fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/acls} -- /home/teuthworker/archive/yuriw-2023-08-17_14:36:27-fs-wip-yuri7-testing-2023-08-16-1309-pacific-distro-default-smithi/7371818/orig.config.yaml
2023-08-17T15:21:42.264 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-17_14:36:27-fs-wip-yuri7-testing-2023-08-16-1309-pacific-distro-default-smithi/7371818
2023-08-17T15:21:42.265 INFO:teuthology.dispatcher.supervisor:Job PID: 20167
2023-08-17T15:21:42.266 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-08-17T15:23:42.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T15:25:42.533 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T15:27:42.702 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T15:29:42.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T15:31:43.046 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T15:33:43.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T15:35:43.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T15:37:43.557 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T15:39:43.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T15:39:43.737 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-08-17T15:39:43.839 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-08-17T15:39:43.839 INFO:teuthology.nuke:Checking targets against current locks
2023-08-17T15:39:43.875 DEBUG:teuthology.nuke:shortname: smithi105
2023-08-17T15:39:43.876 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-17T15:39:43.896 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi105.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-17_14:36:27-fs-wip-yuri7-testing-2023-08-16-1309-pacific-distro-default-smithi/7371818', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-17 15:16:07.008051', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTeht2BvI/Dxl6RTF4xepG7W8n0ikCxXtmj3EY7qOysj92KcDcybLARUSfGzrLrFB8EQxUD+fpa7UKNhhrHNEoDhaosVAQ9i1+Ic2bbe9bIxXeVveCGr15JM2pafgOVOegphRnijZS01za0F7bpKUFGiIz9zgl8lhSBLOXDjYRQItYIuTt5lm9YHr6Ctax6038/Zh3jKlxBfYxJFKFxqtLkE7+OEtSyoOtd5axjjvMsO/+e87Lwu6ZeYzuE4LHyvbjxRtCFMCTD+LyxMl4pyhNay/KQ8rAiYLZpGihJ5aACKLeS66pR8b8SRu6T55kLqlvbURCivvXmBuwckpBSatsJqObToTi4RF/VIRecJ3L674QCr2iLErsGGw3cYppfvXr7IsYwnLyt/XiGCFIKj35QG28gIcpR8IerxpFHBipaQOQ7TDyY3PiaxLLIBYhIocAPoeBmHjqrTExvRtWuBSU5voAcJmaUBEuGPHayN09Q/wH2nbvgBDQWsXk/alpdDc='}
2023-08-17T15:39:43.903 DEBUG:teuthology.nuke:shortname: smithi111
2023-08-17T15:39:43.903 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-17T15:39:43.921 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-17_14:36:27-fs-wip-yuri7-testing-2023-08-16-1309-pacific-distro-default-smithi/7371818', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-17 15:16:07.009938', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE8WUKYWfih88QMpIbUp2gzPVZpE78eTh9BG6W+CeBC5Fqyulm1L6QtEBcOr2pWw1VfEj/tDRw9lWMYalYeveMA='}
2023-08-17T15:39:43.935 INFO:teuthology.orchestra.console.smithi105:Power off
2023-08-17T15:39:43.936 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-17T15:39:43.956 DEBUG:teuthology.orchestra.console.smithi105:power off output: Chassis Power Control: Down/Off
2023-08-17T15:39:43.957 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T15:39:43.974 INFO:teuthology.orchestra.console.smithi111:Power off
2023-08-17T15:39:43.974 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-17T15:39:43.983 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off
2023-08-17T15:39:43.993 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off
2023-08-17T15:39:43.994 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T15:39:44.013 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2023-08-17T15:39:44.085 INFO:teuthology.orchestra.console.smithi105:Power off completed
2023-08-17T15:39:44.114 INFO:teuthology.orchestra.console.smithi111:Power off completed
2023-08-17T15:39:44.236 INFO:teuthology.lock.ops:unlocked: smithi105.front.sepia.ceph.com
2023-08-17T15:39:44.253 INFO:teuthology.lock.ops:unlocked: smithi111.front.sepia.ceph.com