2023-07-21T18:19:01.138 INFO:root:teuthology version: 0.0.1.dev153+g79491cb
2023-07-21T18:19:01.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T18:19:01.140 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T18:19:01.287 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7ff3919b0610>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7ff391376f70>, signals=[15])
2023-07-21T18:19:01.288 INFO:teuthology.lock.ops:Start node 'smithi131.front.sepia.ceph.com' reimaging
2023-07-21T18:19:01.289 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: reset os type and version on server
2023-07-21T18:19:01.289 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server
2023-07-21T18:19:01.316 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging
2023-07-21T18:19:01.316 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server
2023-07-21T18:19:01.317 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2023-07-21T18:19:01.318 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /host {"name": "smithi131"}
2023-07-21T18:19:04.278 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-21T18:19:04.281 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /host {"name": "smithi161"}
2023-07-21T18:19:04.320 DEBUG:teuthology.provision.fog.smithi131:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-21T18:19:04.320 DEBUG:teuthology.provision.fog.smithi131:FOG request: PUT /host/236 {"imageID": 5}
2023-07-21T18:19:04.351 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-21T18:19:04.368 INFO:teuthology.provision.fog.smithi131:Scheduling deploy of rhel 8.6
2023-07-21T18:19:04.368 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None
2023-07-21T18:19:04.388 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-21T18:19:04.388 DEBUG:teuthology.provision.fog.smithi161:FOG request: PUT /host/266 {"imageID": 5}
2023-07-21T18:19:04.434 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /tasktype {"name": "deploy"}
2023-07-21T18:19:04.437 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of rhel 8.6
2023-07-21T18:19:04.437 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-07-21T18:19:04.464 DEBUG:teuthology.provision.fog.smithi131:FOG request: POST /host/236/task {"taskTypeID": 1}
2023-07-21T18:19:04.488 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /tasktype {"name": "deploy"}
2023-07-21T18:19:04.519 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None
2023-07-21T18:19:04.532 DEBUG:teuthology.provision.fog.smithi161:FOG request: POST /host/266/task {"taskTypeID": 1}
2023-07-21T18:19:04.577 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-07-21T18:19:04.616 INFO:teuthology.orchestra.console:Power off smithi131
2023-07-21T18:19:04.617 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-21T18:19:04.645 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T18:19:04.685 INFO:teuthology.orchestra.console:Power off smithi161
2023-07-21T18:19:04.686 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-21T18:19:04.711 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T18:19:08.668 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T18:19:08.732 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T18:19:12.780 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T18:19:12.845 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T18:19:17.891 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T18:19:17.955 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T18:19:18.165 INFO:teuthology.orchestra.console:Power off for smithi161 completed
2023-07-21T18:19:18.266 INFO:teuthology.orchestra.console:Power on smithi161
2023-07-21T18:19:18.267 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-21T18:19:18.291 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T18:19:22.316 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T18:19:23.003 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T18:19:27.427 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T18:19:27.638 INFO:teuthology.orchestra.console:Power on for smithi161 completed
2023-07-21T18:19:27.739 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish
2023-07-21T18:19:27.740 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-07-21T18:19:28.114 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T18:19:28.324 INFO:teuthology.orchestra.console:Power off for smithi131 completed
2023-07-21T18:19:28.425 INFO:teuthology.orchestra.console:Power on smithi131
2023-07-21T18:19:28.426 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-21T18:19:28.446 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T18:19:32.472 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T18:19:37.584 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T18:19:42.695 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T18:19:42.815 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-07-21T18:19:44.374 INFO:teuthology.orchestra.console:Power on for smithi131 completed
2023-07-21T18:19:44.475 INFO:teuthology.provision.fog.smithi131:Waiting for deploy to finish
2023-07-21T18:19:44.476 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None
2023-07-21T18:19:59.464 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-07-21T18:20:14.473 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None
2023-07-21T18:20:34.548 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None
2023-07-21T18:20:34.550 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-07-21T18:20:59.628 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None
2023-07-21T18:20:59.629 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-07-21T18:21:14.708 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-07-21T18:21:14.710 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None
2023-07-21T18:21:35.092 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-07-21T18:21:35.094 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None
2023-07-21T18:21:50.175 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-07-21T18:21:50.176 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None
2023-07-21T18:22:05.240 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None
2023-07-21T18:22:05.241 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-07-21T18:22:15.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T18:22:15.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T18:22:18.356 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131
2023-07-21T18:22:18.357 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-07-21T18:22:24.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T18:22:29.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T18:22:34.369 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131
2023-07-21T18:22:37.424 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-07-21T18:22:40.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T18:22:45.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T18:22:50.380 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131
2023-07-21T18:22:53.456 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-07-21T18:22:56.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T18:23:01.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T18:23:09.460 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-07-21T18:23:15.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T18:23:20.469 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131
2023-07-21T18:23:26.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T18:23:34.548 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131
2023-07-21T18:23:38.867 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-07-21T18:23:40.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T18:23:45.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T18:23:50.869 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-21T18:23:50.870 DEBUG:teuthology.orchestra.run.smithi131:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-21T18:23:51.172 INFO:teuthology.provision.fog.smithi131:Node is ready
2023-07-21T18:23:51.173 DEBUG:teuthology.orchestra.run.smithi131:> hostname
2023-07-21T18:23:51.190 INFO:teuthology.orchestra.run.smithi131.stdout:smithi131.front.sepia.ceph.com
2023-07-21T18:23:51.191 DEBUG:teuthology.orchestra.run.smithi131:> grep smithi131.front.sepia.ceph.com /etc/hosts
2023-07-21T18:23:51.247 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.131 smithi131.front.sepia.ceph.com smithi131
2023-07-21T18:23:51.248 DEBUG:teuthology.orchestra.run.smithi131:> sudo hostname smithi131
2023-07-21T18:23:51.373 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/smithi131.front.sepia.ceph.com/smithi131/g' /etc/hosts
2023-07-21T18:23:51.400 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/172.21.15.131/172.21.15.131/g' /etc/hosts
2023-07-21T18:23:51.468 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/smithi131.front.sepia.ceph.com/smithi131/g' /etc/hostname
2023-07-21T18:23:51.536 DEBUG:teuthology.orchestra.run.smithi131:> sudo hostname smithi131
2023-07-21T18:23:51.601 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release
2023-07-21T18:23:51.658 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="Red Hat Enterprise Linux"
2023-07-21T18:23:51.658 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="8.6 (Ootpa)"
2023-07-21T18:23:51.659 INFO:teuthology.orchestra.run.smithi131.stdout:ID="rhel"
2023-07-21T18:23:51.659 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="fedora"
2023-07-21T18:23:51.659 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="8.6"
2023-07-21T18:23:51.659 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el8"
2023-07-21T18:23:51.659 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-21T18:23:51.659 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31"
2023-07-21T18:23:51.660 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-21T18:23:51.660 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://www.redhat.com/"
2023-07-21T18:23:51.660 INFO:teuthology.orchestra.run.smithi131.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-21T18:23:51.660 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-21T18:23:51.660 INFO:teuthology.orchestra.run.smithi131.stdout:
2023-07-21T18:23:51.660 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-21T18:23:51.660 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-21T18:23:51.661 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-21T18:23:51.661 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-21T18:23:51.661 INFO:teuthology.provision.fog.smithi131:Deploy complete!
2023-07-21T18:23:51.663 DEBUG:teuthology.parallel:result is None
2023-07-21T18:23:52.850 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-21T18:23:52.850 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-21T18:23:53.136 INFO:teuthology.provision.fog.smithi161:Node is ready
2023-07-21T18:23:53.136 DEBUG:teuthology.orchestra.run.smithi161:> hostname
2023-07-21T18:23:53.191 INFO:teuthology.orchestra.run.smithi161.stdout:smithi022
2023-07-21T18:23:53.192 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi022 /etc/hosts
2023-07-21T18:23:53.247 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022
2023-07-21T18:23:53.248 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161
2023-07-21T18:23:53.358 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi022/smithi161/g' /etc/hosts
2023-07-21T18:23:53.385 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.22/172.21.15.161/g' /etc/hosts
2023-07-21T18:23:53.452 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi022/smithi161/g' /etc/hostname
2023-07-21T18:23:53.519 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161
2023-07-21T18:23:53.585 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release
2023-07-21T18:23:53.642 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Red Hat Enterprise Linux"
2023-07-21T18:23:53.643 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8.6 (Ootpa)"
2023-07-21T18:23:53.643 INFO:teuthology.orchestra.run.smithi161.stdout:ID="rhel"
2023-07-21T18:23:53.643 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="fedora"
2023-07-21T18:23:53.643 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8.6"
2023-07-21T18:23:53.644 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8"
2023-07-21T18:23:53.644 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-21T18:23:53.644 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31"
2023-07-21T18:23:53.645 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-21T18:23:53.645 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.redhat.com/"
2023-07-21T18:23:53.645 INFO:teuthology.orchestra.run.smithi161.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-21T18:23:53.645 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-21T18:23:53.646 INFO:teuthology.orchestra.run.smithi161.stdout:
2023-07-21T18:23:53.646 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-21T18:23:53.646 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-21T18:23:53.646 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-21T18:23:53.647 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-21T18:23:53.647 INFO:teuthology.provision.fog.smithi161:Deploy complete!
2023-07-21T18:23:53.648 DEBUG:teuthology.parallel:result is None
2023-07-21T18:24:08.814 INFO:teuthology.lock.ops:Checking smithi131.front.sepia.ceph.com
2023-07-21T18:24:08.815 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-21T18:24:13.840 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com
2023-07-21T18:24:13.840 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-21T18:24:18.074 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: set os type and version on server
2023-07-21T18:24:18.075 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com'
2023-07-21T18:24:18.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T18:24:18.144 DEBUG:teuthology.orchestra.run.smithi131:> true
2023-07-21T18:24:18.274 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com'
2023-07-21T18:24:18.274 DEBUG:teuthology.orchestra.run.smithi131:> uname -m
2023-07-21T18:24:18.331 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64
2023-07-21T18:24:18.331 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release
2023-07-21T18:24:18.389 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="Red Hat Enterprise Linux"
2023-07-21T18:24:18.389 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="8.6 (Ootpa)"
2023-07-21T18:24:18.390 INFO:teuthology.orchestra.run.smithi131.stdout:ID="rhel"
2023-07-21T18:24:18.390 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="fedora"
2023-07-21T18:24:18.390 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="8.6"
2023-07-21T18:24:18.390 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el8"
2023-07-21T18:24:18.391 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-21T18:24:18.391 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31"
2023-07-21T18:24:18.391 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-21T18:24:18.392 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://www.redhat.com/"
2023-07-21T18:24:18.392 INFO:teuthology.orchestra.run.smithi131.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-21T18:24:18.392 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-21T18:24:18.392 INFO:teuthology.orchestra.run.smithi131.stdout:
2023-07-21T18:24:18.393 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-21T18:24:18.393 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-21T18:24:18.393 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-21T18:24:18.393 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-21T18:24:18.394 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server
2023-07-21T18:24:23.422 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server
2023-07-21T18:24:23.422 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com'
2023-07-21T18:24:23.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T18:24:28.500 DEBUG:teuthology.orchestra.run.smithi161:> true
2023-07-21T18:24:28.633 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com'
2023-07-21T18:24:28.633 DEBUG:teuthology.orchestra.run.smithi161:> uname -m
2023-07-21T18:24:28.693 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64
2023-07-21T18:24:28.693 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release
2023-07-21T18:24:28.750 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Red Hat Enterprise Linux"
2023-07-21T18:24:28.750 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8.6 (Ootpa)"
2023-07-21T18:24:28.750 INFO:teuthology.orchestra.run.smithi161.stdout:ID="rhel"
2023-07-21T18:24:28.750 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="fedora"
2023-07-21T18:24:28.750 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8.6"
2023-07-21T18:24:28.750 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8"
2023-07-21T18:24:28.751 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-21T18:24:28.751 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31"
2023-07-21T18:24:28.751 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-21T18:24:28.751 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.redhat.com/"
2023-07-21T18:24:28.752 INFO:teuthology.orchestra.run.smithi161.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-21T18:24:28.752 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-21T18:24:28.752 INFO:teuthology.orchestra.run.smithi161.stdout:
2023-07-21T18:24:28.752 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-21T18:24:28.752 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-21T18:24:28.752 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-21T18:24:28.752 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-21T18:24:28.753 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2023-07-21T18:24:33.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T18:24:33.788 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T18:24:38.885 INFO:teuthology.dispatcher.supervisor:Running job 7346869
2023-07-21T18:24:38.885 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-07-21_17:58:19-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7346869 --name rishabh-2023-07-21_17:58:19-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/strays} -- /home/teuthworker/archive/rishabh-2023-07-21_17:58:19-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7346869/orig.config.yaml
2023-07-21T18:24:38.892 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-07-21_17:58:19-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7346869
2023-07-21T18:24:38.893 INFO:teuthology.dispatcher.supervisor:Job PID: 27339
2023-07-21T18:24:38.893 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-07-21T18:26:38.992 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T18:26:38.994 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T18:28:44.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T18:28:44.173 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T18:30:44.428 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T18:30:44.429 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T18:32:44.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T18:32:44.594 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T18:34:49.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T18:34:49.762 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T18:36:55.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T18:36:55.118 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T18:38:55.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T18:38:55.292 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T18:41:00.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T18:41:00.416 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T18:43:01.696 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T18:43:01.697 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T18:45:01.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T18:45:01.866 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T18:47:04.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T18:47:04.663 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T18:49:09.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T18:49:09.832 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T18:51:09.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T18:51:09.997 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T18:53:10.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T18:53:10.148 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T18:55:10.317 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T18:55:10.317 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T18:57:10.485 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T18:57:10.485 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T18:59:10.673 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T18:59:10.674 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T19:01:10.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T19:01:10.846 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T19:03:11.026 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T19:03:11.026 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T19:05:11.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T19:05:11.194 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T19:07:11.366 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T19:07:11.367 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T19:09:11.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T19:09:11.545 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T19:11:11.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T19:11:11.724 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T19:13:11.885 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T19:13:11.898 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T19:15:12.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T19:15:12.079 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T19:17:12.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T19:17:12.258 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T19:17:12.337 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-07-21T19:17:12.540 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-07-21T19:17:12.540 INFO:teuthology.nuke:Checking targets against current locks
2023-07-21T19:17:12.602 DEBUG:teuthology.nuke:shortname: smithi131
2023-07-21T19:17:12.603 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-21T19:17:12.629 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-21_17:58:19-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7346869', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 18:19:00.320666', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-07-21T19:17:12.633 DEBUG:teuthology.nuke:shortname: smithi161
2023-07-21T19:17:12.634 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-21T19:17:12.658 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-21_17:58:19-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7346869', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 18:19:00.319274', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-07-21T19:17:12.695 INFO:teuthology.orchestra.console:Power off smithi131
2023-07-21T19:17:12.696 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-21T19:17:12.719 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T19:17:12.738 INFO:teuthology.orchestra.console:Power off smithi161
2023-07-21T19:17:12.738 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-21T19:17:12.759 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T19:17:12.850 INFO:teuthology.orchestra.console:Power off for smithi131 completed
2023-07-21T19:17:12.882 INFO:teuthology.orchestra.console:Power off for smithi161 completed
2023-07-21T19:17:13.000 INFO:teuthology.lock.ops:unlocked: smithi131.front.sepia.ceph.com
2023-07-21T19:17:13.026 INFO:teuthology.lock.ops:unlocked: smithi161.front.sepia.ceph.com