2023-06-27T20:13:51.039 INFO:root:teuthology version: 0.0.1.dev130+g3fdf1f2
2023-06-27T20:13:51.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T20:13:51.041 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T20:13:51.226 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fabe27bb6d0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fabe281f5e0>, signals=[15])
2023-06-27T20:13:51.227 INFO:teuthology.lock.ops:Start node 'smithi043.front.sepia.ceph.com' reimaging
2023-06-27T20:13:51.227 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: reset os type and version on server
2023-06-27T20:13:51.228 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server
2023-06-27T20:13:51.257 INFO:teuthology.lock.ops:Start node 'smithi145.front.sepia.ceph.com' reimaging
2023-06-27T20:13:51.257 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: reset os type and version on server
2023-06-27T20:13:51.257 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server
2023-06-27T20:13:51.259 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /host {"name": "smithi043"}
2023-06-27T20:13:51.281 INFO:teuthology.lock.ops:Start node 'smithi156.front.sepia.ceph.com' reimaging
2023-06-27T20:13:51.282 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: reset os type and version on server
2023-06-27T20:13:51.282 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server
2023-06-27T20:13:51.283 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /host {"name": "smithi145"}
2023-06-27T20:13:51.307 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /host {"name": "smithi156"}
2023-06-27T20:13:51.332 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-06-27T20:13:51.344 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-06-27T20:13:51.368 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-06-27T20:13:51.371 DEBUG:teuthology.provision.fog.smithi043:Requesting image smithi_rhel_8.6 (ID 5)
2023-06-27T20:13:51.372 DEBUG:teuthology.provision.fog.smithi043:FOG request: PUT /host/148 {"imageID": 5}
2023-06-27T20:13:51.383 DEBUG:teuthology.provision.fog.smithi145:Requesting image smithi_rhel_8.6 (ID 5)
2023-06-27T20:13:51.383 DEBUG:teuthology.provision.fog.smithi145:FOG request: PUT /host/250 {"imageID": 5}
2023-06-27T20:13:51.408 DEBUG:teuthology.provision.fog.smithi156:Requesting image smithi_rhel_8.6 (ID 5)
2023-06-27T20:13:51.409 DEBUG:teuthology.provision.fog.smithi156:FOG request: PUT /host/261 {"imageID": 5}
2023-06-27T20:13:51.411 INFO:teuthology.provision.fog.smithi043:Scheduling deploy of rhel 8.6
2023-06-27T20:13:51.411 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None
2023-06-27T20:13:51.422 INFO:teuthology.provision.fog.smithi145:Scheduling deploy of rhel 8.6
2023-06-27T20:13:51.422 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-06-27T20:13:51.458 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of rhel 8.6
2023-06-27T20:13:51.458 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None
2023-06-27T20:13:51.484 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /tasktype {"name": "deploy"}
2023-06-27T20:13:51.487 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /tasktype {"name": "deploy"}
2023-06-27T20:13:51.518 DEBUG:teuthology.provision.fog.smithi145:FOG request: POST /host/250/task {"taskTypeID": 1}
2023-06-27T20:13:51.528 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /tasktype {"name": "deploy"}
2023-06-27T20:13:51.530 DEBUG:teuthology.provision.fog.smithi043:FOG request: POST /host/148/task {"taskTypeID": 1}
2023-06-27T20:13:51.570 DEBUG:teuthology.provision.fog.smithi156:FOG request: POST /host/261/task {"taskTypeID": 1}
2023-06-27T20:13:51.589 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-06-27T20:13:51.591 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None
2023-06-27T20:13:51.619 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None
2023-06-27T20:13:51.702 INFO:teuthology.orchestra.console:Power off smithi043
2023-06-27T20:13:51.703 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-27T20:13:51.720 INFO:teuthology.orchestra.console:Power off smithi156
2023-06-27T20:13:51.721 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-27T20:13:51.735 INFO:teuthology.orchestra.console:Power off smithi145
2023-06-27T20:13:51.736 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-27T20:13:51.745 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-27T20:13:51.754 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-27T20:13:51.766 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-27T20:13:51.867 INFO:teuthology.orchestra.console:Power off for smithi156 completed
2023-06-27T20:13:51.878 INFO:teuthology.orchestra.console:Power off for smithi043 completed
2023-06-27T20:13:51.890 INFO:teuthology.orchestra.console:Power off for smithi145 completed
2023-06-27T20:13:51.968 INFO:teuthology.orchestra.console:Power on smithi156
2023-06-27T20:13:51.969 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-27T20:13:51.979 INFO:teuthology.orchestra.console:Power on smithi043
2023-06-27T20:13:51.980 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-27T20:13:51.989 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-27T20:13:51.997 INFO:teuthology.orchestra.console:Power on smithi145
2023-06-27T20:13:51.998 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-27T20:13:52.008 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-27T20:13:52.020 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-27T20:13:56.020 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-27T20:13:56.032 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-27T20:13:56.042 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-27T20:13:56.231 INFO:teuthology.orchestra.console:Power on for smithi156 completed
2023-06-27T20:13:56.243 INFO:teuthology.orchestra.console:Power on for smithi043 completed
2023-06-27T20:13:56.332 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish
2023-06-27T20:13:56.333 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None
2023-06-27T20:13:56.345 INFO:teuthology.provision.fog.smithi043:Waiting for deploy to finish
2023-06-27T20:13:56.345 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None
2023-06-27T20:14:00.157 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-27T20:14:00.366 INFO:teuthology.orchestra.console:Power on for smithi145 completed
2023-06-27T20:14:00.467 INFO:teuthology.provision.fog.smithi145:Waiting for deploy to finish
2023-06-27T20:14:00.468 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-06-27T20:14:11.512 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None
2023-06-27T20:14:11.513 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None
2023-06-27T20:14:15.656 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-06-27T20:14:26.704 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None
2023-06-27T20:14:26.705 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None
2023-06-27T20:14:30.849 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-06-27T20:14:41.888 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None
2023-06-27T20:14:41.890 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None
2023-06-27T20:14:46.084 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-06-27T20:14:57.076 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None
2023-06-27T20:14:57.083 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None
2023-06-27T20:15:01.277 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-06-27T20:15:12.280 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None
2023-06-27T20:15:12.286 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None
2023-06-27T20:15:16.463 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-06-27T20:15:27.508 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None
2023-06-27T20:15:27.509 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None
2023-06-27T20:15:31.652 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-06-27T20:15:42.708 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None
2023-06-27T20:15:42.730 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None
2023-06-27T20:15:46.880 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-06-27T20:15:58.008 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None
2023-06-27T20:15:58.019 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None
2023-06-27T20:16:02.160 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-06-27T20:16:13.529 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None
2023-06-27T20:16:13.530 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None
2023-06-27T20:16:21.085 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-06-27T20:16:28.861 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None
2023-06-27T20:16:28.863 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None
2023-06-27T20:16:29.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-27T20:16:36.410 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-06-27T20:16:44.210 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None
2023-06-27T20:16:53.315 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-06-27T20:16:59.495 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None
2023-06-27T20:17:08.722 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-06-27T20:17:14.908 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None
2023-06-27T20:17:24.116 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-06-27T20:17:29.312 ERROR:teuthology.orchestra.connection:Error authenticating with smithi043.front.sepia.ceph.com: No SSH private key found!
2023-06-27T20:17:29.314 WARNING:teuthology.provision.fog.smithi043:No existing session
2023-06-27T20:17:30.186 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None
2023-06-27T20:17:35.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-27T20:17:39.441 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-06-27T20:17:45.518 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None
2023-06-27T20:17:54.744 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-06-27T20:18:00.818 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None
2023-06-27T20:18:04.016 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-06-27T20:18:07.378 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-27T20:18:07.379 DEBUG:teuthology.orchestra.run.smithi043:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-27T20:18:07.654 INFO:teuthology.provision.fog.smithi043:Node is ready
2023-06-27T20:18:07.654 DEBUG:teuthology.orchestra.run.smithi043:> hostname
2023-06-27T20:18:07.670 INFO:teuthology.orchestra.run.smithi043.stdout:smithi043.front.sepia.ceph.com
2023-06-27T20:18:07.670 DEBUG:teuthology.orchestra.run.smithi043:> grep smithi043.front.sepia.ceph.com /etc/hosts
2023-06-27T20:18:07.726 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43 smithi043.front.sepia.ceph.com smithi043
2023-06-27T20:18:07.727 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043
2023-06-27T20:18:07.856 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hosts
2023-06-27T20:18:07.884 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/172.21.15.43/172.21.15.43/g' /etc/hosts
2023-06-27T20:18:07.951 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hostname
2023-06-27T20:18:08.018 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043
2023-06-27T20:18:08.084 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release
2023-06-27T20:18:08.141 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="Red Hat Enterprise Linux"
2023-06-27T20:18:08.141 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="8.6 (Ootpa)"
2023-06-27T20:18:08.141 INFO:teuthology.orchestra.run.smithi043.stdout:ID="rhel"
2023-06-27T20:18:08.141 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="fedora"
2023-06-27T20:18:08.141 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="8.6"
2023-06-27T20:18:08.141 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el8"
2023-06-27T20:18:08.142 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-06-27T20:18:08.142 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31"
2023-06-27T20:18:08.142 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-06-27T20:18:08.142 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://www.redhat.com/"
2023-06-27T20:18:08.142 INFO:teuthology.orchestra.run.smithi043.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-27T20:18:08.142 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-27T20:18:08.142 INFO:teuthology.orchestra.run.smithi043.stdout:
2023-06-27T20:18:08.143 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-27T20:18:08.143 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-06-27T20:18:08.143 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-27T20:18:08.143 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-06-27T20:18:08.143 INFO:teuthology.provision.fog.smithi043:Deploy complete!
2023-06-27T20:18:08.145 DEBUG:teuthology.parallel:result is None
2023-06-27T20:18:10.070 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-06-27T20:18:16.126 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None
2023-06-27T20:18:25.385 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-06-27T20:18:31.465 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None
2023-06-27T20:18:31.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-27T20:18:34.800 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2023-06-27T20:18:40.698 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-06-27T20:18:40.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-27T20:18:43.856 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2023-06-27T20:18:49.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-27T20:18:52.944 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2023-06-27T20:18:55.980 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-06-27T20:18:58.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-27T20:19:02.000 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2023-06-27T20:19:08.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-27T20:19:11.092 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2023-06-27T20:19:11.246 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-06-27T20:19:17.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-27T20:19:20.176 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2023-06-27T20:19:26.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-27T20:19:26.531 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-06-27T20:19:29.264 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2023-06-27T20:19:35.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-27T20:19:41.793 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-06-27T20:19:57.060 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-06-27T20:20:12.316 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-06-27T20:20:27.576 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-06-27T20:20:35.276 WARNING:teuthology.provision.fog.smithi156:timed out
2023-06-27T20:20:41.283 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-27T20:20:41.600 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-27T20:20:41.601 DEBUG:teuthology.orchestra.run.smithi156:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-27T20:20:41.928 INFO:teuthology.provision.fog.smithi156:Node is ready
2023-06-27T20:20:41.928 DEBUG:teuthology.orchestra.run.smithi156:> hostname
2023-06-27T20:20:41.947 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156
2023-06-27T20:20:41.947 DEBUG:teuthology.orchestra.run.smithi156:> grep smithi156 /etc/hosts
2023-06-27T20:20:42.003 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156
2023-06-27T20:20:42.004 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156
2023-06-27T20:20:42.107 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156/smithi156/g' /etc/hosts
2023-06-27T20:20:42.136 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/172.21.15.156/172.21.15.156/g' /etc/hosts
2023-06-27T20:20:42.202 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156/smithi156/g' /etc/hostname
2023-06-27T20:20:42.267 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156
2023-06-27T20:20:42.331 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release
2023-06-27T20:20:42.386 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="Red Hat Enterprise Linux"
2023-06-27T20:20:42.386 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="8.6 (Ootpa)"
2023-06-27T20:20:42.387 INFO:teuthology.orchestra.run.smithi156.stdout:ID="rhel"
2023-06-27T20:20:42.387 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="fedora"
2023-06-27T20:20:42.387 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="8.6"
2023-06-27T20:20:42.387 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el8"
2023-06-27T20:20:42.387 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-06-27T20:20:42.387 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31"
2023-06-27T20:20:42.387 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-06-27T20:20:42.388 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.redhat.com/"
2023-06-27T20:20:42.388 INFO:teuthology.orchestra.run.smithi156.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-27T20:20:42.388 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-27T20:20:42.388 INFO:teuthology.orchestra.run.smithi156.stdout:
2023-06-27T20:20:42.388 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-27T20:20:42.388 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-06-27T20:20:42.388 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-27T20:20:42.388 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-06-27T20:20:42.389 INFO:teuthology.provision.fog.smithi156:Deploy complete!
2023-06-27T20:20:42.389 DEBUG:teuthology.parallel:result is None
2023-06-27T20:20:42.808 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-06-27T20:20:58.075 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-06-27T20:20:58.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-27T20:21:16.784 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145
2023-06-27T20:21:22.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-27T20:21:25.840 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145
2023-06-27T20:21:31.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-27T20:21:34.896 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145
2023-06-27T20:21:40.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-27T20:21:43.952 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145
2023-06-27T20:21:49.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-27T20:22:49.966 WARNING:teuthology.provision.fog.smithi145:timed out
2023-06-27T20:22:55.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-27T20:22:56.302 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-27T20:22:56.303 DEBUG:teuthology.orchestra.run.smithi145:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-27T20:22:56.585 INFO:teuthology.provision.fog.smithi145:Node is ready
2023-06-27T20:22:56.585 DEBUG:teuthology.orchestra.run.smithi145:> hostname
2023-06-27T20:22:56.602 INFO:teuthology.orchestra.run.smithi145.stdout:smithi145
2023-06-27T20:22:56.602 DEBUG:teuthology.orchestra.run.smithi145:> grep smithi145 /etc/hosts
2023-06-27T20:22:56.656 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.15.145 smithi145.front.sepia.ceph.com smithi145
2023-06-27T20:22:56.657 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145
2023-06-27T20:22:56.780 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145/smithi145/g' /etc/hosts
2023-06-27T20:22:56.808 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/172.21.15.145/172.21.15.145/g' /etc/hosts
2023-06-27T20:22:56.872 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145/smithi145/g' /etc/hostname
2023-06-27T20:22:56.938 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145
2023-06-27T20:22:57.004 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release
2023-06-27T20:22:57.058 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="Red Hat Enterprise Linux"
2023-06-27T20:22:57.059 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="8.6 (Ootpa)"
2023-06-27T20:22:57.059 INFO:teuthology.orchestra.run.smithi145.stdout:ID="rhel"
2023-06-27T20:22:57.059 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="fedora"
2023-06-27T20:22:57.059 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="8.6"
2023-06-27T20:22:57.059 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el8"
2023-06-27T20:22:57.059 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-06-27T20:22:57.059 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31"
2023-06-27T20:22:57.060 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-06-27T20:22:57.060 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://www.redhat.com/"
2023-06-27T20:22:57.060 INFO:teuthology.orchestra.run.smithi145.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-27T20:22:57.060 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-27T20:22:57.060 INFO:teuthology.orchestra.run.smithi145.stdout:
2023-06-27T20:22:57.060 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-27T20:22:57.060 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-06-27T20:22:57.061 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-27T20:22:57.061 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-06-27T20:22:57.061 INFO:teuthology.provision.fog.smithi145:Deploy complete!
2023-06-27T20:22:57.061 DEBUG:teuthology.parallel:result is None
2023-06-27T20:22:57.251 INFO:teuthology.lock.ops:Checking smithi043.front.sepia.ceph.com
2023-06-27T20:22:57.252 INFO:teuthology.lock.ops:New key found. Updating...
2023-06-27T20:22:57.273 INFO:teuthology.lock.ops:Checking smithi145.front.sepia.ceph.com
2023-06-27T20:22:57.274 INFO:teuthology.lock.ops:New key found. Updating...
2023-06-27T20:22:57.298 INFO:teuthology.lock.ops:Checking smithi156.front.sepia.ceph.com
2023-06-27T20:22:57.298 INFO:teuthology.lock.ops:New key found. Updating...
2023-06-27T20:22:57.324 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: set os type and version on server
2023-06-27T20:22:57.325 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com'
2023-06-27T20:22:57.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-27T20:22:57.392 DEBUG:teuthology.orchestra.run.smithi043:> true
2023-06-27T20:22:57.526 DEBUG:teuthology.orchestra.run.smithi043:> uname -m
2023-06-27T20:22:57.585 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64
2023-06-27T20:22:57.585 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release
2023-06-27T20:22:57.643 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="Red Hat Enterprise Linux"
2023-06-27T20:22:57.643 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="8.6 (Ootpa)"
2023-06-27T20:22:57.643 INFO:teuthology.orchestra.run.smithi043.stdout:ID="rhel"
2023-06-27T20:22:57.643 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="fedora"
2023-06-27T20:22:57.643 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="8.6"
2023-06-27T20:22:57.644 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el8"
2023-06-27T20:22:57.644 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-06-27T20:22:57.644 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31"
2023-06-27T20:22:57.644 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-06-27T20:22:57.644 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://www.redhat.com/"
2023-06-27T20:22:57.644 INFO:teuthology.orchestra.run.smithi043.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-27T20:22:57.644 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-27T20:22:57.645 INFO:teuthology.orchestra.run.smithi043.stdout:
2023-06-27T20:22:57.645 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-27T20:22:57.645 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-06-27T20:22:57.645 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-27T20:22:57.645 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-06-27T20:22:57.646 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server
2023-06-27T20:22:57.665 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: set os type and version on server
2023-06-27T20:22:57.665 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com'
2023-06-27T20:22:57.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-27T20:22:57.730 DEBUG:teuthology.orchestra.run.smithi145:> true
2023-06-27T20:22:57.799 DEBUG:teuthology.orchestra.run.smithi145:> uname -m
2023-06-27T20:22:57.856 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64
2023-06-27T20:22:57.857 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release
2023-06-27T20:22:57.914 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="Red Hat Enterprise Linux"
2023-06-27T20:22:57.914 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="8.6 (Ootpa)"
2023-06-27T20:22:57.914 INFO:teuthology.orchestra.run.smithi145.stdout:ID="rhel"
2023-06-27T20:22:57.915 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="fedora"
2023-06-27T20:22:57.915 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="8.6"
2023-06-27T20:22:57.915 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el8"
2023-06-27T20:22:57.915 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-06-27T20:22:57.915 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31"
2023-06-27T20:22:57.915 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-06-27T20:22:57.915 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://www.redhat.com/"
2023-06-27T20:22:57.915 INFO:teuthology.orchestra.run.smithi145.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-27T20:22:57.916 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-27T20:22:57.916 INFO:teuthology.orchestra.run.smithi145.stdout:
2023-06-27T20:22:57.916 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-27T20:22:57.916 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-06-27T20:22:57.916 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-27T20:22:57.916 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-06-27T20:22:57.917 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server
2023-06-27T20:22:57.940 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: set os type and version on server
2023-06-27T20:22:57.940 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com'
2023-06-27T20:22:57.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-27T20:22:58.005 DEBUG:teuthology.orchestra.run.smithi156:> true
2023-06-27T20:22:58.137 DEBUG:teuthology.orchestra.run.smithi156:> uname -m
2023-06-27T20:22:58.193 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64
2023-06-27T20:22:58.194 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release
2023-06-27T20:22:58.250 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="Red Hat Enterprise Linux"
2023-06-27T20:22:58.251 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="8.6 (Ootpa)"
2023-06-27T20:22:58.251 INFO:teuthology.orchestra.run.smithi156.stdout:ID="rhel"
2023-06-27T20:22:58.251 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="fedora"
2023-06-27T20:22:58.251 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="8.6"
2023-06-27T20:22:58.251 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el8"
2023-06-27T20:22:58.251 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-06-27T20:22:58.251 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31"
2023-06-27T20:22:58.251 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-06-27T20:22:58.252 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.redhat.com/"
2023-06-27T20:22:58.252 INFO:teuthology.orchestra.run.smithi156.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-27T20:22:58.252 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-27T20:22:58.252 INFO:teuthology.orchestra.run.smithi156.stdout:
2023-06-27T20:22:58.252 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-27T20:22:58.252 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-06-27T20:22:58.252 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-27T20:22:58.253 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-06-27T20:22:58.253 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server
2023-06-27T20:22:58.273 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T20:22:58.274 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T20:22:58.376 INFO:teuthology.dispatcher.supervisor:Running job 7318063
2023-06-27T20:22:58.376 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-06-27_20:12:06-fs-CephManager-in-CephFSTestCase-testing-default-smithi/7318063 --name rishabh-2023-06-27_20:12:06-fs-CephManager-in-CephFSTestCase-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/dbench}} -- /home/teuthworker/archive/rishabh-2023-06-27_20:12:06-fs-CephManager-in-CephFSTestCase-testing-default-smithi/7318063/orig.config.yaml
2023-06-27T20:22:58.380 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-06-27_20:12:06-fs-CephManager-in-CephFSTestCase-testing-default-smithi/7318063
2023-06-27T20:22:58.380 INFO:teuthology.dispatcher.supervisor:Job PID: 29561
2023-06-27T20:22:58.381 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-06-27T20:24:58.456 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T20:24:58.458 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T20:26:58.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T20:26:58.633 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T20:28:58.801 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T20:28:58.802 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T20:30:58.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T20:30:58.978 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T20:32:59.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T20:32:59.154 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T20:34:59.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T20:34:59.330 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T20:36:59.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T20:36:59.518 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T20:38:59.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T20:38:59.764 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T20:41:00.024 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T20:41:00.025 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T20:43:00.185 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T20:43:00.186 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T20:45:00.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T20:45:00.366 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T20:47:00.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T20:47:00.540 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T20:49:00.712 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T20:49:00.713 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T20:51:00.869 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T20:51:00.870 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T20:53:01.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T20:53:01.029 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T20:55:01.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T20:55:01.197 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T20:57:01.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T20:57:01.378 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T20:59:01.549 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T20:59:01.550 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T21:01:01.734 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T21:01:01.735 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T21:03:01.929 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T21:03:01.930 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T21:05:02.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T21:05:02.098 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T21:07:02.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T21:07:02.262 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T21:09:02.408 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T21:09:02.409 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T21:11:02.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T21:11:02.570 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T21:13:02.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T21:13:02.854 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T21:15:03.029 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T21:15:03.030 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T21:17:03.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T21:17:03.201 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T21:19:03.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T21:19:03.378 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T21:21:03.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T21:21:03.542 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T21:23:03.717 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T21:23:03.718 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T21:25:03.898 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T21:25:03.899 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T21:27:04.073 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T21:27:04.075 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T21:29:04.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T21:29:04.265 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T21:31:04.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T21:31:04.453 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T21:31:04.529 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-06-27T21:31:04.737 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-06-27T21:31:04.738 INFO:teuthology.nuke:Checking targets against current locks
2023-06-27T21:31:04.793 DEBUG:teuthology.nuke:shortname: smithi043
2023-06-27T21:31:04.794 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-27T21:31:04.815 DEBUG:teuthology.nuke:shortname: smithi145
2023-06-27T21:31:04.817 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-27T21:31:04.820 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi043.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-27_20:12:06-fs-CephManager-in-CephFSTestCase-testing-default-smithi/7318063', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-27 20:13:50.160261', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-06-27T21:31:04.845 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi145.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-27_20:12:06-fs-CephManager-in-CephFSTestCase-testing-default-smithi/7318063', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-27 20:13:50.158377', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-06-27T21:31:04.848 DEBUG:teuthology.nuke:shortname: smithi156
2023-06-27T21:31:04.849 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-27T21:31:04.879 INFO:teuthology.orchestra.console:Power off smithi043
2023-06-27T21:31:04.880 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-27T21:31:04.891 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-27_20:12:06-fs-CephManager-in-CephFSTestCase-testing-default-smithi/7318063', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-27 20:13:50.162004', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-06-27T21:31:04.900 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-27T21:31:04.926 INFO:teuthology.orchestra.console:Power off smithi145
2023-06-27T21:31:04.927 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-27T21:31:04.947 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-27T21:31:04.974 INFO:teuthology.orchestra.console:Power off smithi156
2023-06-27T21:31:04.975 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-27T21:31:05.000 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-27T21:31:05.042 INFO:teuthology.orchestra.console:Power off for smithi043 completed
2023-06-27T21:31:05.088 INFO:teuthology.orchestra.console:Power off for smithi145 completed
2023-06-27T21:31:05.124 INFO:teuthology.orchestra.console:Power off for smithi156 completed
2023-06-27T21:31:05.194 INFO:teuthology.lock.ops:unlocked: smithi043.front.sepia.ceph.com
2023-06-27T21:31:05.245 INFO:teuthology.lock.ops:unlocked: smithi145.front.sepia.ceph.com
2023-06-27T21:31:05.269 INFO:teuthology.lock.ops:unlocked: smithi156.front.sepia.ceph.com