2023-07-06T04:13:50.827 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-06T04:13:50.828 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T04:13:50.829 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T04:13:51.007 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc8cf139820>, signals=[15]) 2023-07-06T04:13:51.008 INFO:teuthology.lock.ops:Start node 'smithi003.front.sepia.ceph.com' reimaging 2023-07-06T04:13:51.009 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: reset os type and version on server 2023-07-06T04:13:51.010 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2023-07-06T04:13:51.031 INFO:teuthology.lock.ops:Start node 'smithi144.front.sepia.ceph.com' reimaging 2023-07-06T04:13:51.032 INFO:teuthology.lock.ops:Updating [smithi144.front.sepia.ceph.com]: reset os type and version on server 2023-07-06T04:13:51.032 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2023-07-06T04:13:51.033 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /host {"name": "smithi003"} 2023-07-06T04:13:53.747 INFO:teuthology.lock.ops:Start node 'smithi155.front.sepia.ceph.com' reimaging 2023-07-06T04:13:53.748 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: reset os type and version on server 2023-07-06T04:13:53.748 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2023-07-06T04:13:53.749 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /host {"name": "smithi144"} 2023-07-06T04:13:53.772 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /host {"name": "smithi155"} 2023-07-06T04:13:53.788 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-06T04:13:53.826 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-06T04:13:53.831 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-06T04:13:53.834 DEBUG:teuthology.provision.fog.smithi003:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-06T04:13:53.834 DEBUG:teuthology.provision.fog.smithi003:FOG request: PUT /host/109 {"imageID": 5} 2023-07-06T04:13:53.879 DEBUG:teuthology.provision.fog.smithi144:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-06T04:13:53.879 DEBUG:teuthology.provision.fog.smithi144:FOG request: PUT /host/249 {"imageID": 5} 2023-07-06T04:13:53.881 DEBUG:teuthology.provision.fog.smithi155:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-06T04:13:53.881 DEBUG:teuthology.provision.fog.smithi155:FOG request: PUT /host/260 {"imageID": 5} 2023-07-06T04:13:53.887 INFO:teuthology.provision.fog.smithi003:Scheduling deploy of rhel 8.6 2023-07-06T04:13:53.887 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-06T04:13:53.923 INFO:teuthology.provision.fog.smithi155:Scheduling deploy of rhel 8.6 2023-07-06T04:13:53.924 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-07-06T04:13:53.926 INFO:teuthology.provision.fog.smithi144:Scheduling deploy of rhel 8.6 2023-07-06T04:13:53.926 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-07-06T04:13:53.940 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /tasktype {"name": "deploy"} 2023-07-06T04:13:53.971 DEBUG:teuthology.provision.fog.smithi003:FOG request: POST /host/109/task {"taskTypeID": 1} 2023-07-06T04:13:53.986 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /tasktype {"name": "deploy"} 2023-07-06T04:13:53.987 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /tasktype {"name": "deploy"} 2023-07-06T04:13:54.017 DEBUG:teuthology.provision.fog.smithi144:FOG request: POST /host/249/task {"taskTypeID": 1} 2023-07-06T04:13:54.028 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-06T04:13:54.030 DEBUG:teuthology.provision.fog.smithi155:FOG request: POST /host/260/task {"taskTypeID": 1} 2023-07-06T04:13:54.065 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-07-06T04:13:54.076 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-07-06T04:13:54.116 INFO:teuthology.orchestra.console:Power off smithi003 2023-07-06T04:13:54.117 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T04:13:54.137 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T04:13:54.162 INFO:teuthology.orchestra.console:Power off smithi144 2023-07-06T04:13:54.162 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T04:13:54.176 INFO:teuthology.orchestra.console:Power off smithi155 2023-07-06T04:13:54.176 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T04:13:54.186 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T04:13:54.197 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T04:13:54.307 INFO:teuthology.orchestra.console:Power off for smithi144 completed 2023-07-06T04:13:54.408 INFO:teuthology.orchestra.console:Power on smithi144 2023-07-06T04:13:54.408 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-06T04:13:54.427 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T04:13:58.176 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T04:13:58.219 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T04:13:58.450 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T04:14:03.287 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T04:14:03.329 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T04:14:03.560 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T04:14:08.398 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T04:14:08.440 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T04:14:08.670 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T04:14:13.509 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T04:14:13.551 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T04:14:13.780 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T04:14:13.989 INFO:teuthology.orchestra.console:Power on for smithi144 completed 2023-07-06T04:14:14.090 INFO:teuthology.provision.fog.smithi144:Waiting for deploy to finish 2023-07-06T04:14:14.091 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-07-06T04:14:29.206 INFO:teuthology.orchestra.console:Power off for smithi003 completed 2023-07-06T04:14:29.206 INFO:teuthology.orchestra.console:Power off for smithi155 completed 2023-07-06T04:14:29.307 INFO:teuthology.orchestra.console:Power on smithi003 2023-07-06T04:14:29.307 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-06T04:14:29.315 INFO:teuthology.orchestra.console:Power on smithi155 2023-07-06T04:14:29.315 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-06T04:14:29.340 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T04:14:33.366 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T04:14:37.479 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T04:14:37.689 INFO:teuthology.orchestra.console:Power on for smithi155 completed 2023-07-06T04:14:37.790 INFO:teuthology.provision.fog.smithi155:Waiting for deploy to finish 2023-07-06T04:14:37.791 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-07-06T04:14:42.799 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T04:14:44.171 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-07-06T04:14:47.813 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T04:14:52.924 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T04:14:57.860 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-07-06T04:15:02.864 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T04:15:02.873 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-07-06T04:15:07.992 INFO:teuthology.orchestra.console:Power on for smithi003 completed 2023-07-06T04:15:08.093 INFO:teuthology.provision.fog.smithi003:Waiting for deploy to finish 2023-07-06T04:15:08.093 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-06T04:15:22.952 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-07-06T04:15:22.953 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-07-06T04:15:32.958 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-06T04:15:52.980 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-07-06T04:15:53.032 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-06T04:15:53.035 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-07-06T04:16:08.069 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-07-06T04:16:13.072 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-07-06T04:16:13.073 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-06T04:16:36.208 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-07-06T04:16:36.210 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-06T04:16:36.211 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-07-06T04:16:36.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T04:16:39.344 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-07-06T04:16:45.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T04:16:48.400 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-07-06T04:16:51.280 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-06T04:16:56.285 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-07-06T04:16:56.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T04:17:06.293 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-07-06T04:17:12.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T04:17:20.368 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-07-06T04:17:21.349 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-06T04:17:21.352 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-07-06T04:17:21.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T04:17:21.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T04:17:24.464 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-07-06T04:17:24.465 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-07-06T04:17:26.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T04:17:29.428 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-07-06T04:17:30.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T04:17:35.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T04:17:40.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T04:17:45.481 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-07-06T04:17:45.481 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-07-06T04:17:51.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T04:17:51.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T04:17:54.544 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-07-06T04:17:54.545 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-07-06T04:18:00.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T04:18:00.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T04:18:03.600 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-07-06T04:18:03.601 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-07-06T04:18:04.016 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-07-06T04:18:09.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T04:18:14.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T04:18:19.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T04:18:19.615 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-07-06T04:18:19.953 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-06T04:18:19.953 DEBUG:teuthology.orchestra.run.smithi144:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-06T04:18:20.245 INFO:teuthology.provision.fog.smithi144:Node is ready 2023-07-06T04:18:20.246 DEBUG:teuthology.orchestra.run.smithi144:> hostname 2023-07-06T04:18:20.263 INFO:teuthology.orchestra.run.smithi144.stdout:smithi144.front.sepia.ceph.com 2023-07-06T04:18:20.263 DEBUG:teuthology.orchestra.run.smithi144:> grep smithi144.front.sepia.ceph.com /etc/hosts 2023-07-06T04:18:20.320 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.15.144 smithi144.front.sepia.ceph.com smithi144 2023-07-06T04:18:20.321 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname smithi144 2023-07-06T04:18:20.450 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/smithi144.front.sepia.ceph.com/smithi144/g' /etc/hosts 2023-07-06T04:18:20.477 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/172.21.15.144/172.21.15.144/g' /etc/hosts 2023-07-06T04:18:20.546 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/smithi144.front.sepia.ceph.com/smithi144/g' /etc/hostname 2023-07-06T04:18:20.614 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname smithi144 2023-07-06T04:18:20.681 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2023-07-06T04:18:20.737 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="Red Hat Enterprise Linux" 2023-07-06T04:18:20.737 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="8.6 (Ootpa)" 2023-07-06T04:18:20.737 INFO:teuthology.orchestra.run.smithi144.stdout:ID="rhel" 2023-07-06T04:18:20.738 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="fedora" 2023-07-06T04:18:20.738 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="8.6" 2023-07-06T04:18:20.738 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el8" 2023-07-06T04:18:20.738 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-06T04:18:20.738 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2023-07-06T04:18:20.738 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-06T04:18:20.738 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://www.redhat.com/" 2023-07-06T04:18:20.739 INFO:teuthology.orchestra.run.smithi144.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-06T04:18:20.739 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-06T04:18:20.739 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-07-06T04:18:20.739 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-06T04:18:20.739 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-06T04:18:20.739 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-06T04:18:20.739 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-06T04:18:20.740 INFO:teuthology.provision.fog.smithi144:Deploy complete! 2023-07-06T04:18:20.741 DEBUG:teuthology.parallel:result is None 2023-07-06T04:18:25.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T04:18:28.692 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-07-06T04:18:34.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T04:18:39.701 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-07-06T04:18:45.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T04:18:51.044 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-06T04:18:51.044 DEBUG:teuthology.orchestra.run.smithi003:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-06T04:18:51.315 INFO:teuthology.provision.fog.smithi003:Node is ready 2023-07-06T04:18:51.316 DEBUG:teuthology.orchestra.run.smithi003:> hostname 2023-07-06T04:18:51.333 INFO:teuthology.orchestra.run.smithi003.stdout:smithi003.front.sepia.ceph.com 2023-07-06T04:18:51.333 DEBUG:teuthology.orchestra.run.smithi003:> grep smithi003.front.sepia.ceph.com /etc/hosts 2023-07-06T04:18:51.387 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3 smithi003.front.sepia.ceph.com smithi003 2023-07-06T04:18:51.388 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2023-07-06T04:18:51.497 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hosts 2023-07-06T04:18:51.525 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/172.21.15.3/172.21.15.3/g' /etc/hosts 2023-07-06T04:18:51.591 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hostname 2023-07-06T04:18:51.656 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2023-07-06T04:18:51.720 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2023-07-06T04:18:51.774 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="Red Hat Enterprise Linux" 2023-07-06T04:18:51.774 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="8.6 (Ootpa)" 2023-07-06T04:18:51.774 INFO:teuthology.orchestra.run.smithi003.stdout:ID="rhel" 2023-07-06T04:18:51.775 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="fedora" 2023-07-06T04:18:51.775 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="8.6" 2023-07-06T04:18:51.775 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el8" 2023-07-06T04:18:51.775 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-06T04:18:51.775 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2023-07-06T04:18:51.775 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-06T04:18:51.775 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://www.redhat.com/" 2023-07-06T04:18:51.776 INFO:teuthology.orchestra.run.smithi003.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-06T04:18:51.776 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-06T04:18:51.776 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-07-06T04:18:51.776 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-06T04:18:51.776 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-06T04:18:51.776 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-06T04:18:51.776 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-06T04:18:51.777 INFO:teuthology.provision.fog.smithi003:Deploy complete! 2023-07-06T04:18:51.777 DEBUG:teuthology.parallel:result is None 2023-07-06T04:18:58.032 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-07-06T04:19:04.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T04:19:10.171 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-06T04:19:10.171 DEBUG:teuthology.orchestra.run.smithi155:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-06T04:19:10.425 INFO:teuthology.provision.fog.smithi155:Node is ready 2023-07-06T04:19:10.425 DEBUG:teuthology.orchestra.run.smithi155:> hostname 2023-07-06T04:19:10.481 INFO:teuthology.orchestra.run.smithi155.stdout:smithi022 2023-07-06T04:19:10.481 DEBUG:teuthology.orchestra.run.smithi155:> grep smithi022 /etc/hosts 2023-07-06T04:19:10.536 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-07-06T04:19:10.537 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname smithi155 2023-07-06T04:19:10.661 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/smithi022/smithi155/g' /etc/hosts 2023-07-06T04:19:10.688 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/172.21.15.22/172.21.15.155/g' /etc/hosts 2023-07-06T04:19:10.755 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/smithi022/smithi155/g' /etc/hostname 2023-07-06T04:19:10.821 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname smithi155 2023-07-06T04:19:10.886 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2023-07-06T04:19:10.942 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="Red Hat Enterprise Linux" 2023-07-06T04:19:10.943 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="8.6 (Ootpa)" 2023-07-06T04:19:10.943 INFO:teuthology.orchestra.run.smithi155.stdout:ID="rhel" 2023-07-06T04:19:10.943 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="fedora" 2023-07-06T04:19:10.943 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="8.6" 2023-07-06T04:19:10.943 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el8" 2023-07-06T04:19:10.944 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-06T04:19:10.944 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31" 2023-07-06T04:19:10.944 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-06T04:19:10.944 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://www.redhat.com/" 2023-07-06T04:19:10.944 INFO:teuthology.orchestra.run.smithi155.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-06T04:19:10.944 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-06T04:19:10.944 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-07-06T04:19:10.945 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-06T04:19:10.945 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-06T04:19:10.945 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-06T04:19:10.945 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-06T04:19:10.945 INFO:teuthology.provision.fog.smithi155:Deploy complete! 2023-07-06T04:19:10.946 DEBUG:teuthology.parallel:result is None 2023-07-06T04:19:21.149 INFO:teuthology.lock.ops:Checking smithi003.front.sepia.ceph.com 2023-07-06T04:19:21.150 INFO:teuthology.lock.ops:Checking smithi144.front.sepia.ceph.com 2023-07-06T04:19:21.150 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-06T04:19:26.186 INFO:teuthology.lock.ops:Checking smithi155.front.sepia.ceph.com 2023-07-06T04:19:26.187 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-06T04:19:31.221 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: set os type and version on server 2023-07-06T04:19:31.221 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-07-06T04:19:31.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T04:19:31.290 DEBUG:teuthology.orchestra.run.smithi003:> true 2023-07-06T04:19:31.360 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-07-06T04:19:31.360 DEBUG:teuthology.orchestra.run.smithi003:> uname -m 2023-07-06T04:19:31.420 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64 2023-07-06T04:19:31.420 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2023-07-06T04:19:31.480 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="Red Hat Enterprise Linux" 2023-07-06T04:19:31.481 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="8.6 (Ootpa)" 2023-07-06T04:19:31.481 INFO:teuthology.orchestra.run.smithi003.stdout:ID="rhel" 2023-07-06T04:19:31.481 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="fedora" 2023-07-06T04:19:31.481 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="8.6" 2023-07-06T04:19:31.481 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el8" 2023-07-06T04:19:31.481 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-06T04:19:31.482 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2023-07-06T04:19:31.482 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-06T04:19:31.482 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://www.redhat.com/" 2023-07-06T04:19:31.482 INFO:teuthology.orchestra.run.smithi003.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-06T04:19:31.482 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-06T04:19:31.482 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-07-06T04:19:31.482 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-06T04:19:31.482 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-06T04:19:31.483 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-06T04:19:31.483 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-06T04:19:31.483 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2023-07-06T04:19:36.519 INFO:teuthology.lock.ops:Updating [smithi144.front.sepia.ceph.com]: set os type and version on server 2023-07-06T04:19:36.519 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-07-06T04:19:36.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T04:19:41.638 DEBUG:teuthology.orchestra.run.smithi144:> true 2023-07-06T04:19:41.770 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-07-06T04:19:41.770 DEBUG:teuthology.orchestra.run.smithi144:> uname -m 2023-07-06T04:19:41.829 INFO:teuthology.orchestra.run.smithi144.stdout:x86_64 2023-07-06T04:19:41.830 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2023-07-06T04:19:41.886 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="Red Hat Enterprise Linux" 2023-07-06T04:19:41.887 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="8.6 (Ootpa)" 2023-07-06T04:19:41.887 INFO:teuthology.orchestra.run.smithi144.stdout:ID="rhel" 2023-07-06T04:19:41.887 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="fedora" 2023-07-06T04:19:41.887 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="8.6" 2023-07-06T04:19:41.887 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el8" 2023-07-06T04:19:41.888 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-06T04:19:41.888 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2023-07-06T04:19:41.888 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-06T04:19:41.888 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://www.redhat.com/" 2023-07-06T04:19:41.888 INFO:teuthology.orchestra.run.smithi144.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-06T04:19:41.888 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-06T04:19:41.888 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-07-06T04:19:41.889 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-06T04:19:41.889 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-06T04:19:41.889 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-06T04:19:41.889 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-06T04:19:41.889 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2023-07-06T04:19:44.176 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: set os type and version on server 2023-07-06T04:19:44.176 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-07-06T04:19:44.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T04:19:44.241 DEBUG:teuthology.orchestra.run.smithi155:> true 2023-07-06T04:19:44.374 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-07-06T04:19:44.374 DEBUG:teuthology.orchestra.run.smithi155:> uname -m 2023-07-06T04:19:44.429 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2023-07-06T04:19:44.429 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2023-07-06T04:19:44.486 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="Red Hat Enterprise Linux" 2023-07-06T04:19:44.486 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="8.6 (Ootpa)" 2023-07-06T04:19:44.486 INFO:teuthology.orchestra.run.smithi155.stdout:ID="rhel" 2023-07-06T04:19:44.486 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="fedora" 2023-07-06T04:19:44.487 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="8.6" 2023-07-06T04:19:44.487 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el8" 2023-07-06T04:19:44.487 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-06T04:19:44.487 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31" 2023-07-06T04:19:44.487 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-06T04:19:44.487 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://www.redhat.com/" 2023-07-06T04:19:44.487 INFO:teuthology.orchestra.run.smithi155.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-06T04:19:44.488 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-06T04:19:44.488 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-07-06T04:19:44.488 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-06T04:19:44.488 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-06T04:19:44.488 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-06T04:19:44.488 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-06T04:19:44.489 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2023-07-06T04:19:44.510 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T04:19:44.510 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T04:19:44.614 INFO:teuthology.dispatcher.supervisor:Running job 7327949 2023-07-06T04:19:44.615 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi/7327949 --name rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/fsx}} -- /home/teuthworker/archive/rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi/7327949/orig.config.yaml 2023-07-06T04:19:44.618 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi/7327949 2023-07-06T04:19:44.619 INFO:teuthology.dispatcher.supervisor:Job PID: 13169 2023-07-06T04:19:44.619 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-06T04:21:44.621 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T04:21:44.622 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T04:23:49.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T04:23:49.893 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T04:25:50.069 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T04:25:50.070 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T04:27:50.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T04:27:50.242 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T04:29:50.408 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T04:29:50.408 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T04:31:50.504 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T04:31:50.505 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T04:33:50.681 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T04:33:50.682 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T04:35:50.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T04:35:50.858 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T04:37:51.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T04:37:51.033 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T04:39:51.209 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T04:39:51.210 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T04:41:51.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T04:41:51.386 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T04:43:51.553 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T04:43:51.553 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T04:43:51.709 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-06T04:43:51.855 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-06T04:43:51.856 INFO:teuthology.nuke:Checking targets against current locks 2023-07-06T04:43:51.901 DEBUG:teuthology.nuke:shortname: smithi003 2023-07-06T04:43:51.901 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-06T04:43:51.931 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi003.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi/7327949', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-06 04:13:50.000540', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-06T04:43:51.935 DEBUG:teuthology.nuke:shortname: smithi144 2023-07-06T04:43:51.936 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-06T04:43:51.949 DEBUG:teuthology.nuke:shortname: smithi155 2023-07-06T04:43:51.950 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-06T04:43:51.956 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi/7327949', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-06 04:13:50.001930', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-06T04:43:51.969 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi/7327949', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-06 04:13:50.003071', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-06T04:43:51.987 INFO:teuthology.orchestra.console:Power off smithi003 2023-07-06T04:43:51.988 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T04:43:52.010 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T04:43:52.025 INFO:teuthology.orchestra.console:Power off smithi144 2023-07-06T04:43:52.026 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T04:43:52.042 INFO:teuthology.orchestra.console:Power off smithi155 2023-07-06T04:43:52.042 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T04:43:52.052 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T04:43:52.064 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T04:43:52.151 INFO:teuthology.orchestra.console:Power off for smithi003 completed 2023-07-06T04:43:52.174 INFO:teuthology.orchestra.console:Power off for smithi144 completed 2023-07-06T04:43:52.186 INFO:teuthology.orchestra.console:Power off for smithi155 completed 2023-07-06T04:43:52.314 INFO:teuthology.lock.ops:unlocked: smithi003.front.sepia.ceph.com 2023-07-06T04:43:52.321 INFO:teuthology.lock.ops:unlocked: smithi144.front.sepia.ceph.com 2023-07-06T04:43:52.338 INFO:teuthology.lock.ops:unlocked: smithi155.front.sepia.ceph.com