2023-07-21T22:38:44.224 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-21T22:38:44.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T22:38:44.226 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T22:38:44.378 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f65204938b0>, signals=[15]) 2023-07-21T22:38:44.380 INFO:teuthology.lock.ops:Start node 'smithi123.front.sepia.ceph.com' reimaging 2023-07-21T22:38:44.380 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: reset os type and version on server 2023-07-21T22:38:44.380 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-07-21T22:38:44.405 INFO:teuthology.lock.ops:Start node 'smithi145.front.sepia.ceph.com' reimaging 2023-07-21T22:38:44.405 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: reset os type and version on server 2023-07-21T22:38:44.405 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2023-07-21T22:38:44.406 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /host {"name": "smithi123"} 2023-07-21T22:38:44.428 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /host {"name": "smithi145"} 2023-07-21T22:38:44.488 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-21T22:38:44.505 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-21T22:38:44.529 DEBUG:teuthology.provision.fog.smithi123:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-21T22:38:44.529 DEBUG:teuthology.provision.fog.smithi123:FOG request: PUT /host/228 {"imageID": 5} 2023-07-21T22:38:44.553 DEBUG:teuthology.provision.fog.smithi145:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-21T22:38:44.553 DEBUG:teuthology.provision.fog.smithi145:FOG request: PUT /host/250 {"imageID": 5} 2023-07-21T22:38:44.577 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of rhel 8.6 2023-07-21T22:38:44.577 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-21T22:38:44.596 INFO:teuthology.provision.fog.smithi145:Scheduling deploy of rhel 8.6 2023-07-21T22:38:44.596 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-21T22:38:44.635 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /tasktype {"name": "deploy"} 2023-07-21T22:38:44.644 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /tasktype {"name": "deploy"} 2023-07-21T22:38:44.689 DEBUG:teuthology.provision.fog.smithi123:FOG request: POST /host/228/task {"taskTypeID": 1} 2023-07-21T22:38:44.692 DEBUG:teuthology.provision.fog.smithi145:FOG request: POST /host/250/task {"taskTypeID": 1} 2023-07-21T22:38:44.754 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-21T22:38:44.756 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-21T22:38:44.860 INFO:teuthology.orchestra.console:Power off smithi145 2023-07-21T22:38:44.861 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T22:38:44.877 INFO:teuthology.orchestra.console:Power off smithi123 2023-07-21T22:38:44.877 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T22:38:44.885 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T22:38:44.896 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T22:38:45.007 INFO:teuthology.orchestra.console:Power off for smithi145 completed 2023-07-21T22:38:45.016 INFO:teuthology.orchestra.console:Power off for smithi123 completed 2023-07-21T22:38:45.108 INFO:teuthology.orchestra.console:Power on smithi145 2023-07-21T22:38:45.109 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-21T22:38:45.117 INFO:teuthology.orchestra.console:Power on smithi123 2023-07-21T22:38:45.117 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-21T22:38:45.131 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T22:38:45.140 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T22:38:49.156 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T22:38:49.166 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T22:38:53.272 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T22:38:53.280 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T22:38:53.491 INFO:teuthology.orchestra.console:Power on for smithi123 completed 2023-07-21T22:38:53.592 INFO:teuthology.provision.fog.smithi123:Waiting for deploy to finish 2023-07-21T22:38:53.593 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-21T22:38:53.598 INFO:teuthology.orchestra.console:Power on for smithi145 completed 2023-07-21T22:38:53.699 INFO:teuthology.provision.fog.smithi145:Waiting for deploy to finish 2023-07-21T22:38:53.700 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-21T22:39:08.676 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-21T22:39:08.767 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-21T22:39:23.752 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-21T22:39:23.829 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-21T22:39:38.832 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-21T22:39:38.885 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-21T22:39:53.912 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-21T22:39:53.942 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-21T22:40:08.996 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-21T22:40:09.006 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-21T22:40:24.062 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-21T22:40:24.063 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-21T22:40:39.127 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-21T22:40:39.128 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-21T22:40:54.196 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-21T22:40:54.197 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-21T22:41:09.276 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-21T22:41:09.277 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-21T22:41:24.342 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-21T22:41:24.343 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-21T22:41:39.420 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-21T22:41:39.422 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-21T22:41:39.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T22:41:39.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T22:41:42.544 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-07-21T22:41:42.545 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-21T22:41:48.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T22:41:48.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T22:41:51.600 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-07-21T22:41:51.636 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-21T22:41:57.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T22:41:57.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T22:42:00.656 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-07-21T22:42:00.688 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-21T22:42:06.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T22:42:06.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T22:42:09.712 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-07-21T22:42:09.744 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-21T22:42:15.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T22:42:15.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T22:42:18.768 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-07-21T22:42:18.800 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-21T22:42:24.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T22:42:24.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T22:42:27.856 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-21T22:42:33.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T22:42:36.912 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-21T22:42:42.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T22:42:43.184 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-07-21T22:42:49.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T22:42:52.240 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-07-21T22:42:58.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T22:43:01.300 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-07-21T22:43:07.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T22:43:07.631 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-21T22:43:07.632 DEBUG:teuthology.orchestra.run.smithi145:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-21T22:43:07.879 INFO:teuthology.provision.fog.smithi145:Node is ready 2023-07-21T22:43:07.880 DEBUG:teuthology.orchestra.run.smithi145:> hostname 2023-07-21T22:43:07.894 INFO:teuthology.orchestra.run.smithi145.stdout:smithi145.front.sepia.ceph.com 2023-07-21T22:43:07.895 DEBUG:teuthology.orchestra.run.smithi145:> grep smithi145.front.sepia.ceph.com /etc/hosts 2023-07-21T22:43:07.950 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.15.145 smithi145.front.sepia.ceph.com smithi145 2023-07-21T22:43:07.950 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145 2023-07-21T22:43:08.050 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145.front.sepia.ceph.com/smithi145/g' /etc/hosts 2023-07-21T22:43:08.093 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/172.21.15.145/172.21.15.145/g' /etc/hosts 2023-07-21T22:43:08.160 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145.front.sepia.ceph.com/smithi145/g' /etc/hostname 2023-07-21T22:43:08.226 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145 2023-07-21T22:43:08.291 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2023-07-21T22:43:08.347 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="Red Hat Enterprise Linux" 2023-07-21T22:43:08.347 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="8.6 (Ootpa)" 2023-07-21T22:43:08.347 INFO:teuthology.orchestra.run.smithi145.stdout:ID="rhel" 2023-07-21T22:43:08.348 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="fedora" 2023-07-21T22:43:08.348 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="8.6" 2023-07-21T22:43:08.348 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el8" 2023-07-21T22:43:08.348 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-21T22:43:08.348 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2023-07-21T22:43:08.348 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-21T22:43:08.349 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://www.redhat.com/" 2023-07-21T22:43:08.349 INFO:teuthology.orchestra.run.smithi145.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-21T22:43:08.349 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-21T22:43:08.349 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-21T22:43:08.349 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-21T22:43:08.349 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-21T22:43:08.349 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-21T22:43:08.350 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-21T22:43:08.350 INFO:teuthology.provision.fog.smithi145:Deploy complete! 2023-07-21T22:43:08.352 DEBUG:teuthology.parallel:result is None 2023-07-21T22:43:42.953 WARNING:teuthology.provision.fog.smithi123:timed out 2023-07-21T22:43:48.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T22:43:49.312 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-21T22:43:49.312 DEBUG:teuthology.orchestra.run.smithi123:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-21T22:43:49.619 INFO:teuthology.provision.fog.smithi123:Node is ready 2023-07-21T22:43:49.619 DEBUG:teuthology.orchestra.run.smithi123:> hostname 2023-07-21T22:43:49.639 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123 2023-07-21T22:43:49.639 DEBUG:teuthology.orchestra.run.smithi123:> grep smithi123 /etc/hosts 2023-07-21T22:43:49.699 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123 smithi123.front.sepia.ceph.com smithi123 2023-07-21T22:43:49.699 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123 2023-07-21T22:43:49.814 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123/smithi123/g' /etc/hosts 2023-07-21T22:43:49.847 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/172.21.15.123/172.21.15.123/g' /etc/hosts 2023-07-21T22:43:49.919 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123/smithi123/g' /etc/hostname 2023-07-21T22:43:49.992 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123 2023-07-21T22:43:50.064 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2023-07-21T22:43:50.124 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Red Hat Enterprise Linux" 2023-07-21T22:43:50.124 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="8.6 (Ootpa)" 2023-07-21T22:43:50.124 INFO:teuthology.orchestra.run.smithi123.stdout:ID="rhel" 2023-07-21T22:43:50.124 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="fedora" 2023-07-21T22:43:50.124 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="8.6" 2023-07-21T22:43:50.125 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el8" 2023-07-21T22:43:50.125 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-21T22:43:50.125 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2023-07-21T22:43:50.125 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-21T22:43:50.125 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.redhat.com/" 2023-07-21T22:43:50.125 INFO:teuthology.orchestra.run.smithi123.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-21T22:43:50.125 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-21T22:43:50.126 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T22:43:50.126 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-21T22:43:50.126 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-21T22:43:50.126 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-21T22:43:50.126 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-21T22:43:50.126 INFO:teuthology.provision.fog.smithi123:Deploy complete! 2023-07-21T22:43:50.127 DEBUG:teuthology.parallel:result is None 2023-07-21T22:43:50.311 INFO:teuthology.lock.ops:Checking smithi123.front.sepia.ceph.com 2023-07-21T22:43:50.312 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-21T22:43:50.336 INFO:teuthology.lock.ops:Checking smithi145.front.sepia.ceph.com 2023-07-21T22:43:50.336 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-21T22:43:50.362 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: set os type and version on server 2023-07-21T22:43:50.362 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-21T22:43:50.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T22:43:50.430 DEBUG:teuthology.orchestra.run.smithi123:> true 2023-07-21T22:43:50.503 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-21T22:43:50.504 DEBUG:teuthology.orchestra.run.smithi123:> uname -m 2023-07-21T22:43:50.563 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2023-07-21T22:43:50.564 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2023-07-21T22:43:50.624 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Red Hat Enterprise Linux" 2023-07-21T22:43:50.624 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="8.6 (Ootpa)" 2023-07-21T22:43:50.624 INFO:teuthology.orchestra.run.smithi123.stdout:ID="rhel" 2023-07-21T22:43:50.625 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="fedora" 2023-07-21T22:43:50.625 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="8.6" 2023-07-21T22:43:50.625 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el8" 2023-07-21T22:43:50.625 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-21T22:43:50.626 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2023-07-21T22:43:50.626 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-21T22:43:50.626 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.redhat.com/" 2023-07-21T22:43:50.626 INFO:teuthology.orchestra.run.smithi123.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-21T22:43:50.627 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-21T22:43:50.627 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-21T22:43:50.627 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-21T22:43:50.628 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-21T22:43:50.628 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-21T22:43:50.628 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-21T22:43:50.629 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-07-21T22:43:50.652 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: set os type and version on server 2023-07-21T22:43:50.653 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2023-07-21T22:43:50.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T22:43:50.719 DEBUG:teuthology.orchestra.run.smithi145:> true 2023-07-21T22:43:50.853 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2023-07-21T22:43:50.853 DEBUG:teuthology.orchestra.run.smithi145:> uname -m 2023-07-21T22:43:50.910 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64 2023-07-21T22:43:50.910 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2023-07-21T22:43:50.966 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="Red Hat Enterprise Linux" 2023-07-21T22:43:50.967 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="8.6 (Ootpa)" 2023-07-21T22:43:50.967 INFO:teuthology.orchestra.run.smithi145.stdout:ID="rhel" 2023-07-21T22:43:50.967 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="fedora" 2023-07-21T22:43:50.967 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="8.6" 2023-07-21T22:43:50.967 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el8" 2023-07-21T22:43:50.968 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-21T22:43:50.968 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2023-07-21T22:43:50.968 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-21T22:43:50.968 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://www.redhat.com/" 2023-07-21T22:43:50.968 INFO:teuthology.orchestra.run.smithi145.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-21T22:43:50.968 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-21T22:43:50.969 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-21T22:43:50.969 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-21T22:43:50.969 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-21T22:43:50.969 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-21T22:43:50.969 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-21T22:43:50.970 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2023-07-21T22:43:51.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T22:43:51.036 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T22:43:51.135 INFO:teuthology.dispatcher.supervisor:Running job 7346849 2023-07-21T22:43:51.136 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-21_15:23:26-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi/7346849 --name yuriw-2023-07-21_15:23:26-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi --description fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs/{frag test}} -- /home/teuthworker/archive/yuriw-2023-07-21_15:23:26-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi/7346849/orig.config.yaml 2023-07-21T22:43:51.139 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-21_15:23:26-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi/7346849 2023-07-21T22:43:51.140 INFO:teuthology.dispatcher.supervisor:Job PID: 1838 2023-07-21T22:43:51.140 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-21T22:45:51.240 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T22:45:51.241 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T22:47:51.460 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T22:47:51.461 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T22:49:51.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T22:49:51.638 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T22:51:51.805 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T22:51:51.806 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T22:53:51.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T22:53:51.985 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T22:55:52.157 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T22:55:52.158 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T22:57:52.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T22:57:52.326 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T22:59:52.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T22:59:52.525 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T23:01:52.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T23:01:52.697 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T23:03:52.862 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T23:03:52.863 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T23:05:53.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T23:05:53.036 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T23:07:53.217 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T23:07:53.218 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T23:09:53.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T23:09:53.394 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T23:11:53.568 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T23:11:53.568 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T23:11:53.644 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-21T23:11:53.804 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-21T23:11:53.804 INFO:teuthology.nuke:Checking targets against current locks 2023-07-21T23:11:53.859 DEBUG:teuthology.nuke:shortname: smithi123 2023-07-21T23:11:53.860 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-21T23:11:53.885 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-21_15:23:26-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi/7346849', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 22:38:43.340814', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-21T23:11:53.888 DEBUG:teuthology.nuke:shortname: smithi145 2023-07-21T23:11:53.888 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-21T23:11:53.916 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi145.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-21_15:23:26-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi/7346849', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 22:38:43.342741', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-21T23:11:53.952 INFO:teuthology.orchestra.console:Power off smithi123 2023-07-21T23:11:53.952 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T23:11:53.970 INFO:teuthology.orchestra.console:Power off smithi145 2023-07-21T23:11:54.017 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T23:11:54.027 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T23:11:54.038 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T23:11:54.146 INFO:teuthology.orchestra.console:Power off for smithi123 completed 2023-07-21T23:11:54.159 INFO:teuthology.orchestra.console:Power off for smithi145 completed 2023-07-21T23:11:54.302 INFO:teuthology.lock.ops:unlocked: smithi123.front.sepia.ceph.com 2023-07-21T23:11:54.310 INFO:teuthology.lock.ops:unlocked: smithi145.front.sepia.ceph.com