2023-07-13T22:58:25.240 INFO:root:teuthology version: 0.0.1.dev143+g073e6eb 2023-07-13T22:58:25.242 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T22:58:25.242 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T22:58:25.403 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc9976ae8b0>, signals=[15]) 2023-07-13T22:58:25.405 INFO:teuthology.lock.ops:Start node 'smithi112.front.sepia.ceph.com' reimaging 2023-07-13T22:58:25.405 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: reset os type and version on server 2023-07-13T22:58:25.406 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2023-07-13T22:58:25.426 INFO:teuthology.lock.ops:Start node 'smithi190.front.sepia.ceph.com' reimaging 2023-07-13T22:58:25.427 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: reset os type and version on server 2023-07-13T22:58:25.427 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2023-07-13T22:58:25.429 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /host {"name": "smithi112"} 2023-07-13T22:58:25.450 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /host {"name": "smithi190"} 2023-07-13T22:58:25.514 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-13T22:58:25.525 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-13T22:58:25.554 DEBUG:teuthology.provision.fog.smithi112:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-13T22:58:25.555 DEBUG:teuthology.provision.fog.smithi112:FOG request: PUT /host/217 {"imageID": 5} 2023-07-13T22:58:25.565 DEBUG:teuthology.provision.fog.smithi190:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-13T22:58:25.565 DEBUG:teuthology.provision.fog.smithi190:FOG request: PUT /host/295 {"imageID": 5} 2023-07-13T22:58:25.608 INFO:teuthology.provision.fog.smithi112:Scheduling deploy of rhel 8.6 2023-07-13T22:58:25.608 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-07-13T22:58:25.610 INFO:teuthology.provision.fog.smithi190:Scheduling deploy of rhel 8.6 2023-07-13T22:58:25.611 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-07-13T22:58:25.673 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /tasktype {"name": "deploy"} 2023-07-13T22:58:25.677 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /tasktype {"name": "deploy"} 2023-07-13T22:58:25.713 DEBUG:teuthology.provision.fog.smithi112:FOG request: POST /host/217/task {"taskTypeID": 1} 2023-07-13T22:58:25.719 DEBUG:teuthology.provision.fog.smithi190:FOG request: POST /host/295/task {"taskTypeID": 1} 2023-07-13T22:58:25.761 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-07-13T22:58:25.774 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-07-13T22:58:25.866 INFO:teuthology.orchestra.console:Power off smithi112 2023-07-13T22:58:25.867 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T22:58:25.883 INFO:teuthology.orchestra.console:Power off smithi190 2023-07-13T22:58:25.883 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T22:58:25.892 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T22:58:25.905 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T22:58:29.916 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T22:58:29.928 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T22:58:34.028 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T22:58:34.038 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T22:58:34.248 INFO:teuthology.orchestra.console:Power off for smithi190 completed 2023-07-13T22:58:34.349 INFO:teuthology.orchestra.console:Power on smithi190 2023-07-13T22:58:34.349 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-13T22:58:34.371 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T22:58:38.140 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T22:58:38.350 INFO:teuthology.orchestra.console:Power off for smithi112 completed 2023-07-13T22:58:38.397 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T22:58:38.452 INFO:teuthology.orchestra.console:Power on smithi112 2023-07-13T22:58:38.453 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-13T22:58:38.474 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T22:58:38.607 INFO:teuthology.orchestra.console:Power on for smithi190 completed 2023-07-13T22:58:38.708 INFO:teuthology.provision.fog.smithi190:Waiting for deploy to finish 2023-07-13T22:58:38.708 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-07-13T22:58:42.499 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T22:58:42.708 INFO:teuthology.orchestra.console:Power on for smithi112 completed 2023-07-13T22:58:42.809 INFO:teuthology.provision.fog.smithi112:Waiting for deploy to finish 2023-07-13T22:58:42.810 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-07-13T22:58:53.778 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-07-13T22:58:57.880 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-07-13T22:59:08.848 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-07-13T22:59:12.945 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-07-13T22:59:23.924 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-07-13T22:59:28.012 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-07-13T22:59:38.992 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-07-13T22:59:43.068 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-07-13T22:59:54.056 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-07-13T22:59:58.124 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-07-13T23:00:09.112 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-07-13T23:00:13.178 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-07-13T23:00:24.173 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-07-13T23:00:28.236 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-07-13T23:00:39.231 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-07-13T23:00:43.294 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-07-13T23:00:54.296 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-07-13T23:00:58.352 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-07-13T23:01:09.356 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-07-13T23:01:13.416 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-07-13T23:01:24.438 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-07-13T23:01:24.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:01:27.568 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-07-13T23:01:28.487 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-07-13T23:01:28.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:01:31.632 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-07-13T23:01:33.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:01:36.624 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-07-13T23:01:37.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:01:40.688 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-07-13T23:01:42.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:01:45.680 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-07-13T23:01:46.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:01:49.744 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-07-13T23:01:51.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:01:54.736 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-07-13T23:01:55.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:01:58.800 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-07-13T23:02:00.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:02:03.792 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-07-13T23:02:04.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:02:07.860 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-07-13T23:02:09.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:02:12.848 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-07-13T23:02:13.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:02:16.916 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-07-13T23:02:18.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:02:22.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:03:18.909 WARNING:teuthology.provision.fog.smithi190:timed out 2023-07-13T23:03:22.924 WARNING:teuthology.provision.fog.smithi112:timed out 2023-07-13T23:03:24.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:03:25.161 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-13T23:03:25.162 DEBUG:teuthology.orchestra.run.smithi190:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-13T23:03:25.430 INFO:teuthology.provision.fog.smithi190:Node is ready 2023-07-13T23:03:25.430 DEBUG:teuthology.orchestra.run.smithi190:> hostname 2023-07-13T23:03:25.447 INFO:teuthology.orchestra.run.smithi190.stdout:smithi190 2023-07-13T23:03:25.447 DEBUG:teuthology.orchestra.run.smithi190:> grep smithi190 /etc/hosts 2023-07-13T23:03:25.508 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.15.190 smithi190.front.sepia.ceph.com smithi190 2023-07-13T23:03:25.509 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2023-07-13T23:03:25.618 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190/smithi190/g' /etc/hosts 2023-07-13T23:03:25.646 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/172.21.15.190/172.21.15.190/g' /etc/hosts 2023-07-13T23:03:25.717 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190/smithi190/g' /etc/hostname 2023-07-13T23:03:25.786 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2023-07-13T23:03:25.855 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2023-07-13T23:03:25.914 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Red Hat Enterprise Linux" 2023-07-13T23:03:25.915 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8.6 (Ootpa)" 2023-07-13T23:03:25.915 INFO:teuthology.orchestra.run.smithi190.stdout:ID="rhel" 2023-07-13T23:03:25.915 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="fedora" 2023-07-13T23:03:25.915 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8.6" 2023-07-13T23:03:25.915 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8" 2023-07-13T23:03:25.916 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-13T23:03:25.916 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2023-07-13T23:03:25.916 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-13T23:03:25.916 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.redhat.com/" 2023-07-13T23:03:25.916 INFO:teuthology.orchestra.run.smithi190.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-13T23:03:25.916 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-13T23:03:25.916 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-07-13T23:03:25.917 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-13T23:03:25.917 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-13T23:03:25.917 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-13T23:03:25.917 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-13T23:03:25.918 INFO:teuthology.provision.fog.smithi190:Deploy complete! 2023-07-13T23:03:25.919 DEBUG:teuthology.parallel:result is None 2023-07-13T23:03:28.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:03:29.272 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-13T23:03:29.272 DEBUG:teuthology.orchestra.run.smithi112:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-13T23:03:29.562 INFO:teuthology.provision.fog.smithi112:Node is ready 2023-07-13T23:03:29.563 DEBUG:teuthology.orchestra.run.smithi112:> hostname 2023-07-13T23:03:29.581 INFO:teuthology.orchestra.run.smithi112.stdout:smithi112.front.sepia.ceph.com 2023-07-13T23:03:29.581 DEBUG:teuthology.orchestra.run.smithi112:> grep smithi112.front.sepia.ceph.com /etc/hosts 2023-07-13T23:03:29.639 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112 smithi112.front.sepia.ceph.com smithi112 2023-07-13T23:03:29.639 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112 2023-07-13T23:03:29.768 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hosts 2023-07-13T23:03:29.796 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/172.21.15.112/172.21.15.112/g' /etc/hosts 2023-07-13T23:03:29.865 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hostname 2023-07-13T23:03:29.933 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112 2023-07-13T23:03:30.001 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2023-07-13T23:03:30.058 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="Red Hat Enterprise Linux" 2023-07-13T23:03:30.059 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="8.6 (Ootpa)" 2023-07-13T23:03:30.059 INFO:teuthology.orchestra.run.smithi112.stdout:ID="rhel" 2023-07-13T23:03:30.059 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="fedora" 2023-07-13T23:03:30.059 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="8.6" 2023-07-13T23:03:30.059 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el8" 2023-07-13T23:03:30.060 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-13T23:03:30.060 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2023-07-13T23:03:30.061 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-13T23:03:30.061 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://www.redhat.com/" 2023-07-13T23:03:30.061 INFO:teuthology.orchestra.run.smithi112.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-13T23:03:30.062 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-13T23:03:30.062 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-07-13T23:03:30.062 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-13T23:03:30.062 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-13T23:03:30.062 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-13T23:03:30.062 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-13T23:03:30.063 INFO:teuthology.provision.fog.smithi112:Deploy complete! 2023-07-13T23:03:30.063 DEBUG:teuthology.parallel:result is None 2023-07-13T23:03:30.214 INFO:teuthology.lock.ops:Checking smithi112.front.sepia.ceph.com 2023-07-13T23:03:30.215 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-13T23:03:30.240 INFO:teuthology.lock.ops:Checking smithi190.front.sepia.ceph.com 2023-07-13T23:03:30.241 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-13T23:03:30.267 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: set os type and version on server 2023-07-13T23:03:30.267 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-07-13T23:03:30.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:03:30.335 DEBUG:teuthology.orchestra.run.smithi112:> true 2023-07-13T23:03:30.406 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-07-13T23:03:30.406 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2023-07-13T23:03:30.463 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2023-07-13T23:03:30.463 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2023-07-13T23:03:30.520 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="Red Hat Enterprise Linux" 2023-07-13T23:03:30.520 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="8.6 (Ootpa)" 2023-07-13T23:03:30.520 INFO:teuthology.orchestra.run.smithi112.stdout:ID="rhel" 2023-07-13T23:03:30.520 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="fedora" 2023-07-13T23:03:30.521 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="8.6" 2023-07-13T23:03:30.521 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el8" 2023-07-13T23:03:30.521 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-13T23:03:30.521 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2023-07-13T23:03:30.521 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-13T23:03:30.521 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://www.redhat.com/" 2023-07-13T23:03:30.521 INFO:teuthology.orchestra.run.smithi112.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-13T23:03:30.522 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-13T23:03:30.522 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-07-13T23:03:30.522 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-13T23:03:30.522 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-13T23:03:30.522 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-13T23:03:30.522 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-13T23:03:30.523 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2023-07-13T23:03:30.548 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: set os type and version on server 2023-07-13T23:03:30.549 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-07-13T23:03:30.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:03:30.615 DEBUG:teuthology.orchestra.run.smithi190:> true 2023-07-13T23:03:30.688 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-07-13T23:03:30.688 DEBUG:teuthology.orchestra.run.smithi190:> uname -m 2023-07-13T23:03:30.747 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2023-07-13T23:03:30.748 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2023-07-13T23:03:30.806 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Red Hat Enterprise Linux" 2023-07-13T23:03:30.806 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8.6 (Ootpa)" 2023-07-13T23:03:30.807 INFO:teuthology.orchestra.run.smithi190.stdout:ID="rhel" 2023-07-13T23:03:30.807 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="fedora" 2023-07-13T23:03:30.807 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8.6" 2023-07-13T23:03:30.807 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8" 2023-07-13T23:03:30.808 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-13T23:03:30.808 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2023-07-13T23:03:30.808 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-13T23:03:30.808 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.redhat.com/" 2023-07-13T23:03:30.808 INFO:teuthology.orchestra.run.smithi190.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-13T23:03:30.808 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-13T23:03:30.808 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-07-13T23:03:30.809 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-13T23:03:30.809 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-13T23:03:30.809 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-13T23:03:30.809 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-13T23:03:30.809 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2023-07-13T23:03:30.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:03:30.832 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:03:30.943 INFO:teuthology.dispatcher.supervisor:Running job 7336357 2023-07-13T23:03:30.943 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-07-13_21:35:13-fs-wip-rishabh-2023Jul13-testing-default-smithi/7336357 --name rishabh-2023-07-13_21:35:13-fs-wip-rishabh-2023Jul13-testing-default-smithi --description fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench} -- /home/teuthworker/archive/rishabh-2023-07-13_21:35:13-fs-wip-rishabh-2023Jul13-testing-default-smithi/7336357/orig.config.yaml 2023-07-13T23:03:30.948 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-07-13_21:35:13-fs-wip-rishabh-2023Jul13-testing-default-smithi/7336357 2023-07-13T23:03:30.949 INFO:teuthology.dispatcher.supervisor:Job PID: 4971 2023-07-13T23:03:30.949 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-13T23:05:31.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:05:31.050 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:07:31.236 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:07:31.237 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:09:31.422 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:09:31.422 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:11:31.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:11:31.586 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:13:31.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:13:31.762 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:13:31.831 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-13T23:13:31.945 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-13T23:13:31.945 INFO:teuthology.nuke:Checking targets against current locks 2023-07-13T23:13:32.001 DEBUG:teuthology.nuke:shortname: smithi112 2023-07-13T23:13:32.002 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-13T23:13:32.029 DEBUG:teuthology.nuke:shortname: smithi190 2023-07-13T23:13:32.029 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-13T23:13:32.032 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-13_21:35:13-fs-wip-rishabh-2023Jul13-testing-default-smithi/7336357', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-13 22:58:24.427103', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-13T23:13:32.054 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-13_21:35:13-fs-wip-rishabh-2023Jul13-testing-default-smithi/7336357', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-13 22:58:24.424802', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-13T23:13:32.086 INFO:teuthology.orchestra.console:Power off smithi112 2023-07-13T23:13:32.087 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T23:13:32.110 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:13:32.132 INFO:teuthology.orchestra.console:Power off smithi190 2023-07-13T23:13:32.133 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T23:13:32.155 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:13:32.245 INFO:teuthology.orchestra.console:Power off for smithi112 completed 2023-07-13T23:13:32.275 INFO:teuthology.orchestra.console:Power off for smithi190 completed 2023-07-13T23:13:32.405 INFO:teuthology.lock.ops:unlocked: smithi112.front.sepia.ceph.com 2023-07-13T23:13:32.430 INFO:teuthology.lock.ops:unlocked: smithi190.front.sepia.ceph.com