2023-07-11T08:26:56.427 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-11T08:26:56.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T08:26:56.429 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T08:27:06.939 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f86803d58b0>, signals=[15]) 2023-07-11T08:27:06.941 INFO:teuthology.lock.ops:Start node 'smithi032.front.sepia.ceph.com' reimaging 2023-07-11T08:27:06.942 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: reset os type and version on server 2023-07-11T08:27:06.942 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2023-07-11T08:27:06.969 INFO:teuthology.lock.ops:Start node 'smithi045.front.sepia.ceph.com' reimaging 2023-07-11T08:27:06.969 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: reset os type and version on server 2023-07-11T08:27:06.970 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2023-07-11T08:27:06.972 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /host {"name": "smithi032"} 2023-07-11T08:27:12.000 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /host {"name": "smithi045"} 2023-07-11T08:27:27.044 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-11T08:27:33.086 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-11T08:27:37.218 DEBUG:teuthology.provision.fog.smithi032:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-11T08:27:37.218 DEBUG:teuthology.provision.fog.smithi032:FOG request: PUT /host/137 {"imageID": 5} 2023-07-11T08:27:37.286 INFO:teuthology.provision.fog.smithi032:Scheduling deploy of rhel 8.6 2023-07-11T08:27:37.287 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-11T08:27:37.327 DEBUG:teuthology.provision.fog.smithi045:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-11T08:27:37.327 DEBUG:teuthology.provision.fog.smithi045:FOG request: PUT /host/150 {"imageID": 5} 2023-07-11T08:27:37.404 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /tasktype {"name": "deploy"} 2023-07-11T08:27:37.473 INFO:teuthology.provision.fog.smithi045:Scheduling deploy of rhel 8.6 2023-07-11T08:27:37.473 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-11T08:27:37.532 DEBUG:teuthology.provision.fog.smithi032:FOG request: POST /host/137/task {"taskTypeID": 1} 2023-07-11T08:27:37.657 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /tasktype {"name": "deploy"} 2023-07-11T08:27:37.675 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-11T08:27:37.705 DEBUG:teuthology.provision.fog.smithi045:FOG request: POST /host/150/task {"taskTypeID": 1} 2023-07-11T08:27:37.773 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-11T08:27:47.820 INFO:teuthology.orchestra.console:Power off smithi032 2023-07-11T08:27:47.821 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-11T08:27:47.863 INFO:teuthology.orchestra.console:Power off smithi045 2023-07-11T08:27:47.864 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-11T08:27:52.892 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:27:53.017 INFO:teuthology.orchestra.console:Power off for smithi045 completed 2023-07-11T08:27:53.118 INFO:teuthology.orchestra.console:Power on smithi045 2023-07-11T08:27:53.118 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-11T08:27:58.147 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:28:02.855 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:28:03.159 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:28:03.369 INFO:teuthology.orchestra.console:Power on for smithi045 completed 2023-07-11T08:28:03.470 INFO:teuthology.provision.fog.smithi045:Waiting for deploy to finish 2023-07-11T08:28:03.470 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-11T08:28:08.341 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:28:08.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T08:28:13.465 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:28:16.532 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-07-11T08:28:18.579 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:28:22.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T08:28:23.691 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:28:26.576 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-07-11T08:28:28.802 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:28:32.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T08:28:33.913 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:28:35.632 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-07-11T08:28:39.028 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:28:41.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T08:28:46.640 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:28:46.851 INFO:teuthology.orchestra.console:Power off for smithi032 completed 2023-07-11T08:28:46.952 INFO:teuthology.orchestra.console:Power on smithi032 2023-07-11T08:28:46.953 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-11T08:28:46.977 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:28:49.712 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-07-11T08:28:51.000 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:28:55.112 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:28:55.323 INFO:teuthology.orchestra.console:Power on for smithi032 completed 2023-07-11T08:28:55.424 INFO:teuthology.provision.fog.smithi032:Waiting for deploy to finish 2023-07-11T08:28:55.424 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-11T08:29:00.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T08:29:20.552 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-11T08:29:37.121 ERROR:teuthology.orchestra.connection:Error authenticating with smithi045.front.sepia.ceph.com: Authentication failed. 2023-07-11T08:29:37.123 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-11T08:29:37.123 DEBUG:teuthology.orchestra.run.smithi045:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-11T08:29:37.124 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:29:38.129 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:29:39.134 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:29:40.139 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:29:40.651 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-11T08:29:45.660 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:29:46.665 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:29:47.670 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:29:48.675 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:29:49.680 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:29:50.685 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:29:51.690 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:29:52.695 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:29:53.701 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:29:54.707 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:29:55.712 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:29:56.717 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:29:57.722 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:29:58.726 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:29:59.732 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:30:00.737 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:30:00.760 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-11T08:30:05.765 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:30:06.769 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:30:07.774 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:30:08.778 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:30:09.782 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:30:10.786 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:30:11.790 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:30:12.795 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:30:13.800 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:30:14.805 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:30:15.810 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:30:16.815 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:30:17.820 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:30:18.825 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:30:19.830 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:30:20.835 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:30:20.871 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-11T08:30:25.879 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:30:26.882 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:30:27.887 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:30:28.892 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:30:29.897 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:30:30.902 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:30:31.907 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:30:32.912 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:30:40.962 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-11T08:30:56.397 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-11T08:31:15.324 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-11T08:31:35.418 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-11T08:31:40.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T08:31:43.600 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-07-11T08:31:49.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T08:31:57.680 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-07-11T08:32:03.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T08:32:11.764 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-07-11T08:32:17.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T08:32:22.768 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-11T08:32:22.769 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi045 2023-07-11T08:32:31.776 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-07-11T08:32:31.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T08:32:32.101 DEBUG:teuthology.orchestra.run.smithi045:> true 2023-07-11T08:32:32.365 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-07-11T08:32:32.366 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-11T08:32:32.366 DEBUG:teuthology.orchestra.run.smithi045:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-11T08:32:32.384 INFO:teuthology.provision.fog.smithi045:Node is ready 2023-07-11T08:32:32.385 DEBUG:teuthology.orchestra.run.smithi045:> hostname 2023-07-11T08:32:32.442 INFO:teuthology.orchestra.run.smithi045.stdout:smithi045.front.sepia.ceph.com 2023-07-11T08:32:32.442 DEBUG:teuthology.orchestra.run.smithi045:> grep smithi045.front.sepia.ceph.com /etc/hosts 2023-07-11T08:32:32.500 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45 smithi045.front.sepia.ceph.com smithi045 2023-07-11T08:32:32.501 DEBUG:teuthology.orchestra.run.smithi045:> sudo hostname smithi045 2023-07-11T08:32:32.646 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/smithi045.front.sepia.ceph.com/smithi045/g' /etc/hosts 2023-07-11T08:32:32.676 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/172.21.15.45/172.21.15.45/g' /etc/hosts 2023-07-11T08:32:32.744 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/smithi045.front.sepia.ceph.com/smithi045/g' /etc/hostname 2023-07-11T08:32:32.812 DEBUG:teuthology.orchestra.run.smithi045:> sudo hostname smithi045 2023-07-11T08:32:32.879 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release 2023-07-11T08:32:32.936 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="Red Hat Enterprise Linux" 2023-07-11T08:32:32.936 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="8.6 (Ootpa)" 2023-07-11T08:32:32.936 INFO:teuthology.orchestra.run.smithi045.stdout:ID="rhel" 2023-07-11T08:32:32.936 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="fedora" 2023-07-11T08:32:32.936 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="8.6" 2023-07-11T08:32:32.937 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el8" 2023-07-11T08:32:32.937 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-11T08:32:32.937 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31" 2023-07-11T08:32:32.937 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-11T08:32:32.937 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://www.redhat.com/" 2023-07-11T08:32:32.937 INFO:teuthology.orchestra.run.smithi045.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-11T08:32:32.937 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-11T08:32:32.938 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-11T08:32:32.938 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-11T08:32:32.938 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-11T08:32:32.938 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-11T08:32:32.938 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-11T08:32:32.939 INFO:teuthology.provision.fog.smithi045:Deploy complete! 2023-07-11T08:32:32.940 DEBUG:teuthology.parallel:result is None 2023-07-11T08:32:41.335 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-07-11T08:32:47.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T08:32:54.956 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-11T08:32:54.957 DEBUG:teuthology.orchestra.run.smithi032:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-11T08:32:55.293 INFO:teuthology.provision.fog.smithi032:Node is ready 2023-07-11T08:32:55.293 DEBUG:teuthology.orchestra.run.smithi032:> hostname 2023-07-11T08:32:55.311 INFO:teuthology.orchestra.run.smithi032.stdout:smithi022 2023-07-11T08:32:55.312 DEBUG:teuthology.orchestra.run.smithi032:> grep smithi022 /etc/hosts 2023-07-11T08:32:55.369 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-07-11T08:32:55.370 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032 2023-07-11T08:32:55.494 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi022/smithi032/g' /etc/hosts 2023-07-11T08:32:55.523 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/172.21.15.22/172.21.15.32/g' /etc/hosts 2023-07-11T08:32:55.591 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi022/smithi032/g' /etc/hostname 2023-07-11T08:32:55.659 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032 2023-07-11T08:32:55.726 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2023-07-11T08:32:55.782 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="Red Hat Enterprise Linux" 2023-07-11T08:32:55.783 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="8.6 (Ootpa)" 2023-07-11T08:32:55.783 INFO:teuthology.orchestra.run.smithi032.stdout:ID="rhel" 2023-07-11T08:32:55.783 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="fedora" 2023-07-11T08:32:55.783 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="8.6" 2023-07-11T08:32:55.783 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el8" 2023-07-11T08:32:55.784 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-11T08:32:55.784 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31" 2023-07-11T08:32:55.784 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-11T08:32:55.784 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://www.redhat.com/" 2023-07-11T08:32:55.784 INFO:teuthology.orchestra.run.smithi032.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-11T08:32:55.784 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-11T08:32:55.784 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-07-11T08:32:55.785 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-11T08:32:55.785 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-11T08:32:55.785 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-11T08:32:55.785 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-11T08:32:55.785 INFO:teuthology.provision.fog.smithi032:Deploy complete! 2023-07-11T08:32:55.786 DEBUG:teuthology.parallel:result is None 2023-07-11T08:33:30.969 INFO:teuthology.lock.ops:Checking smithi032.front.sepia.ceph.com 2023-07-11T08:33:30.970 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-11T08:33:35.995 INFO:teuthology.lock.ops:Checking smithi045.front.sepia.ceph.com 2023-07-11T08:33:35.996 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-11T08:33:36.644 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: set os type and version on server 2023-07-11T08:33:36.644 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-07-11T08:33:36.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T08:33:36.716 DEBUG:teuthology.orchestra.run.smithi032:> true 2023-07-11T08:33:36.854 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-07-11T08:33:36.854 DEBUG:teuthology.orchestra.run.smithi032:> uname -m 2023-07-11T08:33:36.912 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64 2023-07-11T08:33:36.912 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2023-07-11T08:33:36.970 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="Red Hat Enterprise Linux" 2023-07-11T08:33:36.971 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="8.6 (Ootpa)" 2023-07-11T08:33:36.971 INFO:teuthology.orchestra.run.smithi032.stdout:ID="rhel" 2023-07-11T08:33:36.972 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="fedora" 2023-07-11T08:33:36.972 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="8.6" 2023-07-11T08:33:36.972 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el8" 2023-07-11T08:33:36.972 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-11T08:33:36.973 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31" 2023-07-11T08:33:36.973 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-11T08:33:36.973 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://www.redhat.com/" 2023-07-11T08:33:36.973 INFO:teuthology.orchestra.run.smithi032.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-11T08:33:36.974 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-11T08:33:36.974 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-07-11T08:33:36.974 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-11T08:33:36.975 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-11T08:33:36.975 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-11T08:33:36.975 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-11T08:33:36.976 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2023-07-11T08:33:36.997 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: set os type and version on server 2023-07-11T08:33:36.997 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-07-11T08:33:36.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T08:33:37.066 DEBUG:teuthology.orchestra.run.smithi045:> true 2023-07-11T08:33:37.206 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-07-11T08:33:37.207 DEBUG:teuthology.orchestra.run.smithi045:> uname -m 2023-07-11T08:33:37.263 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64 2023-07-11T08:33:37.264 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release 2023-07-11T08:33:37.322 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="Red Hat Enterprise Linux" 2023-07-11T08:33:37.322 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="8.6 (Ootpa)" 2023-07-11T08:33:37.322 INFO:teuthology.orchestra.run.smithi045.stdout:ID="rhel" 2023-07-11T08:33:37.322 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="fedora" 2023-07-11T08:33:37.322 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="8.6" 2023-07-11T08:33:37.322 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el8" 2023-07-11T08:33:37.323 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-11T08:33:37.323 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31" 2023-07-11T08:33:37.323 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-11T08:33:37.323 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://www.redhat.com/" 2023-07-11T08:33:37.323 INFO:teuthology.orchestra.run.smithi045.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-11T08:33:37.324 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-11T08:33:37.324 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-11T08:33:37.324 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-11T08:33:37.324 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-11T08:33:37.324 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-11T08:33:37.324 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-11T08:33:37.325 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2023-07-11T08:33:37.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T08:33:37.347 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T08:33:37.458 INFO:teuthology.dispatcher.supervisor:Running job 7333519 2023-07-11T08:33:37.458 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2023-07-11_07:33:56-orch:cephadm-guits-cv-refactor-osd-objectstore-distro-default-smithi/7333519 --name gabrioux-2023-07-11_07:33:56-orch:cephadm-guits-cv-refactor-osd-objectstore-distro-default-smithi --description orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} -- /home/teuthworker/archive/gabrioux-2023-07-11_07:33:56-orch:cephadm-guits-cv-refactor-osd-objectstore-distro-default-smithi/7333519/orig.config.yaml 2023-07-11T08:33:37.462 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2023-07-11_07:33:56-orch:cephadm-guits-cv-refactor-osd-objectstore-distro-default-smithi/7333519 2023-07-11T08:33:37.462 INFO:teuthology.dispatcher.supervisor:Job PID: 12266 2023-07-11T08:33:37.463 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-11T08:35:37.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T08:35:37.565 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T08:37:42.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T08:37:42.749 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T08:39:47.933 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T08:39:47.935 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T08:41:53.110 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T08:41:53.111 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T08:43:53.289 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T08:43:53.290 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T08:45:58.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T08:45:58.466 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T08:48:03.642 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T08:48:03.643 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T08:50:04.921 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T08:50:04.921 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T08:52:10.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T08:52:10.107 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T08:54:15.285 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T08:54:15.286 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T08:56:15.453 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T08:56:15.454 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T08:58:20.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T08:58:20.638 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T08:58:22.819 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-11T08:58:27.982 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-11T08:58:27.982 INFO:teuthology.nuke:Checking targets against current locks 2023-07-11T08:58:28.038 DEBUG:teuthology.nuke:shortname: smithi032 2023-07-11T08:58:28.038 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-11T08:58:28.059 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi032.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-11_07:33:56-orch:cephadm-guits-cv-refactor-osd-objectstore-distro-default-smithi/7333519', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-11 08:26:55.562541', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-11T08:58:28.062 DEBUG:teuthology.nuke:shortname: smithi045 2023-07-11T08:58:28.062 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-11T08:58:33.089 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-11_07:33:56-orch:cephadm-guits-cv-refactor-osd-objectstore-distro-default-smithi/7333519', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-11 08:26:55.564320', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-11T08:58:33.151 INFO:teuthology.orchestra.console:Power off smithi032 2023-07-11T08:58:33.152 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-11T08:58:33.175 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:58:33.194 INFO:teuthology.orchestra.console:Power off smithi045 2023-07-11T08:58:33.195 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-11T08:58:33.220 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:58:33.309 INFO:teuthology.orchestra.console:Power off for smithi032 completed 2023-07-11T08:58:33.344 INFO:teuthology.orchestra.console:Power off for smithi045 completed 2023-07-11T08:58:33.477 INFO:teuthology.lock.ops:unlocked: smithi032.front.sepia.ceph.com 2023-07-11T08:58:33.501 INFO:teuthology.lock.ops:unlocked: smithi045.front.sepia.ceph.com