2023-06-22T13:47:49.221 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-22T13:47:49.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T13:47:49.223 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T13:47:49.388 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb47b4b5430>, signals=[15]) 2023-06-22T13:47:49.389 INFO:teuthology.lock.ops:Start node 'smithi043.front.sepia.ceph.com' reimaging 2023-06-22T13:47:49.390 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: reset os type and version on server 2023-06-22T13:47:49.390 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2023-06-22T13:47:49.413 INFO:teuthology.lock.ops:Start node 'smithi123.front.sepia.ceph.com' reimaging 2023-06-22T13:47:49.414 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: reset os type and version on server 2023-06-22T13:47:49.414 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-06-22T13:47:49.415 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /host {"name": "smithi043"} 2023-06-22T13:47:49.438 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /host {"name": "smithi123"} 2023-06-22T13:47:49.488 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-06-22T13:47:49.508 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-06-22T13:47:49.523 DEBUG:teuthology.provision.fog.smithi043:Requesting image smithi_centos_8.stream (ID 3) 2023-06-22T13:47:49.523 DEBUG:teuthology.provision.fog.smithi043:FOG request: PUT /host/148 {"imageID": 3} 2023-06-22T13:47:49.550 DEBUG:teuthology.provision.fog.smithi123:Requesting image smithi_centos_8.stream (ID 3) 2023-06-22T13:47:49.550 DEBUG:teuthology.provision.fog.smithi123:FOG request: PUT /host/228 {"imageID": 3} 2023-06-22T13:47:49.569 INFO:teuthology.provision.fog.smithi043:Scheduling deploy of centos 8.stream 2023-06-22T13:47:49.570 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-06-22T13:47:49.594 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of centos 8.stream 2023-06-22T13:47:49.595 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-06-22T13:47:49.615 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /tasktype {"name": "deploy"} 2023-06-22T13:47:49.645 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /tasktype {"name": "deploy"} 2023-06-22T13:47:49.649 DEBUG:teuthology.provision.fog.smithi043:FOG request: POST /host/148/task {"taskTypeID": 1} 2023-06-22T13:47:49.680 DEBUG:teuthology.provision.fog.smithi123:FOG request: POST /host/228/task {"taskTypeID": 1} 2023-06-22T13:47:49.698 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-06-22T13:47:49.739 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-06-22T13:47:49.806 INFO:teuthology.orchestra.console:Power off smithi043 2023-06-22T13:47:49.807 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-22T13:47:49.823 INFO:teuthology.orchestra.console:Power off smithi123 2023-06-22T13:47:49.824 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-22T13:47:49.834 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:47:49.849 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:47:53.864 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:47:53.873 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:47:57.976 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:47:57.985 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:47:58.188 INFO:teuthology.orchestra.console:Power off for smithi043 completed 2023-06-22T13:47:58.289 INFO:teuthology.orchestra.console:Power on smithi043 2023-06-22T13:47:58.289 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-22T13:47:58.310 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:48:02.096 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:48:02.307 INFO:teuthology.orchestra.console:Power off for smithi123 completed 2023-06-22T13:48:02.332 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:48:02.408 INFO:teuthology.orchestra.console:Power on smithi123 2023-06-22T13:48:02.409 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-22T13:48:02.428 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:48:06.442 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:48:06.451 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:48:06.653 INFO:teuthology.orchestra.console:Power on for smithi043 completed 2023-06-22T13:48:06.754 INFO:teuthology.provision.fog.smithi043:Waiting for deploy to finish 2023-06-22T13:48:06.755 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-06-22T13:48:10.564 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:48:10.774 INFO:teuthology.orchestra.console:Power on for smithi123 completed 2023-06-22T13:48:10.876 INFO:teuthology.provision.fog.smithi123:Waiting for deploy to finish 2023-06-22T13:48:10.876 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-06-22T13:48:21.832 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-06-22T13:48:25.948 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-06-22T13:48:36.916 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-06-22T13:48:41.020 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-06-22T13:48:51.984 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-06-22T13:48:56.084 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-06-22T13:49:07.052 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-06-22T13:49:11.156 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-06-22T13:49:22.124 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-06-22T13:49:26.228 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-06-22T13:49:37.192 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-06-22T13:49:41.284 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-06-22T13:49:52.248 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-06-22T13:49:56.340 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-06-22T13:50:07.314 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-06-22T13:50:11.397 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-06-22T13:50:22.376 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-06-22T13:50:26.452 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-06-22T13:50:37.436 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-06-22T13:50:37.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:50:41.505 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-06-22T13:50:41.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:50:55.856 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-06-22T13:50:59.952 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-06-22T13:51:01.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:51:04.912 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-06-22T13:51:05.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:51:09.008 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-06-22T13:51:10.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:51:13.968 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-06-22T13:51:15.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:51:18.064 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-06-22T13:51:19.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:51:23.024 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-06-22T13:51:24.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:51:27.120 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-06-22T13:51:29.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:51:33.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:51:36.176 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-06-22T13:51:42.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:52:29.076 WARNING:teuthology.provision.fog.smithi043:timed out 2023-06-22T13:52:35.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:52:35.322 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-22T13:52:35.324 DEBUG:teuthology.orchestra.run.smithi043:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-22T13:52:35.583 INFO:teuthology.provision.fog.smithi043:Node is ready 2023-06-22T13:52:35.583 DEBUG:teuthology.orchestra.run.smithi043:> hostname 2023-06-22T13:52:35.604 INFO:teuthology.orchestra.run.smithi043.stdout:smithi043.front.sepia.ceph.com 2023-06-22T13:52:35.605 DEBUG:teuthology.orchestra.run.smithi043:> grep smithi043.front.sepia.ceph.com /etc/hosts 2023-06-22T13:52:35.667 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43 smithi043.front.sepia.ceph.com smithi043 2023-06-22T13:52:35.667 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043 2023-06-22T13:52:35.787 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hosts 2023-06-22T13:52:35.819 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/172.21.15.43/172.21.15.43/g' /etc/hosts 2023-06-22T13:52:35.892 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hostname 2023-06-22T13:52:35.963 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043 2023-06-22T13:52:36.034 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2023-06-22T13:52:36.095 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream" 2023-06-22T13:52:36.095 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="8" 2023-06-22T13:52:36.095 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos" 2023-06-22T13:52:36.095 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora" 2023-06-22T13:52:36.095 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="8" 2023-06-22T13:52:36.095 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el8" 2023-06-22T13:52:36.096 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-22T13:52:36.096 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31" 2023-06-22T13:52:36.096 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-22T13:52:36.096 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/" 2023-06-22T13:52:36.096 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-22T13:52:36.096 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-22T13:52:36.096 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-22T13:52:36.097 INFO:teuthology.provision.fog.smithi043:Deploy complete! 2023-06-22T13:52:36.098 DEBUG:teuthology.parallel:result is None 2023-06-22T13:52:42.186 WARNING:teuthology.provision.fog.smithi123:timed out 2023-06-22T13:52:48.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:52:48.440 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-22T13:52:48.441 DEBUG:teuthology.orchestra.run.smithi123:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-22T13:52:48.724 INFO:teuthology.provision.fog.smithi123:Node is ready 2023-06-22T13:52:48.724 DEBUG:teuthology.orchestra.run.smithi123:> hostname 2023-06-22T13:52:48.746 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123.front.sepia.ceph.com 2023-06-22T13:52:48.746 DEBUG:teuthology.orchestra.run.smithi123:> grep smithi123.front.sepia.ceph.com /etc/hosts 2023-06-22T13:52:48.808 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123 smithi123.front.sepia.ceph.com smithi123 2023-06-22T13:52:48.808 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123 2023-06-22T13:52:48.932 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hosts 2023-06-22T13:52:48.968 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/172.21.15.123/172.21.15.123/g' /etc/hosts 2023-06-22T13:52:49.040 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hostname 2023-06-22T13:52:49.110 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123 2023-06-22T13:52:49.179 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2023-06-22T13:52:49.239 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="CentOS Stream" 2023-06-22T13:52:49.239 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="8" 2023-06-22T13:52:49.239 INFO:teuthology.orchestra.run.smithi123.stdout:ID="centos" 2023-06-22T13:52:49.239 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="rhel fedora" 2023-06-22T13:52:49.240 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="8" 2023-06-22T13:52:49.240 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el8" 2023-06-22T13:52:49.240 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-22T13:52:49.240 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2023-06-22T13:52:49.240 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-22T13:52:49.241 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://centos.org/" 2023-06-22T13:52:49.241 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-22T13:52:49.241 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-22T13:52:49.241 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-22T13:52:49.241 INFO:teuthology.provision.fog.smithi123:Deploy complete! 2023-06-22T13:52:49.242 DEBUG:teuthology.parallel:result is None 2023-06-22T13:52:49.432 INFO:teuthology.lock.ops:Checking smithi043.front.sepia.ceph.com 2023-06-22T13:52:49.433 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-22T13:52:49.461 INFO:teuthology.lock.ops:Checking smithi123.front.sepia.ceph.com 2023-06-22T13:52:49.461 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-22T13:52:49.487 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: set os type and version on server 2023-06-22T13:52:49.487 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2023-06-22T13:52:49.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:52:49.556 DEBUG:teuthology.orchestra.run.smithi043:> true 2023-06-22T13:52:49.691 DEBUG:teuthology.orchestra.run.smithi043:> uname -m 2023-06-22T13:52:49.751 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64 2023-06-22T13:52:49.752 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2023-06-22T13:52:49.812 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream" 2023-06-22T13:52:49.812 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="8" 2023-06-22T13:52:49.812 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos" 2023-06-22T13:52:49.812 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora" 2023-06-22T13:52:49.812 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="8" 2023-06-22T13:52:49.812 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el8" 2023-06-22T13:52:49.813 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-22T13:52:49.813 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31" 2023-06-22T13:52:49.813 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-22T13:52:49.813 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/" 2023-06-22T13:52:49.813 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-22T13:52:49.813 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-22T13:52:49.813 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-22T13:52:49.814 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2023-06-22T13:52:49.836 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: set os type and version on server 2023-06-22T13:52:49.836 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-06-22T13:52:49.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:52:49.903 DEBUG:teuthology.orchestra.run.smithi123:> true 2023-06-22T13:52:49.973 DEBUG:teuthology.orchestra.run.smithi123:> uname -m 2023-06-22T13:52:50.032 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2023-06-22T13:52:50.033 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2023-06-22T13:52:50.092 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="CentOS Stream" 2023-06-22T13:52:50.092 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="8" 2023-06-22T13:52:50.092 INFO:teuthology.orchestra.run.smithi123.stdout:ID="centos" 2023-06-22T13:52:50.092 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="rhel fedora" 2023-06-22T13:52:50.093 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="8" 2023-06-22T13:52:50.093 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el8" 2023-06-22T13:52:50.093 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-22T13:52:50.093 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2023-06-22T13:52:50.093 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-22T13:52:50.093 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://centos.org/" 2023-06-22T13:52:50.093 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-22T13:52:50.093 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-22T13:52:50.094 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-22T13:52:50.094 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-06-22T13:52:50.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T13:52:50.120 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T13:52:50.217 INFO:teuthology.dispatcher.supervisor:Running job 7311452 2023-06-22T13:52:50.217 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-06-22_11:20:21-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7311452 --name rishabh-2023-06-22_11:20:21-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi --description fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} -- /home/teuthworker/archive/rishabh-2023-06-22_11:20:21-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7311452/orig.config.yaml 2023-06-22T13:52:50.221 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-06-22_11:20:21-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7311452 2023-06-22T13:52:50.222 INFO:teuthology.dispatcher.supervisor:Job PID: 8571 2023-06-22T13:52:50.222 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-22T13:54:50.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T13:54:50.322 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T13:56:50.500 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T13:56:50.501 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T13:58:50.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T13:58:50.699 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T14:00:50.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T14:00:50.874 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T14:02:51.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T14:02:51.054 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T14:04:51.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T14:04:51.226 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T14:06:51.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T14:06:51.405 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T14:08:51.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T14:08:51.574 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T14:10:51.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T14:10:51.751 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T14:12:51.933 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T14:12:51.934 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T14:14:52.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T14:14:52.114 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T14:16:52.297 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T14:16:52.299 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T14:16:52.388 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-22T14:16:52.512 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-22T14:16:52.512 INFO:teuthology.nuke:Checking targets against current locks 2023-06-22T14:16:52.558 DEBUG:teuthology.nuke:shortname: smithi043 2023-06-22T14:16:52.559 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-22T14:16:52.582 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi043.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-22_11:20:21-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7311452', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-22 13:47:48.420345', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkSMHy3D2oYT/l1d4b/Ku4LI58vEVNDnEG/eGGpvqA9w9v76ajP3gI1XtQWbCgv3ILY4jusVNrSOfxLMk6y9UQ51LEPnsNrypwyQQL87fL/+7dwzTOL0HH25cgoF6UP+EDuJRtIscJvl6Z7BwGrSoKkWyES8yfQuTlLIfhEmvMsWxkCp1qKjYv/GFnwvJqbZgfZZqvgiEj8kgtoaaYROOr4VjPm+SOMW6F1r7gQy+ZlIwPkhPKC4SqXRg37CJbKNn+r8dMzP9WTjEGw0OySC5jx5c9bQqgucCRobRwhevKA93iDZmQeI09cG210vXw9nsgqyRRDxBeKXTWuRyvBoB/LSm92qra4SfZ/EVVDhix+of/5R+7Y/tx37r+Y556jsZBtks/9Ud1Fwwj897DwJxvPQOEwOy4c50FxVAunoTcaniFl9RaIiRubLZRI9gkyCLFwuwvjpxm5V1O5ks2Emdl+nU149kpfbBcsG9iDCjjUzUlPQLYcCVtOxhc8OCxoHc='} 2023-06-22T14:16:52.585 DEBUG:teuthology.nuke:shortname: smithi123 2023-06-22T14:16:52.586 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-22T14:16:52.606 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-22_11:20:21-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7311452', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-22 13:47:48.419092', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPeSf1hQoTR9mHTxv3VQQcXF2cHs4avYL82ui0j0fQst+UdrhNEw9s69TDxhLATxVbuv1gMv1mbI/NKvmKC2r7yRM5Ifj+K9Jj5NaMW4lvv7INgcwYaPAK8x9fSBlMjq1z/cLU9xRvjYwOQFmDA3wVUogVoTthy63+cYb71o0JYFj35/Neh77/JC6iv/6SROHsN0kB6O9CFcHKeb+ipSa2jBnNUBRetg9N8C8QuM3kmCggjETY6RgVLN6PBJsfrzzFGlamVCBoZ4rDiLSs/xkN0jlPgaN/MJBpKYjRF1jVYh/wMgnieigA3fkSqTwFwPWOy6bkl6nAki4CrGY8Eo03xmlz+K+YXyx0Ir9PocWwh7Q8LX152FAY4aZAxCtjSbWzzecpr/AJW4AWLryCJHk/uHgJxCFbtAFCzempHdcw441Eew3EnY2ATxXcTWs/Xv1NAe3vGw8/cQrAOe0BIZ77qDwJXvOwmfbH8kArMYD1FFn0QDV+ebgkHmu2avMXocc='} 2023-06-22T14:16:52.640 INFO:teuthology.orchestra.console:Power off smithi043 2023-06-22T14:16:52.641 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-22T14:16:52.665 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T14:16:52.681 INFO:teuthology.orchestra.console:Power off smithi123 2023-06-22T14:16:52.681 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-22T14:16:52.703 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T14:16:52.793 INFO:teuthology.orchestra.console:Power off for smithi043 completed 2023-06-22T14:16:52.825 INFO:teuthology.orchestra.console:Power off for smithi123 completed 2023-06-22T14:16:52.950 INFO:teuthology.lock.ops:unlocked: smithi043.front.sepia.ceph.com 2023-06-22T14:16:52.975 INFO:teuthology.lock.ops:unlocked: smithi123.front.sepia.ceph.com