2023-06-23T21:11:38.284 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-23T21:11:38.286 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T21:11:38.286 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T21:11:38.438 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5c50cd24c0>, signals=[15]) 2023-06-23T21:11:38.439 INFO:teuthology.lock.ops:Start node 'smithi104.front.sepia.ceph.com' reimaging 2023-06-23T21:11:38.440 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: reset os type and version on server 2023-06-23T21:11:38.440 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2023-06-23T21:11:38.465 INFO:teuthology.lock.ops:Start node 'smithi125.front.sepia.ceph.com' reimaging 2023-06-23T21:11:38.466 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: reset os type and version on server 2023-06-23T21:11:38.466 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2023-06-23T21:11:38.467 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /host {"name": "smithi104"} 2023-06-23T21:11:38.490 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /host {"name": "smithi125"} 2023-06-23T21:11:38.547 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-06-23T21:11:38.555 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-06-23T21:11:38.589 DEBUG:teuthology.provision.fog.smithi104:Requesting image smithi_centos_8.stream (ID 3) 2023-06-23T21:11:38.589 DEBUG:teuthology.provision.fog.smithi104:FOG request: PUT /host/209 {"imageID": 3} 2023-06-23T21:11:38.597 DEBUG:teuthology.provision.fog.smithi125:Requesting image smithi_centos_8.stream (ID 3) 2023-06-23T21:11:38.598 DEBUG:teuthology.provision.fog.smithi125:FOG request: PUT /host/230 {"imageID": 3} 2023-06-23T21:11:38.643 INFO:teuthology.provision.fog.smithi104:Scheduling deploy of centos 8.stream 2023-06-23T21:11:38.644 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-06-23T21:11:38.657 INFO:teuthology.provision.fog.smithi125:Scheduling deploy of centos 8.stream 2023-06-23T21:11:38.657 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-23T21:11:38.695 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /tasktype {"name": "deploy"} 2023-06-23T21:11:38.711 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /tasktype {"name": "deploy"} 2023-06-23T21:11:38.729 DEBUG:teuthology.provision.fog.smithi104:FOG request: POST /host/209/task {"taskTypeID": 1} 2023-06-23T21:11:38.749 DEBUG:teuthology.provision.fog.smithi125:FOG request: POST /host/230/task {"taskTypeID": 1} 2023-06-23T21:11:38.780 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-06-23T21:11:38.804 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-23T21:11:38.877 INFO:teuthology.orchestra.console:Power off smithi104 2023-06-23T21:11:38.878 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-23T21:11:38.892 INFO:teuthology.orchestra.console:Power off smithi125 2023-06-23T21:11:38.892 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-23T21:11:38.901 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T21:11:38.914 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T21:11:42.926 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T21:11:42.939 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T21:11:47.042 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T21:11:47.053 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T21:11:47.253 INFO:teuthology.orchestra.console:Power off for smithi104 completed 2023-06-23T21:11:47.264 INFO:teuthology.orchestra.console:Power off for smithi125 completed 2023-06-23T21:11:47.354 INFO:teuthology.orchestra.console:Power on smithi104 2023-06-23T21:11:47.355 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-23T21:11:47.365 INFO:teuthology.orchestra.console:Power on smithi125 2023-06-23T21:11:47.366 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-23T21:11:47.376 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T21:11:47.389 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T21:11:51.404 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T21:11:51.415 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T21:11:55.521 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T21:11:55.530 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T21:11:55.743 INFO:teuthology.orchestra.console:Power on for smithi125 completed 2023-06-23T21:11:55.750 INFO:teuthology.orchestra.console:Power on for smithi104 completed 2023-06-23T21:11:55.844 INFO:teuthology.provision.fog.smithi125:Waiting for deploy to finish 2023-06-23T21:11:55.845 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-23T21:11:55.851 INFO:teuthology.provision.fog.smithi104:Waiting for deploy to finish 2023-06-23T21:11:55.851 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-06-23T21:12:10.928 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-06-23T21:12:10.930 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-23T21:12:26.001 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-23T21:12:26.002 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-06-23T21:12:41.072 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-06-23T21:12:41.073 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-23T21:12:56.156 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-23T21:12:56.158 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-06-23T21:13:11.228 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-23T21:13:11.229 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-06-23T21:13:26.301 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-23T21:13:26.302 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-06-23T21:13:41.394 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-06-23T21:13:41.395 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-23T21:13:56.473 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-06-23T21:13:56.474 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-23T21:14:11.544 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-23T21:14:11.546 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-06-23T21:14:26.608 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-06-23T21:14:26.609 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-23T21:14:41.672 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-06-23T21:14:41.673 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-23T21:14:41.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T21:14:41.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T21:14:44.784 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-06-23T21:14:44.785 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-06-23T21:14:50.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T21:14:50.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T21:14:53.840 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-06-23T21:14:53.841 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-06-23T21:14:59.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T21:14:59.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T21:15:02.896 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-06-23T21:15:02.897 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-06-23T21:15:08.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T21:15:08.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T21:15:11.953 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-06-23T21:15:11.954 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-06-23T21:15:17.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T21:15:17.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T21:15:21.040 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-06-23T21:15:21.041 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-06-23T21:15:27.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T21:15:27.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T21:16:27.108 WARNING:teuthology.provision.fog.smithi125:timed out 2023-06-23T21:16:27.110 WARNING:teuthology.provision.fog.smithi104:timed out 2023-06-23T21:16:33.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T21:16:33.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T21:16:33.358 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-23T21:16:33.359 DEBUG:teuthology.orchestra.run.smithi104:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-23T21:16:33.391 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-23T21:16:33.391 DEBUG:teuthology.orchestra.run.smithi125:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-23T21:16:33.611 INFO:teuthology.provision.fog.smithi104:Node is ready 2023-06-23T21:16:33.612 DEBUG:teuthology.orchestra.run.smithi104:> hostname 2023-06-23T21:16:33.632 INFO:teuthology.orchestra.run.smithi104.stdout:smithi104.front.sepia.ceph.com 2023-06-23T21:16:33.632 DEBUG:teuthology.orchestra.run.smithi104:> grep smithi104.front.sepia.ceph.com /etc/hosts 2023-06-23T21:16:33.677 INFO:teuthology.provision.fog.smithi125:Node is ready 2023-06-23T21:16:33.677 DEBUG:teuthology.orchestra.run.smithi125:> hostname 2023-06-23T21:16:33.691 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.15.104 smithi104.front.sepia.ceph.com smithi104 2023-06-23T21:16:33.692 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104 2023-06-23T21:16:33.699 INFO:teuthology.orchestra.run.smithi125.stdout:smithi125.front.sepia.ceph.com 2023-06-23T21:16:33.699 DEBUG:teuthology.orchestra.run.smithi125:> grep smithi125.front.sepia.ceph.com /etc/hosts 2023-06-23T21:16:33.760 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125 smithi125.front.sepia.ceph.com smithi125 2023-06-23T21:16:33.761 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125 2023-06-23T21:16:33.803 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hosts 2023-06-23T21:16:33.833 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/172.21.15.104/172.21.15.104/g' /etc/hosts 2023-06-23T21:16:33.852 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125.front.sepia.ceph.com/smithi125/g' /etc/hosts 2023-06-23T21:16:33.886 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/172.21.15.125/172.21.15.125/g' /etc/hosts 2023-06-23T21:16:33.902 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hostname 2023-06-23T21:16:33.960 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125.front.sepia.ceph.com/smithi125/g' /etc/hostname 2023-06-23T21:16:33.970 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104 2023-06-23T21:16:34.034 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125 2023-06-23T21:16:34.036 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2023-06-23T21:16:34.095 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="CentOS Stream" 2023-06-23T21:16:34.095 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="8" 2023-06-23T21:16:34.095 INFO:teuthology.orchestra.run.smithi104.stdout:ID="centos" 2023-06-23T21:16:34.096 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="rhel fedora" 2023-06-23T21:16:34.096 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="8" 2023-06-23T21:16:34.096 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el8" 2023-06-23T21:16:34.097 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-23T21:16:34.097 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31" 2023-06-23T21:16:34.097 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-23T21:16:34.097 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://centos.org/" 2023-06-23T21:16:34.098 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-23T21:16:34.098 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-23T21:16:34.098 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-23T21:16:34.099 INFO:teuthology.provision.fog.smithi104:Deploy complete! 2023-06-23T21:16:34.101 DEBUG:teuthology.parallel:result is None 2023-06-23T21:16:34.107 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2023-06-23T21:16:34.169 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="CentOS Stream" 2023-06-23T21:16:34.169 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="8" 2023-06-23T21:16:34.169 INFO:teuthology.orchestra.run.smithi125.stdout:ID="centos" 2023-06-23T21:16:34.169 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="rhel fedora" 2023-06-23T21:16:34.169 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="8" 2023-06-23T21:16:34.170 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el8" 2023-06-23T21:16:34.170 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-23T21:16:34.170 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31" 2023-06-23T21:16:34.170 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-23T21:16:34.170 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://centos.org/" 2023-06-23T21:16:34.170 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-23T21:16:34.170 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-23T21:16:34.171 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-23T21:16:34.171 INFO:teuthology.provision.fog.smithi125:Deploy complete! 2023-06-23T21:16:34.171 DEBUG:teuthology.parallel:result is None 2023-06-23T21:16:34.323 INFO:teuthology.lock.ops:Checking smithi104.front.sepia.ceph.com 2023-06-23T21:16:34.324 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-23T21:16:34.355 INFO:teuthology.lock.ops:Checking smithi125.front.sepia.ceph.com 2023-06-23T21:16:34.355 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-23T21:16:34.381 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: set os type and version on server 2023-06-23T21:16:34.381 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2023-06-23T21:16:34.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T21:16:34.447 DEBUG:teuthology.orchestra.run.smithi104:> true 2023-06-23T21:16:34.517 DEBUG:teuthology.orchestra.run.smithi104:> uname -m 2023-06-23T21:16:34.574 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64 2023-06-23T21:16:34.575 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2023-06-23T21:16:34.632 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="CentOS Stream" 2023-06-23T21:16:34.633 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="8" 2023-06-23T21:16:34.633 INFO:teuthology.orchestra.run.smithi104.stdout:ID="centos" 2023-06-23T21:16:34.633 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="rhel fedora" 2023-06-23T21:16:34.633 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="8" 2023-06-23T21:16:34.633 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el8" 2023-06-23T21:16:34.633 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-23T21:16:34.633 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31" 2023-06-23T21:16:34.634 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-23T21:16:34.634 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://centos.org/" 2023-06-23T21:16:34.634 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-23T21:16:34.634 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-23T21:16:34.634 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-23T21:16:34.635 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2023-06-23T21:16:34.663 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: set os type and version on server 2023-06-23T21:16:34.663 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-06-23T21:16:34.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T21:16:34.731 DEBUG:teuthology.orchestra.run.smithi125:> true 2023-06-23T21:16:34.802 DEBUG:teuthology.orchestra.run.smithi125:> uname -m 2023-06-23T21:16:34.863 INFO:teuthology.orchestra.run.smithi125.stdout:x86_64 2023-06-23T21:16:34.864 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2023-06-23T21:16:34.926 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="CentOS Stream" 2023-06-23T21:16:34.926 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="8" 2023-06-23T21:16:34.926 INFO:teuthology.orchestra.run.smithi125.stdout:ID="centos" 2023-06-23T21:16:34.926 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="rhel fedora" 2023-06-23T21:16:34.926 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="8" 2023-06-23T21:16:34.927 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el8" 2023-06-23T21:16:34.927 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-23T21:16:34.927 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31" 2023-06-23T21:16:34.927 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-23T21:16:34.927 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://centos.org/" 2023-06-23T21:16:34.927 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-23T21:16:34.927 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-23T21:16:34.927 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-23T21:16:34.928 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2023-06-23T21:16:34.954 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T21:16:34.955 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T21:16:35.057 INFO:teuthology.dispatcher.supervisor:Running job 7313984 2023-06-23T21:16:35.058 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-06-23_19:27:35-fs-CephManager-in-CephFSTestCase-testing-default-smithi/7313984 --name rishabh-2023-06-23_19:27:35-fs-CephManager-in-CephFSTestCase-testing-default-smithi --description fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_ffsb traceless/50pc} -- /home/teuthworker/archive/rishabh-2023-06-23_19:27:35-fs-CephManager-in-CephFSTestCase-testing-default-smithi/7313984/orig.config.yaml 2023-06-23T21:16:35.061 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-06-23_19:27:35-fs-CephManager-in-CephFSTestCase-testing-default-smithi/7313984 2023-06-23T21:16:35.062 INFO:teuthology.dispatcher.supervisor:Job PID: 9921 2023-06-23T21:16:35.062 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-23T21:18:35.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T21:18:35.162 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T21:20:35.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T21:20:35.321 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T21:22:35.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T21:22:35.490 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T21:24:35.669 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T21:24:35.670 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T21:26:35.838 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T21:26:35.838 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T21:28:36.001 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T21:28:36.002 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T21:30:36.177 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T21:30:36.178 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T21:32:36.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T21:32:36.386 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T21:34:36.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T21:34:36.528 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T21:36:36.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T21:36:36.698 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T21:36:36.766 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-23T21:36:36.971 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-23T21:36:36.972 INFO:teuthology.nuke:Checking targets against current locks 2023-06-23T21:36:37.028 DEBUG:teuthology.nuke:shortname: smithi104 2023-06-23T21:36:37.029 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-23T21:36:37.054 DEBUG:teuthology.nuke:shortname: smithi125 2023-06-23T21:36:37.055 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-23T21:36:37.057 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi104.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-23_19:27:35-fs-CephManager-in-CephFSTestCase-testing-default-smithi/7313984', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 21:11:37.418991', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLNUWIyAulvdj0WWPH9fVe3iUJ28tkUT8zXU74f0pASBdy8Bc5OkKoP6GXQDKQvrvm9FvlKo8fpH4y4wfuWGQD0='} 2023-06-23T21:36:37.083 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi125.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-23_19:27:35-fs-CephManager-in-CephFSTestCase-testing-default-smithi/7313984', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 21:11:37.421268', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDK2u7b299u7vTKQVI47JY5cr1CTU6zqPWW4bvDkyKnKMynibl13v33DPNeVTxhaGHMfq2YrIpUQdbqRlUG57f0D9f/5qkw6oirLHSq4lVu7I50mbLIRWk5FpdtiGOWgK8luUpNu05Bd6vv/QgdIWYKAewOdQCAY34eaWBGd0pxaHSsyAw/P26m0mgV+A8DBlb0h7uJwi0FmuMLQoOLt4WKV/G+TMFkMGS94IC6falYvsrFkaMrClnJbnyK3PoTQ5Cz8kbzIOtFU8R+gt0K92oVjXDTELTcTdkI8OvQvswTawX6nAnNB98KeDuIXGbpm5hxXs1e5ZrRVrXKMTE6WhKTjlpROY/5QPq/LJ1FFqbm3JozqvRHWRbVS5xeBQTVsTyScytLBbwxvY7iLr1QRdGMjR5yEKdtge9J1dcBtypQOF3VMx0SB1S5GE2xyig2XcNdf9piusFp7ET9gVnP6Rztqj4ts/4sD9C4WngarrWFgjMFuzDHWhleHh2bfYAvqQE='} 2023-06-23T21:36:37.117 INFO:teuthology.orchestra.console:Power off smithi104 2023-06-23T21:36:37.118 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-23T21:36:37.144 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T21:36:37.164 INFO:teuthology.orchestra.console:Power off smithi125 2023-06-23T21:36:37.165 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-23T21:36:37.186 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T21:36:37.275 INFO:teuthology.orchestra.console:Power off for smithi104 completed 2023-06-23T21:36:37.314 INFO:teuthology.orchestra.console:Power off for smithi125 completed 2023-06-23T21:36:37.422 INFO:teuthology.lock.ops:unlocked: smithi104.front.sepia.ceph.com 2023-06-23T21:36:37.464 INFO:teuthology.lock.ops:unlocked: smithi125.front.sepia.ceph.com