2023-07-20T11:23:00.252 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-20T11:23:00.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T11:23:00.254 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T11:23:00.399 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa8f520bee0>, signals=[15]) 2023-07-20T11:23:00.400 INFO:teuthology.lock.ops:Start node 'smithi026.front.sepia.ceph.com' reimaging 2023-07-20T11:23:00.400 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: reset os type and version on server 2023-07-20T11:23:00.401 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2023-07-20T11:23:00.423 INFO:teuthology.lock.ops:Start node 'smithi149.front.sepia.ceph.com' reimaging 2023-07-20T11:23:00.424 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: reset os type and version on server 2023-07-20T11:23:00.424 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-07-20T11:23:00.425 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /host {"name": "smithi026"} 2023-07-20T11:23:00.449 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /host {"name": "smithi149"} 2023-07-20T11:23:00.502 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-20T11:23:00.522 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-20T11:23:00.545 DEBUG:teuthology.provision.fog.smithi026:Requesting image smithi_centos_9.stream (ID 10) 2023-07-20T11:23:00.545 DEBUG:teuthology.provision.fog.smithi026:FOG request: PUT /host/131 {"imageID": 10} 2023-07-20T11:23:00.563 DEBUG:teuthology.provision.fog.smithi149:Requesting image smithi_centos_9.stream (ID 10) 2023-07-20T11:23:00.563 DEBUG:teuthology.provision.fog.smithi149:FOG request: PUT /host/254 {"imageID": 10} 2023-07-20T11:23:00.601 INFO:teuthology.provision.fog.smithi026:Scheduling deploy of centos 9.stream 2023-07-20T11:23:00.601 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-20T11:23:00.606 INFO:teuthology.provision.fog.smithi149:Scheduling deploy of centos 9.stream 2023-07-20T11:23:00.606 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T11:23:00.653 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /tasktype {"name": "deploy"} 2023-07-20T11:23:00.656 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /tasktype {"name": "deploy"} 2023-07-20T11:23:00.688 DEBUG:teuthology.provision.fog.smithi149:FOG request: POST /host/254/task {"taskTypeID": 1} 2023-07-20T11:23:00.690 DEBUG:teuthology.provision.fog.smithi026:FOG request: POST /host/131/task {"taskTypeID": 1} 2023-07-20T11:23:00.741 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T11:23:00.743 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-20T11:23:00.831 INFO:teuthology.orchestra.console:Power off smithi149 2023-07-20T11:23:00.832 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T11:23:00.848 INFO:teuthology.orchestra.console:Power off smithi026 2023-07-20T11:23:00.849 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T11:23:00.859 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T11:23:00.872 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T11:23:04.884 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T11:23:04.896 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T11:23:08.996 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T11:23:09.006 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T11:23:09.207 INFO:teuthology.orchestra.console:Power off for smithi149 completed 2023-07-20T11:23:09.215 INFO:teuthology.orchestra.console:Power off for smithi026 completed 2023-07-20T11:23:09.309 INFO:teuthology.orchestra.console:Power on smithi149 2023-07-20T11:23:09.309 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-20T11:23:09.318 INFO:teuthology.orchestra.console:Power on smithi026 2023-07-20T11:23:09.319 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-20T11:23:09.341 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T11:23:09.361 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T11:23:13.376 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T11:23:13.386 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T11:23:17.488 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T11:23:17.496 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T11:23:17.699 INFO:teuthology.orchestra.console:Power on for smithi026 completed 2023-07-20T11:23:17.707 INFO:teuthology.orchestra.console:Power on for smithi149 completed 2023-07-20T11:23:17.800 INFO:teuthology.provision.fog.smithi026:Waiting for deploy to finish 2023-07-20T11:23:17.801 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-20T11:23:17.807 INFO:teuthology.provision.fog.smithi149:Waiting for deploy to finish 2023-07-20T11:23:17.808 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T11:23:32.900 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T11:23:32.902 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-20T11:23:47.980 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-20T11:23:47.982 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T11:24:03.064 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T11:24:03.067 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-20T11:24:18.137 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-20T11:24:18.138 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T11:24:33.232 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T11:24:33.234 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-20T11:24:48.313 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T11:24:48.315 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-20T11:25:03.392 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-20T11:25:03.393 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T11:25:18.472 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-20T11:25:18.473 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T11:25:33.552 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T11:25:33.553 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-20T11:25:33.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T11:25:36.688 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-20T11:25:42.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T11:25:45.776 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-20T11:25:48.612 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T11:25:48.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T11:25:51.728 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-20T11:25:51.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T11:25:54.832 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-20T11:25:57.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T11:26:00.784 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-20T11:26:00.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T11:26:03.888 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-20T11:26:06.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T11:26:09.844 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-20T11:26:09.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T11:26:12.948 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-20T11:26:15.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T11:26:18.928 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-20T11:26:18.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T11:26:22.000 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-20T11:26:24.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T11:26:27.984 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-20T11:26:28.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T11:26:33.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T11:26:37.044 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-20T11:26:43.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T11:26:46.132 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-20T11:26:52.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T11:27:10.704 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-20T11:27:16.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T11:27:19.764 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-20T11:27:25.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T11:27:26.444 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-20T11:27:26.446 DEBUG:teuthology.orchestra.run.smithi149:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-20T11:27:28.003 WARNING:teuthology.provision.fog.smithi026:timed out 2023-07-20T11:27:34.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T11:27:34.234 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-20T11:27:34.235 DEBUG:teuthology.orchestra.run.smithi026:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-20T11:27:34.584 INFO:teuthology.provision.fog.smithi026:Node is ready 2023-07-20T11:27:34.585 DEBUG:teuthology.orchestra.run.smithi026:> hostname 2023-07-20T11:27:34.601 INFO:teuthology.orchestra.run.smithi026.stdout:smithi026.front.sepia.ceph.com 2023-07-20T11:27:34.601 DEBUG:teuthology.orchestra.run.smithi026:> grep smithi026.front.sepia.ceph.com /etc/hosts 2023-07-20T11:27:34.654 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26 smithi026.front.sepia.ceph.com smithi026 2023-07-20T11:27:34.655 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026 2023-07-20T11:27:34.781 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hosts 2023-07-20T11:27:34.815 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/172.21.15.26/172.21.15.26/g' /etc/hosts 2023-07-20T11:27:34.886 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hostname 2023-07-20T11:27:34.957 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026 2023-07-20T11:27:35.027 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2023-07-20T11:27:35.080 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Stream" 2023-07-20T11:27:35.080 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="9" 2023-07-20T11:27:35.080 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos" 2023-07-20T11:27:35.080 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora" 2023-07-20T11:27:35.081 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="9" 2023-07-20T11:27:35.081 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el9" 2023-07-20T11:27:35.081 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-20T11:27:35.081 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2023-07-20T11:27:35.081 INFO:teuthology.orchestra.run.smithi026.stdout:LOGO="fedora-logo-icon" 2023-07-20T11:27:35.081 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-20T11:27:35.081 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://centos.org/" 2023-07-20T11:27:35.082 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-20T11:27:35.082 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-20T11:27:35.082 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-20T11:27:35.082 INFO:teuthology.provision.fog.smithi026:Deploy complete! 2023-07-20T11:27:35.084 DEBUG:teuthology.parallel:result is None 2023-07-20T11:27:51.977 INFO:teuthology.provision.fog.smithi149:Node is ready 2023-07-20T11:27:51.977 DEBUG:teuthology.orchestra.run.smithi149:> hostname 2023-07-20T11:27:51.996 INFO:teuthology.orchestra.run.smithi149.stdout:smithi149.front.sepia.ceph.com 2023-07-20T11:27:51.997 DEBUG:teuthology.orchestra.run.smithi149:> grep smithi149.front.sepia.ceph.com /etc/hosts 2023-07-20T11:27:52.054 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.149 smithi149.front.sepia.ceph.com smithi149 2023-07-20T11:27:52.054 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149 2023-07-20T11:27:52.167 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hosts 2023-07-20T11:27:52.198 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/172.21.15.149/172.21.15.149/g' /etc/hosts 2023-07-20T11:27:52.268 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hostname 2023-07-20T11:27:52.337 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149 2023-07-20T11:27:52.405 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2023-07-20T11:27:52.461 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream" 2023-07-20T11:27:52.461 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="9" 2023-07-20T11:27:52.461 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos" 2023-07-20T11:27:52.461 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora" 2023-07-20T11:27:52.462 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="9" 2023-07-20T11:27:52.462 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el9" 2023-07-20T11:27:52.462 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-20T11:27:52.462 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2023-07-20T11:27:52.462 INFO:teuthology.orchestra.run.smithi149.stdout:LOGO="fedora-logo-icon" 2023-07-20T11:27:52.462 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-20T11:27:52.462 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/" 2023-07-20T11:27:52.463 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-20T11:27:52.463 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-20T11:27:52.463 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-20T11:27:52.463 INFO:teuthology.provision.fog.smithi149:Deploy complete! 2023-07-20T11:27:52.464 DEBUG:teuthology.parallel:result is None 2023-07-20T11:27:52.624 INFO:teuthology.lock.ops:Checking smithi026.front.sepia.ceph.com 2023-07-20T11:27:52.625 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-20T11:27:52.656 INFO:teuthology.lock.ops:Checking smithi149.front.sepia.ceph.com 2023-07-20T11:27:52.656 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-20T11:27:52.682 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: set os type and version on server 2023-07-20T11:27:52.682 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-07-20T11:27:52.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T11:27:52.780 DEBUG:teuthology.orchestra.run.smithi026:> true 2023-07-20T11:27:52.967 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-07-20T11:27:52.967 DEBUG:teuthology.orchestra.run.smithi026:> uname -m 2023-07-20T11:27:53.021 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64 2023-07-20T11:27:53.022 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2023-07-20T11:27:53.076 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Stream" 2023-07-20T11:27:53.077 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="9" 2023-07-20T11:27:53.077 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos" 2023-07-20T11:27:53.077 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora" 2023-07-20T11:27:53.077 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="9" 2023-07-20T11:27:53.077 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el9" 2023-07-20T11:27:53.077 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-20T11:27:53.077 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2023-07-20T11:27:53.078 INFO:teuthology.orchestra.run.smithi026.stdout:LOGO="fedora-logo-icon" 2023-07-20T11:27:53.078 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-20T11:27:53.078 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://centos.org/" 2023-07-20T11:27:53.078 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-20T11:27:53.078 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-20T11:27:53.078 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-20T11:27:53.079 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2023-07-20T11:27:53.106 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: set os type and version on server 2023-07-20T11:27:53.107 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-07-20T11:27:53.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T11:27:53.189 DEBUG:teuthology.orchestra.run.smithi149:> true 2023-07-20T11:27:53.265 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-07-20T11:27:53.265 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2023-07-20T11:27:53.321 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2023-07-20T11:27:53.322 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2023-07-20T11:27:53.377 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream" 2023-07-20T11:27:53.378 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="9" 2023-07-20T11:27:53.378 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos" 2023-07-20T11:27:53.378 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora" 2023-07-20T11:27:53.379 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="9" 2023-07-20T11:27:53.379 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el9" 2023-07-20T11:27:53.379 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-20T11:27:53.379 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2023-07-20T11:27:53.380 INFO:teuthology.orchestra.run.smithi149.stdout:LOGO="fedora-logo-icon" 2023-07-20T11:27:53.380 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-20T11:27:53.380 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/" 2023-07-20T11:27:53.381 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-20T11:27:53.381 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-20T11:27:53.381 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-20T11:27:53.382 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-07-20T11:27:53.406 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T11:27:53.407 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T11:27:53.511 INFO:teuthology.dispatcher.supervisor:Running job 7344641 2023-07-20T11:27:53.512 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-07-20_08:24:15-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7344641 --name vshankar-2023-07-20_08:24:15-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} -- /home/teuthworker/archive/vshankar-2023-07-20_08:24:15-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7344641/orig.config.yaml 2023-07-20T11:27:53.515 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-07-20_08:24:15-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7344641 2023-07-20T11:27:53.516 INFO:teuthology.dispatcher.supervisor:Job PID: 11831 2023-07-20T11:27:53.516 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-20T11:29:53.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T11:29:53.618 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T11:29:53.701 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-20T11:29:53.808 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-20T11:29:53.809 INFO:teuthology.nuke:Checking targets against current locks 2023-07-20T11:29:53.868 DEBUG:teuthology.nuke:shortname: smithi026 2023-07-20T11:29:53.869 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-20T11:29:53.886 DEBUG:teuthology.nuke:shortname: smithi149 2023-07-20T11:29:53.886 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-20T11:29:53.894 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-20_08:24:15-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7344641', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-20 11:22:59.494704', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAXQBalQIKQzgKYOtgypmVBJIYHKjn3v8GtQHae/Git0404B+y7kpURVPysXs/2E+2uGuQFYrd44jL3+DBb5c9U='} 2023-07-20T11:29:53.907 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-20_08:24:15-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7344641', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-20 11:22:59.492582', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG0aF+qSqnbGKrH0mlmzuTjOExYkCBYgq7Ap9g/L5OtNU+ZHNewJ86NotT5IjmhUXM0kxxN+kt8iQC+zHW+VWmE='} 2023-07-20T11:29:53.946 INFO:teuthology.orchestra.console:Power off smithi026 2023-07-20T11:29:53.947 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T11:29:53.961 INFO:teuthology.orchestra.console:Power off smithi149 2023-07-20T11:29:53.962 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T11:29:53.973 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T11:29:53.987 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T11:29:54.099 INFO:teuthology.orchestra.console:Power off for smithi026 completed 2023-07-20T11:29:54.110 INFO:teuthology.orchestra.console:Power off for smithi149 completed 2023-07-20T11:29:54.265 INFO:teuthology.lock.ops:unlocked: smithi026.front.sepia.ceph.com 2023-07-20T11:29:54.274 INFO:teuthology.lock.ops:unlocked: smithi149.front.sepia.ceph.com