2023-10-21T10:18:43.082 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-21T10:18:43.084 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T10:18:43.223 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9d803c6670>, signals=[15]) 2023-10-21T10:18:43.225 INFO:teuthology.lock.ops:Start node 'smithi062.front.sepia.ceph.com' reimaging 2023-10-21T10:18:43.225 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: reset os type and version on server 2023-10-21T10:18:43.226 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2023-10-21T10:18:43.283 INFO:teuthology.lock.ops:Start node 'smithi155.front.sepia.ceph.com' reimaging 2023-10-21T10:18:43.283 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: reset os type and version on server 2023-10-21T10:18:43.283 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2023-10-21T10:18:43.285 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /host {"name": "smithi062"} 2023-10-21T10:18:43.305 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /host {"name": "smithi155"} 2023-10-21T10:18:43.357 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-21T10:18:43.371 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-21T10:18:43.396 DEBUG:teuthology.provision.fog.smithi062:Requesting image smithi_centos_9.stream (ID 10) 2023-10-21T10:18:43.396 DEBUG:teuthology.provision.fog.smithi062:FOG request: PUT /host/167 {"imageID": 10} 2023-10-21T10:18:43.420 DEBUG:teuthology.provision.fog.smithi155:Requesting image smithi_centos_9.stream (ID 10) 2023-10-21T10:18:43.421 DEBUG:teuthology.provision.fog.smithi155:FOG request: PUT /host/260 {"imageID": 10} 2023-10-21T10:18:43.436 INFO:teuthology.provision.fog.smithi062:Scheduling deploy of centos 9.stream 2023-10-21T10:18:43.436 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-21T10:18:43.480 INFO:teuthology.provision.fog.smithi155:Scheduling deploy of centos 9.stream 2023-10-21T10:18:43.480 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-10-21T10:18:43.509 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /tasktype {"name": "deploy"} 2023-10-21T10:18:43.536 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /tasktype {"name": "deploy"} 2023-10-21T10:18:43.545 DEBUG:teuthology.provision.fog.smithi062:FOG request: POST /host/167/task {"taskTypeID": 1} 2023-10-21T10:18:43.576 DEBUG:teuthology.provision.fog.smithi155:FOG request: POST /host/260/task {"taskTypeID": 1} 2023-10-21T10:18:43.599 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-21T10:18:43.625 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-10-21T10:18:43.698 INFO:teuthology.orchestra.console.smithi062:Power off 2023-10-21T10:18:43.699 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T10:18:43.717 INFO:teuthology.orchestra.console.smithi155:Power off 2023-10-21T10:18:43.718 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T10:18:43.730 DEBUG:teuthology.orchestra.console.smithi062:power off output: Chassis Power Control: Down/Off 2023-10-21T10:18:43.731 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T10:18:43.745 DEBUG:teuthology.orchestra.console.smithi155:power off output: Chassis Power Control: Down/Off 2023-10-21T10:18:43.745 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T10:18:43.754 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2023-10-21T10:18:43.766 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2023-10-21T10:18:43.855 INFO:teuthology.orchestra.console.smithi062:Power off completed 2023-10-21T10:18:43.867 INFO:teuthology.orchestra.console.smithi155:Power off completed 2023-10-21T10:18:43.957 INFO:teuthology.orchestra.console.smithi062:Power on 2023-10-21T10:18:43.958 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-21T10:18:43.969 INFO:teuthology.orchestra.console.smithi155:Power on 2023-10-21T10:18:43.970 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-21T10:18:43.983 DEBUG:teuthology.orchestra.console.smithi062:power on output: Chassis Power Control: Up/On 2023-10-21T10:18:43.984 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T10:18:43.993 DEBUG:teuthology.orchestra.console.smithi155:power on output: Chassis Power Control: Up/On 2023-10-21T10:18:43.993 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T10:18:44.006 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2023-10-21T10:18:44.017 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2023-10-21T10:18:48.010 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T10:18:48.019 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T10:18:48.121 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2023-10-21T10:18:48.130 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2023-10-21T10:18:52.126 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T10:18:52.133 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T10:18:52.236 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on 2023-10-21T10:18:52.241 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on 2023-10-21T10:18:52.338 INFO:teuthology.orchestra.console.smithi062:Power on completed 2023-10-21T10:18:52.345 INFO:teuthology.orchestra.console.smithi155:Power on completed 2023-10-21T10:18:52.439 INFO:teuthology.provision.fog.smithi062:Waiting for deploy to finish 2023-10-21T10:18:52.439 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-21T10:18:52.447 INFO:teuthology.provision.fog.smithi155:Waiting for deploy to finish 2023-10-21T10:18:52.447 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-10-21T10:19:07.522 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-21T10:19:07.524 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-10-21T10:19:22.622 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-21T10:19:22.624 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-10-21T10:19:37.706 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-10-21T10:19:37.708 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-21T10:19:52.800 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-10-21T10:19:52.802 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-21T10:20:07.902 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-10-21T10:20:07.904 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-21T10:20:23.006 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-21T10:20:23.008 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-10-21T10:20:38.095 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-21T10:20:38.099 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-10-21T10:20:53.194 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-10-21T10:20:53.196 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-21T10:21:08.308 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-10-21T10:21:08.309 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-21T10:21:23.430 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-10-21T10:21:23.432 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-21T10:21:23.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:21:38.526 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-10-21T10:21:38.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:21:41.886 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-10-21T10:21:47.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:21:50.970 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-10-21T10:21:56.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:21:56.990 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-10-21T10:22:00.030 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-10-21T10:22:02.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:22:06.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:22:06.074 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-10-21T10:22:09.118 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-10-21T10:22:12.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:22:15.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:22:15.130 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-10-21T10:22:18.202 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-10-21T10:22:21.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:22:24.186 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-10-21T10:22:24.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:22:30.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:22:33.274 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-10-21T10:22:39.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:22:42.334 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-10-21T10:22:42.554 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-10-21T10:22:48.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:22:48.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:22:51.614 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-10-21T10:22:57.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:23:00.698 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-10-21T10:23:06.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:23:07.060 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-21T10:23:07.061 DEBUG:teuthology.orchestra.run.smithi062:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-21T10:23:22.591 INFO:teuthology.provision.fog.smithi062:Node is ready 2023-10-21T10:23:22.592 DEBUG:teuthology.orchestra.run.smithi062:> hostname 2023-10-21T10:23:22.651 INFO:teuthology.orchestra.run.smithi062.stdout:smithi062.front.sepia.ceph.com 2023-10-21T10:23:22.652 DEBUG:teuthology.orchestra.run.smithi062:> grep smithi062.front.sepia.ceph.com /etc/hosts 2023-10-21T10:23:22.710 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62 smithi062.front.sepia.ceph.com smithi062 2023-10-21T10:23:22.710 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062 2023-10-21T10:23:22.848 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062.front.sepia.ceph.com/smithi062/g' /etc/hosts 2023-10-21T10:23:22.883 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/172.21.15.62/172.21.15.62/g' /etc/hosts 2023-10-21T10:23:22.957 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062.front.sepia.ceph.com/smithi062/g' /etc/hostname 2023-10-21T10:23:23.030 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062 2023-10-21T10:23:23.102 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2023-10-21T10:23:23.158 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream" 2023-10-21T10:23:23.158 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="9" 2023-10-21T10:23:23.159 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos" 2023-10-21T10:23:23.159 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora" 2023-10-21T10:23:23.159 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="9" 2023-10-21T10:23:23.159 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el9" 2023-10-21T10:23:23.159 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-21T10:23:23.160 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2023-10-21T10:23:23.160 INFO:teuthology.orchestra.run.smithi062.stdout:LOGO="fedora-logo-icon" 2023-10-21T10:23:23.160 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-21T10:23:23.160 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/" 2023-10-21T10:23:23.160 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T10:23:23.161 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-21T10:23:23.161 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-21T10:23:23.161 INFO:teuthology.provision.fog.smithi062:Deploy complete! 2023-10-21T10:23:23.163 DEBUG:teuthology.parallel:result is None 2023-10-21T10:23:48.346 WARNING:teuthology.provision.fog.smithi155:timed out 2023-10-21T10:23:54.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:23:54.980 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-21T10:23:54.981 DEBUG:teuthology.orchestra.run.smithi155:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-21T10:23:55.317 INFO:teuthology.provision.fog.smithi155:Node is ready 2023-10-21T10:23:55.318 DEBUG:teuthology.orchestra.run.smithi155:> hostname 2023-10-21T10:23:55.333 INFO:teuthology.orchestra.run.smithi155.stdout:smithi155.front.sepia.ceph.com 2023-10-21T10:23:55.333 DEBUG:teuthology.orchestra.run.smithi155:> grep smithi155.front.sepia.ceph.com /etc/hosts 2023-10-21T10:23:55.388 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155 smithi155.front.sepia.ceph.com smithi155 2023-10-21T10:23:55.388 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname smithi155 2023-10-21T10:23:55.488 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/smithi155.front.sepia.ceph.com/smithi155/g' /etc/hosts 2023-10-21T10:23:55.517 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/172.21.15.155/172.21.15.155/g' /etc/hosts 2023-10-21T10:23:55.585 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/smithi155.front.sepia.ceph.com/smithi155/g' /etc/hostname 2023-10-21T10:23:55.653 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname smithi155 2023-10-21T10:23:55.719 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2023-10-21T10:23:55.774 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Stream" 2023-10-21T10:23:55.775 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="9" 2023-10-21T10:23:55.775 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos" 2023-10-21T10:23:55.775 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora" 2023-10-21T10:23:55.775 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="9" 2023-10-21T10:23:55.776 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el9" 2023-10-21T10:23:55.776 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-21T10:23:55.776 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31" 2023-10-21T10:23:55.776 INFO:teuthology.orchestra.run.smithi155.stdout:LOGO="fedora-logo-icon" 2023-10-21T10:23:55.776 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-21T10:23:55.776 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/" 2023-10-21T10:23:55.777 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T10:23:55.777 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-21T10:23:55.777 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-21T10:23:55.777 INFO:teuthology.provision.fog.smithi155:Deploy complete! 2023-10-21T10:23:55.778 DEBUG:teuthology.parallel:result is None 2023-10-21T10:23:55.950 INFO:teuthology.lock.ops:Checking smithi062.front.sepia.ceph.com 2023-10-21T10:23:55.950 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-21T10:23:55.980 INFO:teuthology.lock.ops:Checking smithi155.front.sepia.ceph.com 2023-10-21T10:23:55.980 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-21T10:23:55.997 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: set os type and version on server 2023-10-21T10:23:55.998 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-10-21T10:23:55.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:23:56.098 DEBUG:teuthology.orchestra.run.smithi062:> true 2023-10-21T10:23:56.171 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-10-21T10:23:56.171 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2023-10-21T10:23:56.228 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2023-10-21T10:23:56.229 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2023-10-21T10:23:56.285 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream" 2023-10-21T10:23:56.285 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="9" 2023-10-21T10:23:56.285 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos" 2023-10-21T10:23:56.286 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora" 2023-10-21T10:23:56.286 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="9" 2023-10-21T10:23:56.286 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el9" 2023-10-21T10:23:56.286 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-21T10:23:56.286 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2023-10-21T10:23:56.287 INFO:teuthology.orchestra.run.smithi062.stdout:LOGO="fedora-logo-icon" 2023-10-21T10:23:56.287 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-21T10:23:56.287 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/" 2023-10-21T10:23:56.287 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T10:23:56.287 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-21T10:23:56.288 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-21T10:23:56.288 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2023-10-21T10:23:56.322 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: set os type and version on server 2023-10-21T10:23:56.322 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-10-21T10:23:56.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:23:56.403 DEBUG:teuthology.orchestra.run.smithi155:> true 2023-10-21T10:23:56.472 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-10-21T10:23:56.472 DEBUG:teuthology.orchestra.run.smithi155:> uname -m 2023-10-21T10:23:56.525 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2023-10-21T10:23:56.526 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2023-10-21T10:23:56.577 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Stream" 2023-10-21T10:23:56.578 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="9" 2023-10-21T10:23:56.578 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos" 2023-10-21T10:23:56.578 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora" 2023-10-21T10:23:56.579 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="9" 2023-10-21T10:23:56.579 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el9" 2023-10-21T10:23:56.579 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-21T10:23:56.579 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31" 2023-10-21T10:23:56.579 INFO:teuthology.orchestra.run.smithi155.stdout:LOGO="fedora-logo-icon" 2023-10-21T10:23:56.580 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-21T10:23:56.580 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/" 2023-10-21T10:23:56.580 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T10:23:56.580 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-21T10:23:56.580 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-21T10:23:56.581 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2023-10-21T10:23:56.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T10:23:56.705 INFO:teuthology.dispatcher.supervisor:Running job 7433903 2023-10-21T10:23:56.706 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-20_18:40:51-rados-main-distro-default-smithi/7433903 --name yuriw-2023-10-20_18:40:51-rados-main-distro-default-smithi --description rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/force-sync-many workloads/rados_api_tests} -- /home/teuthworker/archive/yuriw-2023-10-20_18:40:51-rados-main-distro-default-smithi/7433903/orig.config.yaml 2023-10-21T10:23:56.709 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-20_18:40:51-rados-main-distro-default-smithi/7433903 2023-10-21T10:23:56.710 INFO:teuthology.dispatcher.supervisor:Job PID: 3233238 2023-10-21T10:23:56.710 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-21T10:25:56.810 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T10:27:56.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T10:29:57.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T10:31:57.308 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T10:33:57.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T10:35:57.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T10:35:57.719 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-21T10:35:57.822 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-21T10:35:57.823 INFO:teuthology.nuke:Checking targets against current locks 2023-10-21T10:35:57.871 DEBUG:teuthology.nuke:shortname: smithi062 2023-10-21T10:35:57.872 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-21T10:35:57.900 DEBUG:teuthology.nuke:shortname: smithi155 2023-10-21T10:35:57.901 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-21T10:35:57.902 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-20_18:40:51-rados-main-distro-default-smithi/7433903', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-21 10:18:42.264572', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAj3zrKcrS+h3nZZjhKJusiXn7Bnn6R1B2bDq+4LoAe02pJXy0rgKtcaWkOioCRNpqDfOyRrhC4HS9z09ZaLHvk='} 2023-10-21T10:35:57.924 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-20_18:40:51-rados-main-distro-default-smithi/7433903', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-21 10:18:42.266515', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAnj87ckGnDa3OmDpQE1d56qaeqgoMCds7L57QrlL0peFCswcD2a1oaOYMQnD2O7QW7Mfw2a69Re5jgzKZCk3lw='} 2023-10-21T10:35:57.957 INFO:teuthology.orchestra.console.smithi062:Power off 2023-10-21T10:35:57.958 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T10:35:57.979 DEBUG:teuthology.orchestra.console.smithi062:power off output: Chassis Power Control: Down/Off 2023-10-21T10:35:57.980 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T10:35:57.994 INFO:teuthology.orchestra.console.smithi155:Power off 2023-10-21T10:35:57.994 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T10:35:58.004 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2023-10-21T10:35:58.016 DEBUG:teuthology.orchestra.console.smithi155:power off output: Chassis Power Control: Down/Off 2023-10-21T10:35:58.017 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T10:35:58.039 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2023-10-21T10:35:58.105 INFO:teuthology.orchestra.console.smithi062:Power off completed 2023-10-21T10:35:58.141 INFO:teuthology.orchestra.console.smithi155:Power off completed 2023-10-21T10:35:58.258 INFO:teuthology.lock.ops:unlocked: smithi062.front.sepia.ceph.com 2023-10-21T10:35:58.291 INFO:teuthology.lock.ops:unlocked: smithi155.front.sepia.ceph.com