2023-11-07T09:35:34.107 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-07T09:35:34.108 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-07T09:35:34.250 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb5a72a2b80>, signals=[15]) 2023-11-07T09:35:34.251 INFO:teuthology.lock.ops:Start node 'smithi073.front.sepia.ceph.com' reimaging 2023-11-07T09:35:34.252 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: reset os type and version on server 2023-11-07T09:35:34.252 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2023-11-07T09:35:34.279 INFO:teuthology.lock.ops:Start node 'smithi187.front.sepia.ceph.com' reimaging 2023-11-07T09:35:34.280 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: reset os type and version on server 2023-11-07T09:35:34.280 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2023-11-07T09:35:34.282 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /host {"name": "smithi073"} 2023-11-07T09:35:34.312 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /host {"name": "smithi187"} 2023-11-07T09:35:34.376 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-11-07T09:35:34.380 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-11-07T09:35:34.416 DEBUG:teuthology.provision.fog.smithi073:Requesting image smithi_centos_9.stream (ID 10) 2023-11-07T09:35:34.416 DEBUG:teuthology.provision.fog.smithi073:FOG request: PUT /host/178 {"imageID": 10} 2023-11-07T09:35:34.424 DEBUG:teuthology.provision.fog.smithi187:Requesting image smithi_centos_9.stream (ID 10) 2023-11-07T09:35:34.425 DEBUG:teuthology.provision.fog.smithi187:FOG request: PUT /host/292 {"imageID": 10} 2023-11-07T09:35:34.468 INFO:teuthology.provision.fog.smithi073:Scheduling deploy of centos 9.stream 2023-11-07T09:35:34.468 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-11-07T09:35:34.472 INFO:teuthology.provision.fog.smithi187:Scheduling deploy of centos 9.stream 2023-11-07T09:35:34.473 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-11-07T09:35:34.519 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /tasktype {"name": "deploy"} 2023-11-07T09:35:34.523 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /tasktype {"name": "deploy"} 2023-11-07T09:35:34.557 DEBUG:teuthology.provision.fog.smithi187:FOG request: POST /host/292/task {"taskTypeID": 1} 2023-11-07T09:35:34.565 DEBUG:teuthology.provision.fog.smithi073:FOG request: POST /host/178/task {"taskTypeID": 1} 2023-11-07T09:35:34.618 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-11-07T09:35:34.626 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-11-07T09:35:34.706 INFO:teuthology.orchestra.console.smithi073:Power off 2023-11-07T09:35:34.707 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-07T09:35:34.724 INFO:teuthology.orchestra.console.smithi187:Power off 2023-11-07T09:35:34.725 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-07T09:35:34.734 DEBUG:teuthology.orchestra.console.smithi073:power off output: Chassis Power Control: Down/Off 2023-11-07T09:35:34.736 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-07T09:35:34.746 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off 2023-11-07T09:35:34.747 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-07T09:35:34.758 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2023-11-07T09:35:34.769 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-11-07T09:35:34.870 INFO:teuthology.orchestra.console.smithi187:Power off completed 2023-11-07T09:35:34.971 INFO:teuthology.orchestra.console.smithi187:Power on 2023-11-07T09:35:34.972 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-07T09:35:34.996 DEBUG:teuthology.orchestra.console.smithi187:power on output: Chassis Power Control: Up/On 2023-11-07T09:35:34.997 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-07T09:35:35.018 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-11-07T09:35:38.762 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-07T09:35:38.872 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2023-11-07T09:35:39.020 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-07T09:35:39.128 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-11-07T09:35:39.229 INFO:teuthology.orchestra.console.smithi187:Power on completed 2023-11-07T09:35:39.330 INFO:teuthology.provision.fog.smithi187:Waiting for deploy to finish 2023-11-07T09:35:39.331 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-11-07T09:35:42.878 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-07T09:35:42.987 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2023-11-07T09:35:46.990 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-07T09:35:47.099 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2023-11-07T09:35:47.200 INFO:teuthology.orchestra.console.smithi073:Power off completed 2023-11-07T09:35:47.301 INFO:teuthology.orchestra.console.smithi073:Power on 2023-11-07T09:35:47.301 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-07T09:35:47.323 DEBUG:teuthology.orchestra.console.smithi073:power on output: Chassis Power Control: Up/On 2023-11-07T09:35:47.324 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-07T09:35:47.345 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2023-11-07T09:35:51.349 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-07T09:35:51.457 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2023-11-07T09:35:51.558 INFO:teuthology.orchestra.console.smithi073:Power on completed 2023-11-07T09:35:51.659 INFO:teuthology.provision.fog.smithi073:Waiting for deploy to finish 2023-11-07T09:35:51.660 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-11-07T09:35:54.394 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-11-07T09:36:06.721 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-11-07T09:36:09.454 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-11-07T09:36:21.794 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-11-07T09:36:24.509 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-11-07T09:36:36.858 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-11-07T09:36:39.559 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-11-07T09:36:51.918 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-11-07T09:36:54.623 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-11-07T09:37:06.982 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-11-07T09:37:09.685 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-11-07T09:37:22.046 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-11-07T09:37:24.746 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-11-07T09:37:37.126 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-11-07T09:37:39.816 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-11-07T09:37:52.203 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-11-07T09:37:54.887 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-11-07T09:38:07.290 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-11-07T09:38:09.957 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-11-07T09:38:10.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-07T09:38:13.118 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-11-07T09:38:19.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-07T09:38:22.202 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-11-07T09:38:22.388 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-11-07T09:38:28.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-07T09:38:31.258 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-11-07T09:38:37.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-07T09:38:37.453 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-11-07T09:38:37.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-07T09:38:40.315 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-11-07T09:38:40.570 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-11-07T09:38:46.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-07T09:38:46.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-07T09:38:49.406 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-11-07T09:38:49.626 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-11-07T09:38:55.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-07T09:38:55.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-07T09:38:58.494 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-11-07T09:38:58.682 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-11-07T09:39:04.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-07T09:39:04.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-07T09:39:07.742 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-11-07T09:39:13.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-07T09:39:16.826 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-11-07T09:39:22.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-07T09:39:25.882 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-11-07T09:39:31.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-07T09:40:04.531 WARNING:teuthology.provision.fog.smithi187:timed out 2023-11-07T09:40:10.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-07T09:40:10.792 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-07T09:40:10.793 DEBUG:teuthology.orchestra.run.smithi187:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-07T09:40:11.174 INFO:teuthology.provision.fog.smithi187:Node is ready 2023-11-07T09:40:11.175 DEBUG:teuthology.orchestra.run.smithi187:> hostname 2023-11-07T09:40:11.191 INFO:teuthology.orchestra.run.smithi187.stdout:smithi187.front.sepia.ceph.com 2023-11-07T09:40:11.191 DEBUG:teuthology.orchestra.run.smithi187:> grep smithi187.front.sepia.ceph.com /etc/hosts 2023-11-07T09:40:11.247 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.15.187 smithi187.front.sepia.ceph.com smithi187 2023-11-07T09:40:11.247 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2023-11-07T09:40:11.365 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hosts 2023-11-07T09:40:11.395 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/172.21.15.187/172.21.15.187/g' /etc/hosts 2023-11-07T09:40:11.464 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hostname 2023-11-07T09:40:11.532 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2023-11-07T09:40:11.599 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2023-11-07T09:40:11.654 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream" 2023-11-07T09:40:11.654 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="9" 2023-11-07T09:40:11.654 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos" 2023-11-07T09:40:11.655 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora" 2023-11-07T09:40:11.655 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="9" 2023-11-07T09:40:11.655 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el9" 2023-11-07T09:40:11.655 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-07T09:40:11.655 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2023-11-07T09:40:11.656 INFO:teuthology.orchestra.run.smithi187.stdout:LOGO="fedora-logo-icon" 2023-11-07T09:40:11.656 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-07T09:40:11.656 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/" 2023-11-07T09:40:11.656 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-07T09:40:11.656 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-07T09:40:11.657 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-07T09:40:11.657 INFO:teuthology.provision.fog.smithi187:Deploy complete! 2023-11-07T09:40:11.659 DEBUG:teuthology.parallel:result is None 2023-11-07T09:40:31.906 WARNING:teuthology.provision.fog.smithi073:timed out 2023-11-07T09:40:37.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-07T09:40:38.097 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-07T09:40:38.098 DEBUG:teuthology.orchestra.run.smithi073:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-07T09:40:38.411 INFO:teuthology.provision.fog.smithi073:Node is ready 2023-11-07T09:40:38.411 DEBUG:teuthology.orchestra.run.smithi073:> hostname 2023-11-07T09:40:38.425 INFO:teuthology.orchestra.run.smithi073.stdout:smithi073.front.sepia.ceph.com 2023-11-07T09:40:38.426 DEBUG:teuthology.orchestra.run.smithi073:> grep smithi073.front.sepia.ceph.com /etc/hosts 2023-11-07T09:40:38.481 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73 smithi073.front.sepia.ceph.com smithi073 2023-11-07T09:40:38.482 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname smithi073 2023-11-07T09:40:38.602 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi073.front.sepia.ceph.com/smithi073/g' /etc/hosts 2023-11-07T09:40:38.630 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/172.21.15.73/172.21.15.73/g' /etc/hosts 2023-11-07T09:40:38.697 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi073.front.sepia.ceph.com/smithi073/g' /etc/hostname 2023-11-07T09:40:38.764 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname smithi073 2023-11-07T09:40:38.831 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2023-11-07T09:40:38.885 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream" 2023-11-07T09:40:38.886 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="9" 2023-11-07T09:40:38.886 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2023-11-07T09:40:38.886 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2023-11-07T09:40:38.886 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="9" 2023-11-07T09:40:38.887 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el9" 2023-11-07T09:40:38.887 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-07T09:40:38.887 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2023-11-07T09:40:38.887 INFO:teuthology.orchestra.run.smithi073.stdout:LOGO="fedora-logo-icon" 2023-11-07T09:40:38.887 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-07T09:40:38.888 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/" 2023-11-07T09:40:38.888 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-07T09:40:38.888 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-07T09:40:38.888 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-07T09:40:38.889 INFO:teuthology.provision.fog.smithi073:Deploy complete! 2023-11-07T09:40:38.889 DEBUG:teuthology.parallel:result is None 2023-11-07T09:40:39.057 INFO:teuthology.lock.ops:Checking smithi073.front.sepia.ceph.com 2023-11-07T09:40:39.058 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-07T09:40:39.076 INFO:teuthology.lock.ops:Checking smithi187.front.sepia.ceph.com 2023-11-07T09:40:39.077 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-07T09:40:39.103 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: set os type and version on server 2023-11-07T09:40:39.103 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-11-07T09:40:39.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-07T09:40:39.186 DEBUG:teuthology.orchestra.run.smithi073:> true 2023-11-07T09:40:39.252 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-11-07T09:40:39.252 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2023-11-07T09:40:39.306 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2023-11-07T09:40:39.306 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2023-11-07T09:40:39.360 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream" 2023-11-07T09:40:39.361 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="9" 2023-11-07T09:40:39.361 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2023-11-07T09:40:39.361 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2023-11-07T09:40:39.361 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="9" 2023-11-07T09:40:39.362 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el9" 2023-11-07T09:40:39.362 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-07T09:40:39.362 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2023-11-07T09:40:39.362 INFO:teuthology.orchestra.run.smithi073.stdout:LOGO="fedora-logo-icon" 2023-11-07T09:40:39.363 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-07T09:40:39.363 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/" 2023-11-07T09:40:39.363 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-07T09:40:39.363 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-07T09:40:39.363 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-07T09:40:39.364 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2023-11-07T09:40:39.386 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: set os type and version on server 2023-11-07T09:40:39.386 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-11-07T09:40:39.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-07T09:40:39.469 DEBUG:teuthology.orchestra.run.smithi187:> true 2023-11-07T09:40:39.640 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-11-07T09:40:39.641 DEBUG:teuthology.orchestra.run.smithi187:> uname -m 2023-11-07T09:40:39.696 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2023-11-07T09:40:39.696 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2023-11-07T09:40:39.750 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream" 2023-11-07T09:40:39.751 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="9" 2023-11-07T09:40:39.751 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos" 2023-11-07T09:40:39.751 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora" 2023-11-07T09:40:39.751 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="9" 2023-11-07T09:40:39.752 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el9" 2023-11-07T09:40:39.752 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-07T09:40:39.752 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2023-11-07T09:40:39.752 INFO:teuthology.orchestra.run.smithi187.stdout:LOGO="fedora-logo-icon" 2023-11-07T09:40:39.752 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-07T09:40:39.753 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/" 2023-11-07T09:40:39.753 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-07T09:40:39.753 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-07T09:40:39.753 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-07T09:40:39.754 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2023-11-07T09:40:39.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-07T09:40:39.859 INFO:teuthology.dispatcher.supervisor:Running job 7450698 2023-11-07T09:40:39.860 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_nmordech@teuthology --archive /home/teuthworker/archive/nmordech-2023-11-07_09:30:35-rados:thrash-dedup-main-distro-default-smithi/7450698 --name nmordech-2023-11-07_09:30:35-rados:thrash-dedup-main-distro-default-smithi --description rados:thrash-dedup/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/dedup-io-mixed} -- /home/teuthworker/archive/nmordech-2023-11-07_09:30:35-rados:thrash-dedup-main-distro-default-smithi/7450698/orig.config.yaml 2023-11-07T09:40:39.862 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/nmordech-2023-11-07_09:30:35-rados:thrash-dedup-main-distro-default-smithi/7450698 2023-11-07T09:40:39.863 INFO:teuthology.dispatcher.supervisor:Job PID: 1515009 2023-11-07T09:40:39.863 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-07T09:42:39.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-07T09:44:40.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-07T09:46:40.310 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-07T09:48:40.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-07T09:50:40.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-07T09:52:40.808 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-07T09:54:40.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-07T09:56:41.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-07T09:58:41.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-07T10:00:41.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-07T10:02:41.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-07T10:04:41.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-07T10:06:42.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-07T10:08:42.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-07T10:10:42.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-07T10:10:42.422 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-07T10:10:42.529 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-07T10:10:42.530 INFO:teuthology.nuke:Checking targets against current locks 2023-11-07T10:10:42.575 DEBUG:teuthology.nuke:shortname: smithi073 2023-11-07T10:10:42.575 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-07T10:10:42.597 DEBUG:teuthology.nuke:shortname: smithi187 2023-11-07T10:10:42.598 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-07T10:10:42.601 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/nmordech-2023-11-07_09:30:35-rados:thrash-dedup-main-distro-default-smithi/7450698', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-07 09:35:33.272305', 'locked_by': 'scheduled_nmordech@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIt7UqDuJ8DIFzxj7IpBQBqUkHPggprQtebGfW/CPlooQWmHLLxPIL0L8AtpLPKXgfqiamGt9pcGcNPUxp6AazM='} 2023-11-07T10:10:42.621 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/nmordech-2023-11-07_09:30:35-rados:thrash-dedup-main-distro-default-smithi/7450698', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-07 09:35:33.274535', 'locked_by': 'scheduled_nmordech@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJUOefk0H2qoCttbDkj64nq9DyhBB/NzqBy73jVzZqj6VH3It5ERA3RQ+vPdAtedjfLrtkAqFUX43K5LOtUy7O4='} 2023-11-07T10:10:42.647 INFO:teuthology.orchestra.console.smithi073:Power off 2023-11-07T10:10:42.647 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-07T10:10:42.667 DEBUG:teuthology.orchestra.console.smithi073:power off output: Chassis Power Control: Down/Off 2023-11-07T10:10:42.668 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-07T10:10:42.680 INFO:teuthology.orchestra.console.smithi187:Power off 2023-11-07T10:10:42.681 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-07T10:10:42.689 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2023-11-07T10:10:42.702 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off 2023-11-07T10:10:42.703 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-07T10:10:42.723 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-11-07T10:10:42.790 INFO:teuthology.orchestra.console.smithi073:Power off completed 2023-11-07T10:10:42.825 INFO:teuthology.orchestra.console.smithi187:Power off completed 2023-11-07T10:10:42.938 INFO:teuthology.lock.ops:unlocked: smithi073.front.sepia.ceph.com 2023-11-07T10:10:42.971 INFO:teuthology.lock.ops:unlocked: smithi187.front.sepia.ceph.com