2023-08-19T11:22:23.705 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-19T11:22:23.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-19T11:22:23.858 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f49f042f310>, signals=[15]) 2023-08-19T11:22:23.859 INFO:teuthology.lock.ops:Start node 'smithi136.front.sepia.ceph.com' reimaging 2023-08-19T11:22:23.860 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: reset os type and version on server 2023-08-19T11:22:23.860 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2023-08-19T11:22:23.893 INFO:teuthology.lock.ops:Start node 'smithi170.front.sepia.ceph.com' reimaging 2023-08-19T11:22:23.893 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: reset os type and version on server 2023-08-19T11:22:23.894 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2023-08-19T11:22:23.895 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /host {"name": "smithi136"} 2023-08-19T11:22:23.916 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /host {"name": "smithi170"} 2023-08-19T11:22:23.958 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-19T11:22:23.984 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-19T11:22:24.001 DEBUG:teuthology.provision.fog.smithi136:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-19T11:22:24.002 DEBUG:teuthology.provision.fog.smithi136:FOG request: PUT /host/241 {"imageID": 5} 2023-08-19T11:22:24.023 DEBUG:teuthology.provision.fog.smithi170:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-19T11:22:24.024 DEBUG:teuthology.provision.fog.smithi170:FOG request: PUT /host/275 {"imageID": 5} 2023-08-19T11:22:24.046 INFO:teuthology.provision.fog.smithi136:Scheduling deploy of rhel 8.6 2023-08-19T11:22:24.046 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-08-19T11:22:24.067 INFO:teuthology.provision.fog.smithi170:Scheduling deploy of rhel 8.6 2023-08-19T11:22:24.067 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-08-19T11:22:24.100 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /tasktype {"name": "deploy"} 2023-08-19T11:22:24.107 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /tasktype {"name": "deploy"} 2023-08-19T11:22:24.137 DEBUG:teuthology.provision.fog.smithi136:FOG request: POST /host/241/task {"taskTypeID": 1} 2023-08-19T11:22:24.140 DEBUG:teuthology.provision.fog.smithi170:FOG request: POST /host/275/task {"taskTypeID": 1} 2023-08-19T11:22:24.185 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-08-19T11:22:24.189 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-08-19T11:22:24.273 INFO:teuthology.orchestra.console.smithi170:Power off 2023-08-19T11:22:24.274 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-19T11:22:24.296 INFO:teuthology.orchestra.console.smithi136:Power off 2023-08-19T11:22:24.297 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-19T11:22:24.308 DEBUG:teuthology.orchestra.console.smithi170:power off output: Chassis Power Control: Down/Off 2023-08-19T11:22:24.309 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-19T11:22:24.321 DEBUG:teuthology.orchestra.console.smithi136:power off output: Chassis Power Control: Down/Off 2023-08-19T11:22:24.322 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-19T11:22:24.336 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2023-08-19T11:22:24.344 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2023-08-19T11:22:28.340 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-19T11:22:28.350 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-19T11:22:28.452 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2023-08-19T11:22:28.462 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2023-08-19T11:22:32.457 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-19T11:22:32.466 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-19T11:22:32.568 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2023-08-19T11:22:32.577 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2023-08-19T11:22:32.670 INFO:teuthology.orchestra.console.smithi170:Power off completed 2023-08-19T11:22:32.679 INFO:teuthology.orchestra.console.smithi136:Power off completed 2023-08-19T11:22:32.774 INFO:teuthology.orchestra.console.smithi170:Power on 2023-08-19T11:22:32.775 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-19T11:22:32.789 INFO:teuthology.orchestra.console.smithi136:Power on 2023-08-19T11:22:32.790 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-19T11:22:32.802 DEBUG:teuthology.orchestra.console.smithi170:power on output: Chassis Power Control: Up/On 2023-08-19T11:22:32.804 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-19T11:22:32.818 DEBUG:teuthology.orchestra.console.smithi136:power on output: Chassis Power Control: Up/On 2023-08-19T11:22:32.819 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-19T11:22:32.830 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2023-08-19T11:22:32.844 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2023-08-19T11:22:36.832 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-19T11:22:36.845 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-19T11:22:36.945 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2023-08-19T11:22:36.958 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2023-08-19T11:22:40.948 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-19T11:22:40.959 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-19T11:22:41.059 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2023-08-19T11:22:41.071 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2023-08-19T11:22:41.161 INFO:teuthology.orchestra.console.smithi170:Power on completed 2023-08-19T11:22:41.173 INFO:teuthology.orchestra.console.smithi136:Power on completed 2023-08-19T11:22:41.262 INFO:teuthology.provision.fog.smithi170:Waiting for deploy to finish 2023-08-19T11:22:41.263 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-08-19T11:22:41.273 INFO:teuthology.provision.fog.smithi136:Waiting for deploy to finish 2023-08-19T11:22:41.274 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-08-19T11:22:56.333 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-08-19T11:22:56.335 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-08-19T11:23:11.408 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-08-19T11:23:11.409 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-08-19T11:23:26.480 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-08-19T11:23:26.481 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-08-19T11:23:41.556 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-08-19T11:23:41.558 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-08-19T11:23:56.628 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-08-19T11:23:56.629 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-08-19T11:24:11.704 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-08-19T11:24:11.706 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-08-19T11:24:26.782 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-08-19T11:24:26.784 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-08-19T11:24:41.856 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-08-19T11:24:41.858 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-08-19T11:24:56.932 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-08-19T11:24:56.934 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-08-19T11:25:12.030 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-08-19T11:25:12.032 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-08-19T11:25:27.128 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-08-19T11:25:27.129 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-08-19T11:25:27.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-19T11:25:27.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-19T11:25:30.256 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-08-19T11:25:30.257 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-08-19T11:25:36.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-19T11:25:36.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-19T11:25:39.312 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-08-19T11:25:39.317 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-08-19T11:25:45.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-19T11:25:45.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-19T11:25:48.368 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-08-19T11:25:48.372 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-08-19T11:25:54.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-19T11:25:54.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-19T11:25:57.424 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-08-19T11:25:57.456 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-08-19T11:26:03.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-19T11:26:03.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-19T11:26:06.512 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-08-19T11:26:06.516 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-08-19T11:26:12.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-19T11:26:12.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-19T11:26:15.568 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-08-19T11:26:15.569 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-08-19T11:26:21.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-19T11:26:21.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-19T11:27:21.632 WARNING:teuthology.provision.fog.smithi170:timed out 2023-08-19T11:27:21.634 WARNING:teuthology.provision.fog.smithi136:timed out 2023-08-19T11:27:27.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-19T11:27:27.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-19T11:27:27.891 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-19T11:27:27.892 DEBUG:teuthology.orchestra.run.smithi136:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-19T11:27:27.983 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-19T11:27:27.984 DEBUG:teuthology.orchestra.run.smithi170:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-19T11:27:28.153 INFO:teuthology.provision.fog.smithi136:Node is ready 2023-08-19T11:27:28.154 DEBUG:teuthology.orchestra.run.smithi136:> hostname 2023-08-19T11:27:28.171 INFO:teuthology.orchestra.run.smithi136.stdout:smithi136 2023-08-19T11:27:28.172 DEBUG:teuthology.orchestra.run.smithi136:> grep smithi136 /etc/hosts 2023-08-19T11:27:28.231 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.15.136 smithi136.front.sepia.ceph.com smithi136 2023-08-19T11:27:28.231 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136 2023-08-19T11:27:28.257 INFO:teuthology.provision.fog.smithi170:Node is ready 2023-08-19T11:27:28.257 DEBUG:teuthology.orchestra.run.smithi170:> hostname 2023-08-19T11:27:28.275 INFO:teuthology.orchestra.run.smithi170.stdout:smithi170 2023-08-19T11:27:28.276 DEBUG:teuthology.orchestra.run.smithi170:> grep smithi170 /etc/hosts 2023-08-19T11:27:28.333 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170 smithi170.front.sepia.ceph.com smithi170 2023-08-19T11:27:28.334 DEBUG:teuthology.orchestra.run.smithi170:> sudo hostname smithi170 2023-08-19T11:27:28.351 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136/smithi136/g' /etc/hosts 2023-08-19T11:27:28.379 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/172.21.15.136/172.21.15.136/g' /etc/hosts 2023-08-19T11:27:28.446 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136/smithi136/g' /etc/hostname 2023-08-19T11:27:28.476 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/smithi170/smithi170/g' /etc/hosts 2023-08-19T11:27:28.504 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/172.21.15.170/172.21.15.170/g' /etc/hosts 2023-08-19T11:27:28.512 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136 2023-08-19T11:27:28.572 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/smithi170/smithi170/g' /etc/hostname 2023-08-19T11:27:28.578 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2023-08-19T11:27:28.635 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="Red Hat Enterprise Linux" 2023-08-19T11:27:28.635 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="8.6 (Ootpa)" 2023-08-19T11:27:28.635 INFO:teuthology.orchestra.run.smithi136.stdout:ID="rhel" 2023-08-19T11:27:28.635 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="fedora" 2023-08-19T11:27:28.636 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="8.6" 2023-08-19T11:27:28.636 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el8" 2023-08-19T11:27:28.636 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-19T11:27:28.636 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2023-08-19T11:27:28.636 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-19T11:27:28.636 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://www.redhat.com/" 2023-08-19T11:27:28.636 INFO:teuthology.orchestra.run.smithi136.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-19T11:27:28.637 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-19T11:27:28.637 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-08-19T11:27:28.637 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-19T11:27:28.637 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-19T11:27:28.637 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-19T11:27:28.637 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-19T11:27:28.638 INFO:teuthology.provision.fog.smithi136:Deploy complete! 2023-08-19T11:27:28.639 DEBUG:teuthology.parallel:result is None 2023-08-19T11:27:28.640 DEBUG:teuthology.orchestra.run.smithi170:> sudo hostname smithi170 2023-08-19T11:27:28.706 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2023-08-19T11:27:28.762 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="Red Hat Enterprise Linux" 2023-08-19T11:27:28.763 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="8.6 (Ootpa)" 2023-08-19T11:27:28.763 INFO:teuthology.orchestra.run.smithi170.stdout:ID="rhel" 2023-08-19T11:27:28.763 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="fedora" 2023-08-19T11:27:28.763 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="8.6" 2023-08-19T11:27:28.763 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el8" 2023-08-19T11:27:28.764 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-19T11:27:28.764 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2023-08-19T11:27:28.764 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-19T11:27:28.764 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://www.redhat.com/" 2023-08-19T11:27:28.764 INFO:teuthology.orchestra.run.smithi170.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-19T11:27:28.764 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-19T11:27:28.764 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-08-19T11:27:28.765 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-19T11:27:28.765 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-19T11:27:28.765 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-19T11:27:28.765 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-19T11:27:28.765 INFO:teuthology.provision.fog.smithi170:Deploy complete! 2023-08-19T11:27:28.766 DEBUG:teuthology.parallel:result is None 2023-08-19T11:27:28.902 INFO:teuthology.lock.ops:Checking smithi136.front.sepia.ceph.com 2023-08-19T11:27:28.903 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-19T11:27:28.927 INFO:teuthology.lock.ops:Checking smithi170.front.sepia.ceph.com 2023-08-19T11:27:28.928 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-19T11:27:28.945 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: set os type and version on server 2023-08-19T11:27:28.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2023-08-19T11:27:28.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-19T11:27:29.011 DEBUG:teuthology.orchestra.run.smithi136:> true 2023-08-19T11:27:29.076 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2023-08-19T11:27:29.076 DEBUG:teuthology.orchestra.run.smithi136:> uname -m 2023-08-19T11:27:29.132 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64 2023-08-19T11:27:29.132 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2023-08-19T11:27:29.185 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="Red Hat Enterprise Linux" 2023-08-19T11:27:29.186 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="8.6 (Ootpa)" 2023-08-19T11:27:29.186 INFO:teuthology.orchestra.run.smithi136.stdout:ID="rhel" 2023-08-19T11:27:29.186 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="fedora" 2023-08-19T11:27:29.187 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="8.6" 2023-08-19T11:27:29.187 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el8" 2023-08-19T11:27:29.187 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-19T11:27:29.188 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2023-08-19T11:27:29.188 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-19T11:27:29.188 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://www.redhat.com/" 2023-08-19T11:27:29.189 INFO:teuthology.orchestra.run.smithi136.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-19T11:27:29.189 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-19T11:27:29.190 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-08-19T11:27:29.190 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-19T11:27:29.190 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-19T11:27:29.191 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-19T11:27:29.191 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-19T11:27:29.192 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2023-08-19T11:27:29.236 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: set os type and version on server 2023-08-19T11:27:29.236 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2023-08-19T11:27:29.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-19T11:27:29.300 DEBUG:teuthology.orchestra.run.smithi170:> true 2023-08-19T11:27:29.364 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com' 2023-08-19T11:27:29.365 DEBUG:teuthology.orchestra.run.smithi170:> uname -m 2023-08-19T11:27:29.420 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64 2023-08-19T11:27:29.421 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2023-08-19T11:27:29.476 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="Red Hat Enterprise Linux" 2023-08-19T11:27:29.476 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="8.6 (Ootpa)" 2023-08-19T11:27:29.476 INFO:teuthology.orchestra.run.smithi170.stdout:ID="rhel" 2023-08-19T11:27:29.477 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="fedora" 2023-08-19T11:27:29.477 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="8.6" 2023-08-19T11:27:29.477 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el8" 2023-08-19T11:27:29.477 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-19T11:27:29.477 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2023-08-19T11:27:29.477 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-19T11:27:29.477 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://www.redhat.com/" 2023-08-19T11:27:29.478 INFO:teuthology.orchestra.run.smithi170.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-19T11:27:29.478 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-19T11:27:29.478 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-08-19T11:27:29.478 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-19T11:27:29.478 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-19T11:27:29.478 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-19T11:27:29.478 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-19T11:27:29.479 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2023-08-19T11:27:29.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-19T11:27:29.594 INFO:teuthology.dispatcher.supervisor:Running job 7373529 2023-08-19T11:27:29.595 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_leonidus@teuthology --archive /home/teuthworker/archive/leonidus-2023-08-19_09:54:24-fs-wip-lusov-cap-throttle-event-distro-default-smithi/7373529 --name leonidus-2023-08-19_09:54:24-fs-wip-lusov-cap-throttle-event-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota} -- /home/teuthworker/archive/leonidus-2023-08-19_09:54:24-fs-wip-lusov-cap-throttle-event-distro-default-smithi/7373529/orig.config.yaml 2023-08-19T11:27:29.599 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/leonidus-2023-08-19_09:54:24-fs-wip-lusov-cap-throttle-event-distro-default-smithi/7373529 2023-08-19T11:27:29.600 INFO:teuthology.dispatcher.supervisor:Job PID: 26684 2023-08-19T11:27:29.600 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-19T11:29:29.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-19T11:31:29.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-19T11:33:30.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-19T11:35:30.212 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-19T11:37:30.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-19T11:39:30.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-19T11:41:30.717 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-19T11:43:30.901 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-19T11:43:30.975 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-19T11:43:31.078 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-19T11:43:31.079 INFO:teuthology.nuke:Checking targets against current locks 2023-08-19T11:43:31.124 DEBUG:teuthology.nuke:shortname: smithi136 2023-08-19T11:43:31.124 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-19T11:43:31.147 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi136.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2023-08-19_09:54:24-fs-wip-lusov-cap-throttle-event-distro-default-smithi/7373529', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-19 11:22:22.884906', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-08-19T11:43:31.150 DEBUG:teuthology.nuke:shortname: smithi170 2023-08-19T11:43:31.150 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-19T11:43:31.173 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi170.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2023-08-19_09:54:24-fs-wip-lusov-cap-throttle-event-distro-default-smithi/7373529', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-19 11:22:22.883625', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-19T11:43:31.191 INFO:teuthology.orchestra.console.smithi136:Power off 2023-08-19T11:43:31.192 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-19T11:43:31.214 DEBUG:teuthology.orchestra.console.smithi136:power off output: Chassis Power Control: Down/Off 2023-08-19T11:43:31.215 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-19T11:43:31.236 INFO:teuthology.orchestra.console.smithi170:Power off 2023-08-19T11:43:31.237 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-19T11:43:31.246 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2023-08-19T11:43:31.257 DEBUG:teuthology.orchestra.console.smithi170:power off output: Chassis Power Control: Down/Off 2023-08-19T11:43:31.258 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-19T11:43:31.279 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2023-08-19T11:43:31.348 INFO:teuthology.orchestra.console.smithi136:Power off completed 2023-08-19T11:43:31.381 INFO:teuthology.orchestra.console.smithi170:Power off completed 2023-08-19T11:43:31.510 INFO:teuthology.lock.ops:unlocked: smithi136.front.sepia.ceph.com 2023-08-19T11:43:31.532 INFO:teuthology.lock.ops:unlocked: smithi170.front.sepia.ceph.com