2023-09-29T16:28:55.428 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-29T16:28:55.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T16:28:55.553 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7faec8db8670>, signals=[15]) 2023-09-29T16:28:55.554 INFO:teuthology.lock.ops:Start node 'smithi057.front.sepia.ceph.com' reimaging 2023-09-29T16:28:55.554 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: reset os type and version on server 2023-09-29T16:28:55.554 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2023-09-29T16:28:55.572 INFO:teuthology.lock.ops:Start node 'smithi195.front.sepia.ceph.com' reimaging 2023-09-29T16:28:55.573 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: reset os type and version on server 2023-09-29T16:28:55.573 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-09-29T16:28:55.575 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /host {"name": "smithi057"} 2023-09-29T16:28:55.597 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /host {"name": "smithi195"} 2023-09-29T16:28:55.660 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-09-29T16:28:55.670 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-09-29T16:28:55.704 DEBUG:teuthology.provision.fog.smithi057:Requesting image smithi_rhel_8.4 (ID 7) 2023-09-29T16:28:55.705 DEBUG:teuthology.provision.fog.smithi057:FOG request: PUT /host/162 {"imageID": 7} 2023-09-29T16:28:55.714 DEBUG:teuthology.provision.fog.smithi195:Requesting image smithi_rhel_8.4 (ID 7) 2023-09-29T16:28:55.714 DEBUG:teuthology.provision.fog.smithi195:FOG request: PUT /host/300 {"imageID": 7} 2023-09-29T16:28:55.757 INFO:teuthology.provision.fog.smithi057:Scheduling deploy of rhel 8.4 2023-09-29T16:28:55.757 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-09-29T16:28:55.760 INFO:teuthology.provision.fog.smithi195:Scheduling deploy of rhel 8.4 2023-09-29T16:28:55.760 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-09-29T16:28:55.824 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /tasktype {"name": "deploy"} 2023-09-29T16:28:55.832 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /tasktype {"name": "deploy"} 2023-09-29T16:28:55.864 DEBUG:teuthology.provision.fog.smithi195:FOG request: POST /host/300/task {"taskTypeID": 1} 2023-09-29T16:28:55.867 DEBUG:teuthology.provision.fog.smithi057:FOG request: POST /host/162/task {"taskTypeID": 1} 2023-09-29T16:28:56.010 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-09-29T16:28:56.013 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-09-29T16:28:56.124 INFO:teuthology.orchestra.console.smithi195:Power off 2023-09-29T16:28:56.124 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-29T16:28:56.142 INFO:teuthology.orchestra.console.smithi057:Power off 2023-09-29T16:28:56.143 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-29T16:28:56.152 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2023-09-29T16:28:56.153 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T16:28:56.167 DEBUG:teuthology.orchestra.console.smithi057:power off output: Chassis Power Control: Down/Off 2023-09-29T16:28:56.167 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T16:28:56.177 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-09-29T16:28:56.191 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2023-09-29T16:28:56.278 INFO:teuthology.orchestra.console.smithi195:Power off completed 2023-09-29T16:28:56.292 INFO:teuthology.orchestra.console.smithi057:Power off completed 2023-09-29T16:28:56.380 INFO:teuthology.orchestra.console.smithi195:Power on 2023-09-29T16:28:56.380 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-29T16:28:56.392 INFO:teuthology.orchestra.console.smithi057:Power on 2023-09-29T16:28:56.393 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-29T16:28:56.400 DEBUG:teuthology.orchestra.console.smithi195:power on output: Chassis Power Control: Up/On 2023-09-29T16:28:56.400 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T16:28:56.415 DEBUG:teuthology.orchestra.console.smithi057:power on output: Chassis Power Control: Up/On 2023-09-29T16:28:56.415 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T16:28:56.422 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-09-29T16:28:56.437 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2023-09-29T16:29:00.426 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T16:29:00.438 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T16:29:00.537 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-09-29T16:29:00.546 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2023-09-29T16:29:00.638 INFO:teuthology.orchestra.console.smithi195:Power on completed 2023-09-29T16:29:00.647 INFO:teuthology.orchestra.console.smithi057:Power on completed 2023-09-29T16:29:00.740 INFO:teuthology.provision.fog.smithi195:Waiting for deploy to finish 2023-09-29T16:29:00.740 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-09-29T16:29:00.748 INFO:teuthology.provision.fog.smithi057:Waiting for deploy to finish 2023-09-29T16:29:00.748 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-09-29T16:29:15.832 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-09-29T16:29:15.833 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-09-29T16:29:30.922 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-09-29T16:29:30.924 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-09-29T16:29:46.042 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-09-29T16:29:46.044 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-09-29T16:30:01.130 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-09-29T16:30:01.132 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-09-29T16:30:16.236 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-09-29T16:30:16.237 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-09-29T16:30:31.348 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-09-29T16:30:31.350 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-09-29T16:30:46.466 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-09-29T16:30:46.468 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-09-29T16:31:01.570 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-09-29T16:31:01.572 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-09-29T16:31:16.659 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-09-29T16:31:16.660 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-09-29T16:31:31.746 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-09-29T16:31:31.748 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-09-29T16:31:46.831 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-09-29T16:31:46.832 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-09-29T16:31:46.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T16:31:46.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T16:31:49.978 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-09-29T16:31:49.979 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-09-29T16:31:55.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T16:31:55.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T16:31:59.034 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-09-29T16:31:59.035 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-09-29T16:32:05.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T16:32:05.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T16:32:08.122 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-09-29T16:32:08.123 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-09-29T16:32:14.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T16:32:14.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T16:32:17.210 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-09-29T16:32:17.211 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-09-29T16:32:23.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T16:32:23.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T16:32:26.266 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-09-29T16:32:26.267 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-09-29T16:32:32.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T16:32:32.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T16:32:35.358 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-09-29T16:32:41.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T16:32:44.446 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-09-29T16:32:50.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T16:33:32.320 WARNING:teuthology.provision.fog.smithi195:timed out 2023-09-29T16:33:38.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T16:33:38.695 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-29T16:33:38.696 DEBUG:teuthology.orchestra.run.smithi195:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-29T16:33:38.965 INFO:teuthology.provision.fog.smithi195:Node is ready 2023-09-29T16:33:38.966 DEBUG:teuthology.orchestra.run.smithi195:> hostname 2023-09-29T16:33:38.981 INFO:teuthology.orchestra.run.smithi195.stdout:smithi195.front.sepia.ceph.com 2023-09-29T16:33:38.982 DEBUG:teuthology.orchestra.run.smithi195:> grep smithi195.front.sepia.ceph.com /etc/hosts 2023-09-29T16:33:39.037 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.15.195 smithi195.front.sepia.ceph.com smithi195 2023-09-29T16:33:39.038 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2023-09-29T16:33:39.184 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hosts 2023-09-29T16:33:39.210 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/172.21.15.195/172.21.15.195/g' /etc/hosts 2023-09-29T16:33:39.277 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hostname 2023-09-29T16:33:39.343 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2023-09-29T16:33:39.407 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2023-09-29T16:33:39.462 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="Red Hat Enterprise Linux" 2023-09-29T16:33:39.462 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="8.4 (Ootpa)" 2023-09-29T16:33:39.462 INFO:teuthology.orchestra.run.smithi195.stdout:ID="rhel" 2023-09-29T16:33:39.463 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="fedora" 2023-09-29T16:33:39.463 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="8.4" 2023-09-29T16:33:39.463 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el8" 2023-09-29T16:33:39.463 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-09-29T16:33:39.463 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2023-09-29T16:33:39.463 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-09-29T16:33:39.463 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://www.redhat.com/" 2023-09-29T16:33:39.463 INFO:teuthology.orchestra.run.smithi195.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-29T16:33:39.463 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-29T16:33:39.463 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-09-29T16:33:39.463 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-29T16:33:39.464 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-09-29T16:33:39.464 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-29T16:33:39.464 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-09-29T16:33:39.464 INFO:teuthology.provision.fog.smithi195:Deploy complete! 2023-09-29T16:33:39.466 DEBUG:teuthology.parallel:result is None 2023-09-29T16:33:50.462 WARNING:teuthology.provision.fog.smithi057:timed out 2023-09-29T16:33:56.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T16:33:56.705 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-29T16:33:56.705 DEBUG:teuthology.orchestra.run.smithi057:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-29T16:33:57.022 INFO:teuthology.provision.fog.smithi057:Node is ready 2023-09-29T16:33:57.022 DEBUG:teuthology.orchestra.run.smithi057:> hostname 2023-09-29T16:33:57.038 INFO:teuthology.orchestra.run.smithi057.stdout:smithi057.front.sepia.ceph.com 2023-09-29T16:33:57.038 DEBUG:teuthology.orchestra.run.smithi057:> grep smithi057.front.sepia.ceph.com /etc/hosts 2023-09-29T16:33:57.095 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57 smithi057.front.sepia.ceph.com smithi057 2023-09-29T16:33:57.095 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057 2023-09-29T16:33:57.207 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hosts 2023-09-29T16:33:57.235 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/172.21.15.57/172.21.15.57/g' /etc/hosts 2023-09-29T16:33:57.303 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hostname 2023-09-29T16:33:57.370 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057 2023-09-29T16:33:57.436 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2023-09-29T16:33:57.492 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Red Hat Enterprise Linux" 2023-09-29T16:33:57.492 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="8.4 (Ootpa)" 2023-09-29T16:33:57.492 INFO:teuthology.orchestra.run.smithi057.stdout:ID="rhel" 2023-09-29T16:33:57.492 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="fedora" 2023-09-29T16:33:57.492 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="8.4" 2023-09-29T16:33:57.492 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el8" 2023-09-29T16:33:57.492 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-09-29T16:33:57.493 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2023-09-29T16:33:57.493 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-09-29T16:33:57.493 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.redhat.com/" 2023-09-29T16:33:57.493 INFO:teuthology.orchestra.run.smithi057.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-29T16:33:57.493 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-29T16:33:57.493 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-09-29T16:33:57.493 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-29T16:33:57.493 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-09-29T16:33:57.493 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-29T16:33:57.493 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-09-29T16:33:57.494 INFO:teuthology.provision.fog.smithi057:Deploy complete! 2023-09-29T16:33:57.494 DEBUG:teuthology.parallel:result is None 2023-09-29T16:33:57.640 INFO:teuthology.lock.ops:Checking smithi057.front.sepia.ceph.com 2023-09-29T16:33:57.641 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-29T16:33:57.667 INFO:teuthology.lock.ops:Checking smithi195.front.sepia.ceph.com 2023-09-29T16:33:57.667 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-29T16:33:57.692 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: set os type and version on server 2023-09-29T16:33:57.692 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-09-29T16:33:57.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T16:33:57.759 DEBUG:teuthology.orchestra.run.smithi057:> true 2023-09-29T16:33:57.780 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-09-29T16:33:57.781 DEBUG:teuthology.orchestra.run.smithi057:> uname -m 2023-09-29T16:33:57.835 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2023-09-29T16:33:57.836 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2023-09-29T16:33:57.890 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Red Hat Enterprise Linux" 2023-09-29T16:33:57.890 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="8.4 (Ootpa)" 2023-09-29T16:33:57.891 INFO:teuthology.orchestra.run.smithi057.stdout:ID="rhel" 2023-09-29T16:33:57.891 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="fedora" 2023-09-29T16:33:57.891 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="8.4" 2023-09-29T16:33:57.891 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el8" 2023-09-29T16:33:57.891 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-09-29T16:33:57.891 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2023-09-29T16:33:57.891 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-09-29T16:33:57.891 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.redhat.com/" 2023-09-29T16:33:57.891 INFO:teuthology.orchestra.run.smithi057.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-29T16:33:57.891 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-29T16:33:57.891 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-09-29T16:33:57.891 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-29T16:33:57.892 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-09-29T16:33:57.892 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-29T16:33:57.892 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-09-29T16:33:57.892 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2023-09-29T16:33:57.915 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: set os type and version on server 2023-09-29T16:33:57.916 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-09-29T16:33:57.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T16:33:57.982 DEBUG:teuthology.orchestra.run.smithi195:> true 2023-09-29T16:33:58.097 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-09-29T16:33:58.098 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2023-09-29T16:33:58.152 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2023-09-29T16:33:58.152 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2023-09-29T16:33:58.207 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="Red Hat Enterprise Linux" 2023-09-29T16:33:58.207 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="8.4 (Ootpa)" 2023-09-29T16:33:58.207 INFO:teuthology.orchestra.run.smithi195.stdout:ID="rhel" 2023-09-29T16:33:58.207 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="fedora" 2023-09-29T16:33:58.207 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="8.4" 2023-09-29T16:33:58.207 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el8" 2023-09-29T16:33:58.208 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-09-29T16:33:58.208 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2023-09-29T16:33:58.208 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-09-29T16:33:58.208 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://www.redhat.com/" 2023-09-29T16:33:58.208 INFO:teuthology.orchestra.run.smithi195.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-29T16:33:58.208 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-29T16:33:58.208 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-09-29T16:33:58.208 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-29T16:33:58.208 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-09-29T16:33:58.208 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-29T16:33:58.208 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-09-29T16:33:58.209 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-09-29T16:33:58.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T16:33:58.320 INFO:teuthology.dispatcher.supervisor:Running job 7405483 2023-09-29T16:33:58.320 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-09-28_11:54:11-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7405483 --name yuriw-2023-09-28_11:54:11-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi --description fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_dbench_iozone} -- /home/teuthworker/archive/yuriw-2023-09-28_11:54:11-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7405483/orig.config.yaml 2023-09-29T16:33:58.323 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-09-28_11:54:11-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7405483 2023-09-29T16:33:58.323 INFO:teuthology.dispatcher.supervisor:Job PID: 1842177 2023-09-29T16:33:58.324 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-29T16:35:58.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T16:37:58.596 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T16:39:58.773 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T16:41:58.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T16:43:59.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T16:45:59.284 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T16:47:59.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T16:49:59.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T16:51:59.816 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T16:51:59.876 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-09-29T16:51:59.981 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-29T16:51:59.981 INFO:teuthology.nuke:Checking targets against current locks 2023-09-29T16:52:00.038 DEBUG:teuthology.nuke:shortname: smithi057 2023-09-29T16:52:00.039 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-29T16:52:00.057 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-28_11:54:11-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7405483', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-29 16:28:54.609496', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKjzMVmxDEbbW7Jn7H75S16TUmO6Pj5TZUm5Q7rRHgcfqQhhxaT/cwrEgv2uc1rzwqksT9eIOaG6NPhXjmMcFNk='} 2023-09-29T16:52:00.060 DEBUG:teuthology.nuke:shortname: smithi195 2023-09-29T16:52:00.061 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-29T16:52:00.079 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-28_11:54:11-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7405483', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-29 16:28:54.607517', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE2ntabt0k6JTFXRx+ED1HRP/d2uoknhbNEu24lWIribDH01x6EjraFrE7vssGeNIw6ohajZDBGw0fjuyPnrNaY='} 2023-09-29T16:52:00.109 INFO:teuthology.orchestra.console.smithi057:Power off 2023-09-29T16:52:00.110 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-29T16:52:00.133 DEBUG:teuthology.orchestra.console.smithi057:power off output: Chassis Power Control: Down/Off 2023-09-29T16:52:00.133 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T16:52:00.146 INFO:teuthology.orchestra.console.smithi195:Power off 2023-09-29T16:52:00.146 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-29T16:52:00.156 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2023-09-29T16:52:00.168 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2023-09-29T16:52:00.168 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T16:52:00.189 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-09-29T16:52:00.257 INFO:teuthology.orchestra.console.smithi057:Power off completed 2023-09-29T16:52:00.290 INFO:teuthology.orchestra.console.smithi195:Power off completed 2023-09-29T16:52:00.409 INFO:teuthology.lock.ops:unlocked: smithi057.front.sepia.ceph.com 2023-09-29T16:52:00.434 INFO:teuthology.lock.ops:unlocked: smithi195.front.sepia.ceph.com