2023-09-21T00:37:57.391 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-21T00:37:57.392 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T00:37:57.542 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fea0e829670>, signals=[15]) 2023-09-21T00:37:57.543 INFO:teuthology.lock.ops:Start node 'smithi090.front.sepia.ceph.com' reimaging 2023-09-21T00:37:57.544 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: reset os type and version on server 2023-09-21T00:37:57.544 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2023-09-21T00:37:57.571 INFO:teuthology.lock.ops:Start node 'smithi174.front.sepia.ceph.com' reimaging 2023-09-21T00:37:57.572 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: reset os type and version on server 2023-09-21T00:37:57.572 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2023-09-21T00:37:57.574 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /host {"name": "smithi090"} 2023-09-21T00:37:57.596 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /host {"name": "smithi174"} 2023-09-21T00:37:57.649 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-21T00:37:57.674 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-21T00:37:57.690 DEBUG:teuthology.provision.fog.smithi090:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-21T00:37:57.691 DEBUG:teuthology.provision.fog.smithi090:FOG request: PUT /host/195 {"imageID": 5} 2023-09-21T00:37:57.718 DEBUG:teuthology.provision.fog.smithi174:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-21T00:37:57.719 DEBUG:teuthology.provision.fog.smithi174:FOG request: PUT /host/279 {"imageID": 5} 2023-09-21T00:37:57.728 INFO:teuthology.provision.fog.smithi090:Scheduling deploy of rhel 8.6 2023-09-21T00:37:57.728 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-09-21T00:37:57.758 INFO:teuthology.provision.fog.smithi174:Scheduling deploy of rhel 8.6 2023-09-21T00:37:57.758 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-09-21T00:37:57.789 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /tasktype {"name": "deploy"} 2023-09-21T00:37:57.802 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /tasktype {"name": "deploy"} 2023-09-21T00:37:57.824 DEBUG:teuthology.provision.fog.smithi090:FOG request: POST /host/195/task {"taskTypeID": 1} 2023-09-21T00:37:57.837 DEBUG:teuthology.provision.fog.smithi174:FOG request: POST /host/279/task {"taskTypeID": 1} 2023-09-21T00:37:57.942 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-09-21T00:37:57.959 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-09-21T00:37:58.051 INFO:teuthology.orchestra.console.smithi174:Power off 2023-09-21T00:37:58.052 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T00:37:58.067 INFO:teuthology.orchestra.console.smithi090:Power off 2023-09-21T00:37:58.067 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T00:37:58.076 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off 2023-09-21T00:37:58.076 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T00:37:58.087 DEBUG:teuthology.orchestra.console.smithi090:power off output: Chassis Power Control: Down/Off 2023-09-21T00:37:58.088 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T00:37:58.095 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-09-21T00:37:58.109 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on 2023-09-21T00:38:02.098 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T00:38:02.110 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T00:38:02.207 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-09-21T00:38:02.220 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on 2023-09-21T00:38:06.210 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T00:38:06.221 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T00:38:06.320 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-09-21T00:38:06.330 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off 2023-09-21T00:38:06.421 INFO:teuthology.orchestra.console.smithi174:Power off completed 2023-09-21T00:38:06.431 INFO:teuthology.orchestra.console.smithi090:Power off completed 2023-09-21T00:38:06.522 INFO:teuthology.orchestra.console.smithi174:Power on 2023-09-21T00:38:06.523 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-21T00:38:06.532 INFO:teuthology.orchestra.console.smithi090:Power on 2023-09-21T00:38:06.532 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-21T00:38:06.543 DEBUG:teuthology.orchestra.console.smithi174:power on output: Chassis Power Control: Up/On 2023-09-21T00:38:06.544 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T00:38:06.552 DEBUG:teuthology.orchestra.console.smithi090:power on output: Chassis Power Control: Up/On 2023-09-21T00:38:06.553 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T00:38:06.567 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-09-21T00:38:06.574 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off 2023-09-21T00:38:10.570 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T00:38:10.577 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T00:38:10.679 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-09-21T00:38:10.685 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off 2023-09-21T00:38:14.682 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T00:38:14.689 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T00:38:14.792 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-09-21T00:38:14.798 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on 2023-09-21T00:38:14.894 INFO:teuthology.orchestra.console.smithi174:Power on completed 2023-09-21T00:38:14.899 INFO:teuthology.orchestra.console.smithi090:Power on completed 2023-09-21T00:38:14.995 INFO:teuthology.provision.fog.smithi174:Waiting for deploy to finish 2023-09-21T00:38:14.995 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-09-21T00:38:15.000 INFO:teuthology.provision.fog.smithi090:Waiting for deploy to finish 2023-09-21T00:38:15.000 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-09-21T00:38:30.078 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-09-21T00:38:30.079 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-09-21T00:38:45.150 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-09-21T00:38:45.151 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-09-21T00:39:00.226 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-09-21T00:39:00.228 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-09-21T00:39:15.323 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-09-21T00:39:15.324 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-09-21T00:39:30.390 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-09-21T00:39:30.392 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-09-21T00:39:45.465 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-09-21T00:39:45.467 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-09-21T00:40:00.542 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-09-21T00:40:00.544 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-09-21T00:40:15.619 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-09-21T00:40:15.621 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-09-21T00:40:30.699 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-09-21T00:40:30.701 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-09-21T00:40:45.774 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-09-21T00:40:45.775 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-09-21T00:41:00.852 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-09-21T00:41:00.854 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-09-21T00:41:00.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T00:41:15.926 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-09-21T00:41:15.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T00:41:19.258 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-09-21T00:41:25.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T00:41:28.314 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-09-21T00:41:34.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T00:41:34.362 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-09-21T00:41:37.370 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-09-21T00:41:40.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T00:41:43.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T00:41:43.418 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-09-21T00:41:46.426 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-09-21T00:41:49.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T00:41:52.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T00:41:52.478 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-09-21T00:41:58.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T00:42:01.566 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-09-21T00:42:07.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T00:42:10.650 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-09-21T00:42:16.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T00:42:19.710 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-09-21T00:42:24.379 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-21T00:42:24.380 DEBUG:teuthology.orchestra.run.smithi174:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-21T00:42:24.688 INFO:teuthology.provision.fog.smithi174:Node is ready 2023-09-21T00:42:24.689 DEBUG:teuthology.orchestra.run.smithi174:> hostname 2023-09-21T00:42:24.704 INFO:teuthology.orchestra.run.smithi174.stdout:smithi174.front.sepia.ceph.com 2023-09-21T00:42:24.705 DEBUG:teuthology.orchestra.run.smithi174:> grep smithi174.front.sepia.ceph.com /etc/hosts 2023-09-21T00:42:24.760 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.15.174 smithi174.front.sepia.ceph.com smithi174 2023-09-21T00:42:24.761 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174 2023-09-21T00:42:24.957 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174.front.sepia.ceph.com/smithi174/g' /etc/hosts 2023-09-21T00:42:24.985 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/172.21.15.174/172.21.15.174/g' /etc/hosts 2023-09-21T00:42:25.050 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174.front.sepia.ceph.com/smithi174/g' /etc/hostname 2023-09-21T00:42:25.116 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174 2023-09-21T00:42:25.182 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2023-09-21T00:42:25.238 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="Red Hat Enterprise Linux" 2023-09-21T00:42:25.239 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="8.6 (Ootpa)" 2023-09-21T00:42:25.239 INFO:teuthology.orchestra.run.smithi174.stdout:ID="rhel" 2023-09-21T00:42:25.239 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="fedora" 2023-09-21T00:42:25.239 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="8.6" 2023-09-21T00:42:25.239 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el8" 2023-09-21T00:42:25.240 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-21T00:42:25.240 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2023-09-21T00:42:25.240 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-21T00:42:25.240 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://www.redhat.com/" 2023-09-21T00:42:25.240 INFO:teuthology.orchestra.run.smithi174.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-21T00:42:25.241 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-21T00:42:25.241 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-09-21T00:42:25.241 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-21T00:42:25.241 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-21T00:42:25.241 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-21T00:42:25.242 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-21T00:42:25.242 INFO:teuthology.provision.fog.smithi174:Deploy complete! 2023-09-21T00:42:25.244 DEBUG:teuthology.parallel:result is None 2023-09-21T00:42:25.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T00:43:25.774 WARNING:teuthology.provision.fog.smithi090:timed out 2023-09-21T00:43:31.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T00:43:32.110 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-21T00:43:32.110 DEBUG:teuthology.orchestra.run.smithi090:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-21T00:43:32.431 INFO:teuthology.provision.fog.smithi090:Node is ready 2023-09-21T00:43:32.432 DEBUG:teuthology.orchestra.run.smithi090:> hostname 2023-09-21T00:43:32.449 INFO:teuthology.orchestra.run.smithi090.stdout:smithi090.front.sepia.ceph.com 2023-09-21T00:43:32.450 DEBUG:teuthology.orchestra.run.smithi090:> grep smithi090.front.sepia.ceph.com /etc/hosts 2023-09-21T00:43:32.508 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90 smithi090.front.sepia.ceph.com smithi090 2023-09-21T00:43:32.508 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090 2023-09-21T00:43:32.834 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hosts 2023-09-21T00:43:32.866 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/172.21.15.90/172.21.15.90/g' /etc/hosts 2023-09-21T00:43:32.935 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hostname 2023-09-21T00:43:33.003 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090 2023-09-21T00:43:33.071 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2023-09-21T00:43:33.128 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="Red Hat Enterprise Linux" 2023-09-21T00:43:33.128 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="8.6 (Ootpa)" 2023-09-21T00:43:33.128 INFO:teuthology.orchestra.run.smithi090.stdout:ID="rhel" 2023-09-21T00:43:33.129 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="fedora" 2023-09-21T00:43:33.129 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="8.6" 2023-09-21T00:43:33.129 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el8" 2023-09-21T00:43:33.129 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-21T00:43:33.129 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31" 2023-09-21T00:43:33.130 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-21T00:43:33.130 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://www.redhat.com/" 2023-09-21T00:43:33.130 INFO:teuthology.orchestra.run.smithi090.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-21T00:43:33.130 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-21T00:43:33.131 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-09-21T00:43:33.131 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-21T00:43:33.131 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-21T00:43:33.131 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-21T00:43:33.131 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-21T00:43:33.132 INFO:teuthology.provision.fog.smithi090:Deploy complete! 2023-09-21T00:43:33.133 DEBUG:teuthology.parallel:result is None 2023-09-21T00:43:33.283 INFO:teuthology.lock.ops:Checking smithi090.front.sepia.ceph.com 2023-09-21T00:43:33.284 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-21T00:43:33.305 INFO:teuthology.lock.ops:Checking smithi174.front.sepia.ceph.com 2023-09-21T00:43:33.306 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-21T00:43:33.323 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: set os type and version on server 2023-09-21T00:43:33.324 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2023-09-21T00:43:33.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T00:43:33.390 DEBUG:teuthology.orchestra.run.smithi090:> true 2023-09-21T00:43:33.413 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi090.front.sepia.ceph.com' 2023-09-21T00:43:33.414 DEBUG:teuthology.orchestra.run.smithi090:> uname -m 2023-09-21T00:43:33.469 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64 2023-09-21T00:43:33.470 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2023-09-21T00:43:33.526 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="Red Hat Enterprise Linux" 2023-09-21T00:43:33.526 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="8.6 (Ootpa)" 2023-09-21T00:43:33.526 INFO:teuthology.orchestra.run.smithi090.stdout:ID="rhel" 2023-09-21T00:43:33.526 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="fedora" 2023-09-21T00:43:33.526 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="8.6" 2023-09-21T00:43:33.527 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el8" 2023-09-21T00:43:33.527 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-21T00:43:33.527 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31" 2023-09-21T00:43:33.527 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-21T00:43:33.527 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://www.redhat.com/" 2023-09-21T00:43:33.528 INFO:teuthology.orchestra.run.smithi090.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-21T00:43:33.528 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-21T00:43:33.528 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-09-21T00:43:33.528 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-21T00:43:33.528 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-21T00:43:33.529 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-21T00:43:33.529 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-21T00:43:33.529 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2023-09-21T00:43:33.547 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: set os type and version on server 2023-09-21T00:43:33.547 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-09-21T00:43:33.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T00:43:33.615 DEBUG:teuthology.orchestra.run.smithi174:> true 2023-09-21T00:43:33.751 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-09-21T00:43:33.752 DEBUG:teuthology.orchestra.run.smithi174:> uname -m 2023-09-21T00:43:33.808 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2023-09-21T00:43:33.809 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2023-09-21T00:43:33.865 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="Red Hat Enterprise Linux" 2023-09-21T00:43:33.865 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="8.6 (Ootpa)" 2023-09-21T00:43:33.865 INFO:teuthology.orchestra.run.smithi174.stdout:ID="rhel" 2023-09-21T00:43:33.866 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="fedora" 2023-09-21T00:43:33.866 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="8.6" 2023-09-21T00:43:33.866 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el8" 2023-09-21T00:43:33.866 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-21T00:43:33.867 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2023-09-21T00:43:33.867 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-21T00:43:33.867 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://www.redhat.com/" 2023-09-21T00:43:33.867 INFO:teuthology.orchestra.run.smithi174.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-21T00:43:33.867 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-21T00:43:33.868 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-09-21T00:43:33.868 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-21T00:43:33.868 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-21T00:43:33.868 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-21T00:43:33.869 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-21T00:43:33.869 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2023-09-21T00:43:33.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T00:43:33.974 INFO:teuthology.dispatcher.supervisor:Running job 7399326 2023-09-21T00:43:33.975 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-09-20_10:42:39-fs-wip-vshankar-testing-20230920.072635-testing-default-smithi/7399326 --name vshankar-2023-09-20_10:42:39-fs-wip-vshankar-testing-20230920.072635-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-limits} -- /home/teuthworker/archive/vshankar-2023-09-20_10:42:39-fs-wip-vshankar-testing-20230920.072635-testing-default-smithi/7399326/orig.config.yaml 2023-09-21T00:43:33.978 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-09-20_10:42:39-fs-wip-vshankar-testing-20230920.072635-testing-default-smithi/7399326 2023-09-21T00:43:33.979 INFO:teuthology.dispatcher.supervisor:Job PID: 1649801 2023-09-21T00:43:33.979 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-21T00:45:34.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T00:47:34.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T00:49:34.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T00:51:34.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T00:53:34.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T00:55:34.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T00:57:35.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T00:59:35.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T01:01:35.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T01:03:35.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T01:05:35.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T01:07:36.016 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T01:09:36.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T01:09:36.253 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-21T01:09:36.420 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-21T01:09:36.420 INFO:teuthology.nuke:Checking targets against current locks 2023-09-21T01:09:36.468 DEBUG:teuthology.nuke:shortname: smithi090 2023-09-21T01:09:36.469 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-21T01:09:36.493 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi090.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-09-20_10:42:39-fs-wip-vshankar-testing-20230920.072635-testing-default-smithi/7399326', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-21 00:37:56.598301', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-21T01:09:36.497 DEBUG:teuthology.nuke:shortname: smithi174 2023-09-21T01:09:36.498 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-21T01:09:36.520 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-09-20_10:42:39-fs-wip-vshankar-testing-20230920.072635-testing-default-smithi/7399326', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-21 00:37:56.600270', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-21T01:09:36.553 INFO:teuthology.orchestra.console.smithi090:Power off 2023-09-21T01:09:36.554 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T01:09:36.578 DEBUG:teuthology.orchestra.console.smithi090:power off output: Chassis Power Control: Down/Off 2023-09-21T01:09:36.579 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T01:09:36.593 INFO:teuthology.orchestra.console.smithi174:Power off 2023-09-21T01:09:36.594 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T01:09:36.602 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off 2023-09-21T01:09:36.615 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off 2023-09-21T01:09:36.615 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T01:09:36.638 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-09-21T01:09:36.704 INFO:teuthology.orchestra.console.smithi090:Power off completed 2023-09-21T01:09:36.739 INFO:teuthology.orchestra.console.smithi174:Power off completed 2023-09-21T01:09:36.861 INFO:teuthology.lock.ops:unlocked: smithi090.front.sepia.ceph.com 2023-09-21T01:09:36.886 INFO:teuthology.lock.ops:unlocked: smithi174.front.sepia.ceph.com